Multi‐label automatic image annotation approach based on multiple improvement strategies

Abstract

Currently, multi-label automatic image annotation (MAIA) approach based on machine learning has been widely applied and developed. Since extreme learning machine (ELM) has the advantages of simple structure, fast learning speed, better generalisation ability and so on, it is used for MAIA in this study. In order to enhance the annotation performance and generalisation ability of MAIA, some work is designed and implemented. First of all, a novel distance metric learning method based on cost-sensitive learning for MAIA task is proposed to reduce the impact of class imbalance of samples. Second, an improved ELM approach based on singular value decomposition is proposed for implementing MAIA task. Finally, the selection of training samples (STS) strategy based on error correlation is also proposed to improve the generalisation ability and annotation performance of MAIA. Based on the above work, a novel MAIA approach is implemented. The experimental results confirm that the proposed cost-sensitive DLM, improved cost-sensitive ELM and STS can obtain the good generalisation ability, and achieve better annotation performance than the existing MAIA approaches.