Feature Fusion Based Parallel Graph Convolutional Neural Network for Image Annotation

Abstract

Graph neural networks’ application in automatic image annotation is becoming more mature. However, there are still several problems. First, the feature data of the original image obtained by the feature extraction algorithm, such as color features and gradient features, all have the problem of slight intra-class variance and significant inter-class variance. Second, merely utilize the graph convolution neural networks to construct samples or labeled graphs, limiting multimodality’s fusion and expansion. This paper uses a parallel graph convolution network based on feature fusion for automatic image annotation. By fusing the sample features, the inherent defects of the features extracted by a single model are reduced, and the annotation performance under the condition of semi-supervised learning is improved. Experiments on three benchmark image annotation datasets show that this method is superior to the existing methods.