Scene Recognition via Semi-Supervised Multi-Feature Regression

Abstract

With the development of visual sensor equipment (e.g., personal smart phones, vehicle cameras, surveillance videos and camcorders), scene recognition technology has attracted much attention due to its latent applications in visual surveillance, intelligent traffic and aerial remote sensing. Although some progress has been made in the field of scene recognition in recent years, the complexity of scene images and the inadequate numbers of labeled data pose challenges in this area. Hence, to effectively fuse the multiple features of each image and employ the information of both labeled and unlabeled images for scene recognition, we proposed a semi-supervised multi-feature regression (SSMFR) model in this paper. The SSMFR model possesses three advantages. First, the model propagates the labels of labeled data to unlabeled data by utilizing graph-based semi-supervised learning techniques so that both the information regarding unlabeled data and labeled data can be exploited to gain better performance. Second, SSMFR employs multiple graphs to characterize the structures of multiple feature spaces and adaptively assigns the weight to different graphs. Therefore, SSMFR can efficiently preserve the manifold structure of samples in each feature space and adequately exploit the complementary information of multiple features. Moreover, SSMFR adopts a $l_{2,1}$ -norm constraint to learn a sparse and robust classifier for scene recognition. To solve the SSMFR model, we proposed a simple and efficient iterative update optimization scheme. Finally, we also proved the convergence of SSMFR by theoretical analysis and experiments. Experiments were conducted on several benchmark scene datasets, and the experimental results demonstrated that the proposed SSMFR model can obtain better performance for scene recognition than some other state-of-the-art algorithms.