Object detection in multispectral and panchromatic image using superpixel segmentation and multisource feature

Abstract

Object detection is a fundamental problem faced in remote sensing images analysis. Most of object detection methods mainly focus on single-source image and utilize single spectral or spatial information. Therefore, they are easily affected by illumination angle, brightness and the structure similar to the object. To overcome these defects, a novel object detection framework is proposed using superpixel segmentation and multisource features in multispectral and panchromatic images. During multisource feature extraction stage, the local region spectral information and the spatial information are extracted from multispectral and panchromatic patches respectively. Then, we embed these spectral features into spatial features to construct the new multisource features. During the detection stage, superpixel segmentation method is applied to extract candidate patches based on the superpixel centers from multisource images, which makes detection more efficient. Then, multisource features are also extracted from these candidate patches, which are input to SVM for detection. Experiments are implemented using two groups of the panchromatic and multispectral images by WorldView 2. The results indicated that, compared with single-source detection result, the proposed method can effectively improve the detection performance both on precision and recall rate.