Semisupervised nonlinear feature extraction for image classification

Abstract

Feature extraction is of paramount importance for an accurate classification of remote sensing images. Techniques based on data transformations are widely used in this context. However, linear feature extraction algorithms, such as the principal component analysis and partial least squares, can address this problem in a suboptimal way because the data relations are often nonlinear. Kernel methods may alleviate this problem only when the structure of the data manifold is properly captured. However, this is difficult to achieve when small-size training sets are available. In these cases, exploiting the information contained in unlabeled samples together with the available training data can significantly improve data description by defining an effective semisupervised nonlinear feature extraction strategy. We present a novel semisupervised Kernel Partial Least Squares (KPLS) algorithm for non-linear feature extraction. The method relies on combining two kernel functions: the standard RBF kernel using labeled information and a generative kernel directly learned by clustering the data. The effectiveness of the proposed method is successfully illustrated in multi- and hyper-spectral remote sensing image classification: accuracy improvements between +15 – 20% over standard PCA and +10% over advanced kernel PCA and KPLS for both images is obtained. Matlab code is available at http://isp.uv.es for the interested readers.