Dual-Path Siamese CNN for Hyperspectral Image Classification With Limited Training Samples

Abstract

In recent years, deep convolutional neural networks (CNNs) have been widely used for hyperspectral image (HSI) classification. The powerful feature extraction capability and high classification performance of CNN highly depend on sufficient training samples. Unfortunately, it is not a common situation because collecting training samples is time-consuming and expensive. In this letter, in order to make the most of deep CNN with limited training samples, dual-path siamese CNN (Dual-SCNN) is proposed for HSI classification. Specifically, the proposed classification framework is a combination of extended morphological profiles, CNN, siamese network, and spectral–spatial feature fusion. In order to solve the problem of insufficiency in hard negative pairs during the training of a siamese network, adversarial training is combined with Dual-SCNN (Dual-SCNN-AT) for HSI classification. Moreover, a data augmentation method titled mixup is combined with Dual-SCNN and Dual-SCNN-AT to further improve the classification performance of HSI. The obtained results on widely used hyperspectral data sets reveal that the proposed methods provide the competitive results in terms of classification accuracy, especially with limited training samples.