Collaborative learning of lightweight convolutional neural network and deep clustering for hyperspectral image semi-supervised classification with limited training samples

Abstract

Deep learning provides excellent potentials for hyperspectral images (HSIs) classification, but it is infamous for requiring large amount of labeled samples while the collection of high-quality labels for HSIs is extremely expensive and time-consuming. Furthermore, when the limited training samples are available, deep learning methods may suffer from over-fitting. In this work, we propose a novel collaborative learning framework for semi-supervised HSI classification with joint deep convolutional neural networks and deep clustering. Specifically, a lightweight 3D convolutional neural network (CNN) with much less parameters compared with classical 3D CNNs is designed for deep discriminative feature learning and classification. Then a deep clustering method, that is approximate rank-order clustering (AROC) algorithm, is applied to cluster deep features to generate pseudo labels for abundant unlabeled samples. Finally, we fine-tune the lightweight 3D CNN by minimizing a dual-loss (softmax loss and center loss) using both true and pseudo labels. Experimental results on three challenging HSI datasets demonstrate that the proposed method can achieve better performance than other state-of-the-art deep learning based methods and traditional HSI classification methods methods.