3D-CNN and semi-supervised based network for hyperspectral unmixing

Abstract

ABSTRACT Hyperspectral Unmixing (HU), which involves decomposing mixed pixels in hyperspectral images into endmembers and abundance fractions, plays a critical role in spectral analysis. Recent advancements in deep learning methods have shown successful applications in hyperspectral analysis. This paper proposes an end-to-end network structure that combines a Convolutional Neural Network (CNN) and a Multilayer Perceptron (MLP). The 3D-CNN extracts high-level features from both spatial and spectral neighbourhoods of hyperspectral image patches, while the MLP maps these abstracted features to abundance fractions. Considering the challenge of acquiring manual labels, we adopt a Semi-Supervised learning approach that leverages unlabelled data to enhance training. We divide our training data into labelled and unlabelled subsets, defining distinct loss functions for each. Additionally, we introduce a neighbourhood similarity constraint to fully exploit spatial context information. To address scenarios where no labelled data is available, we employ Generative Adversarial Networks (GANs) to generate synthetic labelled samples. Experimental evaluations conducted on both synthetic and real datasets validate the effectiveness of our proposed method, which outperforms several commonly used and state-of-the-art HU methods.