A 3-D-CNN Framework for Hyperspectral Unmixing With Spectral Variability

Abstract

Hyperspectral unmixing plays an important role in hyperspectral image processing and analysis. It aims to decompose mixed pixels into pure spectral signatures and their associated abundances. The hyperspectral image contains spatial information in neighborhood regions, and spectral signatures existing in the region also have a high correlation. However, most autoencoder (AE)-based unmixing methods are pixel-to-pixel methods and ignore these priors. It is helpful to add spectral&#x2013;spatial information into unmixing methods. A recent trend to deal with this problem is to use convolutional neural networks (CNNs). Our proposed framework uses 3-D-CNN-based networks to jointly learn spectral&#x2013;spatial priors. Moreover, previous AE-based unmixing methods use fixed spectral signatures for each pure material. In our work, we use a carefully designed decoder to cope with the endmember variability issue, and variational inference strategy is applied to add uncertainty property into endmembers. To avoid overfitting, we use structured sparsity regularizers to the encoder networks, and <inline-formula> <tex-math notation="LaTeX">$\ell _{2,1}$ </tex-math></inline-formula>-loss is added to the estimated abundances to guarantee the sparseness. Experimental results on both simulated and real data demonstrate the effectiveness of our proposed method.