Semantic Guided prototype learning for Cross-Domain Few-Shot hyperspectral image classification

Abstract

Hyperspectral image(HSI) classification has found extensive application in the field of remote sensing. However, traditional HSI classification methods typically rely on a large number of labeled samples, incurring significant costs and requiring considerable time and effort for acquisition. To address this issue, this paper proposes a novel cross-domain few-shot learning method termed Semantic Guided Prototype Learning (SGPL), which aims to optimize prototype learning through the incorporation semantic information, thereby enhancing the classification accuracy of hyperspectral images in few-shot scenarios. The core idea of the SGPL method is to integrate semantic information into the prototype learning framework, thereby enhancing the expressive capacity of each category prototype. Specifically, HSI category labels are encoded via one-hot encoding, and the corresponding HSI features are concatenated with these encoded vectors to construct an augmented feature representation. These augmented feature vectors are subsequently fed into a prototype generator, which is designed to learn the generation of category prototypes from the concatenated features. Through the application of one-hot encoding and feature concatenation, SGPL effectively captures and leverages discriminative information between classes. Moreover, the proposed model exhibits superior performance on three different HSI datasets: Salinas, the University of Pavia(UP), and Indian Pines(IP) with overall classification accuracies of 91.27%, 85.84%, and 69.33%, respectively, outperforming other methods. The source code is available at https://github.com/AIYAU/SGPL.