Local-global feature fusion network for hyperspectral image classification

Abstract

ABSTRACT Hyperspectral images (HSIs) are rich in spatial and spectral information, making them crucial for accurate classification. While existing convolutional neural network (CNN) methods have shown promise in HSI classification, they primarily focus on local features and struggle with establishing long-range dependencies. To address these limitations, we propose a Local-Global Feature Fusion Network (LGFFN). LGFFN effectively learns joint local-global information from HSIs. Firstly, we employ a group-general convolution parallel module (GGCPM) to extract both local and global spectral features. Next, we utilize parallel branches: a CNN branch for capturing fine-grained spatial information and an improved transformer encoder (ITE) branch for capturing long-distance spatial-spectral features and exploiting semantic information. Finally, we elegantly integrate the diverse features obtained from these branches to obtain classification results. We validate our method on four datasets and compare it with six state-of-the-art hyperspectral classification methods. Our experimental results demonstrate that LGFFN achieves high classification accuracy, outperforming existing methods.