Multi-scale receptive fields: Graph attention neural network for hyperspectral image classification

Abstract

Hyperspectral image (HSI) classification has attracted wide attention in many fields. Applying Graph Neural Network (GNN) to HSI classification is one of the research frontiers, which has improved the HSI classification accuracy greatly. However, GNN-based methods have not been widely applied due to their time-consuming, inefficient information description as well as poor anti-noise robustness. To overcome the deficiencies, a novel multi-scale receptive fields graph attention neural network (MRGAT) is proposed for HSI classification in this paper. In this network, a superpixel segment method is adopted to abstract the original HSI local spatial features. A two-layer one-dimensional convolution neural network (1D CNN) spectral transformer mechanism, is designed to extract the spectral features of superpixels, with which the spectral features can be acquired automatically. Furthermore, graph edges are introduced into Graph Attention Network (GAT) to acquire the local semantic feature of the graph. Moreover, inspired by the transformer network, we design a novel multi-scale receptive field GAT to extract the local-global adjacent node-features and edges-features. Finally, a graph attention network and a softMax function are utilized for multi-receptive feature fusion and pixel-label predicting. On Pavia University, Salinas, and Houston 2013 datasets, the overall accuracies (OAs) of our MRGAT are 71.76%, 82.61%, and 63.82%, respectively. Moreover, the performances with limited labeled samples indicates that the MRGAT contains superior adaptability. Compared with the competitive classifiers, MRGAT achieves high classification efficiency verified by training time comparison experiment.