Hyperspectral Image Classification of Brain-Inspired Spiking Neural Network Based on Attention Mechanism

Abstract

Convolutional neural network has a complex model structure in hyperspectral image (HSI) classification and the energy consumption during training and inference is high, so it cannot be applied in edge computing devices such as software-defined satellites and unmanned aerial vehicles. In order to solve the classification of HSI in edge computing environment, inspired by the principle of neuro-dynamics and brain-inspired computing, we use integrate and fire neurons and shuffle squeeze and excitation network to construct a spiking neural network (SNN-SSEM). This letter designs an approximate derivative back propagation algorithm for discontinuous activation function and realizes the training of spiking neural network. Experiments were conducted on three HSI data sets and the average classification accuracy reached more than 99%. The energy consumption of our model is about 4.5 times that of convolutional neural network with the same architecture. This study is an exploration of the application of scientific theory of brain-inspired computing in hyperspectral remote sensing technology, which can realize real-time classification of HSI in mobile computing environment.