Deep Neural Network with Attention Mechanism for Classification of Motor Imagery EEG

Abstract

This paper presents a deep neural network architecture for the classification of motor imagery electroencephalographic recordings. This classification task usually encounters difficulties such as data with poor signal-to-noise ratio, contamination from muscle activity, body movements, and external interferences, and both intra-subject and inter-subject variability. Through the spatiotemporal features automatically learned from training data, deep neural networks continue to demonstrate their good performance, versatility, and adaptation capability. In this work, we developed a novel neural network model which can extract signal features from multiple electrodes in a manner similar to that of conventional signal processing methods, such as common spatial patterns and common temporal patterns. The proposed neural network model comprises an attention mechanism, which calculates the importance of each electrode, and a spatial convolution layer. Compared to the results obtained using a variety of state-of-the-art deep learning techniques, the proposed scheme represents a considerable advancement in classification accuracy when applied to the BCI competition IV dataset 2a. By training with data of all subjects, the proposed universal neural network model outperforms state-of-the-art methods in terms of classification accuracy.