Brain-computer Interface Competition Research Articles

An EEG channel selection method for motor imagery based on Fisher score and local optimization

Objective. Multi-channel electroencephalogram (EEG) technology in brain–computer interface (BCI) research offers the advantage of enhanced spatial resolution and system performance. However, this also implies that more time is needed in the data processing stage, which is not conducive to the rapid response of BCI. Hence, it is a necessary and challenging task to reduce the number of EEG channels while maintaining decoding effectiveness. Approach. In this paper, we propose a local optimization method based on the Fisher score for within-subject EEG channel selection. Initially, we extract the common spatial pattern characteristics of EEG signals in different bands, calculate Fisher scores for each channel based on these characteristics, and rank them accordingly. Subsequently, we employ a local optimization method to finalize the channel selection. Main results. On the BCI Competition IV Dataset IIa, our method selects an average of 11 channels across four bands, achieving an average accuracy of 79.37%. This represents a 6.52% improvement compared to using the full set of 22 channels. On our self-collected dataset, our method similarly achieves a significant improvement of 24.20% with less than half of the channels, resulting in an average accuracy of 76.95%. Significance. This research explores the importance of channel combinations in channel selection tasks and reveals that appropriately combining channels can further enhance the quality of channel selection. The results indicate that the model selected a small number of channels with higher accuracy in two-class motor imagery EEG classification tasks. Additionally, it improves the portability of BCI systems through channel selection and combinations, offering the potential for the development of portable BCI systems.

A diagonal masking self-attention-based multi-scale network for motor imagery classification

Objective. Electroencephalography (EEG)-based motor imagery (MI) is a promising paradigm for brain-computer interface (BCI), but the non-stationarity and low signal-to-noise ratio of EEG signals make it a challenging task. Approach. To achieve high-precision MI classification, we propose a Diagonal Masking Self-Attention-based Multi-Scale Network (DMSA-MSNet) to fully develop, extract, and emphasize features from different scales. First, for local features, a multi-scale temporal-spatial block is proposed to extract features from different receptive fields. Second, an adaptive branch fusion block is specifically designed to bridge the semantic gap between these coded features from different scales. Finally, in order to analyze global information over long ranges, a diagonal masking self-attention block is introduced, which highlights the most valuable features in the data. Main results. The proposed DMSA-MSNet outperforms state-of-the-art models on the BCI Competition IV 2a and the BCI Competition IV 2b datasets. Significance. Our study achieves rich information extraction from EEG signals and provides an effective solution for MI classification.

Towards Analysis of Multivariate Time Series Using Topological Data Analysis

Topological data analysis (TDA) has proven to be a potent approach for extracting intricate topological structures from complex and high-dimensional data. In this paper, we propose a TDA-based processing pipeline for analyzing multi-channel scalp EEG data. The pipeline starts with extracting both frequency and temporal information from the signals via the Hilbert–Huang Transform. The sequences of instantaneous frequency and instantaneous amplitude across all electrode channels are treated as approximations of curves in the high-dimensional space. TDA features, which represent the local topological structure of the curves, are further extracted and used in the classification models. Three sets of scalp EEG data, including one collected in a lab and two Brain–computer Interface (BCI) competition data, were used to validate the proposed methods, and compare with other state-of-art TDA methods. The proposed TDA-based approach shows superior performance and outperform the winner of the BCI competition. Besides BCI, the proposed method can also be applied to spatial and temporal data in other domains such as computer vision, remote sensing, and medical imaging.

Multi-source transfer learning via optimal transport feature ranking for EEG classification

Motor imagery (MI) brain-computer interface (BCI) paradigms have been extensively used in neurological rehabilitation. However, due to the required long calibration time and non-stationary nature of electroencephalogram (EEG) signals, it is challenging to obtain a substantial sample size of EEG data. Transfer learning (TL), which leverages knowledge from existing subjects to enhance the learning performance in new subjects, has been employed to solve this problem. Previous studies often extract sample features directly from the two domains for transfer learning, leading to poor features and negative transfer. To overcome this limitation, an optimal transport feature selection method was developed in this study to select the most suitable features for migration to enhance the generalization capability of the TL. This was achieved by analyzing the diagonal value similarity of the optimal transport coupling matrix. First, the Riemannian tangent space mapping method was used to map the sample covariance matrix of EEG trials from the Riemannian manifold to tangent space. Secondly, the optimal subset of EEG features was selected via the optimal transport feature selection method. Subsequently, the separate distribution alignment method was employed to minimize dissimilarities between the source and target domains. Finally, the weighted voting mechanisms were integrated for decision fusion. The proposed multi-source transfer feature learning (MSTFL) method was validated based on two public BCI Competition IV datasets. Our results demonstrated superior classification accuracy of 85.93% and 79.48%, respectively, on the two public datasets, compared to state-of-the-art models. These findings indicate the effectiveness of our proposed MSTFL model for both feature extraction and classification of MI signals.

Classification of motor imagery using chaotic entropy based on sub-band EEG source localization

Objective. Electroencephalography (EEG) has been widely used in motor imagery (MI) research by virtue of its high temporal resolution and low cost, but its low spatial resolution is still a major criticism. The EEG source localization (ESL) algorithm effectively improves the spatial resolution of the signal by inverting the scalp EEG to extrapolate the cortical source signal, thus enhancing the classification accuracy. Approach. To address the problem of poor spatial resolution of EEG signals, this paper proposed a sub-band source chaotic entropy feature extraction method based on sub-band ESL. Firstly, the preprocessed EEG signals were filtered into 8 sub-bands. Each sub-band signal was source localized respectively to reveal the activation patterns of specific frequency bands of the EEG signals and the activities of specific brain regions in the MI task. Then, approximate entropy, fuzzy entropy and permutation entropy were extracted from the source signal as features to quantify the complexity and randomness of the signal. Finally, the classification of different MI tasks was achieved using support vector machine. Main result. The proposed method was validated on two MI public datasets (brain–computer interface (BCI) competition III IVa, BCI competition IV 2a) and the results showed that the classification accuracies were higher than the existing methods. Significance. The spatial resolution of the signal was improved by sub-band EEG localization in the paper, which provided a new idea for EEG MI research.

Motor Imagery Classification Using Effective Channel Selection of Multichannel EEG.

Electroencephalography (EEG) is effectively employed to describe cognitive patterns corresponding to different tasks of motor functions for brain-computer interface (BCI) implementation. Explicit information processing is necessary to reduce the computational complexity of practical BCI systems. This paper presents an entropy-based approach to select effective EEG channels for motor imagery (MI) classification in brain-computer interface (BCI) systems. The method identifies channels with higher entropy scores, which is an indication of greater information content. It discards redundant or noisy channels leading to reduced computational complexity and improved classification accuracy. High entropy means a more disordered pattern, whereas low entropy means a less disordered pattern with less information. The entropy of each channel for individual trials is calculated. The weight of each channel is represented by the mean entropy of the channel over all the trials. A set of channels with higher mean entropy are selected as effective channels for MI classification. A limited number of sub-band signals are created by decomposing the selected channels. To extract the spatial features, the common spatial pattern (CSP) is applied to each sub-band space of EEG signals. The CSP-based features are used to classify the right-hand and right-foot MI tasks using a support vector machine (SVM). The effectiveness of the proposed approach is validated using two publicly available EEG datasets, known as BCI competition III-IV(A) and BCI competition IV-I. The experimental results demonstrate that the proposed approach surpasses cutting-edge techniques.

Multi-scale self-attention approach for analysing motor imagery signals in brain-computer interfaces

BackgroundMotor imagery-based electroencephalogram (EEG) brain-computer interface (BCI) technology has seen tremendous advancements in the past several years. Deep learning has outperformed more traditional approaches, such next-gen neuro-technologies, in terms of productivity. It is still challenging to develop and train an end-to-end network that can sufficiently extract the possible characteristics from EEG data used in motor imaging. Brain-computer interface research is largely reliant on the fundamental problem of accurately classifying EEG data. There are still many challenges in the field of MI classification even after researchers have proposed a variety of methods, such as deep learning and machine learning techniques. MethodologyWe provide a model for four-class categorization of motor imagery EEG signals using attention mechanisms: left hand, right hand, foot, and tongue/rest. The model is built on multi-scale spatiotemporal self-attention networks. To determine the most effective channels, self-attention networks are implemented spatially to assign greater weight to channels associated with motion and lesser weight to channels unrelated to motion. To eliminate noise in the temporal domain, parallel multi-scale Temporal Convolutional Network (TCN) layers are utilized to extract temporal domain features at various scales. ResultOn the IV-2b dataset from the BCI Competition, the suggested model achieved an accuracy of 85.09 %; on the IV-2a and IV-2b datasets from the HGD datasets, it was 96.26 %. Comparison with existing methodsIn single-subject classification, this approach demonstrates superior accuracy when compared to existing methods. ConclusionThe findings suggest that this approach exhibits commendable performance, resilience, and capacity for transfer learning.

Assessing robustness to adversarial attacks in attention-based networks: Case of EEG-based motor imagery classification

The classification of motor imagery (MI) using Electroencephalography (EEG) plays a pivotal role in facilitating communication for individuals with physical limitations through Brain-Computer Interface (BCI) systems. Recent strides in Attention-Based Networks (ATN) have showcased remarkable performance in EEG signal classification, presenting a promising alternative to conventional Convolutional Neural Networks (CNNs). However, while CNNs have been extensively analyzed for their resilience against adversarial attacks, the susceptibility of ATNs in comparable scenarios remains largely unexplored. This paper aims to fill this gap by investigating the robustness of ATNs in adversarial contexts. We propose a high-performing attention-based deep learning model specifically designed for classifying Motor Imagery (MI) brain signals extracted from EEG data. Subsequently, we conduct a thorough series of experiments to assess various attack strategies targeting ATNs employed in EEG-based BCI tasks. Our analysis utilizes the widely recognized BCI Competition 2a dataset to demonstrate the effectiveness of attention mechanisms in BCI endeavors. Despite achieving commendable classification results in terms of accuracy (87.15%) and kappa score (0.8287), our findings reveal the vulnerability of attention-based models to adversarial manipulations (accuracy: 9.07%, kappa score: -0.21), highlighting the imperative for bolstering the robustness of attention architectures for EEG classification tasks.

Efficient Feature Learning Model of Motor Imagery EEG Signals with L1-Norm and Weighted Fusion.

Brain-computer interface (BCI) for motor imagery is an advanced technology used in the field of medical rehabilitation. However, due to the poor accuracy of electroencephalogram feature classification, BCI systems often misrecognize user commands. Although many state-of-the-art feature selection methods aim to enhance classification accuracy, they usually overlook the interrelationships between individual features, indirectly impacting the accuracy of feature classification. To overcome this issue, we propose an adaptive feature learning model that employs a Riemannian geometric approach to generate a feature matrix from electroencephalogram signals, serving as the model's input. By integrating the enhanced adaptive L1 penalty and weighted fusion penalty into the sparse learning model, we select the most informative features from the matrix. Specifically, we measure the importance of features using mutual information and introduce an adaptive weight construction strategy to penalize regression coefficients corresponding to each variable adaptively. Moreover, the weighted fusion penalty balances weight differences among correlated variables, reducing the model's overreliance on specific variables and enhancing accuracy. The performance of the proposed method was validated on BCI Competition IV datasets IIa and IIb using the support vector machine. Experimental results demonstrate the effectiveness and superiority of the proposed model compared to the existing models.

P300 intention recognition based on phase lag index (PLI)-rich-club brain functional network.

Brain-computer interface (BCI) technology based on P300 signals has a broad application prospect in the assessment and diagnosis of clinical diseases and game control. The paper of selecting key electrodes to realize a wearable intention recognition system has become a hotspot for scholars at home and abroad. In this paper, based on the rich-club phenomenon that exists in the process of intention generation, a phase lag index (PLI)-rich-club-based intention recognition method for P300 is proposed. The rich-club structure is a network consisting of electrodes that are highly connected with other electrodes in the process of P300 generation. To construct the rich-club network, this paper uses PLI to construct the brain functional network, calculates rich-club coefficients of the network in the range of k degrees, initially identifies rich-club nodes based on the feature of node degree, and then performs a descending order of betweenness centrality and identifies the nodes with larger betweenness centrality as the specific rich-club nodes, extracts the non-linear features and frequency domain features of Rich-club nodes, and finally uses support vector machine for classification. The experimental results show that the range of rich-club coefficients is smaller with intent compared to that without intent. Validation was performed on the BCI Competition III dataset by reducing the number of channels to 17 and 16 for subject A and subject B, with recognition quasi-departure rates of 96.93% and 94.93%, respectively, and on the BCI Competition II dataset by reducing the number of channels to 17 for subjects, with a recognition accuracy of 95.50%.

Multi-scale spatiotemporal attention network for neuron based motor imagery EEG classification

BackgroundIn recent times, the expeditious expansion of Brain-Computer Interface (BCI) technology in neuroscience, which relies on electroencephalogram (EEG) signals associated with motor imagery, has yielded outcomes that rival conventional approaches, notably due to the triumph of deep learning. Nevertheless, the task of developing and training a comprehensive network to extract the underlying characteristics of motor imagining EEG data continues to pose challenges. New methodThis paper presents a multi-scale spatiotemporal self-attention (SA) network model that relies on an attention mechanism. This model aims to classify motor imagination EEG signals into four classes (left hand, right hand, foot, tongue/rest) by considering the temporal and spatial properties of EEG. It is employed to autonomously allocate greater weights to channels linked to motor activity and lesser weights to channels not related to movement, thus choosing the most suitable channels. Neuron utilises parallel multi-scale Temporal Convolutional Network (TCN) layers to extract feature information in the temporal domain at various scales, effectively eliminating temporal domain noise. ResultsThe suggested model achieves accuracies of 79.26%, 85.90%, and 96.96% on the BCI competition datasets IV-2a, IV-2b, and HGD, respectively. Comparison with existing methodsIn terms of single-subject classification accuracy, this strategy demonstrates superior performance compared to existing methods. ConclusionThe results indicate that the proposed strategy exhibits favourable performance, resilience, and transfer learning capabilities.

A two-stage transformer based network for motor imagery classification

Brain-computer interfaces (BCIs) are used to understand brain functioning and develop therapies for neurological and neurodegenerative disorders. Therefore, BCIs are crucial in rehabilitating motor dysfunction and advancing motor imagery applications. For motor imagery, electroencephalogram (EEG) signals are used to classify the subject's intention of moving a body part without actually moving it. This paper presents a two-stage transformer-based architecture that employs handcrafted features and deep learning techniques to enhance the classification performance on benchmarked EEG signals. Stage-1 is built on parallel convolution based EEGNet, multi-head attention, and separable temporal convolution networks for spatiotemporal feature extraction. Further, for enhanced classification, in stage-2, additional features and embeddings extracted from stage-1 are used to train TabNet. In addition, a novel channel cluster swapping data augmentation technique is also developed to handle the issue of limited samples for training deep learning architectures. The developed two-stage architecture offered an average classification accuracy of 88.5 % and 88.3 % on the BCI Competition IV-2a and IV-2b datasets, respectively, which is approximately 3.0 % superior over similar recent reported works.

EEG rhythm separation and time-frequency analysis of fast multivariate empirical mode decomposition for motor imagery BCI.

Motor imagery electroencephalogram (EEG) is widely employed in brain-computer interface (BCI) systems. As a time-frequency analysis method for nonlinear and non-stationary signals, multivariate empirical mode decomposition (MEMD) and its noise-assisted version (NA-MEMD) has been widely used in the preprocessing step of BCI systems for separating EEG rhythms corresponding to specific brain activities. However, when applied to multichannel EEG signals, MEMD or NA-MEMD often demonstrate low robustness to noise and high computational complexity. To address these issues, we have explored the advantages of our recently proposed fast multivariate empirical mode decomposition (FMEMD) and its noise-assisted version (NA-FMEMD) for analyzing motor imagery data. We emphasize that FMEMD enables a more accurate estimation of EEG frequency information and exhibits a more noise-robust decomposition performance with improved computational efficiency. Comparative analysis with MEMD on simulation data and real-world EEG validates the above assertions. The joint average frequency measure is employed to automatically select intrinsic mode functions that correspond to specific frequency bands. Thus, FMEMD-based classification architecture is proposed. Using FMEMD as a preprocessing algorithm instead of MEMD can improve the classification accuracy by 2.3% on the BCI Competition IV dataset. On the Physiobank Motor/Mental Imagery dataset and BCI Competition IV Dataset 2a, FMEMD-based architecture also attained a comparable performance to complex algorithms. The results indicate that FMEMD proficiently extracts feature information from small benchmark datasets while mitigating dimensionality constraints resulting from computational complexity. Hence, FMEMD or NA-FMEMD can be a powerful time-frequency preprocessing method for BCI.

Direct lingam and visibility graphs for analyzing brain connectivity in BCI.

The brain-computer interface (BCI) is a direct pathway of communication between the electrical activity of the brain and an external device. The present paper was aimed to investigate directed connectivity between different areas of the brain during motor imagery (MI)-based BCI. For this purpose, two methods were implemented including, Limited Penetrable Horizontal Visibility Graph (LPHVG) and Direct Lingam. The visibility graph (VG) is a robust algorithm for analyzing complex systems such as the brain. Direct Lingam uses a non-Gaussian model to extract causal links which is appropriate for analyzing large-scale connectivity. First, LPHVG map MI-EEG (electroencephalogram) signals into networks. After extracting the topological features of the networks, a support vector machine classifier was applied to categorize multi-classes MI. The network of all classes was found to be different from one another, and the kappa value of classification was 0.68. The degree sequence of LPHVG was calculated for each channel in order to obtain the direction of brain information flow. Transfer entropy (TE) is used to compute the relations of the channel degree sequence. Therefore, the directed graph between channels was formed. This method is called LPHVG_TE directed graph. The Bayesian network, also known as the Direct LiNGAM model, was implemented for the second method. Finally, images of the LPHVG and Direct Lingam were classified by convolutional neural network (CNN). In this study, Data sets 2a of BCI competition IV was used. The outcomes reveal that the brain network developed by LPHVG (92.7%) might be more effective to distinguish 4 classes of MI than the Direct Lingam (90.6%) and it was shown that graph theory has the potential to get better efficiency of BCI.

Adaptive filter of frequency bands based coordinate attention network for EEG-based motor imagery classification.

In the brain-computer interface (BCI), motor imagery (MI) could be defined as the Electroencephalogram (EEG) signals through imagined movements, and ultimately enabling individuals to control external devices. However, the low signal-to-noise ratio, multiple channels and non-linearity are the essential challenges of accurate MI classification. To tackle these issues, we investigate the role of adaptive frequency bands selection and spatial-temporal feature learning in decoding motor imagery. We propose an Adaptive Filter of Frequency Bands based Coordinate Attention Network (AFFB-CAN) to improve the performance of MI classification. Specifically, we design the AFFB to adaptively obtain the upper and lower limits of frequency bands in order to alleviate information loss caused by manual selection. Next, we propose the CAN-based network to emphasize the key brain regions and temporal segments. And we design a multi-scale module to enhance temporal context learning. The conducted experiments on the BCI Competition IV-2a and 2b datasets reveal that our approach achieves an outstanding average accuracy, kappa values, and Macro F1-Score with 0.7825, 0.7104, and 0.7486 respectively. Similarly, for the BCI Competition IV-2b dataset, the average accuracy, kappa values, and F1-Score obtained are 0.8879, 0.7427, and 0.8734, respectively. The proposed AFFB-CAN method improves the performance of MI classification. In addition, our study confirms previous findings that motor imagery is mainly associated with µ and β rhythms. Moreover, we also find that γ rhythms also play an important role in MI classification.

Graph-Based Information Separator and Area Convolutional Network for EEG-Based Intention Decoding

In the current research on brain-computer interface (BCI), the electroencephalography (EEG) signal is usually only represented by a two-dimensional matrix, and the installation position of the EEG electrodes and the correlation between them are not considered. Actually, the cerebral cortex is a continuous potential surface and the information collected directly from each electrode is influenced by the other electrodes, so direct use of the raw data results in information redundancy. This paper converts the EEG signal into a graph, and then creates an information separator (IS) based on the Laplace matrix of the graph to obtain the independent source information of electrode nodes, and propose an IS-based area convolutional network (IS-ACN). Integrating the proposed IS with some advanced methods, the experimental results show that the incorporation of IS can enhance the performance of these methods. By observing and tracking samples with abnormal noise in the BCI competition IV dataset 2a, it is demonstrated that the proposed method can greatly reduce the influence of noise and effectively obtain the source features of EEG signals with low signal-to-noise ratio, and the average accuracy and kappa coefficient of the proposed IS-ACN on this dataset are 80.59% and 74.1%, respectively.

Transfer learning with data alignment and optimal transport for EEG based motor imagery classification

Objective. The non-stationarity of electroencephalogram (EEG) signals and the variability among different subjects present significant challenges in current Brain–Computer Interfaces (BCI) research, which requires a time-consuming specific calibration procedure to address. Transfer Learning (TL) offers a potential solution by leveraging data or models from one or more source domains to facilitate learning in the target domain, so as to address these challenges. Approach. In this paper, a novel Multi-source domain Transfer Learning Fusion (MTLF) framework is proposed to address the calibration problem. Firstly, the method transforms the source domain data with the resting state segment data, in order to decrease the differences between the source domain and the target domain. Subsequently, feature extraction is performed using common spatial pattern. Finally, an improved TL classifier is employed to classify the target samples. Notably, this method does not require the label information of target domain samples, while concurrently reducing the calibration workload. Main results. The proposed MTLF is assessed on Datasets 2a and 2b from the BCI Competition IV. Compared with other algorithms, our method performed relatively the best and achieved mean classification accuracy of 73.69% and 70.83% on Datasets 2a and 2b respectively. Significance. Experimental results demonstrate that the MTLF framework effectively reduces the discrepancy between the source and target domains and acquires better classification performance on two motor imagery datasets.

Bidirectional feature pyramid attention-based temporal convolutional network model for motor imagery electroencephalogram classification.

As an interactive method gaining popularity, brain-computer interfaces (BCIs) aim to facilitate communication between the brain and external devices. Among the various research topics in BCIs, the classification of motor imagery using electroencephalography (EEG) signals has the potential to greatly improve the quality of life for people with disabilities. This technology assists them in controlling computers or other devices like prosthetic limbs, wheelchairs, and drones. However, the current performance of EEG signal decoding is not sufficient for real-world applications based on Motor Imagery EEG (MI-EEG). To address this issue, this study proposes an attention-based bidirectional feature pyramid temporal convolutional network model for the classification task of MI-EEG. The model incorporates a multi-head self-attention mechanism to weigh significant features in the MI-EEG signals. It also utilizes a temporal convolution network (TCN) to separate high-level temporal features. The signals are enhanced using the sliding-window technique, and channel and time-domain information of the MI-EEG signals is extracted through convolution. Additionally, a bidirectional feature pyramid structure is employed to implement attention mechanisms across different scales and multiple frequency bands of the MI-EEG signals. The performance of our model is evaluated on the BCI Competition IV-2a dataset and the BCI Competition IV-2b dataset, and the results showed that our model outperformed the state-of-the-art baseline model, with an accuracy of 87.5 and 86.3% for the subject-dependent, respectively. In conclusion, the BFATCNet model offers a novel approach for EEG-based motor imagery classification in BCIs, effectively capturing relevant features through attention mechanisms and temporal convolutional networks. Its superior performance on the BCI Competition IV-2a and IV-2b datasets highlights its potential for real-world applications. However, its performance on other datasets may vary, necessitating further research on data augmentation techniques and integration with multiple modalities to enhance interpretability and generalization. Additionally, reducing computational complexity for real-time applications is an important area for future work.

Selective multi–view time–frequency decomposed spatial feature matrix for motor imagery EEG classification

Decoding brain activity from non-invasive motor imagery electroencephalograph (MI-EEG) has garnered significant attentions for brain-computer interface (BCI) and brain disorders. Notably, owing to the remarkable advances in feature representation, extracting and selecting discriminative features in EEG decoding has gained widespread popularity in recent years. However, many EEG studies suffer from limited sample sizes with low signal-to-noise ratio, making it difficult to effectively represent complementary features in a single view. To address this fundamental limitation, this paper proposes a novel method to Selective extract the Multi-View Time-Frequency decomposed Spatial (S-MVTFS) feature matrix, which employs spatial features from Euclidean and Riemannian spaces based on time–frequency decompositions. It selectively extracts discriminative features on manifold embedded space and classifies feature matrix through sparse support matrix machine. The proposed method has been systematically benchmarked on three BCI competition MI-EEG datasets, and its classification performance surpasses several state-of-the-art methods. Notably, the S-MVTFS method achieved average classification improvements of 0.45%, 2.28%, and 2.04% on BCI-III dataset 4a, BCI-IV dataset 1, and BCI-IV dataset 2a, respectively. Moreover, it effectively captures meaningful temporal varying and spatially coupled features with parameter insensitivity. Our method therefore provides a novel MI-EEG tailored feature representation for decoding brain activity.

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model.

Motor imagery (MI) is a cognitive process wherein an individual mentally rehearses a specific movement without physically executing it. Recently, MI-based brain-computer interface (BCI) has attracted widespread attention. However, accurate decoding of MI and understanding of neural mechanisms still face huge challenges. These seriously hinder the clinical application and development of BCI systems based on MI. Thus, it is very necessary to develop new methods to decode MI tasks. In this work, we propose a multi-branch convolutional neural network (MBCNN) with a temporal convolutional network (TCN), an end-to-end deep learning framework to decode multi-class MI tasks. We first used MBCNN to capture the MI electroencephalography signals information on temporal and spectral domains through different convolutional kernels. Then, we introduce TCN to extract more discriminative features. The within-subject cross-session strategy is used to validate the classification performance on the dataset of BCI Competition IV-2a. The results showed that we achieved 75.08% average accuracy for 4-class MI task classification, outperforming several state-of-the-art approaches. The proposed MBCNN-TCN-Net framework successfully captures discriminative features and decodes MI tasks effectively, improving the performance of MI-BCIs. Our findings could provide significant potential for improving the clinical application and development of MI-based BCI systems.