EEG-based Brain-computer Interface System Research Articles

Enhancing learning experiences: EEG-based passive BCI system adapts learning speed to cognitive load in real-time, with motivation as catalyst.

Computer-based learning has gained popularity in recent years, providing learners greater flexibility and freedom. However, these learning environments do not consider the learner's mental state in real-time, resulting in less optimized learning experiences. This research aimed to explore the effect on the learning experience of a novel EEG-based Brain-Computer Interface (BCI) that adjusts the speed of information presentation in real-time during a learning task according to the learner's cognitive load. We also explored how motivation moderated these effects. In accordance with three experimental groups (non-adaptive, adaptive, and adaptive with motivation), participants performed a calibration task (n-back), followed by a memory-based learning task concerning astrological constellations. Learning gains were assessed based on performance on the learning task. Self-perceived mental workload, cognitive absorption and satisfaction were assessed using a post-test questionnaire. Between-group analyses using Mann-Whitney tests suggested that combining BCI and motivational factors led to more significant learning gains and an improved learning experience. No significant difference existed between the BCI without motivational factor and regular non-adaptive interface for overall learning gains, self-perceived mental workload, and cognitive absorption. However, participants who undertook the experiment with an imposed learning pace reported higher overall satisfaction with their learning experience and a higher level of temporal stress. Our findings suggest BCI's potential applicability and feasibility in improving memorization-based learning experiences. Further work should seek to optimize the BCI adaptive index and explore generalizability to other learning contexts.

Enhancing EEG-based brain-computer interface systems through efficient machine learning classification techniques

Advances in the fields of neuroscience and computer science have greatly enhanced the human brain’s ability to communicate and interact with the surrounding environment. In addition, recent steps in machine learning (ML) have increased the use of electroencephalography (EEG)-based BCIs for artificial intelligence (AI) applications. The prevailing challenge in recording EEG sensor data is that the captured signals are mixed with noise, which makes their effective use difficult. Therefore, strengthening the classification stage becomes extremely important and plays a major role in addressing this problem. In this study, we chose five most widely used classification models that obtained the best results in this field and tested them on two open-source databases. We also focused on improving the hyperparameters of each algorithm to obtain best results. Our results indicate excellent results on the first dataset and acceptable for most models on the second, while RF showed superior performance on both with an accuracy of 100% on the first dataset and 86.47% on the second. This was achieved with the lowest training costs, and better performance compared to previous works we evaluated that used the same databases. These results provide valuable insights and advance the development of brain-computer interface (BCI) technology and design.

Two-stage sparse multi-objective evolutionary algorithm for channel selection optimization in BCIs.

Channel selection has become the pivotal issue affecting the widespread application of non-invasive brain-computer interface systems in the real world. However, constructing suitable multi-objective problem models alongside effective search strategies stands out as a critical factor that impacts the performance of multi-objective channel selection algorithms. This paper presents a two-stage sparse multi-objective evolutionary algorithm (TS-MOEA) to address channel selection problems in brain-computer interface systems. In TS-MOEA, a two-stage framework, which consists of the early and late stages, is adopted to prevent the algorithm from stagnating. Furthermore, The two stages concentrate on different multi-objective problem models, thereby balancing convergence and population diversity in TS-MOEA. Inspired by the sparsity of the correlation matrix of channels, a sparse initialization operator, which uses a domain-knowledge-based score assignment strategy for decision variables, is introduced to generate the initial population. Moreover, a Score-based mutation operator is utilized to enhance the search efficiency of TS-MOEA. The performance of TS-MOEA and five other state-of-the-art multi-objective algorithms has been evaluated using a 62-channel EEG-based brain-computer interface system for fatigue detection tasks, and the results demonstrated the effectiveness of TS-MOEA. The proposed two-stage framework can help TS-MOEA escape stagnation and facilitate a balance between diversity and convergence. Integrating the sparsity of the correlation matrix of channels and the problem-domain knowledge can effectively reduce the computational complexity of TS-MOEA while enhancing its optimization efficiency.

Improved motor imagery classification using adaptive spatial filters based on particle swarm optimization algorithm.

As a typical self-paced brain-computer interface (BCI) system, the motor imagery (MI) BCI has been widely applied in fields such as robot control, stroke rehabilitation, and assistance for patients with stroke or spinal cord injury. Many studies have focused on the traditional spatial filters obtained through the common spatial pattern (CSP) method. However, the CSP method can only obtain fixed spatial filters for specific input signals. In addition, the CSP method only focuses on the variance difference of two types of electroencephalogram (EEG) signals, so the decoding ability of EEG signals is limited. To make up for these deficiencies, this study introduces a novel spatial filter-solving paradigm named adaptive spatial pattern (ASP), which aims to minimize the energy intra-class matrix and maximize the inter-class matrix of MI-EEG after spatial filtering. The filter bank adaptive and common spatial pattern (FBACSP), our proposed method for MI-EEG decoding, amalgamates ASP spatial filters with CSP features across multiple frequency bands. Through a dual-stage feature selection strategy, it employs the Particle Swarm Optimization algorithm for spatial filter optimization, surpassing traditional CSP approaches in MI classification. To streamline feature sets and enhance recognition efficiency, it first prunes CSP features in each frequency band using mutual information, followed by merging these with ASP features. Comparative experiments are conducted on two public datasets (2a and 2b) from BCI competition IV, which show the outstanding average recognition accuracy of FBACSP. The classification accuracy of the proposed method has reached 74.61 and 81.19% on datasets 2a and 2b, respectively. Compared with the baseline algorithm, filter bank common spatial pattern (FBCSP), the proposed algorithm improves by 11.44 and 7.11% on two datasets, respectively (p < 0.05). It is demonstrated that FBACSP has a strong ability to decode MI-EEG. In addition, the analysis based on mutual information, t-SNE, and Shapley values further proves that ASP features have excellent decoding ability for MI-EEG signals and explains the improvement of classification performance by the introduction of ASP features. These findings may provide useful information to optimize EEG-based BCI systems and further improve the performance of non-invasive BCI.

EEG-based classification combining Bayesian convolutional neural networks with recurrence plot for motor movement/imagery

Electroencephalogram (EEG)-based Motor imagery (MI) is a key topic in the brain-computer interface (BCI). The EEG-based real execution and motor imagery multi-class classification tasks are also crucial, but only a few kinds of literature research it. In addition, classification accuracy still has room for improvement, and the inter-individual variability problems in BCI applications need to be solved. To address these issues, we developed a novel model (RP-BCNNs) that combines the recurrence plot (RP) and Bayesian Convolutional Neural Networks (BCNNs). First, we employ an RP computation for preprocessed EEG signals of each channel and merge all RPs of all channels into one based on the weighted average method. Then, we feed the RP features into BCNNs to classify 2-class, 3-class, 4-class, and 5-class on real/imaginary movements classification tasks. The results show that the RP-BCNNs model outperforms the state-of-the-art methods, achieving average accuracies of 92.86%, 94.12%, 91.37%, 92.61% for real movements and 94.07%, 93.77%, 90.54%, 91.85% for imaginary movements. Our findings suggest that combining complex network methods with deep learning can improve the classification performance of EEG-based BCI systems (e.g., motor imagery, emotion recognition, and epileptic seizure classification).

Lower-limb kinematic reconstruction during pedaling tasks from EEG signals using Unscented Kalman filter

Kinematic reconstruction of lower-limb movements using electroencephalography (EEG) has been used in several rehabilitation systems. However, the nonlinear relationship between neural activity and limb movement may challenge decoders in real-time Brain-Computer Interface (BCI) applications. This paper proposes a nonlinear neural decoder using an Unscented Kalman Filter (UKF) to infer lower-limb kinematics from EEG signals during pedaling. The results demonstrated maximum decoding accuracy using slow cortical potentials in the delta band (0.1-4 Hz) of 0.33 for Pearson’s r-value and 8 for the signal-to-noise ratio (SNR). This leaves an open door to the development of closed-loop EEG-based BCI systems for kinematic monitoring during pedaling rehabilitation tasks.

A survey on encoding and decoding technology of non-invasive brain-computer interface

A survey on encoding and decoding technology of non-invasive brain-computer interface

Subject-Dependent Artifact Removal for Enhancing Motor Imagery Classifier Performance under Poor Skills.

The Electroencephalography (EEG)-based motor imagery (MI) paradigm is one of the most studied technologies for Brain-Computer Interface (BCI) development. Still, the low Signal-to-Noise Ratio (SNR) poses a challenge when constructing EEG-based BCI systems. Moreover, the non-stationary and nonlinear signal issues, the low-spatial data resolution, and the inter- and intra-subject variability hamper the extraction of discriminant features. Indeed, subjects with poor motor skills have difficulties in practicing MI tasks against low SNR scenarios. Here, we propose a subject-dependent preprocessing approach that includes the well-known Surface Laplacian Filtering and Independent Component Analysis algorithms to remove signal artifacts based on the MI performance. In addition, power- and phase-based functional connectivity measures are studied to extract relevant and interpretable patterns and identify subjects of inefficency. As a result, our proposal, Subject-dependent Artifact Removal (SD-AR), improves the MI classification performance in subjects with poor motor skills. Consequently, electrooculography and volume-conduction EEG artifacts are mitigated within a functional connectivity feature-extraction strategy, which favors the classification performance of a straightforward linear classifier.

Stockwell transform and semi-supervised feature selection from deep features for classification of BCI signals

Over the past few years, the processing of motor imagery (MI) electroencephalography (EEG) signals has been attracted for developing brain-computer interface (BCI) applications, since feature extraction and classification of these signals are extremely difficult due to the inherent complexity and tendency to artifact properties of them. The BCI systems can provide a direct interaction pathway/channel between the brain and a peripheral device, hence the MI EEG-based BCI systems seem crucial to control external devices for patients suffering from motor disabilities. The current study presents a semi-supervised model based on three-stage feature extraction and machine learning algorithms for MI EEG signal classification in order to improve the classification accuracy with smaller number of deep features for distinguishing right- and left-hand MI tasks. Stockwell transform is employed at the first phase of the proposed feature extraction method to generate two-dimensional time–frequency maps (TFMs) from one-dimensional EEG signals. Next, the convolutional neural network (CNN) is applied to find deep feature sets from TFMs. Then, the semi-supervised discriminant analysis (SDA) is utilized to minimize the number of descriptors. Finally, the performance of five classifiers, including support vector machine, discriminant analysis, k-nearest neighbor, decision tree, random forest, and the fusion of them are compared. The hyperparameters of SDA and mentioned classifiers are optimized by Bayesian optimization to maximize the accuracy. The presented model is validated using BCI competition II dataset III and BCI competition IV dataset 2b. The performance metrics of the proposed method indicate its efficiency for classifying MI EEG signals.

An Optimized SWCSP Technique for Feature Extraction in EEG-based BCI System

Brain-computer interface (BCI) is an evolving technology having huge potential for rehabilitation of patients suffering from disorders of the nervous system, besides many other nonmedical applications. Multichannel electroencephalography (EEG) is widely used to provide input signals to a BCI system. Significant research in methodology employed to implement different stages of BCI system, has led to discovery of new issues and challenges. The raw EEG data includes artifacts from environmental and physiological sources, which is eliminated in preprocessing phase of BCI system. It is then followed by a feature extraction stage to isolate a few relevant features for further classification to a particular motor imagery (MI) activity. A feature extraction approach based on spectrally weighted common spatial pattern (SWCSP) is proposed in this paper to improve overall accuracy of a BCI system. The reported literature uses SWCSP for feature extraction, as it has outperformed other techniques. The proposed approach enhances its performance by optimizing its parameters. The independent component analysis (ICA) method is used for detection and removal of irrelevant data, while linear discriminant analysis (LDA) is used as a classifier. The proposed approach is executed on benchmark data-set 2a of BCI competition IV. It yielded classification accuracy of 70.6% across nine subjects, which is higher than all the reported approaches.

3D Input Convolutional Neural Network for SSVEP Classification in Design of Brain Computer Interface for Patient User.

This research was aimed at presenting performance of 3-dimensional input convolutional neural networks for steady-state visual evoked potential classification in a wireless EEG-based brain-computer interface system. Overall performance of a brain-computer interface system depends on information transfer rate. Parameters such as signal classification accuracy rate, signal stimulator structure, and user task completion time affect information transfer rate. In this study, we used 3 types of signal classification methods that are 1-dimensional, 2-dimensional, and 3-dimensional input convolutional neural network. According to online experiment with using 3-dimensional input convolutional neural network, we reached average classification accuracy rate and average information transfer rate as 93.75% and 58.35 bit/min, respectively. This both results significantly higher than the other methods that we used in experiments. Moreover, user task completion time was reduced with using 3-dimensional input convolutional neural network. Our proposed method is novel and state-of-art model for steady-state visual evoked potential classification.

A State-of-the-Art Review of EEG-Based Imagined Speech Decoding.

Currently, the most used method to measure brain activity under a non-invasive procedure is the electroencephalogram (EEG). This is because of its high temporal resolution, ease of use, and safety. These signals can be used under a Brain Computer Interface (BCI) framework, which can be implemented to provide a new communication channel to people that are unable to speak due to motor disabilities or other neurological diseases. Nevertheless, EEG-based BCI systems have presented challenges to be implemented in real life situations for imagined speech recognition due to the difficulty to interpret EEG signals because of their low signal-to-noise ratio (SNR). As consequence, in order to help the researcher make a wise decision when approaching this problem, we offer a review article that sums the main findings of the most relevant studies on this subject since 2009. This review focuses mainly on the pre-processing, feature extraction, and classification techniques used by several authors, as well as the target vocabulary. Furthermore, we propose ideas that may be useful for future work in order to achieve a practical application of EEG-based BCI systems toward imagined speech decoding.

Performance Evaluation of Current State of Brain Computer Interface (BCI) and its Trends

The goal of this study was to broaden a technique to the rapidly growing field of BCI analysis. The goal was to broaden a deep understanding of the neurophysiological processes that might be overloaded to incorporate a BCI system by focusing in the electroencephalogram as the BCI input modality. The research is being carried out in order to gain a better understanding of the human brain's neurophysiology. The purpose of this research is to look into electroencephalography as a method of detecting mental activity. We present a comprehensive overview of EEG-based BCI systems that have been implemented so far. We also explored the future of BCI technology and evaluated by comparing the performance of various feature classification techniques

An EEG-Based Brain Computer Interface for Emotion Recognition and Its Application in Patients with Disorder of Consciousness

Recognizing human emotions based on electroencephalogram (EEG) signals has received a great deal of attentions. Most of the existing studies focused on offline analysis, and real-time emotion recognition using a brain computer interface (BCI) approach remains to be further investigated. In this paper, we proposed an EEG-based BCI system for emotion recognition. Specifically, two classes of video clips that represented positive and negative emotions were presented to the subjects one by one, while the EEG data were collected and processed simultaneously, and instant feedback was provided after each clip. Ten healthy subjects participated in the experiment and achieved a high average online accuracy of 91.5 <inline-formula><tex-math notation="LaTeX">$\pm$</tex-math></inline-formula> 6.34 percent. The experimental results demonstrated that the subjects emotions had been sufficiently evoked and efficiently recognized by our system. Clinically, patients with disorder of consciousness (DOC), such as coma, vegetative state, minimally conscious state and emergence minimally conscious state, suffer from motor impairment and generally cannot provide adequate emotion expressions. Consequently, doctors have difficulty in detecting the emotional states of these patients. Therefore, we applied our emotion recognition BCI system to patients with DOC. Eight DOC patients participated in our experiment, and three of them achieved significant online accuracy. The experimental results show that the proposed BCI system could be a promising tool to detect the emotional states of patients with DOC.

Kernel-Based Phase Transfer Entropy with Enhanced Feature Relevance Analysis for Brain Computer Interfaces

Neural oscillations are present in the brain at different spatial and temporal scales, and they are linked to several cognitive functions. Furthermore, the information carried by their phases is fundamental for the coordination of anatomically distributed processing in the brain. The concept of phase transfer entropy refers to an information theory-based measure of directed connectivity among neural oscillations that allows studying such distributed processes. Phase TE is commonly obtained from probability estimations carried out over data from multiple trials, which bars its use as a characterization strategy in brain–computer interfaces. In this work, we propose a novel methodology to estimate TE between single pairs of instantaneous phase time series. Our approach combines a kernel-based TE estimator defined in terms of Renyi’s α entropy, which sidesteps the need for probability distribution computation with phase time series obtained by complex filtering the neural signals. Besides, a kernel-alignment-based relevance analysis is added to highlight relevant features from effective connectivity-based representation supporting further classification stages in EEG-based brain–computer interface systems. Our proposal is tested on simulated coupled data and two publicly available databases containing EEG signals recorded under motor imagery and visual working memory paradigms. Attained results demonstrate how the introduced effective connectivity succeeds in detecting the interactions present in the data for the former, with statistically significant results around the frequencies of interest. It also reflects differences in coupling strength, is robust to realistic noise and signal mixing levels, and captures bidirectional interactions of localized frequency content. Obtained results for the motor imagery and working memory databases show that our approach, combined with the relevance analysis strategy, codes discriminant spatial and frequency-dependent patterns for the different conditions in each experimental paradigm, with classification performances that do well in comparison with those of alternative methods of similar nature.

Single-trial detection of EEG error-related potentials using modified power-law transformation

Error processing in the human brain is characterized by a distinct neural response that is elicited when the outcome of an event is not the same as expected. This response is known as error-related potential (ErrP). Detection of error-related potentials from a single-trial data can lead the existing Brain-Computer Interface (BCI) systems one step closer to autonomous system. The non-stationarity of the Electroencephalograph (EEG) signal along with poor spatial resolution and low signal-to-noise ratio make the task of detecting ErrP on a single-trial basis challenging. The objective of this work is to propose a novel ErrP detection method based on temporal domain features of ErrP, particularly, the standard deviation measure. The difference in the standard deviation between the correct and the erroneous trials is verified using a statistical test and this information is subsequently used for ErrP detection. In the proposed method, the EEG electrodes from the frontocentral region of the brain are ranked using standard deviation based ranking criterion and a few top-ranked electrodes will be considered for single-trial detection of ErrP. Then, a modified power-law based transformation is proposed to enhance the discriminability between the correct and error trials. The discriminability is enhanced by transforming the samples lying outside a predefined amplitude range according to power-law equation and the samples within the selected amplitude range are transformed linearly. The modified power-law transformation has two parameters K and γ. The parameter K defines the pre-defined amplitude range and γ is the power in the standard power-law equation. The proposed ErrP detection method is tested on a publicly available EEG database of 10 subjects. The proposed transformation increases the discriminability between the erroneous and correct trials and achieves the best trade-off between the sensitivity and the specificity for detecting ErrP on single-trial basis compared to existing methods. The average sensitivity and specificity achieved is 86.17±9.05% and 92.05±3.69% respectively. The higher sensitivity of detection erroneous trials can be used to faithfully correct the wrongly decoded signal in the EEG based BCI system.

A novel explainable machine learning approach for EEG-based brain-computer interface systems

Electroencephalographic (EEG) recordings can be of great help in decoding the open/close hand’s motion preparation. To this end, cortical EEG source signals in the motor cortex (evaluated in the 1-s window preceding movement onset) are extracted by solving inverse problem through beamforming. EEG sources epochs are used as source-time maps input to a custom deep convolutional neural network (CNN) that is trained to perform 2-ways classification tasks: pre-hand close (HC) versus resting state (RE) and pre-hand open (HO) versus RE. The developed deep CNN works well (accuracy rates up to \(89.65 \pm 5.29\%\) for HC versus RE and \(90.50 \pm 5.35\%\) for HO versus RE), but the core of the present study was to explore the interpretability of the deep CNN to provide further insights into the activation mechanism of cortical sources during the preparation of hands’ sub-movements. Specifically, occlusion sensitivity analysis was carried out to investigate which cortical areas are more relevant in the classification procedure. Experimental results show a recurrent trend of spatial cortical activation across subjects. In particular, the central region (close to the longitudinal fissure) and the right temporal zone of the premotor together with the primary motor cortex appear to be primarily involved. Such findings encourage an in-depth study of cortical areas that seem to play a key role in hand’s open/close preparation.

EEG-Based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and Their Applications

Brain-Computer interfaces (BCIs) enhance the capability of human brain activities to interact with the environment. Recent advancements in technology and machine learning algorithms have increased interest in electroencephalographic (EEG)-based BCI applications. EEG-based intelligent BCI systems can facilitate continuous monitoring of fluctuations in human cognitive states under monotonous tasks, which is both beneficial for people in need of healthcare support and general researchers in different domain areas. In this review, we survey the recent literature on EEG signal sensing technologies and computational intelligence approaches in BCI applications, compensating for the gaps in the systematic summary of the past five years. Specifically, we first review the current status of BCI and signal sensing technologies for collecting reliable EEG signals. Then, we demonstrate state-of-the-art computational intelligence techniques, including fuzzy models and transfer learning in machine learning and deep learning algorithms, to detect, monitor, and maintain human cognitive states and task performance in prevalent applications. Finally, we present a couple of innovative BCI-inspired healthcare applications and discuss future research directions in EEG-based BCI research.

An empirical survey of electroencephalography-based brain-computer interfaces

Abstract Objectives The Electroencephalogram (EEG) signal is modified using the Motor Imagery (MI) and it is utilized for patients with high motor impairments. Hence, the direct relationship between the computer and brain is termed as an EEG-based brain-computer interface (BCI). The objective of this survey is to presents an analysis of the existing distinct BCIs based on EEG. Methods This survey provides a detailed review of more than 60 research papers presenting the BCI-based EEG, like motor imagery-based techniques, spatial filtering-based techniques, Steady-State Visual Evoked Potential (SSVEP)-based techniques, machine learning-based techniques, Event-Related Potential (ERP)-based techniques, and online EEG-based techniques. Subsequently, the research gaps and issues of several EEG-based BCI systems are adopted to help the researchers for better future scope. Results An elaborative analyses as well as discussion have been provided by concerning the parameters, like evaluation metrics, year of publication, accuracy, implementation tool, and utilized datasets obtained by various techniques. Conclusions This survey paper exposes research topics on BCI-based EEG, which helps the researchers and scholars, who are interested in this domain.

Optimization of parameters for improving the performance of EEG-based BCI system

Brain–computer interface (BCI) is an active domain which has attracted attention of the research community in recent years. It offers huge potential as a technology which can estimate the intention of a user by analysis of brain signals and establish a communication channel directly between a human brain and an external device. Electroencephalography (EEG) is the most popular signal acquisition technique due to its ease of use and simplicity. In EEG-based BCI systems, electrodes are placed on specific positions on the scalp of the subject to record electrical activity. The BCI system consists of sequential stages of signal acquisition, its preprocessing, feature extraction and feature classification. It is an active research area which has a focus on improving classification accuracy in motor imagery-based BCI systems. The first stage in a BCI system is to acquire EEG signals from different positions of the scalp of the human subject. The acquired brain signals are preprocessed to remove artifacts before these are fed to feature the extraction stage. In this paper, independent component analysis (ICA) technique is used to remove artifacts from acquired signals. Filter bank common spatial pattern (FBCSP) technique is then used for feature extraction and feature selection. A feature classification approach based on support vector machine (SVM) is proposed in this work and its performance is enhanced by optimizing its polynomial kernel parameters. Selection of kernel parameters is done by grid search method using the fivefold cross-validation procedure. The proposed approach is then executed on publicly available data set 2a of BCI Competition IV. Results show that the proposed approach offers higher classification accuracy and lower misclassification rate as compared to other methods executed on the same dataset, as reported in literature.