Brain-computer Interface Research Articles

Gamma-Band Auditory Steady-State Response and Attention: A Systemic Review.

Auditory steady-state response (ASSR) is the result of the brain's ability to follow and entrain its oscillatory activity to the phase and frequency of periodic auditory stimulation. Gamma-band ASSR has been increasingly investigated with intentions to apply it in neuropsychiatric disorders diagnosis as well as in brain-computer interface technologies. However, it is still debatable whether attention can influence ASSR, as the results of the attention effects of ASSR are equivocal. In our study, we aimed to systemically review all known articles related to the attentional modulation of gamma-band ASSRs. The initial literature search resulted in 1283 papers. After the removal of duplicates and ineligible articles, 49 original studies were included in the final analysis. Most analyzed studies demonstrated ASSR modulation with differing attention levels; however, studies providing mixed or non-significant results were also identified. The high versatility of methodological approaches including the utilized stimulus type and ASSR recording modality, as well as tasks employed to modulate attention, were detected and emphasized as the main causality of result inconsistencies across studies. Also, the impact of training, inter-individual variability, and time of focus was addressed.

An emerging discipline: brain-computer interfaces medicine

With the development of brain-computer interface (BCI) technology and its translational application in clinical medicine, BCI medicine has emerged, ushering in profound changes to the practice of medicine, while also bringing forth a series of ethical issues related to BCI medicine. BCI medicine is progressively emerging as a new disciplinary focus, yet to date, there has been limited literature discussing it. Therefore, this paper focuses on BCI medicine, firstly providing an overview of the main potential medical applications of BCI technology. It then defines the discipline, outlines its objectives, methodologies, potential efficacy, and associated translational medical research. Additionally, it discusses the ethics associated with BCI medicine, and introduces the standardized operational procedures for BCI medical applications and the methods for evaluating the efficacy of BCI medical applications. Finally, it anticipates the challenges and future directions of BCI medicine. In the future, BCI medicine may become a new academic discipline or major in higher education. In summary, this article is hoped to provide thoughts and references for the development of the discipline of BCI medicine.

A review of functional electrical stimulation based on brain-computer interface

Individuals with motor dysfunction caused by damage to the central nervous system are unable to transmit voluntary movement commands to their muscles, resulting in a reduced ability to control their limbs. However, traditional rehabilitation methods have problems such as long treatment cycles and high labor costs. Functional electrical stimulation (FES) based on brain-computer interface (BCI) connects the patient's intentions with muscle contraction, and helps to promote the reconstruction of nerve function by recognizing nerve signals and stimulating the moving muscle group with electrical impulses to produce muscle convulsions or limb movements. It is an effective treatment for sequelae of neurological diseases such as stroke and spinal cord injury. This article reviewed the current research status of BCI-based FES from three aspects: BCI paradigms, FES parameters and rehabilitation efficacy, and looked forward to the future development trend of this technology, in order to improve the understanding of BCI-based FES.

Virtual reality-brain computer interface hand function enhancement rehabilitation system incorporating multi-sensory stimulation

Stroke is an acute cerebrovascular disease in which sudden interruption of blood supply to the brain or rupture of cerebral blood vessels cause damage to brain cells and consequently impair the patient's motor and cognitive abilities. A novel rehabilitation training model integrating brain-computer interface (BCI) and virtual reality (VR) not only promotes the functional activation of brain networks, but also provides immersive and interesting contextual feedback for patients. In this paper, we designed a hand rehabilitation training system integrating multi-sensory stimulation feedback, BCI and VR, which guides patients' motor imaginations through the tasks of the virtual scene, acquires patients' motor intentions, and then carries out human-computer interactions under the virtual scene. At the same time, haptic feedback is incorporated to further increase the patients' proprioceptive sensations, so as to realize the hand function rehabilitation training based on the multi-sensory stimulation feedback of vision, hearing, and haptic senses. In this study, we compared and analyzed the differences in power spectral density of different frequency bands within the EEG signal data before and after the incorporation of haptic feedback, and found that the motor brain area was significantly activated after the incorporation of haptic feedback, and the power spectral density of the motor brain area was significantly increased in the high gamma frequency band. The results of this study indicate that the rehabilitation training of patients with the VR-BCI hand function enhancement rehabilitation system incorporating multi-sensory stimulation can accelerate the two-way facilitation of sensory and motor conduction pathways, thus accelerating the rehabilitation process.

The supernumerary robotic limbs of brain-computer interface based on asynchronous steady-state visual evoked potential

Brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP) have attracted much attention in the field of intelligent robotics. Traditional SSVEP-based BCI systems mostly use synchronized triggers without identifying whether the user is in the control or non-control state, resulting in a system that lacks autonomous control capability. Therefore, this paper proposed a SSVEP asynchronous state recognition method, which constructs an asynchronous state recognition model by fusing multiple time-frequency domain features of electroencephalographic (EEG) signals and combining with a linear discriminant analysis (LDA) to improve the accuracy of SSVEP asynchronous state recognition. Furthermore, addressing the control needs of disabled individuals in multitasking scenarios, a brain-machine fusion system based on SSVEP-BCI asynchronous cooperative control was developed. This system enabled the collaborative control of wearable manipulator and robotic arm, where the robotic arm acts as a "third hand", offering significant advantages in complex environments. The experimental results showed that using the SSVEP asynchronous control algorithm and brain-computer fusion system proposed in this paper could assist users to complete multitasking cooperative operations. The average accuracy of user intent recognition in online control experiments was 93.0%, which provides a theoretical and practical basis for the practical application of the asynchronous SSVEP-BCI system.

Visual object detection system based on augmented reality and steady-state visual evoked potential

This study investigates a brain-computer interface (BCI) system based on an augmented reality (AR) environment and steady-state visual evoked potentials (SSVEP). The system is designed to facilitate the selection of real-world objects through visual gaze in real-life scenarios. By integrating object detection technology and AR technology, the system augmented real objects with visual enhancements, providing users with visual stimuli that induced corresponding brain signals. SSVEP technology was then utilized to interpret these brain signals and identify the objects that users focused on. Additionally, an adaptive dynamic time-window-based filter bank canonical correlation analysis was employed to rapidly parse the subjects' brain signals. Experimental results indicated that the system could effectively recognize SSVEP signals, achieving an average accuracy rate of 90.6% in visual target identification. This system extends the application of SSVEP signals to real-life scenarios, demonstrating feasibility and efficacy in assisting individuals with mobility impairments and physical disabilities in object selection tasks.

A deep transfer learning approach for cross-subject recognition of mental tasks based on functional near-infrared spectroscopy

In the field of brain-computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS), traditional subject-specific decoding methods suffer from the limitations of long calibration time and low cross-subject generalizability, which restricts the promotion and application of BCI systems in daily life and clinic. To address the above dilemma, this study proposes a novel deep transfer learning approach that combines the revised inception-residual network (rIRN) model and the model-based transfer learning (TL) strategy, referred to as TL-rIRN. This study performed cross-subject recognition experiments on mental arithmetic (MA) and mental singing (MS) tasks to validate the effectiveness and superiority of the TL-rIRN approach. The results show that the TL-rIRN significantly shortens the calibration time, reduces the training time of the target model and the consumption of computational resources, and dramatically enhances the cross-subject decoding performance compared to subject-specific decoding methods and other deep transfer learning methods. To sum up, this study provides a basis for the selection of cross-subject, cross-task, and real-time decoding algorithms for fNIRS-BCI systems, which has potential applications in constructing a convenient and universal BCI system.

Gesture encoding in human left precentral gyrus neuronal ensembles.

Understanding the cortical activity patterns driving dexterous upper limb motion has the potential to benefit a broad clinical population living with limited mobility through the development of novel brain-computer interface (BCI) technology. The present study examines the activity of ensembles of motor cortical neurons recorded using microelectrode arrays in the dominant hemisphere of two BrainGate clinical trial participants with cervical spinal cord injury as they attempted to perform a set of 48 different hand gestures. Although each participant displayed a unique organization of their respective neural latent spaces, it was possible to achieve classification accuracies of ~70% for all 48 gestures (and ~90% for sets of 10). Our results show that single unit ensemble activity recorded in a single hemisphere of human precentral gyrus has the potential to generate a wide range of gesture-related signals across both hands, providing an intuitive and diverse set of potential command signals for intracortical BCI use.

Evaluation of Different Visual Feedback Methods for Brain-Computer Interfaces (BCI) Based on Code-Modulated Visual Evoked Potentials (cVEP).

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices using electroencephalography (EEG) signals. BCIs based on code-modulated visual evoked potentials (cVEPs) are based on visual stimuli, thus appropriate visual feedback on the interface is crucial for an effective BCI system. Many previous studies have demonstrated that implementing visual feedback can improve information transfer rate (ITR) and reduce fatigue. This research compares a dynamic interface, where target boxes change their sizes based on detection certainty, with a threshold bar interface in a three-step cVEP speller. In this study, we found that both interfaces perform well, with slight variations in accuracy, ITR, and output characters per minute (OCM). Notably, some participants showed significant performance improvements with the dynamic interface and found it less distracting compared to the threshold bars. These results suggest that while average performance metrics are similar, the dynamic interface can provide significant benefits for certain users. This study underscores the potential for personalized interface choices to enhance BCI user experience and performance. By improving user friendliness, performance, and reducing distraction, dynamic visual feedback could optimize BCI technology for a broader range of users.

Inter-participant transfer learning with attention based domain adversarial training for P300 detection

A Brain-computer interface (BCI) system establishes a novel communication channel between the human brain and a computer. Most event related potential-based BCI applications make use of decoding models, which requires training. This training process is often time-consuming and inconvenient for new users. In recent years, deep learning models, especially participant-independent models, have garnered significant attention in the domain of ERP classification. However, individual differences in EEG signals hamper model generalization, as the ERP component and other aspects of the EEG signal vary across participants, even when they are exposed to the same stimuli. This paper proposes a novel One-source domain transfer learning method based Attention Domain Adversarial Neural Network (OADANN) to mitigate data distribution discrepancies for cross-participant classification tasks. We train and validate our proposed model on both a publicly available OpenBMI dataset and a Self-collected dataset, employing a leave one participant out cross validation scheme. Experimental results demonstrate that the proposed OADANN method achieves the highest and most robust classification performance and exhibits significant improvements when compared to baseline methods (CNN, EEGNet, ShallowNet, DeepCovNet) and domain generalization methods (ERM, Mixup, and Groupdro). These findings underscore the efficacy of our proposed method.

Independent Vector Analysis for Feature Extraction in Motor Imagery Classification.

Independent vector analysis (IVA) can be viewed as an extension of independent component analysis (ICA) to multiple datasets. It exploits the statistical dependency between different datasets through mutual information. In the context of motor imagery classification based on electroencephalogram (EEG) signals for the brain-computer interface (BCI), several methods have been proposed to extract features efficiently, mainly based on common spatial patterns, filter banks, and deep learning. However, most methods use only one dataset at a time, which may not be sufficient for dealing with a multi-source retrieving problem in certain scenarios. From this perspective, this paper proposes an original approach for feature extraction through multiple datasets based on IVA to improve the classification of EEG-based motor imagery movements. The IVA components were used as features to classify imagined movements using consolidated classifiers (support vector machines and K-nearest neighbors) and deep classifiers (EEGNet and EEGInception). The results show an interesting performance concerning the clustering of MI-based BCI patients, and the proposed method reached an average accuracy of 86.7%.

SFT-SGAT: A semi-supervised fine-tuning self-supervised graph attention network for emotion recognition and consciousness detection

Emotional recognition is highly important in the field of brain-computer interfaces (BCIs). However, due to the individual variability in electroencephalogram (EEG) signals and the challenges in obtaining accurate emotional labels, traditional methods have shown poor performance in cross-subject emotion recognition. In this study, we propose a cross-subject EEG emotion recognition method based on a semi-supervised fine-tuning self-supervised graph attention network (SFT-SGAT). First, we model multi-channel EEG signals by constructing a graph structure that dynamically captures the spatiotemporal topological features of EEG signals. Second, we employ a self-supervised graph attention neural network to facilitate model training, mitigating the impact of signal noise on the model. Finally, a semi-supervised approach is used to fine-tune the model, enhancing its generalization ability in cross-subject classification. By combining supervised and unsupervised learning techniques, the SFT-SGAT maximizes the utility of limited labeled data in EEG emotion recognition tasks, thereby enhancing the model’s performance. Experiments based on leave-one-subject-out cross-validation demonstrate that SFT-SGAT achieves state-of-the-art cross-subject emotion recognition performance on the SEED and SEED-IV datasets, with accuracies of 92.04% and 82.76%, respectively. Furthermore, experiments conducted on a self-collected dataset comprising ten healthy subjects and eight patients with disorders of consciousness (DOCs) revealed that the SFT-SGAT attains high classification performance in healthy subjects (maximum accuracy of 95.84%) and was successfully applied to DOC patients, with four patients achieving emotion recognition accuracies exceeding 60%. The experiments demonstrate the effectiveness of the proposed SFT-SGAT model in cross-subject EEG emotion recognition and its potential for assessing levels of consciousness in patients with DOC.

Intelligent medicine in focus: the 5 stages of evolution in robot-assisted surgery for prostate cancer in the past 20 years and future implications

Robot-assisted surgery has evolved into a crucial treatment for prostate cancer (PCa). However, from its appearance to today, brain-computer interface, virtual reality, and metaverse have revolutionized the field of robot-assisted surgery for PCa, presenting both opportunities and challenges. Especially in the context of contemporary big data and precision medicine, facing the heterogeneity of PCa and the complexity of clinical problems, it still needs to be continuously upgraded and improved. Keeping this in mind, this article summarized the 5 stages of the historical development of robot-assisted surgery for PCa, encompassing the stages of emergence, promotion, development, maturity, and intelligence. Initially, safety concerns were paramount, but subsequent research and engineering advancements have focused on enhancing device efficacy, surgical technology, and achieving precise multi modal treatment. The dominance of da Vinci robot-assisted surgical system has seen this evolution intimately tied to its successive versions. In the future, robot-assisted surgery for PCa will move towards intelligence, promising improved patient outcomes and personalized therapy, alongside formidable challenges. To guide future development, we propose 10 significant prospects spanning clinical, research, engineering, materials, social, and economic domains, envisioning a future era of artificial intelligence in the surgical treatment of PCa.

EEG-Based Feature Classification Combining 3D-Convolutional Neural Networks with Generative Adversarial Networks for Motor Imagery.

The adoption of convolutional neural networks (CNNs) for decoding electroencephalogram (EEG)-based motor imagery (MI) in brain-computer interfaces has significantly increased recently. The effective extraction of motor imagery features is vital due to the variability among individuals and temporal states. This study introduces a novel network architecture, 3D-convolutional neural network-generative adversarial network (3D-CNN-GAN), for decoding both within-session and cross-session motor imagery. Initially, EEG signals were extracted over various time intervals using a sliding window technique, capturing temporal, frequency, and phase features to construct a temporal-frequency-phase feature (TFPF) three-dimensional feature map. Generative adversarial networks (GANs) were then employed to synthesize artificial data, which, when combined with the original datasets, expanded the data capacity and enhanced functional connectivity. Moreover, GANs proved capable of learning and amplifying the brain connectivity patterns present in the existing data, generating more distinctive brain network features. A compact, two-layer 3D-CNN model was subsequently developed to efficiently decode these TFPF features. Taking into account session and individual differences in EEG data, tests were conducted on both the public GigaDB dataset and the SHU laboratory dataset. On the GigaDB dataset, our 3D-CNN and 3D-CNN-GAN models achieved two-class within-session motor imagery accuracies of 76.49% and 77.03%, respectively, demonstrating the algorithm's effectiveness and the improvement provided by data augmentation. Furthermore, on the SHU dataset, the 3D-CNN and 3D-CNN-GAN models yielded two-class within-session motor imagery accuracies of 67.64% and 71.63%, and cross-session motor imagery accuracies of 58.06% and 63.04%, respectively. The 3D-CNN-GAN algorithm significantly enhances the generalizability of EEG-based motor imagery brain-computer interfaces (BCIs). Additionally, this research offers valuable insights into the potential applications of motor imagery BCIs.

An Intrinsically Explainable Method to Decode P300 Waveforms from EEG Signal Plots Based on Convolutional Neural Networks.

This work proposes an intrinsically explainable, straightforward method to decode P300 waveforms from electroencephalography (EEG) signals, overcoming the black box nature of deep learning techniques. The proposed method allows convolutional neural networks to decode information from images, an area where they have achieved astonishing performance. By plotting the EEG signal as an image, it can be both visually interpreted by physicians and technicians and detected by the network, offering a straightforward way of explaining the decision. The identification of this pattern is used to implement a P300-based speller device, which can serve as an alternative communication channel for persons affected by amyotrophic lateral sclerosis (ALS). This method is validated by identifying this signal by performing a brain-computer interface simulation on a public dataset from ALS patients. Letter identification rates from the speller on the dataset show that this method can identify the P300 signature on the set of 8 patients. The proposed approach achieves similar performance to other state-of-the-art proposals while providing clinically relevant explainability (XAI).

Transforming the Anthropomorphic Passive Free-Flow Foot Prosthesis Into a Powered Foot Prosthesis With Intuitive Control and Sensation (Bionic FFF).

Approximately 89% of all service members with amputations do not return to duty. Restoring intuitive neural control with somatosensory sensation is a key to improving the safety and efficacy of prosthetic locomotion. However, natural somatosensory feedback from lower-limb prostheses has not yet been incorporated into any commercial prostheses. We developed a neuroprosthesis with intuitive bidirectional control and somatosensation and evoking phase-dependent locomotor reflexes, we aspire to significantly improve the prosthetic rehabilitation and long-term functional outcomes of U.S. amputees. We implanted the skin and bone integrated pylon with peripheral neural interface pylon into the cat distal tibia, electromyographic electrodes into the residual gastrocnemius muscle, and nerve cuff electrodes on the distal tibial and sciatic nerves. Results. The bidirectional neural interface that was developed was integrated into the existing passive Free-Flow Foot and Ankle prosthesis, WillowWood, Mount Sterling, OH. The Free-Flow Foot was chosen because it had the highest Index of Anthropomorphicity among lower-limb prostheses and was the first anthropomorphic prosthesis brought to market. Conclusion. The cats walked on a treadmill with no cutaneous feedback from the foot in the control condition and with their residual distal tibial nerve stimulated during the stance phase of walking.

La filosofia alla prova dei linguaggi artificiali

Introdution: In recent years, the philosophy of language has undergone significant transformations thanks to developments in artificial intelligence and brain-machine interfaces (BMI). The introduction of the fourth version of Chat GPT and advancements in BMIs, such as Elon Musk's Neuralink, mark the beginning of a new era in human-machine communication. This study compares natural and artificial languages in light of recent debates on the use of artificial intelligence for the simulation of natural languages (Large Language Models, LLM). Metodologhia: The analysis reveals that Chat GPT technology is complementary to, rather than competitive with, human linguistic capabilities. LLMs excel in formal linguistic competence but are limited in the functional understanding of language, highlighting the distinction between language processing in the human brain and the functioning of LLMs. Furthermore, BMIs are opening new possibilities for direct communication between human brains and machines, as demonstrated by BrainNet projects. Results: These developments raise ethical and philosophical questions regarding the ownership of thoughts and individual integrity. Methodologically, the study examines neuroscientific research through philosophical analysis to highlight theoretical-conceptual implications. Conclusion: The conclusions suggest that while advanced technologies offer new communication perspectives, a thorough reflection on ethical and legal issues is necessary for responsible use.

Surface Electromyography-Based Recognition of Electronic Taste Sensations.

Taste sensation recognition is a core for taste-related queries. Most prior research has been devoted to recognizing the basic taste sensations using the Brain-Computer Interface (BCI), which includes EEG, MEG, EMG, and fMRI. This research aims to recognize electronic taste (E-Taste) sensations based on surface electromyography (sEMG). Silver electrodes with platinum plating of the E-Taste device were placed on the tongue's tip to stimulate various tastes and flavors. In contrast, the electrodes of the sEMG were placed on facial muscles to collect the data. The dataset was organized and preprocessed, and a random forest classifier was applied, giving a five-fold accuracy of 70.43%. The random forest classifier was used on each participant dataset individually and in groups, providing the highest accuracy of 84.79% for a single participant. Moreover, various feature combinations were extracted and acquired 72.56% accuracy after extracting eight features. For a future perspective, this research offers guidance for electronic taste recognition based on sEMG.

Longevity of a Brain–Computer Interface for Amyotrophic Lateral Sclerosis

SummaryThe durability of communication with the use of brain–computer interfaces in persons with progressive neurodegenerative disease has not been extensively examined. We report on 7 years of independent at-home use of an implanted brain–computer interface for communication by a person with advanced amyotrophic lateral sclerosis (ALS), the inception of which was reported in 2016. The frequency of at-home use increased over time to compensate for gradual loss of control of an eye-gaze–tracking device, followed by a progressive decrease in use starting 6 years after implantation. At-home use ended when control of the brain–computer interface became unreliable. No signs of technical malfunction were found. Instead, the amplitude of neural signals declined, and computed tomographic imaging revealed progressive atrophy, which suggested that ALS-related neurodegeneration ultimately rendered the brain–computer interface ineffective after years of successful use, although alternative explanations are plausible. (Funded by the National Institute on Deafness and Other Communication Disorders and others; ClinicalTrials.gov number, NCT02224469.)

Democratizing EEG: Embedding Electroencephalography in a Head-Mounted Display for Ubiquitous Brain-Computer Interfacing

Open hardware and the need for ecologically valid measurements drive the Electroencephalography (EEG) democratization movement—EEG has been steadily transcending the boundaries of clinical research, making its way into interdisciplinary fields. In Human-Computer Interaction (HCI), EEG is used to measure cognitive workload and infer cognitive processes for building cognition-aware systems. We describe and evaluate our BCIglass prototype where EEG electrodes are embedded in the frame of a mainstream Head-Mounted Display (HMD) to create a skull-peripheral topology. We devised a lab study with 34 participants who completed seven established cognitive tasks. Then, we conducted a pilot field study with one participant to test BCIglass in everyday-life settings. Our findings demonstrate that BCIglass captures EEG activity in a manner comparable to a research-grade EEG-cap system. Our topology infers the cognitive task at hand, and the underlying cognitive process(es) by proxy, with an accuracy of ∼80% and only three electrodes at the skull periphery. Embedding EEG electrodes in lightweight HMDs represents a promising approach in the quest to achieve ubiquitous brain-computer interfacing in real-world settings.