Brain-computer Interface Users Research Articles

A click-based electrocorticographic brain-computer interface enables long-term high-performance switch scan spelling.

Brain-computer interfaces (BCIs) can restore communication for movement- and/or speech-impaired individuals by enabling neural control of computer typing applications. Single command click detectors provide a basic yet highly functional capability. We sought to test the performance and long-term stability of click decoding using a chronically implanted high density electrocorticographic (ECoG) BCI with coverage of the sensorimotor cortex in a human clinical trial participant (ClinicalTrials.gov, NCT03567213) with amyotrophic lateral sclerosis. We trained the participant's click detector using a small amount of training data (<44 min across 4 days) collected up to 21 days prior to BCI use, and then tested it over a period of 90 days without any retraining or updating. Using a click detector to navigate a switch scanning speller interface, the study participant can maintain a median spelling rate of 10.2 characters per min. Though a transient reduction in signal power modulation can interrupt usage of a fixed model, a new click detector can achieve comparable performance despite being trained with even less data (<15 min, within 1 day). These results demonstrate that a click detector can be trained with a small ECoG dataset while retaining robust performance for extended periods, providing functional text-based communication to BCI users.

From Science Fiction to Reality: Exploring Brain-Computer Interfaces and their Human Applications

Direct control of mechanical or electrical equipment through mental activity is made possible by brain-computer interfaces (BCIs), often referred to as brain-machine interfaces (BMIs). Using only brain signals, users of BCIs can operate external systems without using neurostimulators, which trigger neural tissues. This allows users to avoid using peripheral neurological and muscle systems. The brain's ability to incorporate and regulate mechanical devices as extensions of its own physiological processes is demonstrated by this capability.When it comes to helping those with severe impairments, BCI systems have a lot of potential uses. For people who suffer from neurological conditions like amyotrophic lateral sclerosis, brainstem stroke, or spinal cord injury who are completely paralyzed or "locked in," they provide a substantial benefit in terms of communication. By directly converting brain intent into executable commands, BCI technology aims to enable communication. This is especially helpful for those who are unable to speak.Neuroprosthetics, which attempt to restore lost motor and sensory functions, have been the main focus of BCI research and development. These systems make use of artificial devices to treat brain-related illnesses, take over for faulty nervous system functions, and compensate for compromised sensory organs. As this science develops, brain-computer interfaces (BCIs) have the potential to improve cognitive capacities and the quality of life for people with severe disabilities.

Prospectively identifying risks and controls for advanced brain-computer interfaces: A Networked Hazard Analysis and Risk Management System (Net-HARMS) approach

The introduction of advanced digital technologies continues to increase system complexity and introduce risks, which must be proactively identified and managed to support system resilience. Brain-computer interfaces (BCIs) are one such technology; however, the risks arising from broad societal use of the technology have yet to be identified and controlled. This study applied a structured systems thinking-based risk assessment method to prospectively identify risks and risk controls for a hypothetical future BCI system lifecycle. The application of the Networked Hazard Analysis and Risk Management System (Net-HARMS) method identified over 800 risks throughout the BCI system lifecycle, from BCI development and regulation through to BCI use, maintenance, and decommissioning. High-criticality risk themes include the implantation and degradation of unsafe BCIs, unsolicited brain stimulation, incorrect signals being sent to safety-critical technologies, and insufficiently supported BCI users. Over 600 risk controls were identified that could be implemented to support system safety and performance resilience. Overall, many highly-impactful BCI system safety and performance risks may arise throughout the BCI system lifecycle and will require collaborative efforts from a wide range of BCI stakeholders to adequately control. Whilst some of the identified controls are practical, work is required to develop a more systematic set of controls to best support the design of a resilient sociotechnical BCI system.

Evaluation of Different Visual Feedback Methods for Brain-Computer Interfaces (BCI) Based on Code-Modulated Visual Evoked Potentials (cVEP).

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices using electroencephalography (EEG) signals. BCIs based on code-modulated visual evoked potentials (cVEPs) are based on visual stimuli, thus appropriate visual feedback on the interface is crucial for an effective BCI system. Many previous studies have demonstrated that implementing visual feedback can improve information transfer rate (ITR) and reduce fatigue. This research compares a dynamic interface, where target boxes change their sizes based on detection certainty, with a threshold bar interface in a three-step cVEP speller. In this study, we found that both interfaces perform well, with slight variations in accuracy, ITR, and output characters per minute (OCM). Notably, some participants showed significant performance improvements with the dynamic interface and found it less distracting compared to the threshold bars. These results suggest that while average performance metrics are similar, the dynamic interface can provide significant benefits for certain users. This study underscores the potential for personalized interface choices to enhance BCI user experience and performance. By improving user friendliness, performance, and reducing distraction, dynamic visual feedback could optimize BCI technology for a broader range of users.

Considerations and discussions on the clear definition and definite scope of brain-computer interfaces.

Brain-computer interface (BCI) is a revolutionizing human-computer interaction with potential applications in both medical and non-medical fields, emerging as a cutting-edge and trending research direction. Increasing numbers of groups are engaging in BCI research and development. However, in recent years, there has been some confusion regarding BCI, including misleading and hyped propaganda about BCI, and even non-BCI technologies being labeled as BCI. Therefore, a clear definition and a definite scope for BCI are thoroughly considered and discussed in the paper, based on the existing definitions of BCI, including the six key or essential components of BCI. In the review, different from previous definitions of BCI, BCI paradigms and neural coding are explicitly included in the clear definition of BCI provided, and the BCI user (the brain) is clearly identified as a key component of the BCI system. Different people may have different viewpoints on the definition and scope of BCI, as well as some related issues, which are discussed in the article. This review argues that a clear definition and definite scope of BCI will benefit future research and commercial applications. It is hoped that this review will reduce some of the confusion surrounding BCI and promote sustainable development in this field.

How different immersive environments affect intracortical brain computer interfaces.

As brain-computer interface (BCI) research advances, many new applications are being developed. Tasks can be performed in different environments, and whether a BCI user can switch environments seamlessly will influence the ultimate utility of a clinical device. Here we investigate the importance of the immersiveness of the virtual environment used to train BCI decoders on the resulting decoder and its generalizability between environments. Two participants who had intracortical electrodes implanted in their precentral gyrus used a BCI to control a virtual arm, either viewed immersively through virtual reality goggles or at a distance on a flat television monitor. Each participant performed better with a decoder trained and tested in the environment they had used the most prior to the study, one for each environment type. The neural tuning to the desired movement was minimally influenced by the immersiveness of the environment. Finally, in further testing with one of the participants, we found that decoders trained in one environment generalized well to the other environment, but the order in which the environments were experienced within a session mattered. Overall, experience with an environment was more influential on performance than the immersiveness of the environment, but BCI performance generalized well after accounting for experience.

Brain-computer interfaces and human factors: the role of language and cultural differences-Still a missing gap?

Brain-computer interfaces (BCIs) aim at the non-invasive investigation of brain activity for supporting communication and interaction of the users with their environment by means of brain-machine assisted technologies. Despite technological progress and promising research aimed at understanding the influence of human factors on BCI effectiveness, some topics still remain unexplored. The aim of this article is to discuss why it is important to consider the language of the user, its embodied grounding in perception, action and emotions, and its interaction with cultural differences in information processing in future BCI research. Based on evidence from recent studies, it is proposed that detection of language abilities and language training are two main topics of enquiry of future BCI studies to extend communication among vulnerable and healthy BCI users from bench to bedside and real world applications. In addition, cultural differences shape perception, actions, cognition, language and emotions subjectively, behaviorally as well as neuronally. Therefore, BCI applications should consider cultural differences in information processing to develop culture- and language-sensitive BCI applications for different user groups and BCIs, and investigate the linguistic and cultural contexts in which the BCI will be used.

Improving motor imagery through a mirror box for BCI users.

The aim of this study was to evaluate mirror visual feedback (MVF) as a training tool for brain-computer interface (BCI) users. This is because approximately 20-30% of subjects require more training to operate a BCI system using motor imagery. Electroencephalograms (EEGs) were recorded from 18 healthy subjects, using event-related desynchronization (ERD) to observe the responses during the movement or movement intention of the hand for the conditions of control, imagination, and the MVF with the mirror box. We constituted two groups: group 1: control, imagination, and MVF; group 2: control, MVF, and imagination. There were significant differences in imagination conditions between groups using MVF before or after imagination (right-hand, P = 0.0403; left-hand, P = 0.00939). The illusion of movement through MVF is not possible in all subjects, but even in those cases, we found an increase in imagination when the subject used the MVF previously. The increase in the r2s of imagination in the right and left hands suggests cross-learning. The increase in motor imagery recorded with EEG after MVF suggests that the mirror box made it easier to imagine movements. Our results provide evidence that the MVF could be used as a training tool to improve motor imagery.NEW & NOTEWORTHY The increase in motor imagery recorded with EEG after MVF (mirror visual feedback) suggests that the mirror box made it easier to imagine movements. Our results demonstrate that MVF could be used as a training tool to improve motor imagery.

Optimal Stimulus Properties for Steady-State Visually Evoked Potential Brain–Computer Interfaces: A Scoping Review

Brain–computer interfaces (BCIs) based on steady-state visually evoked potentials (SSVEPs) have been well researched due to their easy system configuration, little or no user training and high information transfer rates. To elicit an SSVEP, a repetitive visual stimulus (RVS) is presented to the user. The properties of this RVS (e.g., frequency, luminance) have a significant influence on the BCI performance and user comfort. Several studies in this area in the last one-and-half decades have focused on evaluating different stimulus parameters (i.e., properties). However, there is little research on the synthesis of the existing studies, as the last review on the subject was published in 2010. Consequently, we conducted a scoping review of related studies on the influence of stimulus parameters on SSVEP response and user comfort, analyzed them and summarized the findings considering the physiological and neurological processes associated with BCI performance. In the review, we found that stimulus type, frequency, color contrast, luminance contrast and size/shape of the retinal image are the most important stimulus properties that influence SSVEP response. Regarding stimulus type, frequency and luminance, there is a trade-off between the best SSVEP response quality and visual comfort. Finally, since there is no unified measuring method for visual comfort and a lack of differentiation in the high-frequency band, we proposed a measuring method and a division of the band. In summary, the review highlights which stimulus properties are important to consider when designing SSVEP BCIs. It can be used as a reference point for future research in BCI, as it will help researchers to optimize the design of their SSVEP stimuli.

Perspective and Boundary Exploration of Privacy Transfer Dilemma in Brain–Computer Interface—Dimension Based on Ethical Matrix

The advent of intelligent technologies, notably Brain–Computer Interfaces (BCIs), has introduced novel privacy dilemmas. Ensuring judicious privacy transfer is imperative for the application of BCI technology and pivotal for fostering economic and technological progress. This study adopts privacy transfer as the research perspective and employs an ethical matrix as the research method. It establishes BCI users as the central core interests, with marketers, developers, and medical personnel as stakeholders. Departing from the binary opposition of public and private in traditional privacy theory, this article proposes ethical principles such as maximizing benefits, minimizing harm, and respecting independent decision-making power. It constructs a judgment matrix for the privacy transfer of BCIs, utilizing this matrix to identify ethical risks like privacy disclosure and hijacking. This study analyzes the reasons for risks, aiming to overcome dilemmas and construct an ethical matrix to explore privacy transfer boundary division methods suitable for BCI technology and tailored to different stakeholders.

Federated Motor Imagery Classification for Privacy-Preserving Brain-Computer Interfaces.

Training an accurate classifier for EEG-based brain-computer interface (BCI) requires EEG data from a large number of users, whereas protecting their data privacy is a critical consideration. Federated learning (FL) is a promising solution to this challenge. This paper proposes Federated classification with local Batch-specific batch normalization and Sharpness-aware minimization (FedBS) for privacy protection in EEG-based motor imagery (MI) classification. FedBS utilizes local batch-specific batch normalization to reduce data discrepancies among different clients, and sharpness-aware minimization optimizer in local training to improve model generalization. Experiments on three public MI datasets using three popular deep learning models demonstrated that FedBS outperformed six state-of-the-art FL approaches. Remarkably, it also outperformed centralized training, which does not consider privacy protection at all. In summary, FedBS protects user EEG data privacy, enabling multiple BCI users to participate in large-scale machine learning model training, which in turn improves the BCI decoding accuracy.

Crowdsourcing Affective Annotations Via fNIRS-BCI

Affective annotation refers to the process of labeling media content based on the emotions they evoke. Since such experiences are inherently subjective and depend on individual differences, the central challenge is associating digital content with its affective, interindividual experience. Here, we present a first-of-its-kind methodology for affective annotation directly from brain signals by monitoring the affective experience of a crowd of individuals via functional near-infrared spectroscopy (fNIRS). An experiment is reported in which fNIRS was recorded from 31 participants to develop a brain-computer interface (BCI) for affective annotation. Brain signals evoked by images were used to draw predictions about the affective dimensions that characterize the stimuli. By combining annotations, the results show that monitoring crowd responses can draw accurate affective annotations, with performance improving significantly with increases in crowd size. Our methodology demonstrates a proof-of-concept to source affective annotations from a crowd of BCI users without requiring any auxiliary mental or physical interaction.

It takes two (seconds): decreasing encoding time for two-choice functional near-infrared spectroscopy brain-computer interface communication.

Brain-computer interfaces (BCIs) can provide severely motor-impaired patients with a motor-independent communication channel. Functional near-infrared spectroscopy (fNIRS) constitutes a promising BCI-input modality given its high mobility, safety, user comfort, cost-efficiency, and relatively low motion sensitivity. The present study aimed at developing an efficient and convenient two-choice fNIRS communication BCI by implementing a relatively short encoding time (2s), considerably increasing communication speed, and decreasing the cognitive load of BCI users. To encode binary answers to 10 biographical questions, 10 healthy adults repeatedly performed a combined motor-speech imagery task within 2 different time windows guided by auditory instructions. Each answer-encoding run consisted of 10 trials. Answers were decoded during the ongoing experiment from the time course of the individually identified most-informative fNIRS channel-by-chromophore combination. The answers of participants were decoded online with an accuracy of 85.8% (run-based group mean). Post-hoc analysis yielded an average single-trial accuracy of 68.1%. Analysis of the effect of number of trial repetitions showed that the best information-transfer rate could be obtained by combining four encoding trials. The study demonstrates that an encoding time as short as 2s can enable immediate, efficient, and convenient fNIRS-BCI communication.

A large EEG database with users’ profile information for motor imagery brain-computer interface research

We present and share a large database containing electroencephalographic signals from 87 human participants, collected during a single day of brain-computer interface (BCI) experiments, organized into 3 datasets (A, B, and C) that were all recorded using the same protocol: right and left hand motor imagery (MI). Each session contains 240 trials (120 per class), which represents more than 20,800 trials, or approximately 70 hours of recording time. It includes the performance of the associated BCI users, detailed information about the demographics, personality profile as well as some cognitive traits and the experimental instructions and codes (executed in the open-source platform OpenViBE). Such database could prove useful for various studies, including but not limited to: (1) studying the relationships between BCI users’ profiles and their BCI performances, (2) studying how EEG signals properties varies for different users’ profiles and MI tasks, (3) using the large number of participants to design cross-user BCI machine learning algorithms or (4) incorporating users’ profile information into the design of EEG signal classification algorithms.

Meditation as an effective BCI training protocol for controlling virtual wheeled robots

Background: Brain-Computer Interface (BCI) systems allow the use of electroencephalographic activities to control devices. As such, it can be an important tool for disabled people since using a BCI does not involves any muscular stimulation. Despite its great potential as an assistive technology, BCI systems are yet scarcely available outside scientific contexts. The main reason is that BCI is still not accurate enough for real world situations. In this paper, we investigated if mindfulness meditation can help BCI users to perform better, particularly on controlling virtual wheeled robots. Controlling virtual wheeled robots must be seen as an important BCI research issue, since disabled people can take the best advantages from assistive wheeled robots. Methods: Case-control study with 30 subjects, meditators and non-meditators, who controlled a virtual wheeled robot using a BCI system. Results: In straight-ahead moves, the robot was 30% faster when controlled by meditators. In stop-and-go moves, the meditators controlled the robot with an accuracy of 66% while the non-meditators’ accuracy was 27%. In rectangular shape moves, meditators also performed better than non-meditators, with an accuracy of 40% against 7% of non-meditators. Conclusion: The results show that meditators performed better than non-meditators. As such, we recommend combining mindfulness meditation with standard BCI training protocols for better control of virtual wheeled robots.

Meditation as an effective BCI training protocol for controlling wheeled robots

Background: Brain-Computer Interface (BCI) systems allow the use of electroencephalographic activities to control devices. As such, it can be an important tool for disabled people since using a BCI does not involves any muscular stimulation. Despite its great potential as an assistive technology, BCI systems are yet scarcely available outside scientific contexts. The main reason is that BCI is still not accurate enough for real world situations. In this paper, we investigated if mindfulness meditation can help BCI users to perform better, particularly on controlling wheeled robots. Controlling wheeled robots must be seen as an important BCI research issue, since disabled people can take the best advantages from assistive wheeled robots. Methods: Case-control study with 30 subjects, meditators and non-meditators, who controlled a simulated wheeled robot using a BCI system. Results: In straight-ahead moves, the robot was 30% faster when controlled by meditators. In stop-and-go moves, the meditators controlled the robot with an accuracy of 66% while the non-meditators’ accuracy was 27%. In rectangular shape moves, meditators also performed better than non-meditators, with an accuracy of 40% against 7% of non-meditators. Conclusion: The results show that meditators performed better than non-meditators. As such, we recommend combining mindfulness meditation with standard BCI training protocols for better control of wheeled robots.

EEG motor imagery classification using deep learning approaches in naïve BCI users

Motor Imagery (MI)-Brain Computer-Interfaces (BCI) illiteracy defines that not all subjects can achieve a good performance in MI-BCI systems due to different factors related to the fatigue, substance consumption, concentration, and experience in the use. To reduce the effects of lack of experience in the use of BCI systems (naïve users), this paper presents the implementation of three Deep Learning (DL) methods with the hypothesis that the performance of BCI systems could be improved compared with baseline methods in the evaluation of naïve BCI users. The methods proposed here are based on Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM)/Bidirectional Long Short-Term Memory (BiLSTM), and a combination of CNN and LSTM used for upper limb MI signal discrimination on a dataset of 25 naïve BCI users. The results were compared with three widely used baseline methods based on the Common Spatial Pattern (CSP), Filter Bank Common Spatial Pattern (FBCSP), and Filter Bank Common Spatial-Spectral Pattern (FBCSSP), in different temporal window configurations. As results, the LSTM-BiLSTM-based approach presented the best performance, according to the evaluation metrics of Accuracy, F-score, Recall, Specificity, Precision, and ITR, with a mean performance of 80% (maximum 95%) and ITR of 10 bits/min using a temporal window of 1.5 s. The DL Methods represent a significant increase of 32% compared with the baseline methods (p < 0.05). Thus, with the outcomes of this study, it is expected to increase the controllability, usability, and reliability of the use of robotic devices in naïve BCI users.

EEG-based BCI Dataset of Semantic Concepts for Imagination and Perception Tasks

Electroencephalography (EEG) is a widely-used neuroimaging technique in Brain Computer Interfaces (BCIs) due to its non-invasive nature, accessibility and high temporal resolution. A range of input representations has been explored for BCIs. The same semantic meaning can be conveyed in different representations, such as visual (orthographic and pictorial) and auditory (spoken words). These stimuli representations can be either imagined or perceived by the BCI user. In particular, there is a scarcity of existing open source EEG datasets for imagined visual content, and to our knowledge there are no open source EEG datasets for semantics captured through multiple sensory modalities for both perceived and imagined content. Here we present an open source multisensory imagination and perception dataset, with twelve participants, acquired with a 124 EEG channel system. The aim is for the dataset to be open for purposes such as BCI related decoding and for better understanding the neural mechanisms behind perception, imagination and across the sensory modalities when the semantic category is held constant.

Talking with hands and feet: Selective somatosensory attention and fMRI enable robust and convenient brain-based communication

In brain-based communication, voluntarily modulated brain signals (instead of motor output) are utilized to interact with the outside world. The possibility to circumvent the motor system constitutes an important alternative option for severely paralyzed. Most communication brain-computer interface (BCI) paradigms require intact visual capabilities and impose a high cognitive load, but for some patients, these requirements are not given. In these situations, a better-suited, less cognitively demanding information-encoding approach may exploit auditorily-cued selective somatosensory attention to vibrotactile stimulation. Here, we propose, validate and optimize a novel communication-BCI paradigm using differential fMRI activation patterns evoked by selective somatosensory attention to tactile stimulation of the right hand or left foot. Using cytoarchitectonic probability maps and multi-voxel pattern analysis (MVPA), we show that the locus of selective somatosensory attention can be decoded from fMRI-signal patterns in (especially primary) somatosensory cortex with high accuracy and reliability, with the highest classification accuracy (85.93%) achieved when using Brodmann area 2 (SI-BA2) at a probability level of 0.2. Based on this outcome, we developed and validated a novel somatosensory attention-based yes/no communication procedure and demonstrated its high effectiveness even when using only a limited amount of (MVPA) training data. For the BCI user, the paradigm is straightforward, eye-independent, and requires only limited cognitive functioning. In addition, it is BCI-operator friendly given its objective and expertise-independent procedure. For these reasons, our novel communication paradigm has high potential for clinical applications.

Can vibrotactile stimulation and tDCS help inefficient BCI users?

Brain-computer interface (BCI) has helped people by allowing them to control a computer or machine through brain activity without actual body movement. Despite this advantage, BCI cannot be used widely because some people cannot achieve controllable performance. To solve this problem, researchers have proposed stimulation methods to modulate relevant brain activity to improve BCI performance. However, multiple studies have reported mixed results following stimulation, and the comparative study of different stimulation modalities has been overlooked. Accordingly, this study was designed to compare vibrotactile stimulation and transcranial direct current stimulation’s (tDCS) effects on brain activity modulation and motor imagery BCI performance among inefficient BCI users. We recruited 44 subjects and divided them into sham, vibrotactile stimulation, and tDCS groups, and low performers were selected from each stimulation group. We found that the latter’s BCI performance in the vibrotactile stimulation group increased significantly by 9.13% (p < 0.01), and while the tDCS group subjects’ performance increased by 5.13%, it was not significant. In contrast, sham group subjects showed no increased performance. In addition to BCI performance, pre-stimulus alpha band power and the phase locking values (PLVs) averaged over sensory motor areas showed significant increases in low performers following stimulation in the vibrotactile stimulation and tDCS groups, while sham stimulation group subjects and high performers showed no significant stimulation effects across all groups. Our findings suggest that stimulation effects may differ depending upon BCI efficiency, and inefficient BCI users have greater plasticity than efficient BCI users.