Non-invasive Brain-computer Interface Research Articles

Classification of Spatial Temporal Patterns Based on Neuromorphic Networks

This work is devoted to the problems of developing neuromorphic classifiers of spatiotemporal patterns, as well as their application in neurointerfaces. Classifiers of spatiotemporal patterns based on neural networks, support vector machines, deep neural networks, and Riemannian geometry are considered. A comparative study of these classifiers is carried out in the plane of the accuracy of multiclass recognition of electroencephalographic signals showing time-dependent bioelectrical activity in different areas of the brain during the imagination of different movements. It is shown that such classifiers can provide an accuracy of 60-80% when recognizing from two to four classes of imaginary movements. A new type of classifier based on a neuromorphic network, based on the biosimilar neurons built on the Izhikevich model, is proposed. The network processes input spike sequences and generates pulse streams of different frequencies at the outputs. The network is trained using the Supervised STDP algorithm based on labeled information containing examples of the correct recognition of the required pattern classes. The recognized pattern class is determined by the maximum frequency of the output sequence. The neuromorphic classifier showed an average classification accuracy of 90% for 4 classes of imaginary commands and a maximum of 95%. By modeling the robot control task in the virtual environment it is shown that such accuracy is sufficient for the effective use of the classifier as part of a non-invasive brain-computer interface for non-contact control of robotic devices.

Advancements in brain-computer interfaces for the rehabilitation of unilateral spatial neglect: a concise review.

This short review examines recent advancements in neurotechnologies within the context of managing unilateral spatial neglect (USN), a common condition following stroke. Despite the success of brain-computer interfaces (BCIs) in restoring motor function, there is a notable absence of effective BCI devices for treating cerebral visual impairments, a prevalent consequence of brain lesions that significantly hinders rehabilitation. This review analyzes current non-invasive BCIs and technological solutions dedicated to cognitive rehabilitation, with a focus on visuo-attentional disorders. We emphasize the need for further research into the use of BCIs for managing cognitive impairments and propose a new potential solution for USN rehabilitation, by combining the clinical subtleties of this syndrome with the technological advancements made in the field of neurotechnologies.

Design and Evaluation of CPU-, GPU-, and FPGA-Based Deployment of a CNN for Motor Imagery Classification in Brain-Computer Interfaces

Brain–computer interfaces (BCIs) have gained popularity in recent years. Among noninvasive BCIs, EEG-based systems stand out as the primary approach, utilizing the motor imagery (MI) paradigm to discern movement intentions. Initially, BCIs were predominantly focused on nonembedded systems. However, there is now a growing momentum towards shifting computation to the edge, offering advantages such as enhanced privacy, reduced transmission bandwidth, and real-time responsiveness. Despite this trend, achieving the desired target remains a work in progress. To illustrate the feasibility of this shift and quantify the potential benefits, this paper presents a comparison of deploying a CNN for MI classification across different computing platforms, namely, CPU-, embedded GPU-, and FPGA-based. For our case study, we utilized data from 29 participants included in a dataset acquired using an EEG cap for training the models. The FPGA solution emerged as the most efficient in terms of the power consumption–inference time product. Specifically, it delivers an impressive reduction of up to 89% in power consumption compared to the CPU and 71% compared to the GPU and up to a 98% reduction in memory footprint for model inference, albeit at the cost of a 39% increase in inference time compared to the GPU. Both the embedded GPU and FPGA outperform the CPU in terms of inference time.

Comprehensive Review of Noninvasive Brain-Computer Interfaces for Controlling Robotic Arms

A robotic arm is a mechanical device with a given number of Degrees of Freedom (DoFs) that mimics the functions of a human arm and performs any desired task, such as grasping and moving objects. Current research is directed toward the design of robots and artificial human body parts controlled by brain signals, translating human thoughts into actions. Brain-Computer Interface (BCI) systems have been used to enable people with motor disabilities to control assistive robotic equipment that replaces the lost functions. This paper presents a review of the state-of-the-art of the latest papers dealing with the control of a robotic arm based on Electroencephalogram (EEG). A comparative study of the different methods and techniques used in different blocks of the robotic arm’s noninvasive BCI controlling system is conducted. These blocks include signal acquisition using noninvasive electrodes, signal preprocessing, feature extraction, classification, and command. Additionally, this paper presents a performance comparison of the reviewed controlling systems of robotic arms using EEG signals.

Exploring Aesthetic Perception in Impaired Aging: A Multimodal Brain-Computer Interface Study.

In the field of neuroscience, brain-computer interfaces (BCIs) are used to connect the human brain with external devices, providing insights into the neural mechanisms underlying cognitive processes, including aesthetic perception. Non-invasive BCIs, such as EEG and fNIRS, are critical for studying central nervous system activity and understanding how individuals with cognitive deficits process and respond to aesthetic stimuli. This study assessed twenty participants who were divided into control and impaired aging (AI) groups based on MMSE scores. EEG and fNIRS were used to measure their neurophysiological responses to aesthetic stimuli that varied in pleasantness and dynamism. Significant differences were identified between the groups in P300 amplitude and late positive potential (LPP), with controls showing greater reactivity. AI subjects showed an increase in oxyhemoglobin in response to pleasurable stimuli, suggesting hemodynamic compensation. This study highlights the effectiveness of multimodal BCIs in identifying the neural basis of aesthetic appreciation and impaired aging. Despite its limitations, such as sample size and the subjective nature of aesthetic appreciation, this research lays the groundwork for cognitive rehabilitation tailored to aesthetic perception, improving the comprehension of cognitive disorders through integrated BCI methodologies.

Continuous tracking using deep learning-based decoding for noninvasive brain-computer interface.

Brain-computer interfaces (BCI) using electroencephalography provide a noninvasive method for users to interact with external devices without the need for muscle activation. While noninvasive BCIs have the potential to improve the quality of lives of healthy and motor-impaired individuals, they currently have limited applications due to inconsistent performance and low degrees of freedom. In this study, we use deep learning (DL)-based decoders for online continuous pursuit (CP), a complex BCI task requiring the user to track an object in 2D space. We developed a labeling system to use CP data for supervised learning, trained DL-based decoders based on two architectures, including a newly proposed adaptation of the PointNet architecture, and evaluated the performance over several online sessions. We rigorously evaluated the DL-based decoders in a total of 28 human participants, and found that the DL-based models improved throughout the sessions as more training data became available and significantly outperformed a traditional BCI decoder by the last session. We also performed additional experiments to test an implementation of transfer learning by pretraining models on data from other subjects, and midsession training to reduce intersession variability. The results from these experiments showed that pretraining did not significantly improve performance, but updating the models' midsession may have some benefit. Overall, these findings support the use of DL-based decoders for improving BCI performance in complex tasks like CP, which can expand the potential applications of BCI devices and help to improve the quality of lives of healthy and motor-impaired individuals.

Customizing the human-avatar mapping based on EEG error related potentials

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside the virtual body when they perceive erroneous interaction, i.e. a break-in-embodiment (BiE). However, the way to detect such an inadequate event is currently limited to questionnaires or spontaneous reports from users. The ability to implicitly detect BiE in real-time enables us to adjust human-avatar mapping without interruption. Approach. We propose and empirically demonstrate a novel brain computer interface (BCI) approach that monitors the occurrence of BiE based on the users’ brain oscillatory activity in real-time to adjust the human-avatar mapping in VR. We collected EEG activity of 37 participants while they performed reaching movements with their avatar with different magnitude of distortion. Main results. Our BCI approach seamlessly predicts occurrence of BiE in varying magnitude of erroneous interaction. The mapping has been customized by BCI-reinforcement learning (RL) closed-loop system to prevent BiE from occurring. Furthermore, a non-personalized BCI decoder generalizes to new users, enabling ‘Plug-and-Play’ ErrP-based non-invasive BCI. The proposed VR system allows customization of human-avatar mapping without personalized BCI decoders or spontaneous reports. Significance. We anticipate that our newly developed VR-BCI can be useful to maintain an engaging avatar-based interaction and a compelling immersive experience while detecting when users notice a problem and seamlessly correcting it.

Biomedical Engineering Research Based on Computer Propagation Technology: Treatment of neurodigestive diseases

With the support of the Institute of Cancer Hospital of Chifeng University, Sarkov and Markov Memorial Health Informatics Laboratory designed a new working concept of innovative Nursing by using neural network and Brain–computer interface technology. The research team proposed a direct connection between human or animal brain (or brain cell culture) and external equipment. In the case of one-way Brain–computer interface, the computer may accept commands from the brain. Using this point to detect the emotion of patients after surgery and carry out necessary gourds, a two-way information exchange method and model of two-way Brain–computer interface are also proposed. The potential non-invasive Brain–computer interface designed by us has been deeply studied, mainly because of its good time resolution, ease of use, portability and relatively low price. Especially in the specific application and working practice of EEG (Electroencephalography), our achievements directly meet the application of clinical institutions.

The role of eye movement signals in non-invasive brain-computer interface typing system.

Brain-Computer Interfaces (BCIs) have shown great potential in providing communication and control for individuals with severe motor disabilities. However, traditional BCIs that rely on electroencephalography (EEG) signals suffer from low information transfer rates and high variability across users. Recently, eye movement signals have emerged as a promising alternative due to their high accuracy and robustness. Eye movement signals are the electrical or mechanical signals generated by the movements and behaviors of the eyes, serving to denote the diverse forms of eye movements, such as fixations, smooth pursuit, and other oculomotor activities like blinking. This article presents a review of recent studies on the development of BCI typing systems that incorporate eye movement signals. We first discuss the basic principles of BCI and the recent advancements in text entry. Then, we provide a comprehensive summary of the latest advancements in BCI typing systems that leverage eye movement signals. This includes an in-depth analysis of hybrid BCIs that are built upon the integration of electrooculography (EOG) and eye tracking technology, aiming to enhance the performance and functionality of the system. Moreover, we highlight the advantages and limitations of different approaches, as well as potential future directions. Overall, eye movement signals hold great potential for enhancing the usability and accessibility of BCI typing systems, and further research in this area could lead to more effective communication and control for individuals with motor disabilities.

Estimating and approaching the maximum information rate of noninvasive visual brain-computer interface

An essential priority of visual brain-computer interfaces (BCIs) is to enhance the information transfer rate (ITR) to achieve high-speed communication. Despite notable progress, noninvasive visual BCIs have encountered a plateau in ITRs, leaving it uncertain whether higher ITRs are achievable. In this study, we used information theory to study the characteristics and capacity of the visual-evoked channel, which leads us to investigate whether and how we can decode higher information rates in a visual BCI system. Using information theory, we estimate the upper and lower bounds of the information rate with the white noise (WN) stimulus. Consequently, we found out that the information rate is determined by the signal-to-noise ratio (SNR) in the frequency domain, which reflects the spectrum resources of the channel. Based on this discovery, we propose a broadband WN BCI by implementing stimuli on a broader frequency band than the steady-state visual evoked potentials (SSVEPs)-based BCI. Through validation, the broadband BCI outperforms the SSVEP BCI by an impressive 7 bps, setting a record of 50 bps. The integration of information theory and the decoding analysis presented in this study offers valuable insights applicable to general sensory-evoked BCIs, providing a potential direction of next-generation human-machine interaction systems.

Abstract TP86: Stroke-Impaired Proprioception Limits Motor Recovery With BCI-FES Device

Introduction: Non-invasive brain-computer interface (BCI) therapy with contingent (i.e., closed-loop) functional electrical stimulation (FES) shows efficacy improving motor function. However, it is not well understood why some stroke survivors respond better to closed-looped BCI-FES intervention than others. Contingent BCI-FES intervention drives neuroplastic change toward adaptive functional connectivity in stroke-impaired sensorimotor brain areas by enriching the afferent feedback environment. The interruption of afferent-efferent feedback circuits is a neural correlate of long-term acquired disability and intactness of functional connections predicts recovery capacity. Studies suggest that proprioception is essential for motor learning and performance. Therefore, we hypothesize that proprioceptive intactness is essential for recovery of motor performance when using a BCI-FES. Methods: Participants with upper extremity motor loss resulting from stroke (n=35) completed up to 30 hours of closed-loop BCI-FES. Results: Change in ARAT scores over the course of the control period were compared to ARAT change scores over the intervention period at a one-month follow up assessment. On average, participants in the intervention realized greater change in ARAT (M = 2.11, SD = 4.68) than during the control phase (M = 0.294, SD = 3.53). An independent-samples t-test indicated this difference, 1.82, 95%CI [-4.17, 0.534], was not statistically significant, t (40.901) = -1.56, p = 0.126. Preliminary results indicate that Proprioceptive sensory loss has a greater limiting effect on recovery than cutaneous somatosensory loss. Discussion: Rehabilitating motor capacity after stroke depends on the intactness of sensorimotor neural circuits. If afference signals are missing or degraded due to stroke, motor recovery is poor. When the stroke spares afferent connectivity to the peripheral muscles, the sensorimotor cortex can leverage plasticity-based motor rehab strategies such as BCI-FES. Conclusion: Intactness of sensorimotor circuits is related to baseline severity of motor impairment as well as recovery of motor function. Efficacious prescription of BCI-FES intervention is best suited for patients with stroke-spared proprioception.

A comprehensive dataset for home appliance control using ERP-based BCIs with the application of inter-subject transfer learning.

Brain-computer interfaces (BCIs) have a potential to revolutionize human-computer interaction by enabling direct links between the brain and computer systems. Recent studies are increasingly focusing on practical applications of BCIs-e.g., home appliance control just by thoughts. One of the non-invasive BCIs using electroencephalography (EEG) capitalizes on event-related potentials (ERPs) in response to target stimuli and have shown promise in controlling home appliance. In this paper, we present a comprehensive dataset of online ERP-based BCIs for controlling various home appliances in diverse stimulus presentation environments. We collected online BCI data from a total of 84 subjects among whom 60 subjects controlled three types of appliances (TV: 30, door lock: 15, and electric light: 15) with 4 functions per appliance, 14 subjects controlled a Bluetooth speaker with 6 functions via an LCD monitor, and 10 subjects controlled air conditioner with 4 functions via augmented reality (AR). Using the dataset, we aimed to address the issue of inter-subject variability in ERPs by employing the transfer learning in two different approaches. The first approach, "within-paradigm transfer learning," aimed to generalize the model within the same paradigm of stimulus presentation. The second approach, "cross-paradigm transfer learning," involved extending the model from a 4-class LCD environment to different paradigms. The results demonstrated that transfer learning can effectively enhance the generalizability of BCIs based on ERP across different subjects and environments.

Brain-Computer Interfaces for Communication in Patients with Disorders of Consciousness: A Gap Analysis and Scientific Roadmap.

We developed a gap analysis that examines the role of brain-computer interfaces (BCI) in patients with disorders of consciousness (DoC), focusing on their assessment, establishment of communication, and engagement with their environment. The Curing Coma Campaign convened a Coma Science work group that included 16 clinicians and neuroscientists with expertise in DoC. The work group met online biweekly and performed a gap analysis of the primary question. We outline a roadmap for assessing BCI readiness in patients with DoC and for advancing the use of BCI devices in patients with DoC. Additionally, we discuss preliminary studies that inform development of BCI solutions for communication and assessment of readiness for use of BCIs in DoC study participants. Special emphasis is placed on the challenges posed by the complex pathophysiologies caused by heterogeneous brain injuries and their impact on neuronal signaling. The differences between one-way and two-way communication are specifically considered. Possible implanted and noninvasive BCI solutions for acute and chronic DoC in adult and pediatric populations are also addressed. We identify clinical and technical gaps hindering the use of BCI in patients with DoC in each of these contexts and provide a roadmap for research aimed at improving communication for adults and children with DoC, spanning the clinical spectrum from intensive care unit to chronic care.

Subject-Independent Deep Architecture for EEG-Based Motor Imagery Classification.

Motor imagery (MI) classification based on electroencephalogram (EEG) is a widely-used technique in non-invasive brain-computer interface (BCI) systems. Since EEG recordings suffer from heterogeneity across subjects and labeled data insufficiency, designing a classifier that performs the MI independently from the subject with limited labeled samples would be desirable. To overcome these limitations, we propose a novel subject-independent semi-supervised deep architecture (SSDA). The proposed SSDA consists of two parts: an unsupervised and a supervised element. The training set contains both labeled and unlabeled data samples from multiple subjects. First, the unsupervised part, known as the columnar spatiotemporal auto-encoder (CST-AE), extracts latent features from all the training samples by maximizing the similarity between the original and reconstructed data. A dimensional scaling approach is employed to reduce the dimensionality of the representations while preserving their discriminability. Second, a supervised part learns a classifier based on the labeled training samples using the latent features acquired in the unsupervised part. Moreover, we employ center loss in the supervised part to minimize the embedding space distance of each point in a class to its center. The model optimizes both parts of the network in an end-to-end fashion. The performance of the proposed SSDA is evaluated on test subjects who were not seen by the model during the training phase. To assess the performance, we use two benchmark EEG-based MI task datasets. The results demonstrate that SSDA outperforms state-of-the-art methods and that a small number of labeled training samples can be sufficient for strong classification performance.

Robust Decoding of Upper-Limb Movement Direction Under Cognitive Distraction With Invariant Patterns in Embedding Manifold.

Motor brain-computer interfaces (BCIs) have gained growing research interest in motor rehabilitation, restoration, and prostheses control. Decoding upper-limb movement direction with noninvasive BCIs has been extensively investigated. However, few of them address the intervention of cognitive distraction that impairs decoding performance in practice. In this study, we propose a novel decoding model with invariant patterns in embedding manifold on a mixed dataset pooled from electroencephalograph (EEG) signals under different attentional states. We reconstruct an embedding low-dimensional manifold that intrinsically characterizes movements of the upper limb and transfer patterns of neural activities decomposed from brain functional connectivity (FC) to the manifold subspace to further preserve movement-related information. Experimental results showed that the proposed decoding model had higher robustness on the mixed dataset of attentive and distracted states compared to the baseline method. Our research provides insights into modeling a uniform underlying mechanism of movement-related EEG signals and can help enhance the practicability of BCI systems under real-world situations.

Non-invasive brain-computer interfaces effectively improve motor function, sensory function, and activities of daily living in patients with spinal cord injury: a systematic review and meta-analysis

After spinal cord injury (SCI), severe motor, sensory, and autonomic dysfunction of the limbs below the injury level occurs, significantly reducing the patient’s ability to perform activities of daily living (ADL) and quality of life. Brain-computer interface (BCI), as a new rehabilitation intervention, can extract brain signals, bypass the diseased segments, and translate them into commands to control external devices to restore the sensory and motor functions of SCI. However, the current high-quality research evidence for BCI treatment of SCI is insufficient, so this review aims to evaluate the effectiveness and feasibility of non-invasive BCI training for improving motor, sensory, and ADL in patients with SCI. The BCI-related trial literature was retrieved from seven databases (PubMed, Cochrane Library, Embase, Web of Science, China National Knowledge Infrastructure, WanFang database, and China Scientific Journals Full Text Database). A total of seven studies (n = 102 patients with SCI) were included for meta-analysis using a fixed-effect model, with effect sizes reported as standardized mean differences. BCI training effectively improve motor function in patients with SCI, especially those in the subacute phase, but to no significant effect in patients with chronic phase. Moreover, the treatment effect of BCI is better when the number of interventions is less than 30 times and a single session lasting longer than 60 minutes is more effective. BCI intervention also showed a positive impact for sensory function and ADL on patients with SCI, and improved quality of life in SCI patients. As a rehabilitation method, BCI has been proven to be effective in improving the motor function of patients with SCI. This provides more choices in future rehabilitation protocols for SCI.

Combining Robotic Vision with Non-Invasive Brain-Computer Interfaces Development and Future Directions

The profound growth in brain-computer interface (BCI) technology has brought forth novel interdisciplinary applications, particularly in the realm of robotics. This review delves into the challenges of using non-invasive BCIs for precise robotic arm operations, with an emphasis on the transformative potential of integrating BCI with machine vision. Based on some problems in BCI applications, this paper emphasizes the use of machine vision combined with BCI signals to help non-invasive brain-computer interfaces improve the correctness and efficiency. Through detailed analysis, it is demonstrated how computer vision complements BCI, ameliorating issues like inherent noise and decoding inefficiencies associated with non-invasive BCIs. Moreover, the discussion touches upon the enhanced user experience offered by this integrated approach, and the potential it holds for addressing the compatibility challenges in BCIs. Although the combination of the two technologies can solve mutual problems, there are also certain limitations. For example, two different data may be more complex, so there are higher requirements for algorithms and processing methods. In addition, the development of a combination of two devices The system will have higher overhead, making it impossible for the average person to afford the cost of using it at the same time。As BCI technology continues its upward trajectory, this synthesis with robotic vision heralds a new era of harmonized human-machine interactions.

Brain-Computer Interfaces Can Significantly Improve The Quality of Life for Aged People - A Review

As the global population ages, numerous programs have emerged to enhance the quality of life for seniors, addressing factors such as mental and physical well-being, mental illnesses, concurrent health issues, loneliness, and social interactions. Cognitive decline in aging poses a significant public health concern, impacting families and communities emotionally and financially. This review explores the effectiveness of healthcare surveillance combined with Brain-Computer Interfaces (BCIs) in improving memory and focus among a group of healthy seniors. Maintaining a high quality of life for the elderly is crucial, fostering resilience and perseverance. The review data suggests the potential of non-invasive BCIs, integrated with IoT-based Smart Home Technology (SHT), to enhance the Quality of Life (BCI-QOL) for seniors. The review focuses on advancing non-invasive BCI technology to support the health and well-being of older individuals, addressing dementia and physical impairments. It also discusses supportive BCI technologies for smart homes catering to seniors with motor control deficits. This comprehensive review aims to assess the immediate and long-term impact of regional features on the well-being and quality of life of seniors. The BCI-QOL-based system holds promise in enhancing cognition and focus, aiming for security, intuitiveness, and appropriateness for older users.

Improved motor imagery classification using adaptive spatial filters based on particle swarm optimization algorithm.

As a typical self-paced brain-computer interface (BCI) system, the motor imagery (MI) BCI has been widely applied in fields such as robot control, stroke rehabilitation, and assistance for patients with stroke or spinal cord injury. Many studies have focused on the traditional spatial filters obtained through the common spatial pattern (CSP) method. However, the CSP method can only obtain fixed spatial filters for specific input signals. In addition, the CSP method only focuses on the variance difference of two types of electroencephalogram (EEG) signals, so the decoding ability of EEG signals is limited. To make up for these deficiencies, this study introduces a novel spatial filter-solving paradigm named adaptive spatial pattern (ASP), which aims to minimize the energy intra-class matrix and maximize the inter-class matrix of MI-EEG after spatial filtering. The filter bank adaptive and common spatial pattern (FBACSP), our proposed method for MI-EEG decoding, amalgamates ASP spatial filters with CSP features across multiple frequency bands. Through a dual-stage feature selection strategy, it employs the Particle Swarm Optimization algorithm for spatial filter optimization, surpassing traditional CSP approaches in MI classification. To streamline feature sets and enhance recognition efficiency, it first prunes CSP features in each frequency band using mutual information, followed by merging these with ASP features. Comparative experiments are conducted on two public datasets (2a and 2b) from BCI competition IV, which show the outstanding average recognition accuracy of FBACSP. The classification accuracy of the proposed method has reached 74.61 and 81.19% on datasets 2a and 2b, respectively. Compared with the baseline algorithm, filter bank common spatial pattern (FBCSP), the proposed algorithm improves by 11.44 and 7.11% on two datasets, respectively (p < 0.05). It is demonstrated that FBACSP has a strong ability to decode MI-EEG. In addition, the analysis based on mutual information, t-SNE, and Shapley values further proves that ASP features have excellent decoding ability for MI-EEG signals and explains the improvement of classification performance by the introduction of ASP features. These findings may provide useful information to optimize EEG-based BCI systems and further improve the performance of non-invasive BCI.

Advanced Electrode Technologies for Noninvasive Brain-Computer Interfaces.

Brain-computer interfaces (BCIs) have garnered significant attention in recent years due to their potential applications in medical, assistive, and communication technologies. Building on this, noninvasive BCIs stand out as they provide a safe and user-friendly method for interacting with the human brain. In this work, we provide a comprehensive overview of the latest developments and advancements in material, design, and application of noninvasive BCIs electrode technology. We also explore the challenges and limitations currently faced by noninvasive BCI electrode technology and sketch out the technological roadmap from three dimensions: Materials and Design; Performances; Mode and Function. We aim to unite research efforts within the field of noninvasive BCI electrode technology, focusing on the consolidation of shared goals and fostering integrated development strategies among a diverse array of multidisciplinary researchers.