Visual Brain-computer Interface Research Articles

A user-friendly visual brain-computer interface based on high-frequency steady-state visual evoked fields recorded by OPM-MEG

Objective. Magnetoencephalography (MEG) shares a comparable time resolution with electroencephalography. However, MEG excels in spatial resolution, enabling it to capture even the subtlest and weakest brain signals for brain-computer interfaces (BCIs). Leveraging MEG’s capabilities, specifically with optically pumped magnetometers (OPM-MEG), proves to be a promising avenue for advancing MEG-BCIs, owing to its exceptional sensitivity and portability. This study harnesses the power of high-frequency steady-state visual evoked fields (SSVEFs) to build an MEG-BCI system that is flickering-imperceptible, user-friendly, and highly accurate. Approach. We have constructed a nine-command BCI that operates on high-frequency SSVEF (58–62 Hz with a 0.5 Hz interval) stimulation. We achieved this by placing the light source inside and outside the magnetic shielding room, ensuring compliance with non-magnetic and visual stimulus presentation requirements. Five participants took part in offline experiments, during which we collected six-channel multi-dimensional MEG signals along both the vertical (Z-axis) and tangential (Y-axis) components. Our approach leveraged the ensemble task-related component analysis algorithm for SSVEF identification and system performance evaluation. Main Results. The offline average accuracy of our proposed system reached an impressive 92.98% when considering multi-dimensional conjoint analysis using data from both the Z and Y axes. Our method achieved a theoretical average information transfer rate (ITR) of 58.36 bits min−1 with a data length of 0.7 s, and the highest individual ITR reached an impressive 63.75 bits min−1. Significance. This study marks the first exploration of high-frequency SSVEF-BCI based on OPM-MEG. These results underscore the potential and feasibility of MEG in detecting subtle brain signals, offering both theoretical insights and practical value in advancing the development and application of MEG in BCI systems.

Estimating and approaching the maximum information rate of noninvasive visual brain-computer interface

An essential priority of visual brain-computer interfaces (BCIs) is to enhance the information transfer rate (ITR) to achieve high-speed communication. Despite notable progress, noninvasive visual BCIs have encountered a plateau in ITRs, leaving it uncertain whether higher ITRs are achievable. In this study, we used information theory to study the characteristics and capacity of the visual-evoked channel, which leads us to investigate whether and how we can decode higher information rates in a visual BCI system. Using information theory, we estimate the upper and lower bounds of the information rate with the white noise (WN) stimulus. Consequently, we found out that the information rate is determined by the signal-to-noise ratio (SNR) in the frequency domain, which reflects the spectrum resources of the channel. Based on this discovery, we propose a broadband WN BCI by implementing stimuli on a broader frequency band than the steady-state visual evoked potentials (SSVEPs)-based BCI. Through validation, the broadband BCI outperforms the SSVEP BCI by an impressive 7 bps, setting a record of 50 bps. The integration of information theory and the decoding analysis presented in this study offers valuable insights applicable to general sensory-evoked BCIs, providing a potential direction of next-generation human-machine interaction systems.

A Dual-Branch Spatio-Temporal-Spectral Transformer Feature Fusion Network for EEG-Based Visual Recognition

Recognizing visual objects from single-trial electroencephalograph (EEG) signals is a promising brain-computer interface (BCI) technology. However, due to the redundant features from noisy multi-channel EEG signals, it is still a challenging task to achieve high precision recognition. Recent deep learning approaches commonly extract spatio-temporal features of EEG signals, which neglect important spectral-temporal features and may degrade the EEG recognition performance. To address the deficiency, we propose a novel channel attention weighting and multi-level adaptive spectral aggregation based dual-branch spatio-temporal-spectral Transformer feature fusion network (CAW-MASA-STST) for EEG-based visual recognition. Specially, we first develop a channel attention weighting (CAW) to automatically learn the channel weights of EEG signals. Then, a graph convolution-based multi-level adaptive spectral aggregation (MASA) is employed to aggregate spectral-temporal features of different sub-bands. Finally, a spatio-temporal-spectral Transformer (STST) is designed to fuse spatio-temporal and spectral-temporal features, which enhances the comprehensive learning ability by modeling the temporal dependencies of the fused features. Competitive experimental results on two public datasets demonstrate that the proposed method is able to achieve superior recognition performance compared with the state-of-the-art methods, indicating a feasible solution for visual recognition-based BCI technology. The code of our proposed method will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/ljbuaa/VisualDecoding</uri> .

Improving the performance of P300-based BCIs by mitigating the effects of stimuli-related evoked potentials through regularized spatial filtering

Objective. the P300-based brain–computer interface (BCI) establishes a communication channel between the mind and a computer by translating brain signals into commands. These systems typically employ a visual oddball paradigm, where different objects (linked to specific commands) are randomly and frequently intensified. Upon observing the target object, users experience an elicitation of a P300 event-related potential in their electroencephalography (EEG). However, detecting the P300 signal can be challenging due to its very low signal-to-noise ratio (SNR), often compromised by the sequence of visual evoked potentials (VEPs) generated in the occipital regions of the brain in response to periodic visual stimuli. While various approaches have been explored to enhance the SNR of P300 signals, the impact of VEPs has been largely overlooked. The main objective of this study is to investigate how VEPs impact P300-based BCIs. Subsequently, the study aims to propose a method for EEG spatial filtering to alleviate the effect of VEPs and enhance the overall performance of these BCIs. Approach. our approach entails analyzing recorded EEG signals from visual P300-based BCIs through temporal, spectral, and spatial analysis techniques to identify the impact of VEPs. Subsequently, we introduce a regularized version of the xDAWN algorithm, a well-established spatial filter known for enhancing single-trial P300s. This aims to simultaneously enhance P300 signals and suppress VEPs, contributing to an improved overall signal quality. Main results. analyzing EEG signals shows that VEPs can significantly contaminate P300 signals, resulting in a decrease in the overall performance of P300-based BCIs. However, our proposed method for simultaneous enhancement of P300 and suppression of VEPs demonstrates improved performance in P300-based BCIs. This improvement is verified through several experiments conducted with real P300 data. Significance. this study focuses on the effects of VEPs on the performance of P300-based BCIs, a problem that has not been adequately addressed in previous studies. It opens up a new path for investigating these BCIs. Moreover, the proposed spatial filtering technique has the potential to further enhance the performance of these systems.

Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems

Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions. Approach. To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days. Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation. Significance. Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications.

A sub-region combination scheme for spatial coding in a high-frequency SSVEP-based BCI

Objective. In studying the spatial coding mechanism of visual evoked potentials, it is significant to construct a model that shows the relationship between steady-state visual evoked potential (SSVEP) responses to the local and global visual field stimulation. In order to investigate whether SSVEPs produced by sub-region stimulation can predict that produced by joint region stimulation, a sub-region combination scheme for spatial coding in a high-frequency SSVEP-based brain-computer interface (BCI) is developed innovatively. Approach. An annular visual field is divided equally into eight sub-regions. The 60 Hz visual stimuli in different sub-regions and joint regions are presented separately to participants. The SSVEP produced by the sub-region stimulation is superimposed to simulate the SSVEP produced by the joint region stimulation with different spatial combinations. A four-class spatially-coded BCI paradigm is used to evaluate the simulated classification performance, and the performance ranking of all simulated SSVEPs is obtained. Six representative stimulus patterns from two performance levels and three stimulus areas are applied to the online BCI system for each participant. Main results. The experimental result shows that the proposed scheme can implement a spatially-coded visual BCI system and realize satisfactory performance with imperceptible flicker. Offline analysis indicates that the classification accuracy and information transfer rate (ITR) are 89.69 ± 8.75% and 24.35 ± 7.09 bits min−1 with 3 s data length under the 3/8 stimulus area. The online BCI system reaches an average classification accuracy of 87.50 ± 9.13% with 3 s data length, resulting in an ITR of 22.48 ± 6.71 bits min−1 under the 3/8 stimulus area. Significance. This study proves the feasibility of using the sub-region’s response to predict the joint region’s response. It has the potential to extend to other frequency bands and lays a foundation for future research on more complex spatial coding methods.

Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces

Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, inflammation risks and even irreversible damage to soft tissues. Here, we propose in-ear visual and auditory BCIs based on in-ear bioelectronics, named as SpiralE, which can adaptively expand and spiral along the auditory meatus under electrothermal actuation to ensure conformal contact. Participants achieve offline accuracies of 95% in 9-target steady state visual evoked potential (SSVEP) BCI classification and type target phrases successfully in a calibration-free 40-target online SSVEP speller experiment. Interestingly, in-ear SSVEPs exhibit significant 2nd harmonic tendencies, indicating that in-ear sensing may be complementary for studying harmonic spatial distributions in SSVEP studies. Moreover, natural speech auditory classification accuracy can reach 84% in cocktail party experiments. The SpiralE provides innovative concepts for designing 3D flexible bioelectronics and assists the development of biomedical engineering and neural monitoring.

A novel visual brain-computer interfaces paradigm based on evoked related potentials evoked by weak and small number of stimuli.

Traditional visual Brain-Computer Interfaces (v-BCIs) usually use large-size stimuli to attract more attention from users and then elicit more distinct and robust EEG responses, which would cause visual fatigue and limit the length of use of the system. On the contrary, small-size stimuli always need multiple and repeated stimulus to code more instructions and increase separability among each code. These common v-BCIs paradigms can cause problems such as redundant coding, long calibration time, and visual fatigue. To address these problems, this study presented a novel v-BCI paradigm using weak and small number of stimuli, and realized a nine-instruction v-BCI system that controlled by only three tiny stimuli. Each of these stimuli were located between instructions, occupied area with eccentricities subtended 0.4°, and flashed in the row-column paradigm. The weak stimuli around each instruction would evoke specific evoked related potentials (ERPs), and a template-matching method based on discriminative spatial pattern (DSP) was employed to recognize these ERPs containing the intention of users. Nine subjects participated in the offline and online experiments using this novel paradigm. The average accuracy of the offline experiment was 93.46% and the online average information transfer rate (ITR) was 120.95 bits/min. Notably, the highest online ITR achieved 177.5 bits/min. These results demonstrate the feasibility of using a weak and small number of stimuli to implement a friendly v-BCI. Furthermore, the proposed novel paradigm achieved higher ITR than traditional ones using ERPs as the controlled signal, which showed its superior performance and may have great potential of being widely used in various fields.

A new grid stimulus with subtle flicker perception for user-friendly SSVEP-based BCIs

Objective. The traditional uniform flickering stimulation pattern shows strong steady-state visual evoked potential (SSVEP) responses and poor user experience with intense flicker perception. To achieve a balance between performance and comfort in SSVEP-based brain–computer interface (BCI) systems, this study proposed a new grid stimulation pattern with reduced stimulation area and low spatial contrast. Approach. A spatial contrast scanning experiment was conducted first to clarify the relationship between the SSVEP characteristics and the signs and values of spatial contrast. Four stimulation patterns were involved in the experiment: the ON and OFF grid stimulation patterns that separately activated the positive or negative contrast information processing pathways, the ON–OFF grid stimulation pattern that simultaneously activated both pathways, and the uniform flickering stimulation pattern that served as a control group. The contrast-intensity and contrast-user experience curves were obtained for each stimulation pattern. Accordingly, the optimized stimulation schemes with low spatial contrast (the ON-50% grid stimulus, the OFF-50% grid stimulus, and the Flicker-30% stimulus) were applied in a 12-target and a 40-target BCI speller and compared with the traditional uniform flickering stimulus (the Flicker-500% stimulus) in the evaluation of BCI performance and subjective experience. Main results. The OFF-50% grid stimulus showed comparable online performance (12-target, 2 s: 69.87 ± 0.74 vs. 69.76 ± 0.58 bits min−1, 40-target, 4 s: 57.02 ± 2.53 vs. 60.79 ± 1.08 bits min−1) and improved user experience (better comfortable level, weaker flicker perception and higher preference level) compared to the traditional Flicker-500% stimulus in both multi-targets BCI spellers. Significance. Selective activation of the negative contrast information processing pathway using the new OFF-50% grid stimulus evoked robust SSVEP responses. On this basis, high-performance and user-friendly SSVEP-based BCIs have been developed and implemented, which has important theoretical significance and application value in promoting the development of the visual BCI technology.

Adaptive classification helps hybrid visual brain computer interface systems handle non‐stationary cortical signals

AbstractThe classifier efficiency of the brain‐computer interface systems is significantly impacted by the non‐stationarity of electroencephalogram (EEG) signals. We propose an adaptive variant of the linear discriminant analysis (LDA) classifier as a solution to this problem. This classifier constantly adjusts its parameters to account for the most recent EEG data. In this study, the authors will update the mean values as well as the covariance matrix of each class pair. Visually evoked cortical potential datasets are used to check how well the proposed classifier performs. The authors prove that the proposed adaptive LDA performs much better than both static multiclass LDA and adaptive PMean LDA.

Effect of Stimulus Size in a Visual ERP-Based BCI under RSVP.

Rapid serial visual presentation (RSVP) is currently one of the most suitable paradigms for use with a visual brain-computer interface based on event-related potentials (ERP-BCI) by patients with a lack of ocular motility. However, gaze-independent paradigms have not been studied as closely as gaze-dependent ones, and variables such as the sizes of the stimuli presented have not yet been explored under RSVP. Hence, the aim of the present work is to assess whether stimulus size has an impact on ERP-BCI performance under the RSVP paradigm. Twelve participants tested the ERP-BCI under RSVP using three different stimulus sizes: small (0.1 × 0.1 cm), medium (1.9 × 1.8 cm), and large (20.05 × 19.9 cm) at 60 cm. The results showed significant differences in accuracy between the conditions; the larger the stimulus, the better the accuracy obtained. It was also shown that these differences were not due to incorrect perception of the stimuli since there was no effect from the size in a perceptual discrimination task. The present work therefore shows that stimulus size has an impact on the performance of an ERP-BCI under RSVP. This finding should be considered by future ERP-BCI proposals aimed at users who need gaze-independent systems.

A novel brain-computer interface based on audio-assisted visual evoked EEG and spatial-temporal attention CNN.

ObjectiveBrain-computer interface (BCI) can translate intentions directly into instructions and greatly improve the interaction experience for disabled people or some specific interactive applications. To improve the efficiency of BCI, the objective of this study is to explore the feasibility of an audio-assisted visual BCI speller and a deep learning-based single-trial event related potentials (ERP) decoding strategy.ApproachIn this study, a two-stage BCI speller combining the motion-onset visual evoked potential (mVEP) and semantically congruent audio evoked ERP was designed to output the target characters. In the first stage, the different group of characters were presented in the different locations of visual field simultaneously and the stimuli were coded to the mVEP based on a new space division multiple access scheme. And then, the target character can be output based on the audio-assisted mVEP in the second stage. Meanwhile, a spatial-temporal attention-based convolutional neural network (STA-CNN) was proposed to recognize the single-trial ERP components. The CNN can learn 2-dimentional features including the spatial information of different activated channels and time dependence among ERP components. In addition, the STA mechanism can enhance the discriminative event-related features by adaptively learning probability weights.Main resultsThe performance of the proposed two-stage audio-assisted visual BCI paradigm and STA-CNN model was evaluated using the Electroencephalogram (EEG) recorded from 10 subjects. The average classification accuracy of proposed STA-CNN can reach 59.6 and 77.7% for the first and second stages, which were always significantly higher than those of the comparison methods (p < 0.05).SignificanceThe proposed two-stage audio-assisted visual paradigm showed a great potential to be used to BCI speller. Moreover, through the analysis of the attention weights from time sequence and spatial topographies, it was proved that STA-CNN could effectively extract interpretable spatiotemporal EEG features.

Effective 2-D cursor control system using hybrid SSVEP + P300 visual brain computer interface.

Acursorcontrolsystembasedonbrain-computer interface (BCI) provides efficient computer access. These systems operate without any muscular activity from the user. ConventionalBCI-basedcursorcontrolsystemshaveseverallimitations. Therefore, hybrid SSVEP + P300 visual BCI (VBCI)-basedcursorcontrolisneeded to overcome these limitations. This paper explores the feasibility of using noninvasive hybrid SSVEP + P300 VBCI for cursor control as a universal form of computer access. The proposed cursor control system has a graphical user interface (GUI) design that simultaneously evokes both SSVEP and P300 signals in the human cortex. The performance metrics of the proposed system are compared with conventional SSVEP VBCI and P300 VBCI-based cursor control systems. The proposed hybrid SSVEP + P300 BCI-based cursor control system achieves a maximum accuracy of 97.51% with a 27.15 bit/min information transfer rate (ITR). The results proved that the proposed system performed more efficiently than other systems. The proposed system was tested in a noisy environment and found to be suitable for real-world applications.

Exploring the Ability to Classify Visual Perception and Visual Imagery EEG Data: Toward an Intuitive BCI System

Providing an intuitive interface for the actual use of brain–computer interface (BCI) can increase BCI users’ convenience greatly. We explored the possibility that visual imagery can be used as a paradigm that may constitute a more intuitive, active BCI. To do so, electroencephalography (EEG) data were collected during visual perception and imagery experiments. Three image categories (object, digit, shape) and three different images per category were used as visual stimuli. EEG data from seven subjects were used in this work. Three types of visual perception/imagery EEG data were preprocessed for classification: raw time series data; time–frequency maps; and common spatial pattern (CSP). Five types of classifiers (EEGNet, 1D convolutional neural network (CNN), MultiRocket, MobileNet, support vector machine (SVM)) were applied to each applicable data type among the three preprocessed types. Thus, we investigated the feasibility of classifying three-category or nine-class visual perception/imagery over various classifiers and preprocessed data types. We found that the MultiRocket network showed the best classification performance: yielding approximately 57.02% (max 63.62%) for three-category classification in visual perception and approximately 46.43% (max 71.38%) accuracy for three-category classification in visual imagery. However, no meaningfully improved performance was achieved in the nine-class classification in either visual perception or imagery, although visual perception yielded slightly higher accuracy than visual imagery. From our extensive investigation, we found that visual perception and visual imagery data may be classified; however, it is somewhat doubtful whether either may be applicable to an actual BCI system. It is believed that introducing better-designed advanced deep learning networks together with more informative feature extractions may improve the performance of EEG visual perception/imagery classifications. In addition, a more sophisticated experimental design paradigm may enhance the potential to achieve more intuitive visual imagery BCI.

Brain-Computer Interfaces: Investigating the Transition from Visually Evoked to Purely Imagined Steady-State Potentials.

Brain-Computer Interfaces (BCIs) based on Steady State Visually Evoked Potentials (SSVEPs) have proven effective and provide significant accuracy and information-transfer rates. This family of strategies, however, requires external devices that provide the frequency stimuli required by the technique. This limits the scenarios in which they can be applied, especially when compared to other BCI approaches. In this work, we have investigated the possibility of obtaining frequency responses in the EEG output based on the pure visual imagination of SSVEP-eliciting stimuli. Our results show that not only that EEG signals present frequency-specific peaks related to the frequency the user is focusing on, but also that promising classification accuracy can be achieved, paving the way for a robust and reliable visual imagery BCI modality. Clinical relevance-Brain computer interfaces play a fundamental role in enhancing the quality of life of patients with severe motor impairments. Strategies based on purely imagined stimuli, like the one presented here, are particularly impacting, especially in the most severe cases.

Improving Cross-State and Cross-Subject Visual ERP-Based BCI With Temporal Modeling and Adversarial Training.

Brain-computer interface (BCI) is a useful device for people without relying on peripheral nerves and muscles. However, the performance of the event-related potential (ERP)-based BCI declines when applying it to real environments, especially in cross-state and cross-subject conditions. Here we employ temporal modeling and adversarial training to improve the visual ERP-based BCI under different mental workload states and to alleviate the problems above. The rationality of our method is that the ERP-based BCI is based on electroencephalography (EEG) signals recorded from the scalp's surface, continuously changing with time and somewhat stochastic. In this paper, we propose a hierarchical recurrent network to encode all ERP signals in each repetition at the same time and model them with a temporal manner to predict which visual event elicited an ERP. The hierarchical architecture is a simple yet effective method for organizing recurrent layers in a deep structure to model long sequence signals. Taking a cue from recent advances in adversarial training, we further applied dynamic adversarial perturbations to create adversarial examples to enhance the model performance. We conduct our experiments on one published visual ERP-based BCI task with 15 subjects and 3 different auditory workload states. The results indicate that our hierarchical method can effectively model the long sequence EEG raw data, outperform the baselines on most conditions, including cross-state and cross-subject conditions. Finally, we show how deep learning-based methods with limited EEG data can improve ERP-based BCI with adversarial training. Our code is available at https://github.com/aispeech-lab/VisBCI.

Artificial Intelligence Algorithms in Visual Evoked Potential-Based Brain-Computer Interfaces for Motor Rehabilitation Applications: Systematic Review and Future Directions.

Brain-Computer Interface (BCI) is a technology that uses electroencephalographic (EEG) signals to control external devices, such as Functional Electrical Stimulation (FES). Visual BCI paradigms based on P300 and Steady State Visually Evoked potentials (SSVEP) have shown high potential for clinical purposes. Numerous studies have been published on P300- and SSVEP-based non-invasive BCIs, but many of them present two shortcomings: (1) they are not aimed for motor rehabilitation applications, and (2) they do not report in detail the artificial intelligence (AI) methods used for classification, or their performance metrics. To address this gap, in this paper the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology was applied to prepare a systematic literature review (SLR). Papers older than 10 years, repeated or not related to a motor rehabilitation application, were excluded. Of all the studies, 51.02% referred to theoretical analysis of classification algorithms. Of the remaining, 28.48% were for spelling, 12.73% for diverse applications (control of wheelchair or home appliances), and only 7.77% were focused on motor rehabilitation. After the inclusion and exclusion criteria were applied and quality screening was performed, 34 articles were selected. Of them, 26.47% used the P300 and 55.8% the SSVEP signal. Five applications categories were established: Rehabilitation Systems (17.64%), Virtual Reality environments (23.52%), FES (17.64%), Orthosis (29.41%), and Prosthesis (11.76%). Of all the works, only four performed tests with patients. The most reported machine learning (ML) algorithms used for classification were linear discriminant analysis (LDA) (48.64%) and support vector machine (16.21%), while only one study used a deep learning algorithm: a Convolutional Neural Network (CNN). The reported accuracy ranged from 38.02 to 100%, and the Information Transfer Rate from 1.55 to 49.25 bits per minute. While LDA is still the most used AI algorithm, CNN has shown promising results, but due to their high technical implementation requirements, many researchers do not justify its implementation as worthwile. To achieve quick and accurate online BCIs for motor rehabilitation applications, future works on SSVEP-, P300-based and hybrid BCIs should focus on optimizing the visual stimulation module and the training stage of ML and DL algorithms.

A visual brain-computer interface as communication aid for patients with amyotrophic lateral sclerosis

ObjectiveBrain-Computer Interface (BCI) spellers that make use of code-modulated Visual Evoked Potentials (cVEP) may provide a fast and more accurate alternative to existing visual BCI spellers for patients with Amyotrophic Lateral Sclerosis (ALS). However, so far the cVEP speller has only been tested on healthy participants. MethodsWe assess the brain responses, BCI performance and user experience of the cVEP speller in 20 healthy participants and 10 ALS patients. All participants performed a cued and free spelling task, and a free selection of Yes/No answers. Results27 out of 30 participants could perform the cued spelling task with an average accuracy of 79% for ALS patients, 88% for healthy older participants and 94% for healthy young participants. All 30 participants could answer Yes/No questions freely, with an average accuracy of around 90%. ConclusionsWith ALS patients typing on average 10 characters per minute, the cVEP speller presented in this paper outperforms other visual BCI spellers. SignificanceThese results support a general usability of cVEP signals for ALS patients, which may extend far beyond the tested speller to control e.g. an alarm, automatic door, or TV within a smart home.

Efficient Quadcopter Flight Control Using Hybrid SSVEP + P300 Visual Brain Computer Interface

ABSTRACT The objective of this study was to assess the feasibility of hybrid SSVEP + P300 visual BCI systems for quad-copter flight control in physical world. Existing BCI-based quad-copter flight control has limitations of slow navigation, lower system accuracy, rigorous user training requirement and lesser number of independent control commands. So, there is need of hybrid BCI design that combines evoked SSVEP and P300 potentials to control flight direction of quad-copter movement. GUI design is developed such that user can effectively control quad-copter flight by gazing at visual stimuli buttons that produce SSVEP & P300 potentials simultaneously in human cortex. We compare the performance metrics of the proposed flight control systems with other existing BCI-based flight control as conventional SSVEP BCI and P300 BCI and commercially available keyboard flight control systems. Results proved that the proposed system outperforms the existing BCI-based flight control systems but has slightly lower performance efficiency than the commercial keyboard flight control systems. Further, the proposed quad-copter flight control system proved its suitability for patients with severe motor disabilities.

Closed-loop EEG study on visual recognition during driving

Objective. In contrast to the classical visual brain–computer interface (BCI) paradigms, which adhere to a rigid trial structure and restricted user behavior, electroencephalogram (EEG)-based visual recognition decoding during our daily activities remains challenging. The objective of this study is to explore the feasibility of decoding the EEG signature of visual recognition in experimental conditions promoting our natural ocular behavior when interacting with our dynamic environment. Approach. In our experiment, subjects visually search for a target object among suddenly appearing objects in the environment while driving a car-simulator. Given that subjects exhibit an unconstrained overt visual behavior, we based our study on eye fixation-related potentials (EFRPs). We report on gaze behavior and single-trial EFRP decoding performance (fixations on visually similar target vs. non-target objects). In addition, we demonstrate the application of our approach in a closed-loop BCI setup. Main results. To identify the target out of four symbol types along a road segment, the BCI system integrated decoding probabilities of multiple EFRP and achieved the average online accuracy of 0.37 ± 0.06 (12 subjects), statistically significantly above the chance level. Using the acquired data, we performed a comparative study of classification algorithms (discriminating target vs. non-target) and feature spaces in a simulated online scenario. The EEG approaches yielded similar moderate performances of at most 0.6 AUC, yet statistically significantly above the chance level. In addition, the gaze duration (dwell time) appears to be an additional informative feature in this context. Significance. These results show that visual recognition of sudden events can be decoded during active driving. Therefore, this study lays a foundation for assistive and recommender systems based on the driver’s brain signals.