Based Brain-computer Interfaces Systems Research Articles

High-Density Electroencephalogram Facilitates the Detection of Small Stimuli in Code-Modulated Visual Evoked Potential Brain-Computer Interfaces.

In recent years, there has been a considerable amount of research on visual evoked potential (VEP)-based brain-computer interfaces (BCIs). However, it remains a big challenge to detect VEPs elicited by small visual stimuli. To address this challenge, this study employed a 256-electrode high-density electroencephalogram (EEG) cap with 66 electrodes in the parietal and occipital lobes to record EEG signals. An online BCI system based on code-modulated VEP (C-VEP) was designed and implemented with thirty targets modulated by a time-shifted binary pseudo-random sequence. A task-discriminant component analysis (TDCA) algorithm was employed for feature extraction and classification. The offline and online experiments were designed to assess EEG responses and classification performance for comparison across four different stimulus sizes at visual angles of 0.5°, 1°, 2°, and 3°. By optimizing the data length for each subject in the online experiment, information transfer rates (ITRs) of 126.48 ± 14.14 bits/min, 221.73 ± 15.69 bits/min, 258.39 ± 9.28 bits/min, and 266.40 ± 6.52 bits/min were achieved for 0.5°, 1°, 2°, and 3°, respectively. This study further compared the EEG features and classification performance of the 66-electrode layout from the 256-electrode EEG cap, the 32-electrode layout from the 128-electrode EEG cap, and the 21-electrode layout from the 64-electrode EEG cap, elucidating the pivotal importance of a higher electrode density in enhancing the performance of C-VEP BCI systems using small stimuli.

Exploring inter-trial coherence for inner speech classification in EEG-based brain–computer interface

Objective. In recent years, electroencephalogram (EEG)-based brain–computer interfaces (BCIs) applied to inner speech classification have gathered attention for their potential to provide a communication channel for individuals with speech disabilities. However, existing methodologies for this task fall short in achieving acceptable accuracy for real-life implementation. This paper concentrated on exploring the possibility of using inter-trial coherence (ITC) as a feature extraction technique to enhance inner speech classification accuracy in EEG-based BCIs. Approach. To address the objective, this work presents a novel methodology that employs ITC for feature extraction within a complex Morlet time-frequency representation. The study involves a dataset comprising EEG recordings of four different words for ten subjects, with three recording sessions per subject. The extracted features are then classified using k-nearest-neighbors (kNNs) and support vector machine (SVM). Main results. The average classification accuracy achieved using the proposed methodology is 56.08% for kNN and 59.55% for SVM. These results demonstrate comparable or superior performance in comparison to previous works. The exploration of inter-trial phase coherence as a feature extraction technique proves promising for enhancing accuracy in inner speech classification within EEG-based BCIs. Significance. This study contributes to the advancement of EEG-based BCIs for inner speech classification by introducing a feature extraction methodology using ITC. The obtained results, on par or superior to previous works, highlight the potential significance of this approach in improving the accuracy of BCI systems. The exploration of this technique lays the groundwork for further research toward inner speech decoding.

Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs.

Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI studies focused on improving the decoding accuracy, with only a few considering the adversarial security. Although many adversarial defense approaches have been proposed in other application domains such as computer vision, previous research showed that their direct extensions to BCIs degrade the classification accuracy on benign samples. This phenomenon greatly affects the applicability of adversarial defense approaches to EEG-based BCIs. To mitigate this problem, we propose alignment-based adversarial training (ABAT), which performs EEG data alignment before adversarial training. Data alignment aligns EEG trials from different domains to reduce their distribution discrepancies, and adversarial training further robustifies the classification boundary. The integration of data alignment and adversarial training can make the trained EEG classifiers simultaneously more accurate and more robust. Experiments on five EEG datasets from two different BCI paradigms (motor imagery classification, and event related potential recognition), three convolutional neural network classifiers (EEGNet, ShallowCNN and DeepCNN) and three different experimental settings (offline within-subject cross-block/-session classification, online cross-session classification, and pre-trained classifiers) demonstrated its effectiveness. It is very intriguing that adversarial attacks, which are usually used to damage BCI systems, can be used in ABAT to simultaneously improve the model accuracy and robustness.

A hybrid steady-state visual evoked response-based brain-computer interface with MEG and EEG

While recent developments in electroencephalogram (EEG)-based brain-computer interfaces (BCIs) have enabled a bridge between the brain and external devices with relatively high communication speed, there is still room for improvement. Notably, the phenomenon of “BCI illiteracy,” which refers to the 15%–30% of people who struggle to type or control devices using BCI, remains unsolved, limiting the practical application of BCI systems. The EEG-based BCIs performance is constrained by the low-quality scalp EEG signals due to the attenuation and distortion of the skull. To address these limitations, this study proposes a hybrid BCI system combining EEG with magnetoencephalogram (MEG), a neuroimaging technology not influenced by the volume conduction effect, to boost BCI performance by enhancing signal quality. Comparative experiments involving 22 subjects showed that the steady-state visual evoked response (SSVER) from MEG has a wider range of effective bandwidth and higher signal-to-noise ratio than EEG. Moreover, differences in the spectral and spatiotemporal characteristics of MEG and EEG explain better performance. Simultaneous MEG-EEG recording experiments suggested that the hybrid MEG-EEG BCI achieved a significantly higher information transfer rate than either modality alone (hybrid: 312 ± 17 bits/min, MEG: 272 ± 17 bits/min, EEG: 240 ± 27 bits/min). Moreover, the 40-target classification accuracy of “BCI illiterate” increased from 50% to 95% with the help of MEG. These results highlight the methodological advantages of a hybrid MEG-EEG BCI, suggesting a promising paradigm for implementing high-speed BCIs.

Automated labeling and online evaluation for self-paced movement detection BCI

Electroencephalogram (EEG)-based brain–computer interfaces (BCIs) allow users to use brain signals to control external instruments, and movement intention detecting BCIs can aid in the rehabilitation of patients who have lost motor function. Existing studies in this area mostly rely on cue-based data collection that facilitates sample labeling but introduces noise from cue stimuli; moreover, it requires extensive user training, and cannot reflect real usage scenarios. In contrast, self-paced BCIs can overcome the limitations of the cue-based approach by supporting users to perform movements at their own initiative and pace, but they fall short in labeling. Therefore, in this study, we proposed an automated labeling approach that can cross-reference electromyography (EMG) signals for EEG labeling with zero human effort. Furthermore, considering that only a few studies have focused on evaluating BCI systems for online use and most of them do not report details of the online systems, we developed and present in detail a pseudo-online evaluation suite to facilitate online BCI research. We collected self-paced movement EEG data from 10 participants performing opening and closing hand movements for training and evaluation. The results show that the automated labeling method can contend well with noisy data compared with the baseline labeling method. We also explored popular machine learning models for online self-paced movement detection. The results demonstrate the capability of our online pipeline, and that a well-performing offline model does not necessarily translate to a well-performing online model owing to the specific settings of an online BCI system. Our proposed automated labeling method, online evaluation suite, and dataset take a concrete step towards real-world self-paced BCI systems.

Adaptive Window Method Based on FBCCA for Optimal SSVEP Recognition.

In the conventional studies related to steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), the window length (detection time) was typically predetermined through the offline analysis, which had limitations of practical applicability of a BCI system due to the inter-subject/trial variability of electroencephalography (EEG) signals. To address these limitations, this study aims to automatically optimize the window length for each trial based on training-free approaches and proposes a novel adaptive window method (ANCOVA-based filter-bank canonical correlation analysis, ABFCCA) for SSVEP-based BCIs. The proposed method is based on analysis of covariance (ANCOVA) which is applied after feature extraction by the conventional training-free SSVEP recognition approaches. To evaluate the performance of the proposed method, conventional fixed window and recent adaptive window methods were compared using two open-access datasets. In the Benchmark dataset, the average information transfer rate (ITR) was 146.81 bits/min, the average accuracy 93.55%, and the average window length 1.53 s. In the OpenBMI dataset, the average ITR was 119.01 bits/min, the average accuracy 83.50%, and the average window length 0.65 s. The proposed method significantly outperformed the conventional approaches with fixed window in terms of the accuracy and ITR, and is applicable to various SSVEP-based BCI paradigms based on the criterion of significance level without offline analysis to find optimal hyper-parameters. ABFCCA is enabled the practical use of various BCI systems by automatically optimizing the window length independently.

High-Frequency Vibrating Stimuli Using the Low-Cost Coin-Type Motors for SSSEP-Based BCI.

Steady-state somatosensory-evoked potential- (SSSEP-) based brain-computer interfaces (BCIs) have been applied for assisting people with physical disabilities since it does not require gaze fixation or long-time training. Despite the advancement of various noninvasive electroencephalogram- (EEG-) based BCI paradigms, researches on SSSEP with the various frequency range and related classification algorithms are relatively unsettled. In this study, we investigated the feasibility of classifying the SSSEP within high-frequency vibration stimuli induced by a versatile coin-type eccentric rotating mass (ERM) motor. Seven healthy subjects performed selective attention (SA) tasks with vibration stimuli attached to the left and right index fingers. Three EEG feature extraction methods, followed by a support vector machine (SVM) classifier, have been tested: common spatial pattern (CSP), filter-bank CSP (FBCSP), and mutual information-based best individual feature (MIBIF) selection after the FBCSP. Consequently, the FBCSP showed the highest performance at 71.5 ± 2.5% for classifying the left and right-hand SA tasks than the other two methods (i.e., CSP and FBCSP-MIBIF). Based on our findings and approach, the high-frequency vibration stimuli using low-cost coin motors with the FBCSP-based feature selection can be potentially applied to developing practical SSSEP-based BCI systems.

Automatic detection of code-modulated visual evoked potentials using novel covariance estimators and short-time EEG signals

Background and Objective:Over the last years, code-modulated visual evoked potentials (cVEP)-based brain–computer interfaces (BCIs) have been developed as robust and non-invasive tools to construct high-speed communication systems. Recently, beamforming-based algorithms have extensively been used in cVEP-based BCI systems because of the need for short-time stimulation and less training data. One of the main drawbacks of the beamforming-based approaches is that their performance highly depends on estimating data covariance matrix and calculating activation patterns. Methods:In the present study, two novel covariance estimators (i.e., the modified convex combination (MCC) and the maximum likelihood (ML) techniques) are proposed to estimate a robust and more reliable covariance matrix. In the ML method, a new sparsity constraint is considered to express the specific eigendecomposition of the covariance matrix as a sparse matrix transform (SMT). Then, the SMT is calculated using the product of pairwise coordinate rotations. These rotations can be constructed by a cross-validation method. Two stimulation presentation rates of 60 and 120 Hz are used for the coding sequence. Results:Both of the suggested approaches (i.e., the MCC and SMT-based techniques) can efficiently improve the performance of the conventional spatiotemporal beamforming-based methods by providing a robust estimate of the covariance matrix in short stimulation times. Based on the experimental results, it can be concluded that the proposed SMT and MCC methods achieve the best results for the 60 and 120 Hz stimulus presentation rates, respectively. However, for both stimulus presentation rates, the proposed SMT and MCC-based methods remarkably outperform other state-of-the-art methods in cVEP-based BCI, such as conventional spatiotemporal beamforming and optimized support vector machines (SVM). Also, the results showed that the 120 Hz stimulus presentation rate provided faster communication. This procedure is performed by obtaining a maximal Information Transfer Rate (ITR) of 187.38 bits/minute. Conclusion:Finally, the present study suggested that the proposed MCC and SMT-based techniques could automatically detect the gazed targets. Also, these methods could be used as non-invasive alternatives over conventional methods.

A Novel Classification Framework Using the Graph Representations of Electroencephalogram for Motor Imagery Based Brain-Computer Interface

The motor imagery (MI) based brain-computer interfaces (BCIs) have been proposed as a potential physical rehabilitation technology. However, the low classification accuracy achievable with MI tasks is still a challenge when building effective BCI systems. We propose a novel MI classification model based on measurement of functional connectivity between brain regions and graph theory. Specifically, motifs describing local network structures in the brain are extracted from functional connectivity graphs. A graph embedding model called Ego-CNNs is then used to build a classifier, which can convert the graph from a structural representation to a fixed-dimensional vector for detecting critical structure in the graph. We validate our proposed method on four datasets, and the results show that our proposed method produces high classification accuracies in two-class classification tasks (92.8% for dataset 1, 93.4% for dataset 2, 96.5% for dataset 3, and 80.2% for dataset 4) and multiclass classification tasks (90.33% for dataset 1). Our proposed method achieves a mean Kappa value of 0.88 across nine participants, which is superior to other methods we compared it to. These results indicate that there is a local structural difference in functional connectivity graphs extracted under different motor imagery tasks. Our proposed method has great potential for motor imagery classification in future studies.

Universal adversarial perturbations for CNN classifiers in EEG-based BCIs

Objective. Multiple convolutional neural network (CNN) classifiers have been proposed for electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, CNN models have been found vulnerable to universal adversarial perturbations (UAPs), which are small and example-independent, yet powerful enough to degrade the performance of a CNN model, when added to a benign example. Approach. This paper proposes a novel total loss minimization (TLM) approach to generate UAPs for EEG-based BCIs. Main results. Experimental results demonstrated the effectiveness of TLM on three popular CNN classifiers for both target and non-target attacks. We also verified the transferability of UAPs in EEG-based BCI systems. Significance. To our knowledge, this is the first study on UAPs of CNN classifiers in EEG-based BCIs. UAPs are easy to construct, and can attack BCIs in real-time, exposing a potentially critical security concern of BCIs.

A novel training-free recognition method for SSVEP-based BCIs using dynamic window strategy

Objective. Filter bank canonical correlation analysis (FBCCA) is a widely-used classification approach implemented in steady-state visual evoked potential (SSVEP)–based brain computer interfaces (BCIs). However, conventional detection algorithms for SSVEP recognition problems, including the FBCCA, were usually based on ‘fixed window’ strategy. That’s to say, these algorithms always analyze data with fixed length. This study devoted to enhance the performance of SSVEP-based BCIs by designing a new dynamic window strategy which automatically finds an optimal data length to achieve higher information transfer rate (ITR). Approach. The main purpose of ‘dynamic window’ is to minimize the required data length while maintaining high accuracy. This study projected the correlation coefficients of FBCCA into probability space by softmax function and built a hypothesis testing model, which took risk function as evaluation of classification result’s ‘credibility’. In order to evaluate the superiority of this approach, FBCCA with fixed data length (FBCCA-FW) and spatial temporal equalization dynamic window (STE-DW) were implemented for comparison. Main results. Fourteen healthy subjects’ results were concluded by a 40-target online SSVEP-based BCI speller system. The results suggest that this proposed approach significantly outperforms STE-DW and FBCCA-FW in terms of accuracy and ITR. Significance. By incorporating the fundamental ideas of FBCCA and dynamic window strategy, this study proposed a new training-free dynamical optimization algorithm, which significantly improved the performance of online SSVEP-based BCI systems.

Comparison of Modern Highly Interactive Flicker-Free Steady State Motion Visual Evoked Potentials for Practical Brain-Computer Interfaces.

Motion-based visual evoked potentials (mVEP) is a new emerging trend in the field of steady-state visual evoked potentials (SSVEP)-based brain–computer interfaces (BCI). In this paper, we introduce different movement-based stimulus patterns (steady-state motion visual evoked potentials—SSMVEP), without employing the typical flickering. The tested movement patterns for the visual stimuli included a pendulum-like movement, a flipping illusion, a checkerboard pulsation, checkerboard inverse arc pulsations, and reverse arc rotations, all with a spelling task consisting of 18 trials. In an online experiment with nine participants, the movement-based BCI systems were evaluated with an online four-target BCI-speller, in which each letter may be selected in three steps (three trials). For classification, the minimum energy combination and a filter bank approach were used. The following frequencies were utilized: 7.06 Hz, 7.50 Hz, 8.00 Hz, and 8.57 Hz, reaching an average accuracy between 97.22% and 100% and an average information transfer rate (ITR) between 15.42 bits/min and 33.92 bits/min. All participants successfully used the SSMVEP-based speller with all types of stimulation pattern. The most successful SSMVEP stimulus was the SSMVEP1 (pendulum-like movement), with the average results reaching 100% accuracy and 33.92 bits/min for the ITR.

Internal Feature Selection Method of CSP Based on L1-Norm and Dempster-Shafer Theory.

The common spatial pattern (CSP) algorithm is a well-recognized spatial filtering method for feature extraction in motor imagery (MI)-based brain-computer interfaces (BCIs). However, due to the influence of nonstationary in electroencephalography (EEG) and inherent defects of the CSP objective function, the spatial filters, and their corresponding features are not necessarily optimal in the feature space used within CSP. In this work, we design a new feature selection method to address this issue by selecting features based on an improved objective function. Especially, improvements are made in suppressing outliers and discovering features with larger interclass distances. Moreover, a fusion algorithm based on the Dempster-Shafer theory is proposed, which takes into consideration the distribution of features. With two competition data sets, we first evaluate the performance of the improved objective functions in terms of classification accuracy, feature distribution, and embeddability. Then, a comparison with other feature selection methods is carried out in both accuracy and computational time. Experimental results show that the proposed methods consume less additional computational cost and result in a significant increase in the performance of MI-based BCI systems.

Prediction of Motor Imagery Performance based on Pre-Trial Spatio-Spectral Alertness Features.

Electroencephalogram (EEG) based brain-computer interfaces (BCIs) enable communication by interpreting the user intent based on measured brain electrical activity. Such interpretation is usually performed by supervised classifiers constructed in training sessions. However, changes in cognitive states of the user, such as alertness and vigilance, during test sessions lead to variations in EEG patterns, causing classification performance decline in BCI systems. This research focuses on effects of alertness on the performance of motor imagery (MI) BCI as a common mental control paradigm. It proposes a new protocol to predict MI performance decline by alertness-related pre-trial spatio-spectral EEG features. The proposed protocol can be used for adapting the classifier or restoring alertness based on the cognitive state of the user during BCI applications.

Implementing Over 100 Command Codes for a High-Speed Hybrid Brain-Computer Interface Using Concurrent P300 and SSVEP Features.

Recently, electroencephalography (EEG)- based brain-computer interfaces (BCIs) have made tremendous progress in increasing communication speed. However, current BCI systems could only implement a small number of command codes, which hampers their applicability. This study developed a high-speed hybrid BCI system containing as many as 108 instructions, which were encoded by concurrent P300 and steady-state visual evoked potential (SSVEP) features and decoded by an ensemble task-related component analysis method. Notably, besides the frequency-phase-modulated SSVEP and time-modulated P300 features as contained in the traditional hybrid P300 and SSVEP features, this study found two new distinct EEG features for the concurrent P300 and SSVEP features, i.e., time-modulated SSVEP and frequency-phase- modulated P300. Ten subjects spelled in both offline and online cued-guided spelling experiments. Other ten subjects took part in online copy-spelling experiments. Offline analyses demonstrate that the concurrent P300 and SSVEP features can provide adequate classification information to correctly select the target from 108 characters in 1.7 seconds. Online cued-guided spelling and copy-spelling tests further show that the proposed BCI system can reach an average information transfer rate (ITR) of 172.46± 32.91 bits/min and 164.69± 33.32 bits/min respectively, with a peak value of 238.41 bits/min (The demo video of online copy-spelling can be found at https://www.youtube.com/watch?v=EW2Q08oHSBo). We expand a BCI instruction set to over 100 command codes with high-speed in an efficient manner, which significantly improves the degree of freedom of BCIs. This study hold promise for broadening the applications of BCI systems.

Classification of Selective Attention Within Steady-State Somatosensory Evoked Potentials From Dry Electrodes Using Mutual Information-Based Spatio-Spectral Feature Selection

Nowadays, the steady-state somatosensory evoked potential (SSSEP)-based brain-computer interfaces (BCIs) has been developed for improving the quality of daily life for people with physical disabilities. However, due to its poor performance of recognizing selective attention tasks and inattention(rest)-state, the SSSEP-based BCI has not been widely used for practical interfaces. In this paper, we propose a mutual information-based spatio-spectral feature selection method for recognizing selective attention tasks and inattention(rest)-state using dry electrodes considering a real-life application, when vibration stimuli were applied to both index fingers. In our methods, the filter-bank common spatial pattern (FBCSP) was used for extracting spatio-spectral features of the SSSEP. Then, discriminative features were selected using a mutual information-based best individual feature (MIBIF) algorithm. The regularized linear discriminant analysis (RLDA) used as the classifier. The feasibility of the proposed method was demonstrated through eight healthy subjects using the vibration stimuli induced SSSEP with spatially clear and distinguishable patterns for SSSEP-based BCI. From our study, the proposed method showed the best classification accuracy with a kappa value of 0.35±0.17. Furthermore, based on the ANOVA with posthoc tests, the proposed method showed significantly higher accuracy as 57.9% in decoding three classes (p -value <; 0.01) compared to the fast Fourier transform (FFT) and common spatial pattern (CSP)-based previous feature extraction methods. Consequently, the proposed FBCSP and MIBIF-based methods and findings can further help to improve decoding performance and develop the SSSEP-based BCI systems for real-world applications.

Maximum Signal Fraction Analysis for Enhancing Signal-to-Noise Ratio of EEG Signals in SSVEP-Based BCIs

Various improved canonical correlation analysis (CCA) methods were developed for enhancing the performance of steady-state visual evoked potential (SSVEP)-based brain–computer interfaces (BCIs). Among them, the method combining CCA spatial filters from sine-cosine references and individual templates yielded the highest performance. However, the CCA aims to optimize the correlation between two sets of variables rather than the signal-to-noise ratio (SNR) of the SSVEP signals, upon which the performance of an SSVEP-based BCI depends mainly. In this paper, a novel algorithm, namely, maximum signal fraction analysis (MSFA), is proposed for creating spatial filters based on individual training data. The spatial filter for a specific stimulus target is estimated by directly maximizing the averaged SNR of the observed signals across multiple trials. An individual template is calculated for each target by averaging training signals of multiple trials. Target recognition is based on template matching between filtered template signals and a single-trial testing signal. Classification performance of the MSFA-based method was evaluated on a benchmark dataset and compared with that of the CCA-based methods. The results suggest that the proposed MSFA method significantly outperforms the CCA-based methods in terms of classification accuracy, and thus, it has great potential to be applied in the real-life SSVEP-based BCI systems.

Analysis of Electroencephalography Event-Related Desynchronisation and Synchronisation Induced by Lower-Limb Stepping Motor Imagery

Bilateral upper-limb motor imagery has been demonstrated to be a useful mental task in electroencephalography (EEG)-based brain–computer interfaces (BCIs). By contrast, few studies have examined bilateral lower-limb motor imagery, and all of them have focused on imaginary foot movements. The left–right classification accuracy reported in these studies based on the EEG mu rhythm (8–13 Hz) and beta band (13–30 Hz) remains unsatisfactory. The present study investigated the possibility of using lower-limb stepping motor imagery as the mental task and analysed the EEG difference between imaginary left-leg stepping (L-stepping) and right-leg stepping (R-stepping) movements. An experimental paradigm was designed to collect 5-s motor imagery EEG signals at nine recording sites around the vertex of the brain. Results from eight able-bodied participants indicated that the commonly used mu event-related desynchronisation (ERD) feature exhibited no significant difference between the two imaginary movements for all recording sites and all time intervals within the 5-s motor imagery period. Regarding the other commonly used feature, beta event-related synchronisation, no significant difference between the two imagery tasks was observed for most of the recording sites and time intervals. Instead, theta band (4–8 Hz) ERD significantly differed between the L- and R-stepping imagery tasks at five sites (FC4, C3, CP3, Cz, CPz) within the first 2 s after motor imagery cue onset. The findings from the present study may be a basis for further development of BCI systems for decoding left and right stepping during mental exercise where the two motions are alternately imagined.

Decoding hand gestures from primary somatosensory cortex using high-density ECoG

Electrocorticography (ECoG) based Brain-Computer Interfaces (BCIs) have been proposed as a way to restore and replace motor function or communication in severely paralyzed people. To date, most motor-based BCIs have either focused on the sensorimotor cortex as a whole or on the primary motor cortex (M1) as a source of signals for this purpose. Still, target areas for BCI are not confined to M1, and more brain regions may provide suitable BCI control signals. A logical candidate is the primary somatosensory cortex (S1), which not only shares similar somatotopic organization to M1, but also has been suggested to have a role beyond sensory feedback during movement execution. Here, we investigated whether four complex hand gestures, taken from the American sign language alphabet, can be decoded exclusively from S1 using both spatial and temporal information. For decoding, we used the signal recorded from a small patch of cortex with subdural high-density (HD) grids in five patients with intractable epilepsy. Notably, we introduce a new method of trial alignment based on the increase of the electrophysiological response, which virtually eliminates the confounding effects of systematic and non-systematic temporal differences within and between gestures execution. Results show that S1 classification scores are high (76%), similar to those obtained from M1 (74%) and sensorimotor cortex as a whole (85%), and significantly above chance level (25%). We conclude that S1 offers characteristic spatiotemporal neuronal activation patterns that are discriminative between gestures, and that it is possible to decode gestures with high accuracy from a very small patch of cortex using subdurally implanted HD grids. The feasibility of decoding hand gestures using HD-ECoG grids encourages further investigation of implantable BCI systems for direct interaction between the brain and external devices with multiple degrees of freedom.

Optimizing the Face Paradigm of BCI System by Modified Mismatch Negative Paradigm.

Many recent studies have focused on improving the performance of event-related potential (ERP) based brain computer interfaces (BCIs). The use of a face pattern has been shown to obtain high classification accuracies and information transfer rates (ITRs) by evoking discriminative ERPs (N200 and N400) in addition to P300 potentials. Recently, it has been proved that the performance of traditional P300-based BCIs could be improved through a modification of the mismatch pattern. In this paper, a mismatch inverted face pattern (MIF-pattern) was presented to improve the performance of the inverted face pattern (IF-pattern), one of the state of the art patterns used in visual-based BCI systems. Ten subjects attended in this experiment. The result showed that the mismatch inverted face pattern could evoke significantly larger vertex positive potentials (p < 0.05) and N400s (p < 0.05) compared to the inverted face pattern. The classification accuracy (mean accuracy is 99.58%) and ITRs (mean bit rate is 27.88 bit/min) of the mismatch inverted face pattern was significantly higher than that of the inverted face pattern (p < 0.05).