Performance Of SSVEP-based Brain-computer Interface Research Articles

Small Data Least-Squares Transformation (sd-LST) for Fast Calibration of SSVEP-Based BCIs.

Steady-state visual evoked potential (SSVEP) is one of the most popular brain-computer interface (BCI) paradigms, with high information transmission rate and signal-to-noise ratio. Many calibration-free and calibration-based approaches have been proposed to improve the performance of SSVEP-based BCIs. This paper considers a quick calibration scenario, where there are plenty of data from multiple source subjects, but only a small number of calibration trials from a subset of stimulus frequencies for the new subject. We propose small data least-squares transformation (sd-LST) to solve this problem. Experiments on three publicly available SSVEP datasets demonstrated that sd-LST outperformed several classical or state-of-the-art approaches, with only about 10 calibration trials for 40-target SSVEP-based BCI spellers.

Convolutional Correlation Analysis for Enhancing the Performance of SSVEP-Based Brain-Computer Interface.

Currently, most of the high-performance models for frequency recognition of steady-state visual evoked potentials (SSVEPs) are linear. However, SSVEPs collected from different channels can have non-linear relationship among each other. Linearly combining electroencephalogram (EEG) from multiple channels is not the most accurate solution in SSVEPs classification. To further improve the performance of SSVEP-based brain-computer interface (BCI), we propose a convolutional neural network-based non-linear model, i.e. convolutional correlation analysis (Conv-CA). Different from pure deep learning models, Conv-CA use convolutional neural networks (CNNs) at the top of a self-defined correlation layer. The CNNs function on how to transform multiple channel EEGs into a single EEG signal. The correlation layer calculates the correlation coefficients between the transformed single EEG signal and reference signals. The CNNs provide non-linear operations to combine EEGs in different channels and different time. And the correlation layer constrains the fitting space of the deep learning model. A comparison study between the proposed Conv-CA method and the task-related component analysis (TRCA) based methods is conducted. Both methods are validated on a 40-class SSVEP benchmark dataset recorded from 35 subjects. The study verifies that the Conv-CA method significantly outperforms the TRCA-based methods. Moreover, Conv-CA has good explainability since its inputs of the correlation layer can be analyzed for visualizing what the model learnt from the data. Conv-CA is a non-linear extension of spatial filters. Its CNN structures can be further explored and tuned for reaching a better performance. The structure of combining neural networks and unsupervised features has the potential to be applied to the classification of other signals.

Design of SSVEP Enhancement-Based Brain Computer Interface

Brain computer interface (BCI) system is a communication bridge between the brain and the external device, and it has been rapidly developed in the recent years. Here, steady state visually evoked potential (SSVEP) is one of the most frequently used control methods for BCI due to its advantages of low training requirement and high stability. However, some people present unobvious SSVEP feature at the location of the primary visual cortex, and this will reduce the performance of SSVEP-based BCIs. In this study, a novel field programmable gate array (FPGA)-based brain computer interface with SSVEP enhancement is proposed to improve the above issue. In the proposed system, a SSVEP-enhancement active dry electrode is designed to acquire good quality of electroencephalography (EEG) without conductive gels, and further enhance the local EEG signal. The experimental results show the proposed system can effectively improve the signal-to-noise ratio of SSVEP and the information transfer rate. Moreover, compared with the current SSVEP-based BCIs in the previous studies, the proposed BCI system contains the advantages of local EEG enhancement, wearablility, wireless transmission, front-end BCI translation, and it contains the potential of applying in many BCI applications in daily life.

The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli.

Steady-state visual evoked potential (SSVEP) is a periodic response to a repetitive visual stimulus at a specific frequency. Currently, SSVEP is widely treated as an attention tag in cognitive activities and is used as an input signal for brain–computer interfaces (BCIs). However, whether SSVEP can be used as a reliable indicator has been a controversial issue. We focused on the independence of SSVEP from frequency allocation and number of stimuli. First, a cue–target paradigm was adopted to examine the interaction between SSVEPs evoked by two stimuli with different frequency allocations under different attention conditions. Second, we explored whether signal strength and the performance of SSVEP-based BCIs were affected by the number of stimuli. The results revealed that no significant interaction of SSVEP responses appeared between attended and unattended stimuli under various frequency allocations, regardless of their appearance in the fundamental or second-order harmonic. The amplitude of SSVEP suffered no significant gain or loss under different numbers of stimuli, but the performance of SSVEP-based BCIs varied along with duration of stimuli; that is, the recognition rate was not affected by the number of stimuli when the duration of stimuli was long enough, while the information transfer rate (ITR) presented the opposite trend. It can be concluded that SSVEP is a reliable tool for marking and monitoring multiple stimuli simultaneously in cognitive studies, but much caution should be taken when choosing a suitable duration and the number of stimuli, in order to achieve optimal utility of BCIs in the future.

Enhancing performance of SSVEP-based BCI by unsupervised learning information from test trials.

Steady-State Visual Evoked Potentials (SSVEPs) have become one of the most used neural signals for brain- computer interfaces (BCIs) due to their stability and high signal- to-noise rate. However, the performance of SSVEP-based BCIs would degrade with a few training samples. This study was proposed to enhance the detection of SSVEP by combining the supervised learning information from training samples and the unsupervised learning information from the trial to be tested. A new method, i.e. cyclic shift trials (CST), was proposed to generate new calibration samples from the test data, which were furtherly used to create the templates and spatial filters of task- related component analysis (TRCA). The test-trial templates and spatial filters were combined with training-sample templates and spatial filters to recognize SSVEP. The proposed algorithm was tested on a benchmark dataset. As a result, it reached significantly higher classification accuracy than traditional TRCA when only two training samples were used. Speciflcally, the accuracy was improved by 9.5% for 0.7s data. Therefore, this study demonstrates CST is effective to improve the performance of SSVEP-BCI.

Stress-Induced Effects in Resting EEG Spectra Predict the Performance of SSVEP-Based BCI.

Most research in Brain-Computer-Interfaces (BCI) focuses on technologies to improve accuracy and speed. Little has been done on the effects of subject variability, both across individuals and within the same individual, on BCI performance. For example, stress, arousal, motivation, and fatigue can all affect the electroencephalogram (EEG) signals used by a BCI, which in turn impacts performance. Overcoming the impact of such user variability on BCI performance is an impending and inevitable challenge for routine applications of BCIs in the real world. To systematically explore the factors affecting BCI performance, this study embeds a Steady-State Visually Evoked Potential (SSVEP) based BCI into a "game with a purpose" (GWAP) to obtain data over significant lengths of time, under both high- and low-stress conditions. Ten healthy volunteers played a GWAP that resembles popular match-three games, such as Jewel Quest, Zoo Boom, or Candy Crush. We recorded the target search time, target search accuracy, and EEG signals during gameplay to investigate the impacts of stress on EEG signals and BCI performance. We used Canonical Correlation Analysis (CCA) to determine whether the subject had found and attended to the correct target. The experimental results show that SSVEP target-classification accuracy is reduced by stress. We also found a negative correlation between EEG spectra and the SNR of EEG in the frontal and occipital regions during gameplay, with a larger negative correlation for the high-stress conditions. Furthermore, CCA also showed that when the EEG alpha and theta power increased, the search accuracy decreased, and the spectral amplitude drop was more evident under the high-stress situation. These results provide new, valuable insights into research on how to improve the robustness of BCIs in real-world applications.

Decision-Making Selector (DMS) for Integrating CCA-Based Methods to Improve Performance of SSVEP-Based BCIs.

Recent research has demonstrated improved performance of a brain-computer interface (BCI) using fusion based approaches. This paper proposes a novel decision-making selector (DMS) to integrate classification decisions of different frequency recognition methods based on canonical correlation analysis (CCA) which were used in decoding steady state visual evoked potentials (SSVEPs). The DMS method selects a decision more likely to be correct from two methods namely as M1 and M2 by separating the M1-false and M2-false trials. To measure the uncertainty of each decision, feature vectors were extracted using the largest and second largest correlation coefficients corresponding to all the stimulus frequencies. The proposed method was evaluated by integrating all pairs of 7 CCA-based algorithms, including CCA, individual template-based CCA (ITCCA), multi-set CCA (MsetCCA), L1-regularized multi-way CCA (L1-MCCA), filter bank CCA (FBCCA), extended CCA (ECCA), and task-related component analysis (TRCA). The experimental results obtained from a 40-target dataset of thirty-five subjects showed that the proposed DMS method was validated to obtain an enhanced performance by integrating the algorithms with close accuracies. The results suggest that the proposed DMS method is effective in integrating decisions of different methods to improve the performance of SSVEP-based BCIs.

Enhancing performance of subject-specific models via subject-independent information for SSVEP-based BCIs.

Recently, brain-computer interface (BCI) systems developed based on steady-state visual evoked potential (SSVEP) have attracted much attention due to their high information transfer rate (ITR) and increasing number of targets. However, SSVEP-based methods can be improved in terms of their accuracy and target detection time. We propose a new method based on canonical correlation analysis (CCA) to integrate subject-specific models and subject-independent information and enhance BCI performance. We propose to use training data of other subjects to optimize hyperparameters for CCA-based model of a specific subject. An ensemble version of the proposed method is also developed for a fair comparison with ensemble task-related component analysis (TRCA). The proposed method is compared with TRCA and extended CCA methods. A publicly available, 35-subject SSVEP benchmark dataset is used for comparison studies and performance is quantified by classification accuracy and ITR. The ITR of the proposed method is higher than those of TRCA and extended CCA. The proposed method outperforms extended CCA in all conditions and TRCA for time windows greater than 0.3 s. The proposed method also outperforms TRCA when there are limited training blocks and electrodes. This study illustrates that adding subject-independent information to subject-specific models can improve performance of SSVEP-based BCIs.

Correction to "Correlated Component Analysis for Enhancing the Performance of SSVEP-Based Brain-Computer Interface".

In the above paper [1], a method has been proposed to use the correlated component analysis (CORCA) to learn spatial filters with multiple blocks of individual training data for steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) scenario. In order to evaluate the performance of CORCA, the task-related component analysis (TRCA)-based method was used as a baseline method [2]. For a fair and convincing comparison, the MATLAB codes on the website (https://github.com/mnakanishi/TRCA-SSVEP) for implementing TRCA method provided by Dr. Masaki Nakanishi, the first author of [2], were used to take the role of the TRCA method. At that time, the proposed CORCA-based method outperforms the TRCA-based method [1].

Semi-simulation Experiments for Quantifying the Performance of SSVEP-based BCI after Reducing Artifacts from Trapezius Muscles.

Muscular artifacts often contaminate electroencephalograms (EEGs) and deteriorate the performance of brain-computer interfaces (BCIs). Although many artifact reduction techniques are available, most of the studies have focused on their reduction ability (i.e. reconstruction errors), and it has been missing to evaluate their effect on the performance of BCIs. This study aims at evaluating the performance of a state-of-the-art muscular artifact reduction technique on a scenario of a steady-state visual evoked potentials (SSVEPs)based BCI. The performance was evaluated based on a semisimulation setting using a benchmark dataset of SSVEPs artificially contaminated by muscular artifacts acquired from the trapezius. Our results showed that combining the artifact reduction method and the classification algorithm based on the task-related component analysis gained improved classification accuracy. Interestingly, the artifact reduction setting minimizing the reconstruction errors, i.e. elaborately recovering the true EEG waveforms, was inconsistent to the one maximizing the classification performance. The results suggest that artifact reduction methods should be tuned so as to tomaximize performance of BCIs.

Correlated Component Analysis for Enhancing the Performance of SSVEP-Based Brain-Computer Interface.

A new method for steady-state visual evoked potentials (SSVEPs) frequency recognition is proposed to enhance the performance of SSVEP-based brain-computer interface (BCI). Correlated component analysis (CORCA) is introduced, which originally was designed to find linear combinations of electrodes that are consistent across subjects and maximally correlated between them. We propose a CORCA algorithm to learn spatial filters with multiple blocks of individual training data for SSVEP-based BCI scenario. The spatial filters are used to remove background noises by combining the multichannel electroencephalogram signals. We conduct a comparison between the proposed CORCA-based and the task-related component analysis (TRCA) based methods using a 40-class SSVEP benchmark data set recorded from 35 subjects. Our experimental study validates the efficiency of the CORCA-based method, and the extensive comparison results indicate that the CORCA-based method significantly outperforms the TRCA-based method. Superior performance demonstrates that the proposed method holds the promising potential to achieve satisfactory performance for SSVEP-based BCI with a large number of targets.

A new multivariate empirical mode decomposition method for improving the performance of SSVEP-based brain–computer interface

Objective. Accurate and efficient detection of steady-state visual evoked potentials (SSVEP) in electroencephalogram (EEG) is essential for the related brain–computer interface (BCI) applications. Approach. Although the canonical correlation analysis (CCA) has been applied extensively and successfully to SSVEP recognition, the spontaneous EEG activities and artifacts that often occur during data recording can deteriorate the recognition performance. Therefore, it is meaningful to extract a few frequency sub-bands of interest to avoid or reduce the influence of unrelated brain activity and artifacts. This paper presents an improved method to detect the frequency component associated with SSVEP using multivariate empirical mode decomposition (MEMD) and CCA (MEMD-CCA). EEG signals from nine healthy volunteers were recorded to evaluate the performance of the proposed method for SSVEP recognition. Main results. We compared our method with CCA and temporally local multivariate synchronization index (TMSI). The results suggest that the MEMD-CCA achieved significantly higher accuracy in contrast to standard CCA and TMSI. It gave the improvements of 1.34%, 3.11%, 3.33%, 10.45%, 15.78%, 18.45%, 15.00% and 14.22% on average over CCA at time windows from 0.5 s to 5 s and 0.55%, 1.56%, 7.78%, 14.67%, 13.67%, 7.33% and 7.78% over TMSI from 0.75 s to 5 s. The method outperformed the filter-based decomposition (FB), empirical mode decomposition (EMD) and wavelet decomposition (WT) based CCA for SSVEP recognition. Significance. The results demonstrate the ability of our proposed MEMD-CCA to improve the performance of SSVEP-based BCI.

BCI Demographics II: How Many (and What Kinds of) People Can Use a High-Frequency SSVEP BCI?

Brain-computer interface (BCI) systems use brain activity as an input signal and enable communication without movement. This study is a successor of our previous study (BCI demographics I) and examines correlations among BCI performance, personal preferences, and different subject factors such as age or gender for two sets of steady-state visual evoked potential (SSVEP) stimuli: one in the medium frequency range (13, 14, 15 and 16 Hz) and another in the high-frequency range (34, 36, 38, 40 Hz). High-frequency SSVEPs (above 30 Hz) diminish user fatigue and risk of photosensitive epileptic seizures. Results showed that most people, despite having no prior BCI experience, could use the SSVEP-based Bremen-BCI system in a very noisy field setting at a fair. Results showed that demographic parameters as well as handedness, tiredness, alcohol and caffeine consumption, etc., have no significant effect on the performance of SSVEP-based BCI. Most subjects did not consider the flickering stimuli annoying, only five out of total 86 participants indicated change in fatigue during the experiment. 84 subjects performed with a mean information transfer rate of 17.24 ±6.99 bit/min and an accuracy of 92.26 ±7.82% with the medium frequency set, whereas only 56 subjects performed with a mean information transfer rate of 12.10 ±7.31 bit/min and accuracy of 89.16 ±9.29% with the high-frequency set. These and other demographic analyses may help identify the best BCI for each user.