Steady-state Visual Evoked Potential Signals Research Articles

Frequency-dependent dynamics of steady-state visual evoked potentials under sustained flicker stimulation

Steady-state visual evoked potentials (SSVEP) are electroencephalographic signals elicited when the brain is exposed to a visual stimulus with a steady frequency. We analyzed the temporal dynamics of SSVEP during sustained flicker stimulation at 5, 10, 15, 20 and 40 Hz. We found that the amplitudes of the responses were not stable over time. For a 5 Hz stimulus, the responses progressively increased, while, for higher flicker frequencies, the amplitude increased during the first few seconds and often showed a continuous decline afterward. We hypothesize that these two distinct sets of frequency-dependent SSVEP signal properties reflect the contribution of parvocellular and magnocellular visual pathways generating sustained and transient responses, respectively. These results may have important applications for SSVEP signals used in research and brain-computer interface technology and may contribute to a better understanding of the frequency-dependent temporal mechanisms involved in the processing of prolonged periodic visual stimuli.

A fused multi-subfrequency bands and CBAM SSVEP-BCI classification method based on convolutional neural network.

For the brain-computer interface (BCI) system based on steady-state visual evoked potential (SSVEP), it is difficult to obtain satisfactory classification performance for short-time window SSVEP signals by traditional methods. In this paper, a fused multi-subfrequency bands and convolutional block attention module (CBAM) classification method based on convolutional neural network (CBAM-CNN) is proposed for discerning SSVEP-BCI tasks. This method extracts multi-subfrequency bands SSVEP signals as the initial input of the network model, and then carries out feature fusion on all feature inputs. In addition, CBAM is embedded in both parts of the initial input and feature fusion for adaptive feature refinement. To verify the effectiveness of the proposed method, this study uses the datasets of Inner Mongolia University of Technology (IMUT) and Tsinghua University (THU) to evaluate the performance of the proposed method. The experimental results show that the highest accuracy of CBAM-CNN reaches 0.9813 percentage point (pp). Within 0.1-2s time window, the accuracy of CBAM-CNN is 0.0201-0.5388 (pp) higher than that of CNN, CCA-CWT-SVM, CCA-SVM, CCA-GNB, FBCCA, and CCA. Especially in the short-time window range of 0.1-1s, the performance advantage of CBAM-CNN is more significant. The maximum information transmission rate (ITR) of CBAM-CNN is 503.87bit/min, which is 227.53bit/min-503.41bit/min higher than the above six EEG decoding methods. The study further results show that CBAM-CNN has potential application value in SSVEP decoding.

Impact of adaptive filtering-based component analysis method on steady-state visual evoked potential based brain computer interface systems

<span lang="EN-US">The significance of brain computer interface (BCI) systems is immensely high, especially for disabled people and patients with nervous system failure. Therefore, in this study, adaptive filtering-based component analysis (AFCA) model is presented to enhance target box identification efficiency at varied flickering frequencies in a visual stimulation process by efficient acquisition of electroencephalogram (EEG) signals for the application of steady-state visually evoked potential based BCI system. Furthermore, optimization of proposed AFCA model is performed based on the maximized reproducibility of correlated components. A multimedia authoring and management using your eyes and mind (MAMEM) steady-state visual evoked potential (SSVEP) dataset is utilized for efficient training of EEG signals and background entities are eliminated using adaptive filters in a pre-processing stage. Additionally, spatial filtering components are obtained to detect target flickering box based on the obtained quality features. Performance is measured by acquisition of SSVEP signals in terms of reconstruction efficiency, classification accuracy and information transfer rate (ITR) using proposed AFCA model. Mean classification accuracy for all 11 subject is 93.48% and ITR is 308.23 bpm. Further, classification accuracy is relatively higher than various SSVEP classification algorithms.</span>

Multi-frequency steady-state visual evoked potential dataset

The Steady-State Visual Evoked Potential (SSVEP) is a widely used modality in Brain-Computer Interfaces (BCIs). Existing research has demonstrated the capabilities of SSVEP that use single frequencies for each target in various applications with relatively small numbers of commands required in the BCI. Multi-frequency SSVEP has been developed to extend the capability of single-frequency SSVEP to tasks that involve large numbers of commands. However, the development on multi-frequency SSVEP methodologies is falling behind compared to the number of studies with single-frequency SSVEP. This dataset was constructed to promote research in multi-frequency SSVEP by making SSVEP signals collected with different frequency stimulation settings publicly available. In this dataset, SSVEPs were collected from 35 participants using single-, dual-, and tri-frequency stimulation and with three different multi-frequency stimulation variants.

A Time-Local Weighted Transformation Recognition Framework for Steady State Visual Evoked Potentials Based Brain-Computer Interfaces.

Canonical correlation analysis (CCA), Multivariate synchronization index (MSI), and their extended methods have been widely used for target recognition in Brain-computer interfaces (BCIs) based on Steady State Visual Evoked Potentials (SSVEP), and covariance calculation is an important process for these algorithms. Some studies have proved that embedding time-local information into the covariance can optimize the recognition effect of the above algorithms. However, the optimization effect can only be observed from the recognition results and the improvement principle of time-local information cannot be explained. Therefore, we propose a time-local weighted transformation (TT) recognition framework that directly embeds the time-local information into the electroencephalography signal through weighted transformation. The influence mechanism of time-local information on the SSVEP signal can then be observed in the frequency domain. Low-frequency noise is suppressed on the premise of sacrificing part of the SSVEP fundamental frequency energy, the harmonic energy of SSVEP is enhanced at the cost of introducing a small amount of high-frequency noise. The experimental results show that the TT recognition framework can significantly improve the recognition ability of the algorithms and the separability of extracted features. Its enhancement effect is significantly better than the traditional time-local covariance extraction method, which has enormous application potential.

Hybrid Brain-Computer Interface Controlled Soft Robotic Glove for Stroke Rehabilitation.

Soft robotic glove controlled by a brain-computer interface (BCI) have demonstrated effectiveness in hand rehabilitation for stroke patients. Current systems mostly rely on static visual representations for patients to perform motor imagination (MI) tasks, resulting in lower BCI performance. Therefore, this study innovatively used MI and high-frequency steady-state visual evoked potential (SSVEP) to construct a friendly and natural hybrid BCI paradigm. Specifically, the stimulation interface sequentially presented decomposed action pictures of the left and right hands gripping a ball, with the pictures flashing at specific stimulation frequencies (left: 34 Hz, right: 35 Hz). Integrating soft robotic glove as feedback, we established a comprehensive "peripheral - central - peripheral" hand rehabilitation system to facilitate the hand rehabilitation of patients. Filter bank common spatial pattern (FBCSP) and filter bank canonical correlation analysis (FBCCA) algorithms were used to identify MI and SSVEP signals, respectively. Additionally, to fuse the features of these two signals, we proposed a novel fusion algorithm for improving the recognition accuracy of the system. The feasibility of the proposed system was validated through online experiments involving 12 healthy subjects and 9 stroke patients, achieving accuracy rates of 95.83 ± 6.83% and 63.33 ± 10.38%, respectively. The accuracy of MI and SSVEP in 12 healthy subjects reached 81.67 ± 15.63% and 95.14 ± 7.47%, both lower than the accuracy after fusion, these results confirmed the effectiveness of the proposed algorithm. The accuracy rate was more than 50% in both healthy subjects and patients, confirming the effectiveness of the proposed system.

Filter bank second-order underdamped stochastic resonance analysis for implementing a short-term high-speed SSVEP detection

ObjectiveThe progression of brain-computer interfaces (BCIs) has been propelled by breakthroughs in neuroscience, signal processing, and machine learning, marking it as a dynamic field of study over the past few decades. Nevertheless, the nonlinear and non-stationary characteristics of steady-state visual evoked potentials (SSVEPs), coupled with the incongruity between frequently employed linear techniques and nonlinear signal attributes, resulted in the subpar performance of mainstream non-training algorithms like canonical correlation analysis (CCA), multivariate synchronization index (MSI), and filter bank CCA (FBCCA) in short-term SSVEP detection. MethodsTo tackle this problem, the novel fusions of common filter bank analysis, CCA dimensionality reduction methods, USSR models, and MSI recognition models are used in SSVEP signal recognition. ResultsUnlike conventional linear techniques such as CCA, MSI, and FBCCA, the filter bank second-order underdamped stochastic resonance (FBUSSR) analysis demonstrates superior efficacy in the detection of short-term high-speed SSVEPs. ConclusionThis research enlists 32 subjects and uses a public dataset to assess the proposed approach, and the experimental outcomes indicate that the non-training method can attain greater recognition precision and stability. Furthermore, under the conditions of the newly proposed fusion method and light stimulation, the USSR model exhibits the most optimal enhancement effect. SignificanceThe findings of this study underscore the expansive potential for the application of BCI systems in the realm of neuroscience and signal processing.

Enhancing multi-class SSVEP classification performance using regularized covariance estimators, spatiotemporal beamforming, and short-time EEG trials

One of the main challenges in BCI technologies is the problem of poor information transfer rate (ITR) of BCI systems and its effect on reducing the commands users can give. At the state of the art, the Linearly Constrained Minimum Variance (LCMV) beamformer is one of the most effective strategies that can provide satisfactory performance in the analysis of steady-state visual evoked potentials (SSVEP). When only a short-period SSVEP signal is available, a poor estimate of the covariance matrix used in the original LCMV method is obtained. Therefore, the main drawback of the conventional LCMV beamformer and its spatiotemporal form (LCMVst) is that they require a long-period SSVEP signal to achieve a reliable estimate for the beamformer weights. To cope with the mentioned problems, this paper presents two types of regularized estimators to achieve a robust estimate for the covariance matrix when only a short-period SSVEP signal is available. These two types, which are user-independent, include the convex combination (CC) and general linear combination (GLC) methods. In the next step, in order to provide suitable beamformer weights, the CC and GLC covariance estimators are combined with the original LCMVst beamformer. Furthermore, two new subject-based electrode selection algorithms, i.e., sequential forward electrode selection (SFES) algorithm and common spatial pattern (CSP) based technique, are applied to pick out the best collection of electrodes and to maximize the classification accuracy. The introduced methods were assessed using a four-class SSVEP dataset recorded on 20 subjects. Experimental results indicate that the proposed estimators optimally classify SSVEPs by estimating proper beamformer weights. The proposed LCMVst-CC and LCMVst-GLC beamformers improved the average classification accuracy by about 27.75% in comparison to the original LCMV-based beamformer at the 0.25-second segment length. Using SSVEP stimulations, we show that our proposed beamformers offer a better classification performance than the conventional LCMV-based spatiotemporal beamformer for all stimulation times.

A hybrid BCI combining SSVEP and EOG and its application for continuous wheelchair control

Brain-computer interfaces (BCIs) have emerged as one of the most promising techniques for individuals with motor disabilities to control external devices directly without peripheral pathways. While the discrete control strategy is widely adopted in BCI systems, the continuous control strategy provides intuitive and fluent control of robotic devices. However, the steady-state visual evoked potential (SSVEP)-based BCI is still far from practical applications of continuous control. One of the existing challenges is the long erroneous transition time, i.e., the duration from when the subject switches towards a new target to when the BCI system recognizes this new target. Therefore, this study proposed a hybrid BCI combining SSVEP and electrooculography (EOG). First, the prior probability distribution of the intended target was obtained by the SSVEP detection method. Different from directly picking the one with the maximum probability as the conventional SSVEP-based BCI did, the captured saccade event in the EOG signal served as an additional event to optimize this probability distribution, and the target was then extrapolated and outputted. An offline experiment simulating the target switching process and an online experiment of virtual wheelchair control were designed and conducted. The proposed hybrid BCI significantly outperformed the conventional SSVEP-based BCI in both the offline experiment (continuous accuracy:64.99 ± 3.44 % vs. 55.76 ± 3.67 %, transition time: 1.19 ± 0.073 s vs. 1.65 ± 0.08 s) and the online wheelchair control experiment (success rate: 81.67 ± 5.75 % vs. 16.67 %± 3.76 %; collision times with the dynamic obstacle: 1.50 ± 0.50 vs. 8.25 ± 0.37; minimum distance to dynamic obstacle: 1.41 ± 0.13 m vs. 0.31 ± 0.08 m). The results revealed that by combining the SSVEP and EOG signals, the proposed hybrid BCI can significantly diminish the transition time in SSVEP-based BCI and achieve continuous, fluent control. The present study provides a novel framework for integrating the SSVEP and EOG, and promotes the potential applications of continuous brain-actuated robotic devices.

Combining biosignals with RFID to develop a multimodal-shared control interface

The paper presents an approach to develop assistive devices by combining multimodal biosignals and radio frequency identification (RFID). The brain and eye signals have been used as multimodal biosignals to control the movement of a robot in four directions and help reach near the object following a predefined path. RFID shared control over object identification, and the gripper arm connected at the end effector of the robot performs pick and place operations. Horizontal electrooculography (EOG) has been used for x-directional movement control and electroencephalography (EEG) signal obtained by visual stimulus, called steady-state visual-evoked potential (SSVEP) has been used for y-directional movement control of a robot. The SSVEP signal has also been used to ring an alarm in case of an emergency call by the user. Two parameters classification accuracy (CA) and information transfer rate (ITR) have been calculated for the performance evaluation of the proposed multimodal-shared control model and have shown improved results as compared to previous literature. The results also proved that the proposed model can be used for real-time mobility assistive applications.

SSVEP unsupervised adaptive feature recognition method based on self-similarity of same-frequency signals.

As an important human-computer interaction technology, steady-state visual evoked potential (SSVEP) plays a key role in the application of brain computer interface (BCI) systems by accurately decoding SSVEP signals. Currently, the majority SSVEP feature recognition methods use a static classifier. However, electroencephalogram (EEG) signals are non-stationary and time-varying. Hence, an adaptive classification method would be an alternative option to a static classifier for tracking the changes in EEG feature distribution, as its parameters can be re-estimated and updated with the input of new EEG data. In this study, an unsupervised adaptive classification algorithm is designed based on the self-similarity of same-frequency signals. The proposed classification algorithm saves the EEG data that has undergone feature recognition as a template signal in accordance with its estimated label, and the new testing signal is superimposed with the template signals at each stimulus frequency as the new test signals to be analyzed. With the continuous input of EEG data, the template signals are continuously updated. By comparing the classification accuracy of the original testing signal and the testing signal superimposed with the template signals, this study demonstrates the effectiveness of using the self-similarity of same-frequency signals in the adaptive classification algorithm. The experimental results also show that the longer the SSVEP-BCI system is used, the better the responses of users on SSVEP are, and the more significantly the adaptive classification algorithm performs in terms of feature recognition. The testing results of two public datasets show that the adaptive classification algorithm outperforms the static classification method in terms of feature recognition. The proposed adaptive classification algorithm can update the parameters with the input of new EEG data, which is of favorable impact for the accurate analysis of EEG data with time-varying characteristics.

EEG measurement for the effect of perceptual eye position and eye position training on comitant strabismus.

One of the clinical features of comitant strabismus is that the deviation angles in the first and second eye positions are equal. However, there has been no report of consistency in the electroencephalography (EEG) signals between the 2 positions. In order to address this issue, we developed a new paradigm based on perceptual eye position. We collected steady-state visual evoked potentials (SSVEPs) signals and resting-state EEG data before and after the eye position training. We found that SSVEP signals could characterize the suppression effect and eye position effect of comitant strabismus, that is, the SSVEP response of the dominant eye was stronger than that of the strabismus eye in the first eye position but not in the second eye position. Perceptual eye position training could modulate the frequency band activities in the occipital and surrounding areas. The changes in the visual function of comitant strabismus after training could also be characterized by SSVEP. There was a correlation between intermodulation frequency, power of parietal electrodes, and perceptual eye position, indicating that EEG might be a potential indicator for evaluating strabismus visual function.

Laplacian reference is optimal for steady-state visual-evoked potentials.

Steady-state visual-evoked potentials (SSVEPs) are widely used in human neuroscience studies and applications such as brain-computer interfaces (BCIs). Surprisingly, no previous study has systematically evaluated different reference methods for SSVEP analysis, despite that signal reference is crucial for the proper assessment of neural activities. In the present study, using four datasets from our previous SSVEP studies (Chen J, Valsecchi M, Gegenfurtner KR. J Neurophysiol 118: 749-754, 2017; Chen J, Valsecchi M, Gegenfurtner KR. Neuropsychologia 102: 206-216, 2017; Chen J, McManus M, Valsecchi M, Harris LR, Gegenfurtner KR. J Vis 19: 8, 2019) and three public datasets from other studies (Baker DH, Vilidaite G, Wade AR. PLoS Comput Biol 17: e1009507, 2021; Lygo FA, Richard B, Wade AR, Morland AB, Baker DH. NeuroImage 230: 117780, 2021; Vilidaite G, Norcia AM, West RJH, Elliott CJH, Pei F, Wade AR, Baker DH. Proc R Soc B 285: 20182255, 2018), we compared four reference methods: monopolar reference, common average reference, averaged-mastoids reference, and Laplacian reference. The quality of the resulting SSVEP signals was compared in terms of both signal-to-noise ratios (SNRs) and reliability. The results showed that Laplacian reference, which uses signals at the maximally activated electrode after subtracting the average of the nearby electrodes to reduce common noise, gave rise to the highest SNRs. Furthermore, the Laplacian reference resulted in SSVEP signals that were highly reliable across recording sessions or trials. These results suggest that Laplacian reference is optimal for SSVEP studies and applications. Laplacian reference is especially advantageous for SSVEP experiments where short preparation time is preferred as it requires only data from the maximally activated electrode and a few surrounding electrodes.NEW & NOTEWORTHY The present study provides a comprehensive evaluation of the use of different reference methods for steady-state visual-evoked potentials (SSVEPs) and has found that Laplacian reference increases signal-to-noise ratios (SNRs) and enhances reliabilities of SSVEP signals. Thus, the results suggest that Laplacian reference is optimal for SSVEP analysis.

Using Determinant Point Process in Generative Adversarial Networks for SSVEP Signals Synthesis.

Steady-state visual evoked potential (SSVEP) is one of the main paradigms of brain-computer interface (BCI). However, the acquisition method of SSVEP can cause subject fatigue and discomfort, leading to the insufficiency of SSVEP databases. Inspired by generative determinantal point process (GDPP), we utilize the determinantal point process in generative adversarial network (GAN) to generate SSVEP signals. We investigate the ability of the method to synthesize signals from the Benchmark dataset. We further use some evaluation metrics to verify its validity. Results prove that the usage of this method significantly improved the authenticity of generated data and the accuracy (97.636%) of classification using deep learning in SSVEP data augmentation.

TRCA-Net: using TRCA filters to boost the SSVEP classification with convolutional neural network

Objective. The steady-state visual evoked potential (SSVEP)-based brain–computer interface has received extensive attention in research due to its simple system, less training data, and high information transfer rate. There are currently two prominent methods dominating the classification of SSVEP signals. One is the knowledge-based task-related component analysis (TRCA) method, whose core idea is to find the spatial filters by maximizing the inter-trial covariance. The other is the deep learning-based approach, which directly learns a classification model from data. However, how to integrate the two methods to achieve better performance has not been studied before. Approach. In this study, we develop a novel algorithm named TRCA-Net (TRCA-Net) to enhance SSVEP signal classification, which enjoys the advantages of both the knowledge-based method and the deep model. Specifically, the proposed TRCA-Net first performs TRCA to obtain spatial filters, which extract task-related components of data. Then the TRCA-filtered features from different filters are rearranged as new multi-channel signals for a deep convolutional neural network (CNN) for classification. Introducing the TRCA filters to a deep learning-based approach improves the signal-to-noise ratio of input data, hence benefiting the deep learning model. Main results. We evaluate the performance of TRCA-Net using two publicly available large-scale benchmark datasets, and the results demonstrate the effectiveness of TRCA-Net. Additionally, offline and online experiments separately testing ten and five subjects further validate the robustness of TRCA-Net. Further, we conduct ablation studies on different CNN backbones and demonstrate that our approach can be transplanted into other CNN models to boost their performance. Significance. The proposed approach is believed to have a promising potential for SSVEP classification and promote its practical applications in communication and control. The code is available at https://github.com/Sungden/TRCA-Net.

Decoding emotion from high-frequency steady state visual evoked potential (SSVEP)

BackgroundSteady-state visual evoked potential (SSVEP) by flickering sensory stimuli has been widely applied in the brain-machine interface (BMI). Yet, it remains largely unexplored whether affective information could be decoded from the signal of SSVEP, especially from the frequencies higher than the critical flicker frequency (an upper-frequency limit one can see the flicker). New MethodParticipants fixated on visual stimuli presented at 60 Hz above the critical flicker frequency. The stimuli were pictures with different affective valance (positive, neutral, negative) in distinctive semantic categories (human, animal, scene). SSVEP entrainment in the brain evoked by the flickering stimuli at 60 Hz was used to decode the affective and semantic information. ResultsDuring the presentation of stimuli (1 s), the affective valance could be decoded from the SSVEP signals at 60 Hz, while the semantic categories could not. In contrast, neither affective nor semantic information could be decoded from the brain signal one second before the onset of stimuli. Comparison with Existing Method(s)Previous studies focused mainly on EEG activity tagged at frequencies lower than the critical flickering frequency and investigated whether the affective valence of stimuli drew participants’ attention. The current study was the first to use SSVEP signals from high-frequency (60 Hz) above the critical flickering frequency to decode affective information from stimuli. The high-frequency flickering was invisible and thus substantially reduced the fatigue of participants. ConclusionsWe found that affective information could be decoded from high-frequency SSVEP and the current finding could be added to designing affective BMI in the future.

A Methodology for Enhancing SSVEP Features Using Adaptive Filtering Based on the Spatial Distribution of EEG Signals.

In this paper, we propose a classification algorithm of EEG signal based on canonical correlation analysis (CCA) and integrated with adaptive filtering. It can enhance the detection of steady-state visual evoked potentials (SSVEPs) in a brain-computer interface (BCI) speller. An adaptive filter is employed in front of the CCA algorithm to improve the signal-to-noise ratio (SNR) of SSVEP signals by removing background electroencephalographic (EEG) activities. The ensemble method is developed to integrate recursive least squares (RLS) adaptive filter corresponding to multiple stimulation frequencies. The method is tested by the SSVEP signal recorded from six targets by actual experiment and the EEG in a public SSVEP dataset of 40 targets from Tsinghua University. The accuracy rates of the CCA method and the CCA-based integrated RLS filter algorithm (RLS-CCA method) are compared. Experiment results show that the proposed RLS-CCA-based method significantly improves the classification accuracy compared with the pure CCA method. Especially when the number of EEG leads is low (three occipital electrodes and five non occipital electrodes), its advantage is more significant, and accuracy reaches 91.23%, which is more suitable for wearable environments where high-density EEG is not easy to collect.

Classification of SSVEP signals using the combined FoCCA-KNN method and comparison with other machine learning methods

Brain–computer interfaces (BCI) can be used to decode brain activity and extract commands to control external devices. The inherent complexity of brain signals and the interconnectedness of the information processing steps of these signals have created a sense of the need to use machine learning methods and identify the appropriate pattern to increase the accuracy of the results. In this paper, a new classification approach, which combines the extraction of steady-state visual evoked potentials (SSVEP) signal properties using the Fusing Canonical Coefficients (FoCCA) method and machine learning algorithms, is proposed to increase the accuracy of SSVEP signal classification. This approach, which uses the FoCCA algorithm or other existing algorithms as a feature extractor, is considered a new approach in the processing of brain signals. The results obtained from Support vector machines (SVM), K-Nearest Neighbor (KNN), and Decision Tree algorithms are also compared with each other and has studied and compared to the existing statistical methods. Using the FoCCA method will help us to extract and select the appropriate features to present to the machine learning algorithm and classify the signals, and the application of machine learning algorithms will play an effective role in increasing the classification accuracy.

A hybrid P300-SSVEP brain-computer interface speller with a frequency enhanced row and column paradigm.

This study proposes a new hybrid brain-computer interface (BCI) system to improve spelling accuracy and speed by stimulating P300 and steady-state visually evoked potential (SSVEP) in electroencephalography (EEG) signals. A frequency enhanced row and column (FERC) paradigm is proposed to incorporate the frequency coding into the row and column (RC) paradigm so that the P300 and SSVEP signals can be evoked simultaneously. A flicker (white-black) with a specific frequency from 6.0 to 11.5 Hz with an interval of 0.5 Hz is assigned to one row or column of a 6 × 6 layout, and the row/column flashes are carried out in a pseudorandom sequence. A wavelet and support vector machine (SVM) combination is adopted for P300 detection, an ensemble task-related component analysis (TRCA) method is used for SSVEP detection, and the two detection possibilities are fused using a weight control approach. The implemented BCI speller achieved an accuracy of 94.29% and an information transfer rate (ITR) of 28.64 bit/min averaged across 10 subjects during the online tests. An accuracy of 96.86% is obtained during the offline calibration tests, higher than that of only using P300 (75.29%) or SSVEP (89.13%). The SVM in P300 outperformed the previous linear discrimination classifier and its variants (61.90-72.22%), and the ensemble TRCA in SSVEP outperformed the canonical correlation analysis method (73.33%). The proposed hybrid FERC stimulus paradigm can improve the performance of the speller compared with the classical single stimulus paradigm. The implemented speller can achieve comparable accuracy and ITR to its state-of-the-art counterparts with advanced detection algorithms.

An Analysis of Deep Learning Models in SSVEP-Based BCI: A Survey.

The brain-computer interface (BCI), which provides a new way for humans to directly communicate with robots without the involvement of the peripheral nervous system, has recently attracted much attention. Among all the BCI paradigms, BCIs based on steady-state visual evoked potentials (SSVEPs) have the highest information transfer rate (ITR) and the shortest training time. Meanwhile, deep learning has provided an effective and feasible solution for solving complex classification problems in many fields, and many researchers have started to apply deep learning to classify SSVEP signals. However, the designs of deep learning models vary drastically. There are many hyper-parameters that influence the performance of the model in an unpredictable way. This study surveyed 31 deep learning models (2011-2023) that were used to classify SSVEP signals and analyzed their design aspects including model input, model structure, performance measure, etc. Most of the studies that were surveyed in this paper were published in 2021 and 2022. This survey is an up-to-date design guide for researchers who are interested in using deep learning models to classify SSVEP signals.