Steady-state Motion Visual Evoked Potential Research Articles

Performance of the Action Observation-Based Brain-Computer Interface in Stroke Patients and Gaze Metrics Analysis.

Brain-computer interfaces (BCIs) are anticipated to improve the efficacy of rehabilitation for people with motor disabilities. However, applying BCI in clinical practice is still a challenge due to the great diversity of patients. In the current study, a novel action observation (AO) based BCI was proposed and tested on stroke patients. Ten non-hemineglect patients and ten hemineglect patients were recruited. Four AO stimuli were designed, each presenting a decomposed action to complete the reach-and-grasp task. EEG data and eye movement data were collected. Eye movement data was utilized to analyze the reasons for individual differences in BCI performance. Task discriminative component analysis was utilized to perform online target detection. The results showed that the designed AO-based BCI could simultaneously induce steady state motion visual evoked potential (SSMVEP) from the occipital region and sensory motor rhythm from the sensorimotor region in stroke patients. The average online detection accuracy among the four AO stimuli reached 67% within 3 s in the non-hemineglect group, while the accuracy only reached 35% in the hemineglect group. Gaze metrics showed that the average total duration of fixations during the stimulus phase in the hemineglect group was only 1.31 s ± 0.532 s which was significantly lower than that in the non-hemineglect group. The results indicated that hemineglect patients have difficulty gazing at the AO stimulus, resulting in poor detection performance and weak desynchronization in the sensorimotor region. Furthermore, the degree of neglect is inversely proportional to the target detection accuracy in hemineglect stroke patients. In addition, the gaze metrics associated with cognitive load were significantly correlated with the accuracy in non-hemineglect patients. It indicated the cognitive load may affect the AO-based BCI. The current study will expedite the clinical application of AO-based BCI.

A novel multiple time-frequency sequential coding strategy for hybrid brain-computer interface.

BackgroundFor brain-computer interface (BCI) communication, electroencephalography provides a preferable choice due to its high temporal resolution and portability over other neural recording techniques. However, current BCIs are unable to sufficiently use the information from time and frequency domains simultaneously. Thus, we proposed a novel hybrid time-frequency paradigm to investigate better ways of using the time and frequency information.MethodWe adopt multiple omitted stimulus potential (OSP) and steady-state motion visual evoked potential (SSMVEP) to design the hybrid paradigm. A series of pre-experiments were undertaken to study factors that would influence the feasibility of the hybrid paradigm and the interaction between multiple features. After that, a novel Multiple Time-Frequencies Sequential Coding (MTFSC) strategy was introduced and explored in experiments.ResultsOmissions with multiple short and long durations could effectively elicit time and frequency features, including the multi-OSP, ERP, and SSVEP in this hybrid paradigm. The MTFSC was feasible and efficient. The preliminary online analysis showed that the accuracy and the ITR of the nine-target stimulator over thirteen subjects were 89.04% and 36.37 bits/min.SignificanceThis study first combined the SSMVEP and multi-OSP in a hybrid paradigm to produce robust and abundant time features for coding BCI. Meanwhile, the MTFSC proved feasible and showed great potential in improving performance, such as expanding the number of BCI targets by better using time information in specific stimulated frequencies. This study holds promise for designing better BCI systems with a novel coding method.

DF-SSmVEP: Dual Frequency Aggregated Steady-State Motion Visual Evoked Potential Design with Bifold Canonical Correlation Analysis.

Recent advancements in Electroencephalographic (EEG) sensor technologies and signal processing algorithms have paved the way for further evolution of Brain Computer Interfaces (BCI) in several practical applications, ranging from rehabilitation systems to smart consumer technologies. When it comes to Signal Processing (SP) for BCI, there has been a surge of interest on Steady-State motion Visual Evoked Potentials (SSmVEP), where motion stimulation is used to address key issues associated with conventional light flashing/flickering. Such benefits, however, come with the price of being less accurate and having a lower Information Transfer Rate (ITR). From this perspective, this paper focuses on the design of a novel SSmVEP paradigm without using resources such as trial time, phase, and/or number of targets to enhance the ITR. The proposed design is based on the intuitively pleasing idea of integrating more than one motion within a single SSmVEP target stimuli, simultaneously. To elicit SSmVEP, we designed a novel and innovative dual frequency aggregated modulation paradigm, called the Dual Frequency Aggregated Steady-State motion Visual Evoked Potential (DF-SSmVEP), by concurrently integrating “Radial Zoom” and “Rotation” motions in a single target without increasing the trial length. Compared to conventional SSmVEPs, the proposed DF-SSmVEP framework consists of two motion modes integrated and shown simultaneously each modulated by a specific target frequency. The paper also develops a specific unsupervised classification model, referred to as the Bifold Canonical Correlation Analysis (BCCA), based on two motion frequencies per target. The corresponding covariance coefficients are used as extra features improving the classification accuracy. The proposed DF-SSmVEP is evaluated based on a real EEG dataset and the results corroborate its superiority. The proposed DF-SSmVEP outperforms its counterparts and achieved an average ITR of 30.7 ± 1.97 and an average accuracy of 92.5 ± 2.04, while the Radial Zoom and Rotation result in average ITRs of 18.35 ± 1 and 20.52 ± 2.5, and average accuracies of 68.12 ± 3.5 and 77.5 ± 3.5, respectively.

Statistical Evaluation of Factors Influencing Inter-Session and Inter-Subject Variability in EEG-Based Brain Computer Interface

A cognitive alteration in the form of diverse mental states has a significant impact on the performance of electroencephalography (EEG) based brain computer interface (BCI). Such alterations include change in concentration levels commonly recognized as being indicated by the alpha rhythm, drowsiness or mental fatigue which occurs during EEG signal acquisition. Change in mental state give rise to a challenge of variability in EEG characteristics across sessions and subjects. Consequently, this variability constitutes to low intention detection rate (IDR) that renders BCI performance unreliable. This study investigates the impact of multiple factors that lead to the poor performance of the EEG-BCI. Five factors (i) concentration level, (ii) selection of independent components(IC), (iii) inter-session variability, (iv) inter-subject variability, and (v) classification methods on the IDR in EEG based BCI. The alpha rhythm, as the indicator of concentration level, is validated, and the relationship between the alpha rhythm and the IDR is studied among sessions. In addition, ICs are examined to determine their effects on the IDR across sessions. The possibility of two sessions to contain similar EEG characteristics is also examined, where both sessions are acquired from the same subject in different days. Moreover, the possibility of two different subjects to containing similar EEG characteristics is examined. Furthermore, to conquer the challenge of variability in EEG dynamics a feature transfer learning (TL) approach is proposed in this study. Furthermore, three classification methods (TL, KNN and NB) are examined and compared to determine whether multi-source neural information can improve the classification accuracy of individual sessions or subjects. Three EEG datasets acquired using different paradigms are used for experiments. The datasets include steady state motion visual evoked potential (SSMVEP), motor imagery (MI) and BCI competition IV-a dataset. Experimental results have shown that selection of independent components has an effect on the IDR. In this case IC-2 and IC-11 achieved a lowest and highest accuracies of 51% and 100% for SSMVEP datasets, while IC-9 and the double-component (IC-2 and IC-13) achieved a lowest and highest accuracies of 40% and 69% for MI datasets respectively. The second experiment demonstrated that higher alpha rhythm, depicted by a lower IDR corresponds to a lower concentration level. While a lower alpha rhythm depicted by a higher IDR corresponds to a higher concentration level. Moreover, variability within sessions can significantly deteriorate intention detection rate across sessions. As such a decline in accuracy from 82% to 61%, and from 56% to 44% was observed across both SSMVEP and MI sessions during inter-session experiment respectively. Integration of samples from different sessions but same subject resulted in a highest accuracy of 65%, 59% and 40% for SSMVEP, MI and BCI competition dataset. Integration of samples from different subjects resulted in a highest accuracy of 65%, 44% and 48% for SSMVEP, BCI competition and MI datasets. When three classifiers are evaluated and compared to determine whether multi-source neural information can improve the classification accuracy of individual sessions and subjects or domains, both KNN and NB achieved highest accuracies of 59% and 52% respectively, while TL showed a significant increase with an accuracy of 98% achieved using SSMVEP sessions. In a similarly manner both KNN and NB achieved highest accuracies of 49% and 42% respectively using SSMVEP subjects, while TL showed a significant increase with an accuracy of 64% achieved. Furthermore, when 9 MI subject acquired from BCI competition dataset, both KNN and NB achieved highest accuracies of 68% and 65% respectively, while a significant increase in accuracy was observed when TL is used with accuracy of 99% achieved. In conclusion, the change of alpha rhythm magnitude among sessions significantly affect the IDR across sessions. While component selection across sessions has significant effects due to non-linear and non-stationary nature of EEG signals. Moreover, merging of ICs from different sessions, and inter-subject factor introduce challenges of overfitting resulting in low IDR. The classification methods are also found critical, because some advanced classification methods can improve the classification accuracy.

Enhanced System Robustness of Asynchronous BCI in Augmented Reality Using Steady-State Motion Visual Evoked Potential.

This study evaluated the effect of change in background on steady state visually evoked potentials (SSVEP) and steady state motion visually evoked potentials (SSMVEP) based brain computer interfaces (BCI) in a small-profile augmented reality (AR) headset. A four target SSVEP and SSMVEP BCI was implemented using the Cognixion AR headset prototype. An active (AB) and a non-active background (NB) were evaluated. The signal characteristics and classification performance of the two BCI paradigms were studied. Offline analysis was performed using canonical correlation analysis (CCA) and complex-spectrum based convolutional neural network (C-CNN). Finally, the asynchronous pseudo-online performance of the SSMVEP BCI was evaluated. Signal analysis revealed that the SSMVEP stimulus was more robust to change in background compared to SSVEP stimulus in AR. The decoding performance revealed that the C-CNN method outperformed CCA for both stimulus types and NB background, in agreement with results in the literature. The average offline accuracies for W = 1 s of C-CNN were (NB vs. AB): SSVEP: 82% ±15% vs. 60% ±21% and SSMVEP: 71.4% ± 22% vs. 63.5% ± 18%. Additionally, for W = 2 s, the AR-SSMVEP BCI with the C-CNN method was 83.3% ± 27% (NB) and 74.1% ±22% (AB). The results suggest that with the C-CNN method, the AR-SSMVEP BCI is both robust to change in background conditions and provides high decoding accuracy compared to the AR-SSVEP BCI. This study presents novel results that highlight the robustness and practical application of SSMVEP BCIs developed with a low-cost AR headset.

MHLCNN: Multi-Harmonic Linkage CNN Model for SSVEP and SSMVEP Signal Classification

Visual evoked potential (VEP)-related EEG signals have attracted widespread attention in the construction of brain-computer interface (BCI) systems. However, long-term use of the BCI system is prone to fatigue. Effectively coping with fatigue is the key to expanding BCI application scenarios. In this brief, we conduct two VEP experiments and propose a novel, concise and practical convolutional neural network (CNN) model to study and solve this problem. In detail, firstly, in terms of the stimulus frequencies in VEP experiments, we intercept the spectrum sequences of the fundamental waves and two harmonics. All these spectrum sequences are then paralleled input into the proposed multi-harmonic linkage CNN (MHLCNN) model, through three branches. Finally, the linkage characteristics of multiple harmonics are combined for VEP signal classification. The experimental results demonstrate that the proposed model shows good scalability, and can respectively improve the average classification accuracy by 23.17% and 15.85% when applied to steady-state VEP (SSVEP) signals in fatigue state and steady-state motion VEP (SSMVEP) signals, compared with the benchmark methods. All these provide a feasible and high-quality solution for reducing the impact of fatigue on the performance of VEP-based BCI systems.

Can a highly accurate multi-class SSMVEP BCI induce sensory-motor rhythm in the sensorimotor area?

Objective. Different visual stimuli might have different effects on the brain, e.g. the change of brightness, non-biological movement and biological movement. Approach. In this study, flicker, checkerboard and gaiting stimuli were chosen as visual stimuli to investigate whether steady-state motion visual evoked potential (SSMVEP) effect on the sensorimotor area for rehabilitation. The gaiting stimulus was designed as the gaiting sequence of a human. The hypothesis is that only observing the designed gaiting stimulus would simultaneously induce: (1) SSMVEP in the occipital area, similarly to an SSVEP stimulus; and (2) sensorimotor rhythm (SMR) in the primary sensorimotor area, because such action observation could activate the mirror neuron system. Canonical correlation analysis was used to detect SSMVEP from occipital electroencephalograms (EEG), and event-related spectral perturbation was used to identify SMR in the EEG from the sensorimotor area. Main results. The results showed that the designed gaiting stimulus-induced SSMVEP, with classification accuracies of 88.9 ± 12.0% in a four-class scenario. More importantly, it induced clear and sustained event-related desynchronization/synchronization (ERD/ERS), while no ERD/ERS could be observed when the other two SSVEP stimuli were used. Further, for participants with a sufficiently clear SSMVEP pattern (classification accuracy >85%), the ERD index values in the mu-beta band induced by the proposed gaiting stimulus were statistically different from those of the other two types of stimulus. Significance. Therefore, a novel brain–computer interface (BCI) based on the designed stimulus has potential in neurorehabilitation applications because it simultaneously has the high accuracy of an SSMVEP (sim90% accuracy in a four-class setup) and the ability to activate the sensorimotor area.

Effect of Competing Stimuli for Steady-State Visually Evoked Potential and Steady-State Motion Visually Evoked Potential

Changes in stimuli proximity have been shown to affect the performance of brain computer interfaces (BCI) based on steady-state visual evoked potentials (SSVEP). Specifically, closely placed visual stimuli compete for neural representations, which is called the effect of competing stimuli. Recently, steady-state motion visual evoked potential (SSMVEP) has been proposed to alleviate some of the inherent limitations of SSVEP. In this study, the SSVEP and SSMVEP paradigms were systematically compared under three different inter-stimulus distances to modulate the effect of competing stimuli. Offline analysis was performed to study the steady-state response characteristics, strength of the responses and overall BCI decoding performance. Thirteen healthy subjects participated in the experiment; two types of visual stimulus with seven classes were presented: a flickering stimulus for SSVEP and a radial contraction-expansion checkerboard for the SSMVEP. The canonical correlation analysis (CCA) was used to study the signal characteristics and the offline decoding performance using only three EEG channels, O1, O2 and Oz. The results demonstrated that SSMVEP was not only less sensitive to competing stimuli, but also consistently outperformed SSVEP in their presence. Further, the SSMVEP response reached its steady-state faster than SSVEP. The signal characteristics analysis revealed that the SSVEP performances were better than SSMVEP in the lowest frequency tested ( 13 Hz). The findings in this study indicate that SSMVEP is likely a more practical BCI paradigm than the classic SSVEP for many real-world applications.

Effects of fatigue on steady state motion visual evoked potentials: Optimised stimulus parameters for a zoom motion-based brain-computer interface

Background and ObjectiveIn flicker-based steady-state visual evoked potentials (SSVEP) brain-computer interface (BCI), the system performance decreases due to prolonged repeated visual stimulation. To reduce the performance decrease due to visual fatigue, the zoom motion based steady-state motion visual evoked potentials (SSMVEPs) paradigm had been proposed. In this study, the stimulation parameters of the paradigm are optimised to mitigate the decrease in detection accuracy for SSMVEP due to visual fatigue. MethodsEight zoom motion-based SSMVEP paradigms with different stimulation parameters were compared. The graph size, luminance, colour, and shape, as well as the frequency range and interval of the stimulation and refresh rate of the screen was changed to determine the optimal paradigm with high recognition accuracy and reduced fatigue effects. The signal-to-noise ratio (SNR) of SSMVEP was also calculated for four fatigue levels. Moreover, the power spectral density of electroencephalograph (EEG) alpha and theta bands during ongoing activity was calculated for the stimulation experiment to evaluate fatigue at the start and end of the stimulation task. ResultsAll stimulation SSMVEP paradigms exhibited high accuracies. Changes in luminance, colour, and shape did not impact the recognition accuracy, nor did a higher stimulation frequency or lower frequency interval of each stimulation block. However, the paradigm with smaller stimulus achieved the highest average target selection accuracy of 97.2%, compared to 94.9% for the standard paradigm. Furthermore, it exhibited almost zero reduction in recognition accuracy due to fatigue. From fatigue level 1 to level 4, the smaller zoom motion-based SSMVEP exhibited a lower decrease in the SNR of SSMVEP and a lower alpha/theta ratio decrease during ongoing stimulation activity compared to the standard paradigm. ConclusionsFor a zoom motion-based SSMVEP paradigm, changing multiple stimulation parameters can lead to the same high performance as the standard paradigm. Moreover, using a smaller stimulus can reduce the accuracy decrease caused by fatigue because the SNR decrease in the evoked SSMVEP state was negligible and the alpha/theta index decrease during ongoing activity was lower than that for the standard paradigm.

A novel motion coupling coding method for brain-computer interfaces.

Objectives The best frequency response band for the steady-state visual evoked potential (SSVEP) stimulus for humans is limited. This results in a reduced number of encoded targets. Methods To circumvent these limitations, we propose a motion-coupled, steady-state motion visual evoked potential (SSMVEP) method. We designed a stimulus paradigm that couples both sinusoidal and square wave motions. The paradigm performs a spiral motion with a higher frequency in the form of sinusoidal wave, and alters the size of the lower frequency via the square wave form. Results The motion-coupled SSMVEP method could simultaneously induce stable motion frequency and coupling frequency, and there was no loss of frequency component. Conclusions The proposed method has been evaluated to have substantial potential for increasing the number of coding targets, which is an effective supplement to the existing studies.

Towards solving of the Illiteracy phenomenon for VEP-based brain-computer interfaces

Brain-Computer Interface (BCI) systems use brain activity as an input signal and enable communication without requiring bodily movement. This novel technology may help impaired patients and users with disabilities to communicate with their environment. Over the years, researchers investigated the performance of subjects in different BCI paradigms, stating that 15%–30% of BCI users are unable to reach proficiency in using a BCI system and therefore were labelled as BCI illiterates. Recent progress in the BCIs based on the visually evoked potentials (VEPs) necessitates re-considering of this term, as very often all subjects are able to use VEP-based BCI systems. This study examines correlations among BCI performance, personal preferences, and further demographic factors for three different modern visually evoked BCI paradigms: (1) the conventional Steady-State Visual Evoked Potentials (SSVEPs) based on visual stimuli flickering at specific constant frequencies (fVEP), (2) Steady-State motion Visual Evoked Potentials (SSmVEP), and (3) code-modulated Visual Evoked Potentials (cVEP). Demographic parameters, as well as handedness, vision correction, BCI experience, etc., have no significant effect on the performance of VEP-based BCI. Most subjects did not consider the flickering stimuli annoying, only 20 out of a total of 86 participants indicated a change in fatigue during the experiment. 83 subjects were able to successfully finish all spelling tasks with the fVEP speller, with a mean (SD) information transfer rate of 31.87 bit/min (9.83) and an accuracy of 95.28% (5.18), respectively. Compared to that, 80 subjects were able to successfully finish all spelling tasks using SSmVEP, with a mean information transfer rate of 26.44 bit/min (8.04) and an accuracy of 91.10% (6.01), respectively. Finally, all 86 subjects were able to successfully finish all spelling tasks with the cVEP speller, with a mean information transfer rate of 40.23 bit/min (7.63) and an accuracy of 97.83% (3.37).

A Deep Learning Method for Improving the Classification Accuracy of SSMVEP-Based BCI

Steady State Motion Visual Evoked Potential (SSMVEP)-based Brain Computer Interface (BCI) is widely studied and has been used to varies of occasions on account of its good performance, mild stimulation, and free of additional training. We design a trolley control system based on SSMVEP signals and observe a phenomenon named “BCI Illiterate,” in which case some subjects present unsatisfactory performance with low classification accuracies. In order to cope with this challenging problem in real-world contexts, we introduce a deep learning (DL) method. The method allows improving the accuracies for both EEG literate and EEG illiterate. In particular, we firstly conduct SSMVEP experiments to obtain EEG signals from 10 subjects, including 5 EEG literates and 5 EEG illiterates. Then we construct a convolutional neural network with long short-term memory (CNN-LSTM) framework, which allows extracting the spectral, spatial, and temporal features of EEG signals, to realize the high classification accuracies of SSMVEP signals. The results show that DL method can reach 96.83% and 91.86% for EEG literate and EEG illiterate respectively, which are 12.68% and 31.08% higher than the results of traditional methods. These results indicate that DL method is not only suitable for EEG literate, but more importantly, can greatly improve the performance for EEG illiterate, which finally can enhance the robustness and universality of the SSMVEP-based BCI.

Classification of EEG Signals on VEP-Based BCI Systems With Broad Learning

Brain–computer interface (BCI) systems based on electroencephalography (EEG) signals have been extensively used in medical practice. To enhance the BCI performance, improving the classification accuracy of EEG signals is the key, which has always been the focus of research and development. In this article, a novel method integrating complex network and broad learning system (BLS) is proposed for visual evoked potential (VEP)-based BCI research. First, systematic VEP-based brain experiments are conducted for obtaining EEG signals, including steady-state VEP (SSVEP) and steady-state motion VEP (SSMVEP). Then, limited penetrable visibility graph (LPVG) and its degree sequence are employed to implement the preliminary feature extraction. All these features are finally fed into a BLS to study and classify the SSVEP and SSMVEP signals, respectively. The classification results show that our LPVG-based BLS can effectively classify VEP-based EEG signals, with average classification accuracy 96.22% for SSVEP and 74.54% for SSMVEP. These results are significantly better than other comparison methods as well as traditional CCA-based methods. All these open up new venues for studying EEG-based BCI systems via the fusion of network science and BLS.

Objective and quantitative assessment of interocular suppression in strabismic amblyopia based on steady-state motion visual evoked potentials

In this study, we aimed to explore an objective, sensitive and quantitative measurement of interocular suppression in strabismic amblyopia. We compared 11 strabismic subjects with 12 normal vision subjects to explore the different response characterizations in normal eyes, nondominant and dominant eyes of strabismic subjects by using steady-state motion visual evoked potentials (SSMVEPs). Stimulation at different temporal frequencies was presented to two eyes by using an interocular dichoptic technique. Furthermore, canonical correlation analysis (CCA), signal-to-noise ratio (SNR) and some statistical methods, such as the paired t-test, analysis of variance (ANOVA) and correlation analysis, were used to analyze electroencephalography (EEG) signals. We proposed two indices—divergence J and suppression imbalance (SI) to describe the deficits in interocular suppression—and one index — mask attenuation coefficient (MAC)— to describe the influence of a dichoptic mask from the dominant eyes to nondominant eyes of strabismic subjects. A significant difference was found between nondominant and dominant eyes of strabismic subjects in SSMVEP response and SNR value while no apparent difference was observed between the two eyes in subjects with normal vision. There was a strong linear correlation between divergence J, SI and visual acuity difference of two eyes both in strabismic amblyopia and normal vision. A linear correlation was also found between visual acuity difference and MAC in patients with strabismic amblyopia. Our findings suggest that SSMVEPs can be an objective and quantitative method for measuring the interocular suppression in strabismus and assessing the deficits of strabismic amblyopia.

Multivariate weighted recurrent network for analyzing SSMVEP signals from EEG literate and illiterate

Recently, the Steady-State Motion Visual Evoked Potential (SSMVEP)-based Brain Computer Interface (BCI) has attracted a lot of attention. We design a SSMVEP-based BCI, in which a ring-shaped motion checkerboard pattern is used to realize SSMVEP stimulation. In particular, we firstly conduct SSMVEP experiments to obtain electroencephalogram (EEG) signals from 10 subjects, including 5 EEG literates and 5 EEG illiterates. By using the Canonical Correlation Analysis (CCA) and Support Vector Machine (SVM) method, we find that the classification accuracies of EEG illiterates are relatively lower than that of EEG literates. Thus, in order to investigate the differences in brain cognitive processes between the two groups of subjects, we construct a multivariate weighted recurrence network and analyze the weighted local efficiency and the clustering coefficient of the two groups. The results indicate that in SSMVEP experiment, there are significant differences between the two groups of subjects in these two network indicators. Our approach and analysis provide novel insights into the cognitive behavior of the brain and understanding of the “BCI Illiteracy” problem.

Characterization of SSMVEP-based EEG signals using multiplex limited penetrable horizontal visibility graph.

The steady state motion visual evoked potential (SSMVEP)-based brain computer interface (BCI), which incorporates the motion perception capabilities of the human visual system to alleviate the negative effects caused by strong visual stimulation from steady-state VEP, has attracted a great deal of attention. In this paper, we design a SSMVEP-based experiment by Newton's ring paradigm. Then, we use the canonical correlation analysis and Support Vector Machines to classify SSMVEP signals for the SSMVEP-based electroencephalography (EEG) signal detection. We find that the classification accuracy of different subjects under fatigue state is much lower than that in the normal state. To probe into this, we develop a multiplex limited penetrable horizontal visibility graph method, which enables to infer a brain network from 62-channel EEG signals. Subsequently, we analyze the variation of the average weighted clustering coefficient and the weighted global efficiency corresponding to these two brain states and find that both network measures are lower under fatigue state. The results suggest that the associations and information transfer efficiency among different brain regions become weaker when the brain state changes from normal to fatigue, which provide new insights into the explanations for the reduced classification accuracy. The promising classification results and the findings render the proposed methods particularly useful for analyzing EEG recordings from SSMVEP-based BCI system.

Objective and quantitative assessment of visual acuity and contrast sensitivity based on steady-state motion visual evoked potentials using concentric-ring paradigm.

The traditional assessment of visual acuity and contrast sensitivity depends more on subjective judgments. Steady-state motion visual evoked potentials (SSMVEPs) can provide an objective and quantitative method to evaluate visual functions such as visual acuity and contrast sensitivity. Here, we explored the possibility of objective SSMVEP visual acuity and contrast sensitivity testing, and compared its performance with that of psychophysical methods. In this study, we designed a specific concentric ring with oscillating expansion and contraction SSMVEP paradigm to assess visual acuity and contrast sensitivity. By changing the parameters of the paradigm, the SSMVEP paradigm with different contrasts and spatial frequencies corresponding to different visual acuity and contrast sensitivity was designed. Moreover, we proposed a threshold determination criterion to define the corresponding objective SSMVEP visual acuity and contrast sensitivity. We tested visual acuity and contrast sensitivity of sixteen healthy adults utilizing this paradigm with an electroencephalography system. Our data suggested that there was no significant difference between objective visual acuity and contrast sensitivity measurements based on the SSMVEPs and subjective psychophysical ones. Our study proved that SSMVEPs can be an objective and quantitative method to measure visual acuity and contrast sensitivity.

Steady-State Motion Visual Evoked Potential (SSMVEP) Enhancement Method Based on Time-Frequency Image Fusion

The steady-state motion visual evoked potential (SSMVEP) collected from the scalp suffers from strong noise and is contaminated by artifacts such as the electrooculogram (EOG) and the electromyogram (EMG). Spatial filtering methods can fuse the information of different brain regions, which is beneficial for the enhancement of the active components of the SSMVEP. Traditional spatial filtering methods fuse electroencephalogram (EEG) in the time domain. Based on the idea of image fusion, this study proposed an SSMVEP enhancement method based on time-frequency (T-F) image fusion. The purpose is to fuse SSMVEP in the T-F domain and improve the enhancement effect of the traditional spatial filtering method on SSMVEP active components. Firstly, two electrode signals were transformed from the time domain to the T-F domain via short-time Fourier transform (STFT). The transformed T-F signals can be regarded as T-F images. Then, two T-F images were decomposed via two-dimensional multiscale wavelet decomposition, and both the high-frequency coefficients and low-frequency coefficients of the wavelet were fused by specific fusion rules. The two images were fused into one image via two-dimensional wavelet reconstruction. The fused image was subjected to mean filtering, and finally, the fused time-domain signal was obtained by inverse STFT (ISTFT). The experimental results show that the proposed method has better enhancement effect on SSMVEP active components than the traditional spatial filtering methods. This study indicates that it is feasible to fuse SSMVEP in the T-F domain, which provides a new idea for SSMVEP analysis.

A Convolutional Neural Network for the Detection of Asynchronous Steady State Motion Visual Evoked Potential.

A key issue in brain-computer interface (BCI) is the detection of intentional control (IC) states and non-intentional control (NC) states in an asynchronous manner. Furthermore, for steady-state visual evoked potential (SSVEP) BCI systems, multiple states (sub-states) exist within the IC state. Existing recognition methods rely on a threshold technique, which is difficult to realize high accuracy, i.e., simultaneously high true positive rate and low false positive rate. To address this issue, we proposed a novel convolutional neural network (CNN) to detect IC and NC states in a SSVEP-BCI system for the first time. Specifically, the steady-state motion visual evoked potentials (SSMVEP) paradigm, which has been shown to induce less visual discomfort, was chosen as the experimental paradigm. Two processing pipelines were proposed for the detection of IC and NC states. The first one was using CNN as a multi-class classifier to discriminate between all the states in IC and NC state (FFT-CNN). The second one was using CNN to discriminate between IC and NC states, and using canonical correlation analysis (CCA) to perform classification tasks within the IC (FFT-CNN-CCA). We demonstrated that both pipelines achieved a significant increase in accuracy for low-performance healthy participants when traditional algorithms such as CCA threshold were used. Furthermore, the FFT-CNN-CCA pipeline achieved better performance than the FFT-CNN pipeline based on the stroke patients' data. In summary, we showed that CNN can be used for robust detection in an asynchronous SSMVEP-BCI with great potential for out-of-lab BCI applications.

A Radial Zoom Motion-Based Paradigm for Steady State Motion Visual Evoked Potentials.

Background: In steady state visual evoked potential (SSVEP)-based brain-computer interfaces, prolonged repeated flicker stimulation would reduce the system performance. To reduce the visual discomfort and fatigue, while ensuring recognition accuracy, and information transmission rate (ITR), a novel motion paradigm based on the steady-state motion visual evoked potentials (SSMVEPs) is proposed.Methods: The novel SSMVEP paradigm of the radial zoom motion was realized using the sinusoidal form to modulate the size of the stimuli. The radial zoom motion-based SSMVEP paradigm was compared with the flicker-based SSVEP paradigm and the SSMVEP paradigm based on Newton's ring motion. The canonical correlation analysis was used to identify the frequency of the eight targets, the recognition accuracy of different paradigms with different stimulation frequencies, and the ITR under different stimulation durations were calculated. The subjective comfort scores and fatigue scores, and decrease in the accuracy due to fatigue was evaluated.Results: The average recognition accuracy of the novel radial zoom motion-based SSMVEP paradigm was 93.4%, and its ITR reached 42.5 bit/min, which was greater than the average recognition accuracy of the SSMVEP paradigm based on Newton's ring motion. The comfort score of the novel paradigm was greater than both the flicker-based SSVEP paradigm and SSMVEP paradigm based on Newton's ring motion. The decrease in the recognition accuracy due to fatigue was less than that of the SSSMVEP paradigm based on Newton's ring motion.Conclusion: The SSMVEP paradigm based on radial zoom motion has high recognition accuracy and ITR with low visual discomfort and fatigue scores. The method has potential advantages in overcoming the performance decline caused by fatigue.