Multivariate Synchronization Index Research Articles

Multiscale noise suppression and feature frequency extraction in SSVEP based on underdamped second-order stochastic resonance

Objective. As one of the commonly used control signals of brain–computer interface (BCI), steady-state visual evoked potential (SSVEP) exhibits advantages of stability, periodicity and minimal training requirements. However, SSVEP retains the non-linear, non-stationary and low signal-to-noise ratio (SNR) characteristics of EEG. The traditional SSVEP extraction methods regard noise as harmful information and highlight the useful signal by suppressing the noise. In the collected EEG, noise and SSVEP are usually coupled together, the useful signal is inevitably attenuated while the noise is suppressed. Also, an additional band-pass filter is needed to eliminate the multi-scale noise, which causes the edge effect. Approach. To address this issue, a novel method based on underdamped second-order stochastic resonance (USSR) is proposed in this paper for SSVEP extraction. Main results. A synergistic effect produced by noise, useful signal and the nonlinear system can force the energy of noise to be transferred into SSVEP, and hence amplifying the useful signal while suppressing multi-scale noise. The recognition performances of detection are compared with the widely-used canonical coefficient analysis (CCA) and multivariate synchronization index (MSI). Significance. The comparison results indicate that USSR exhibits increased accuracy and faster processing speed, which effectively improves the information transmission rate (ITR) of SSVEP-based BCI.

Brain–Computer Interface-Based Stochastic Navigation and Control of a Semiautonomous Mobile Robot in Indoor Environments

In this paper, a brain–computer interface (BCI)-based navigation and control strategy is developed for a mobile robot in indoor environments. It combines the simultaneous localization and mapping to achieve the navigation and positioning for a mobile robot in indoor environments, where the RGB landmarks are regarded as the environmental features learned by the FastSLAM algorithm. The online BCI, based on steady-state visually evoked potentials, exploits multivariate synchronization index classification algorithm to analyze the human electroencephalograph (EEG) signals so that the human intention can be recognized accurately, and then the EEG-based motion commands are produced for the mobile robot. Probability potential field approach based on the probability density function of 2-D normal distribution is connected with the brain signals to generate a collision-free trajectory for the mobile robot. The entire system is semiautonomous, since the robot’s low level behaviors are autonomous and the stochastic navigation is executed by the BCI, and it is verified by the extensive experiments involving five volunteers. All the participants can successfully tele-operate the mobile robot, and the experimental results have verified the effectiveness of the proposed approach.

Evaluating the Influence of Chromatic and Luminance Stimuli on SSVEPs from Behind-the-Ears and Occipital Areas.

This work presents a study of chromatic and luminance stimuli in low-, medium-, and high-frequency stimulation to evoke steady-state visual evoked potential (SSVEP) in the behind-the-ears area. Twelve healthy subjects participated in this study. The electroencephalogram (EEG) was measured on occipital (Oz) and left and right temporal (TP9 and TP10) areas. The SSVEP was evaluated in terms of amplitude, signal-to-noise ratio (SNR), and detection accuracy using power spectral density analysis (PSDA), canonical correlation analysis (CCA), and temporally local multivariate synchronization index (TMSI) methods. It was found that stimuli based on suitable color and luminance elicited stronger SSVEP in the behind-the-ears area, and that the response of the SSVEP was related to the flickering frequency and the color of the stimuli. Thus, green-red stimulus elicited the highest SSVEP in medium-frequency range, and green-blue stimulus elicited the highest SSVEP in high-frequency range, reaching detection accuracy rates higher than 80%. These findings will aid in the development of more comfortable, accurate and stable BCIs with electrodes positioned on the behind-the-ears (hairless) areas.

A frequency recognition method based on multitaper spectral analysis and SNR estimation for SSVEP-based brain-computer interface.

Over the past several years, steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have attracted wide attention in the field of BCIs research due to high information transfer rate, little user training, and applicability to the majority. In conventional recognition methods for training-free SSVEP-based BCIs, the energy difference between the frequencies of electroencephalogram (EEG) background noise is usually ignored, therefore, there is a significant variance among the recognition accuracy of different stimulus frequencies. In order to improve the performance of training-free SSVEP-based BCIs system and balance the accuracy of recognition between different stimulus frequencies, a recognition method based on multitaper spectral analysis and signal-to-noise ratio estimation (MTSA-SNR) is proposed in this paper. A 40-class SSVEP public benchmark SSVEP dataset recorded from 35 subjects was used to evaluate the performance of the proposed method. Under the condition of 2.25s data length, the accuracy of the three methods were 81.1% (MTSA-SNR), 74.5% (canonical correlation analysis, CCA) and 73.4% (multivariate synchronization index, MSI), and the corresponding ITRs were 101 bits/min (MTSA-SNR), 89 bits/min (CCA), 87 bits/min (MSI). In the low frequency range (8-9.8Hz), the average recognition accuracy of the three methods is 82.9% (MTSA-SNR), 82.0% (CCA), 83.3% (MSI). The average accuracy of the three methods was 78.6% (MTSA-SNR), 64.9% (CCA) and 61.8% (MSI) in the high frequency range (14-15.8Hz). According to the results, the proposed method can effectively improve the performance of training-free SSVEP-based BCI system, and balance the recognition accuracy between different stimulation frequencies.

A new multivariate empirical mode decomposition method for improving the performance of SSVEP-based brain–computer interface

Objective. Accurate and efficient detection of steady-state visual evoked potentials (SSVEP) in electroencephalogram (EEG) is essential for the related brain–computer interface (BCI) applications. Approach. Although the canonical correlation analysis (CCA) has been applied extensively and successfully to SSVEP recognition, the spontaneous EEG activities and artifacts that often occur during data recording can deteriorate the recognition performance. Therefore, it is meaningful to extract a few frequency sub-bands of interest to avoid or reduce the influence of unrelated brain activity and artifacts. This paper presents an improved method to detect the frequency component associated with SSVEP using multivariate empirical mode decomposition (MEMD) and CCA (MEMD-CCA). EEG signals from nine healthy volunteers were recorded to evaluate the performance of the proposed method for SSVEP recognition. Main results. We compared our method with CCA and temporally local multivariate synchronization index (TMSI). The results suggest that the MEMD-CCA achieved significantly higher accuracy in contrast to standard CCA and TMSI. It gave the improvements of 1.34%, 3.11%, 3.33%, 10.45%, 15.78%, 18.45%, 15.00% and 14.22% on average over CCA at time windows from 0.5 s to 5 s and 0.55%, 1.56%, 7.78%, 14.67%, 13.67%, 7.33% and 7.78% over TMSI from 0.75 s to 5 s. The method outperformed the filter-based decomposition (FB), empirical mode decomposition (EMD) and wavelet decomposition (WT) based CCA for SSVEP recognition. Significance. The results demonstrate the ability of our proposed MEMD-CCA to improve the performance of SSVEP-based BCI.

The extension of multivariate synchronization index method for SSVEP-based BCI

Multichannel frequency detection methods for SSVEP-based BCI have received increasing interest in recent years. Among the alternative methods, multivariate synchronization index (MSI) is a potential one to achieve robust performance for SSVEP-based BCI. This study further presents an extension to MSI (termed as EMSI) for frequency recognition, which leverage the method of time delay embedding. The new method incorporates the first-order time delayed version of the EEG data during calculation the synchronization index. The effectiveness of the proposed method is validated by comparing it with the standard MSI on the actual SSVEP datasets collected from eleven subjects. The experimental results indicate that the EMSI significantly outperforms the MSI at four time windows. It suggests that the EMSI is a promising methodology for frequency recognition and could further improve the performance of SSVEP-based BCI system.

A convolutional neural network for steady state visual evoked potential classification under ambulatory environment.

The robust analysis of neural signals is a challenging problem. Here, we contribute a convolutional neural network (CNN) for the robust classification of a steady-state visual evoked potentials (SSVEPs) paradigm. We measure electroencephalogram (EEG)-based SSVEPs for a brain-controlled exoskeleton under ambulatory conditions in which numerous artifacts may deteriorate decoding. The proposed CNN is shown to achieve reliable performance under these challenging conditions. To validate the proposed method, we have acquired an SSVEP dataset under two conditions: 1) a static environment, in a standing position while fixated into a lower-limb exoskeleton and 2) an ambulatory environment, walking along a test course wearing the exoskeleton (here, artifacts are most challenging). The proposed CNN is compared to a standard neural network and other state-of-the-art methods for SSVEP decoding (i.e., a canonical correlation analysis (CCA)-based classifier, a multivariate synchronization index (MSI), a CCA combined with k-nearest neighbors (CCA-KNN) classifier) in an offline analysis. We found highly encouraging SSVEP decoding results for the CNN architecture, surpassing those of other methods with classification rates of 99.28% and 94.03% in the static and ambulatory conditions, respectively. A subsequent analysis inspects the representation found by the CNN at each layer and can thus contribute to a better understanding of the CNN’s robust, accurate decoding abilities.

Robust frequency recognition for SSVEP-based BCI with temporally local multivariate synchronization index.

Multivariate synchronization index (MSI) has been proved to be an efficient method for frequency recognition in SSVEP-BCI systems. It measures the correlation according to the entropy of the normalized eigenvalues of the covariance matrix of multichannel signals. In the MSI method, the estimation of covariance matrix omits the temporally local structure of samples. In this study, a new spatio-temporal method, termed temporally local MSI (TMSI), was presented. This new method explicitly exploits temporally local information in modelling the covariance matrix. In order to evaluate the performance of the TMSI, we performs a comparison between the two methods on the real SSVEP datasets from eleven subjects. The results show that the TMSI outperforms the standard MSI. TMSI benefits from exploiting the temporally local structure of EEG signals, and could be a potential method for robust performance of SSVEP-based BCI.

Advancing the detection of steady-state visual evoked potentials in brain–computer interfaces

Objective. Spatial filtering has proved to be a powerful pre-processing step in detection of steady-state visual evoked potentials and boosted typical detection rates both in offline analysis and online SSVEP-based brain–computer interface applications. State-of-the-art detection methods and the spatial filters used thereby share many common foundations as they all build upon the second order statistics of the acquired Electroencephalographic (EEG) data, that is, its spatial autocovariance and cross-covariance with what is assumed to be a pure SSVEP response. The present study aims at highlighting the similarities and differences between these methods. Approach. We consider the canonical correlation analysis (CCA) method as a basis for the theoretical and empirical (with real EEG data) analysis of the state-of-the-art detection methods and the spatial filters used thereby. We build upon the findings of this analysis and prior research and propose a new detection method (CVARS) that combines the power of the canonical variates and that of the autoregressive spectral analysis in estimating the signal and noise power levels. Main results. We found that the multivariate synchronization index method and the maximum contrast combination method are variations of the CCA method. All three methods were found to provide relatively unreliable detections in low signal-to-noise ratio (SNR) regimes. CVARS and the minimum energy combination methods were found to provide better estimates for different SNR levels. Significance. Our theoretical and empirical results demonstrate that the proposed CVARS method outperforms other state-of-the-art detection methods when used in an unsupervised fashion. Furthermore, when used in a supervised fashion, a linear classifier learned from a short training session is able to estimate the hidden user intention, including the idle state (when the user is not attending to any stimulus), rapidly, accurately and reliably.

Anti-noise Capability Improvement of Minimum Energy Combination Method for SSVEP Detection

Minimum energy combination (MEC) is a widely used method for frequency recognition in steady state visual evoked potential based BCI systems. Although it can reach acceptable performances, this method remains sensitive to noise. This paper introduces a new technique for the improvement of the MEC method allowing ameliorating its Anti-noise capability. The Empirical mode decomposition (EMD) and the moving average filter were used to separate noise from relevant signals. The results show that the proposed BCI system has a higher accuracy than systems based on Canonical Correlation Analysis (CCA) or Multivariate Synchronization Index (MSI). In fact, the system achieves an average accuracy of about 99% using real data measured from five subjects by means of the EPOC EMOTIVE headset with three visual stimuli. Also by using four commands, the system accuracy reaches 91.78% with an information-transfer rate of about 27.18 bits/min.

Comparison of the influence of stimuli color on Steady-State Visual Evoked Potentials

IntroductionThe main idea of a traditional Steady State Visually Evoked Potentials (SSVEP)-BCI is the activation of commands through gaze control. For this purpose, the retina of the eye is excited by a stimulus at a certain frequency. Several studies have shown effects related to different kind of stimuli, frequencies, window lengths, techniques of feature extraction and even classification. So far, none of the previous studies has performed a comparison of performance of stimuli colors through LED technology. This study addresses precisely this important aspect and would be a great contribution to the topic of SSVEP-BCIs. Additionally, the performance of different colors at different frequencies and the visual comfort were evaluated in each case.MethodsLEDs of four different colors (red, green, blue and yellow) flickering at four distinct frequencies (8, 11, 13 and 15 Hz) were used. Twenty subjects were distributed in two groups performing different protocols. Multivariate Synchronization Index (MSI) was the technique adopted as feature extractor.ResultsThe accuracy was gradually enhanced with the increase of the time window. From our observations, the red color provides, in most frequencies, both highest rates of accuracy and Information Transfer Rate (ITR) for detection of SSVEP.ConclusionAlthough the red color has presented higher ITR, this color was turned in the less comfortable one and can even elicit epileptic responses according to the literature. For this reason, the green color is suggested as the best choice according to the proposed rules. In addition, this color has shown to be safe and accurate for an SSVEP-BCI.

Sequence detection analysis based on canonical correlation for steady-state visual evoked potential brain computer interfaces

Background: Steady-state visual evoked potential (SSVEP) has been widely applied to develop brain computer interface (BCI) systems. The essence of SSVEP recognition is to recognize the frequency component of target stimulus focused by a subject significantly present in EEG spectrum.New method: In this paper, a novel statistical approach based on sequence detection (SD) is proposed for improving the performance of SSVEP recognition. This method uses canonical correlation analysis (CCA) coefficients to observe SSVEP signal sequence. And then, a threshold strategy is utilized for SSVEP recognition.Results: The result showed the classification performance with the longer duration of time window achieved the higher accuracy for most subjects. And the average time costing per trial was lower than the predefined recognition time. It was implicated that our approach could improve the speed of BCI system in contrast to other methods.Comparison with existing method(s): In comparison with other resultful algorithms, experimental accuracy of SD approach was better than those using a widely used CCA-based method and two newly proposed algorithms, least absolute shrinkage and selection operator (LASSO) recognition model as well as multivariate synchronization index (MSI) method. Furthermore, the information transfer rate (ITR) obtained by SD approach was higher than those using other three methods for most participants.Conclusions: These conclusions demonstrated that our proposed method was promising for a high-speed online BCI.

Development of a Human Machine Interface for Control of Robotic Wheelchair and Smart Environment

In this work, we address the problem of integrating a robotic wheelchair into a smart environment. This approach allows people with disabilities to control home appliances of the environment using a Human Computer Interface (HCI) based on different biological signals. The home appliances includes TV, radio, lights/lamp and fan. Three control paradigms using surface Electromyography (sEMG), Electrooculography (EOG) and Electroencephalography (EEG) signals were used. These signals are captured through a biosignal acquisition system. Three sub-paradigms for sEMG/EOG analyzes were defined: moving eyes horizontally (left/right), raising brow and prolonged clench. On the other hand, the navigation of the wheelchair is executed through an Steady-State Visually Evoked Potentials (SSVEP)-BCI. Each stage of our proposed system showed a good performance for most subjects. Therefore, volunteers were recruited to participate of the study and were distributed in two groups (subjects for home appliances and subjects for SSVEP-BCI). The average accuracy for prolonged clench approach was of 95%, the raising brow was 85% and moving eyes achieved 93%. Multivariate Synchronization Index (MSI) was used for feature extraction from EEG signals. The flickering frequencies were 8.0 Hz (top), 11.0 Hz (right), 13.0 Hz (bottom) and 15.0 Hz (left). Results from this approach showed that classification varies in the range of 45-77% among subjects using window length of 1 s.

Multivariate synchronization index for frequency recognition of SSVEP-based brain–computer interface

Multichannel frequency recognition methods are prevalent in SSVEP-BCI systems. These methods increase the convenience of the BCI system for users and require no calibration data. A novel multivariate synchronization index (MSI) for frequency recognition was proposed in this paper. This measure characterized the synchronization between multichannel EEGs and the reference signals, the latter of which were defined according to the stimulus frequency. For the simulation and real data, the proposed method showed better performance than the widely used canonical correlation analysis (CCA) and minimum energy combination (MEC), especially for short data length and a small number of channels. The MSI was also implemented successfully in an online SSVEP-based BCI system, thus further confirming its feasibility for application systems. Because fast and accurate recognition is crucial for practical systems, we recommend MSI as a potential method for frequency recognition in future SSVEP-BCI.

Multivariate Business Cycle Synchronization in Small Samples*

AbstractIn this paper, we study the degree of business cycle synchronization by means of a small sample version of the Harding and Pagan's [Journal of Econometrics (2006) Vol. 132, pp. 59–79] Generalized Method of Moment test. We show that the asymptotic version of the test gets increasingly distorted in small samples when the number of countries grows large. However, a block bootstrapped version of the test can remedy the size distortion when the time series length divided by the number of countries T/n is sufficiently large. Applying the technique to a number of business cycle proxies of developed economies, we are unable to reject the null hypothesis of a non‐zero common multivariate synchronization index for certain economically meaningful subsets of these countries.