Based Brain-computer Interface Research Articles

Exploiting Convolutional Recurrent Neural Networks for Enhanced EEG-based Emotion Recognition

Abstract. Emotion recognition is a branch of artificial intelligence that analyzes human emotional states through facial expressions, voice, or physiological signals. It enhances human-computer interaction, facilitating more personalized and empathetic technology experiences, crucial for fields like mental health, customer service, and human-robot interaction. In recent years, research on emotion recognition using these tools has grown rapidly, involving multiple interdisciplinary fields. With the aid of electroencephalogram (EEG)-based brain-computer interfaces (BCIs), the emotional states of users can be sensed and analyzed. It offers a direct, non-intrusive insight into user emotions, enhancing user experience and system responsiveness. This approach is crucial for developing adaptive artificial intelligence (AI) in fields like healthcare for personalized treatments and in entertainment for immersive experiences, advancing human-technology symbiosis. This paper compares five current machine learning (ML)-based emotion recognition methods leveraging EEG signals, aiming to evaluate their effectiveness and applicability in emotion recognition. The paper concludes that while both Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) have their strengths, the combination of them provides the best performance in EEG-based emotion recognition.

Classification of motor imagery EEG with ensemble RNCA model

Motor Imagery (MI) based brain-computer interface (BCI) systems are used for regaining the motor functions of neurophysiologically affected persons. But the performance of MI tasks is degraded due to the presence of redundant EEG channels. Hence, a novel ensemble regulated neighborhood component analysis (ERNCA) method provides a perfect identification of neural region that stimulate motor movements. Domains of statistical, frequency, spatial and transform-based features narrowed down the misclassification rate. The gradient boosting method selects the relevant features thereby reduces the computational complexity. Finally, Bayesian optimized ensemble classifier finetuned the classification accuracies of 97.22 % and 91.62 % for Datasets IIIa and IVa respectively. This approach is further strengthened by analyzing real-time data with the accuracy of 93.75 %. This method qualifies out of four benchmark methods with significant percent of improvement in accuracy for these three datasets. As per the spatial distribution of refined EEG channels, majority of the brain's motor functions concentrates on frontal and central cortex regions of brain.

Enhancing detection of SSVEP-based BCIs via a novel temporally local canonical correlation analysis

BackgroundIn recent years, spatial filter-based frequency recognition methods have become popular in steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems. However, these methods are ineffective in suppressing local noise, and they rely on the length of the data. In practical applications, enhancing recognition performance with short data windows is a significant challenge for the BCI systems. New methodWith extracting temporal information and eliminating local noise, a temporally local canonical correlation analysis based on training data-driven (TI-tdCCA) method is proposed to enhance the recognition performance of SSVEPs. Based on a novel framework, the filters are derived by incorporating the Laplacian matrix through the use of TI-CCA between the concatenated training data and individual templates. The target frequency is subsequently determined by applying the appropriate spatial filters and Laplacian matrix. ResultsThe experimental results on two datasets, consisting of 40 classes and recording from 35 and 70 subjects respectively, demonstrate that the proposed method consistently outperforms the eight competing methods in the majority of cases. The proposed method is simultaneously evaluated by an extended version that incorporates artificial reference signals. The extended method demonstrates a significant improvement over the proposed method. Specifically, with a time window of 0.7 s, the average recognition accuracy of the subjects increases by 10.71 % on the Benchmark dataset and by 6.98 % on the BETA dataset, respectively. Comparison with existing methodsOur extended method outperforms the state-of-the-art methods by at least 3 %, and it effectively suppresses local noise and maintains excellent scalability. Conclusions for research articlesThe proposed method can effectively combine spatial and temporal filters to improve the recognition performance of SSVEPs.

Leveraging Transfer Superposition Theory for StableState Visual Evoked Potential Cross-Subject Frequency Recognition.

In steady-state visual evoked potential (SSVEP)based brain-computer interfaces (BCIs), various spatial filtering methods based on individual calibration data have been proposed to alleviate the interference of spontaneous activities in SSVEP signals for enhancing the SSVEP detection performance. However, the necessary calibration procedures take time, cause visual fatigue and reduce usability. For the calibration-free scenario, we propose a cross-subject frequency identification method based on transfer superimposed theory for SSVEP frequency decoding. First, a multi-channel signal decomposition model was constructed. Next, we used the cross least squares iterative method to create individual specific transfer spatial filters as well as source subject transfer superposition templates in the source subject. Then, we identified common knowledge among source subjects using a prototype spatial filter to make common transfer spatial filters and common impulse responses. Following, we reconstructed a global transfer superimposition template with SSVEP frequency characteristics. Finally, an ensemble cross-subject transfer learning method was proposed for SSVEP frequency recognition by combining the sourcesubject transfer mode, the global transfer mode, and the sinecosine reference template. Offline tests on two public datasets show that the proposed method significantly outperforms the FBCCA, TTCCA, and CSSFT methods. More importantly, the proposed method can be directly used in online SSVEP recognition without calibration. The proposed algorithm was robust, which is important for a practical BCI.

Attention-based CNN model for motor imagery classification from nonlinear EEG signals

Motor imagery (MI)-based brain–computer interface (BCI) provides a promising solution for the limb rehabilitation of stroke patients. For better rehabilitation performance, high-precision classification of MI-related EEG signals plays a critical role. However, this is still a challenging problem for multi-category MI signals. In this paper, we focus on four commonly used stroke rehabilitation actions, and propose a modular temporal–spatial attention-based CNN (MTSACNN) model for MI classification. In detail, we carry out the MI experiments and acquire the EEG signals related to imagining left/right fist clenching and left/right wrist dorsiflexion. MTSACNN model firstly extracts the low-order MI features through the temporal–spatial feature extraction module (TSFE module). Especially, a group attention mechanism is proposed for intra-group information interaction. Secondly, considering the short- and long-term working characteristics of brain, high-order temporal features are further extracted and fused by the multi-level feature fusion module (MLFF module). Finally, four auxiliary losses are arranged in the classification module (C module) to speed up the model optimization process. The experimental results show that MTSACNN model can achieve good performance in decoding rehabilitation-related MI brain intentions, achieving an average classification accuracy of 72.05% for fourteen subjects. This work is beneficial to promote the construction of high-performance stroke rehabilitation BCI system.

A temporal–spectral fusion transformer with subject-specific adapter for enhancing RSVP-BCI decoding

The Rapid Serial Visual Presentation (RSVP)-based Brain–Computer Interface (BCI) is an efficient technology for target retrieval using electroencephalography (EEG) signals. The performance improvement of traditional decoding methods relies on a substantial amount of training data from new test subjects, which increases preparation time for BCI systems. Several studies introduce data from existing subjects to reduce the dependence of performance improvement on data from new subjects, but their optimization strategy based on adversarial learning with extensive data increases training time during the preparation procedure. Moreover, most previous methods only focus on the single-view information of EEG signals, but ignore the information from other views which may further improve performance. To enhance decoding performance while reducing preparation time, we propose a Temporal-Spectral fusion transformer with Subject-specific Adapter (TSformer-SA). Specifically, a cross-view interaction module is proposed to facilitate information transfer and extract common representations across two-view features extracted from EEG temporal signals and spectrogram images. Then, an attention-based fusion module fuses the features of two views to obtain comprehensive discriminative features for classification. Furthermore, a multi-view consistency loss is proposed to maximize the feature similarity between two views of the same EEG signal. Finally, we propose a subject-specific adapter to rapidly transfer the knowledge of the model trained on data from existing subjects to decode data from new subjects. Experimental results show that TSformer-SA significantly outperforms comparison methods and achieves outstanding performance with limited training data from new subjects. This facilitates efficient decoding and rapid deployment of BCI systems in practical use.

A brief survey on human activity recognition using motor imagery of EEG signals.

Human being's biological processes and psychological activities are jointly connected to the brain. So, the examination of human activity is more significant for the well-being of humans. There are various models for brain activity detection considering neuroimaging for attaining decreased time requirement, increased control commands, and enhanced accuracy. Motor Imagery (MI)-based Brain-Computer Interface (BCI) systems create a way in which the brain can interact with the environment by processing Electroencephalogram (EEG) signals. Human Activity Recognition (HAR) deals with identifying the physiological activities of human beings based on sensory signals. This survey reviews the different methods available for HAR based on MI-EEG signals. A total of 50 research articles based on HAR from EEG signals are considered in this survey. This survey discusses the challenges faced by various techniques for HAR. Moreover, the papers are assessed considering various parameters, techniques, publication year, performance metrics, utilized tools, employed databases, etc. There were many techniques developed to solve the problem of HAR and they are classified as Machine Learning (ML) and Deep Learning (DL)models. At last, the research gaps and limitations of the techniques were discussed that contribute to developing an effective HAR.

User-wise perturbations for user identity protection in EEG-based BCIs.

An electroencephalogram (EEG)-based brain-computer interface (BCI) is a direct communication pathway between the human brain and a computer. Most research so far studied more accurate BCIs, but much less attention has been paid to the ethics of BCIs. Aside from task-specific information, EEG signals also contain rich private information, e.g., user identity, emotion, disorders, etc., which should be protected. We show for the first time that adding user-wise perturbations can make identity information in EEG unlearnable. We propose four types of user-wise privacy-preserving perturbations, i.e., random noise, synthetic noise, error minimization noise, and error maximization noise. After adding the proposed perturbations to EEG training data, the user identity information in the data becomes unlearnable, while the BCI task information remains unaffected. Experiments on six EEG datasets using three neural network classifiers and various traditional machine learning models demonstrated the robustness and practicability of the proposed perturbations. Our research shows the feasibility of hiding user identity information in EEG data without impacting the primary BCI task information.

Towards imagined speech: Identification of brain states from EEG signals for BCI-based communication systems

BackgroundThe electroencephalogram (EEG) based brain-computer interface (BCI) system employing imagined speech serves as a mechanism for decoding EEG signals to facilitate control over external devices or communication with the external world at the moment the user desires. To effectively deploy such BCIs, it is imperative to accurately discern various brain states from continuous EEG signals when users initiate word imagination. New methodThis study involved the acquisition of EEG signals from 15 subjects engaged in four states: resting, listening, imagined speech, and actual speech, each involving a predefined set of 10 words. The EEG signals underwent preprocessing, segmentation, spatio-temporal and spectral analysis of each state, and functional connectivity analysis using the phase locking value (PLV) method. Subsequently, five features were extracted from the frequency and time-frequency domains. Classification tasks were performed using four machine learning algorithms in both pair-wise and multiclass scenarios, considering subject-dependent and subject-independent data. ResultsIn the subject-dependent scenario, the random forest (RF) classifier achieved a maximum accuracy of 94.60 % for pairwise classification, while the artificial neural network (ANN) classifier achieved a maximum accuracy of 66.92 % for multiclass classification. In the subject-independent scenario, the random forest (RF) classifier achieved maximum accuracies of 81.02 % for pairwise classification and 55.58 % for multiclass classification. Moreover, EEG signals were classified based on frequency bands and brain lobes, revealing that the theta (θ) and delta (δ) bands, as well as the frontal and temporal lobes, are sufficient for distinguishing between brain states. ConclusionThe findings promise to develop a system capable of automatically segmenting imagined speech segments from continuous EEG signals.

Adversarial artifact detection in EEG-based brain–computer interfaces

Objective. machine learning has achieved significant success in electroencephalogram (EEG) based brain-computer interfaces (BCIs), with most existing research focusing on improving the decoding accuracy. However, recent studies have shown that EEG-based BCIs are vulnerable to adversarial attacks, where small perturbations added to the input can cause misclassification. Detecting adversarial examples is crucial for both understanding this phenomenon and developing effective defense strategies.Approach. this paper, for the first time, explores adversarial detection in EEG-based BCIs. We extend several popular adversarial detection approaches from computer vision to BCIs. Two new Mahalanobis distance based adversarial detection approaches, and three cosine distance based adversarial detection approaches, are also proposed, which showed promising performance in detecting three kinds of white-box attacks.Main results. we evaluated the performance of eight adversarial detection approaches on three EEG datasets, three neural networks, and four types of adversarial attacks. Our approach achieved an area under the curve score of up to 99.99% in detecting white-box attacks. Additionally, we assessed the transferability of different adversarial detectors to unknown attacks.Significance. through extensive experiments, we found that white-box attacks may be easily detected, and differences exist in the distributions of different types of adversarial examples. Our work should facilitate understanding the vulnerability of existing BCI models and developing more secure BCIs in the future.

Short-length SSVEP data extension by a novel generative adversarial networks based framework.

Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.

The Development of a Multicommand Tactile Event-Related Potential-Based Brain–Computer Interface Utilizing a Low-Cost Wearable Vibrotactile Stimulator

A tactile event-related potential (ERP)-based brain–computer interface (BCI) system is an alternative for enhancing the control and communication abilities of quadriplegic patients with visual or auditory impairments. Hence, in this study, we proposed a tactile stimulus pattern using a vibrotactile stimulator for a multicommand BCI system. Additionally, we observed a tactile ERP response to the target from random vibrotactile stimuli placed in the left and right wrist and elbow positions to create commands. An experiment was conducted to explore the location of the proposed vibrotactile stimulus and to verify the multicommand tactile ERP-based BCI system. Using the proposed features and conventional classification methods, we examined the classification efficiency of the four commands created from the selected EEG channels. The results show that the proposed vibrotactile stimulation with 15 stimulus trials produced a prominent ERP response in the Pz channels. The average classification accuracy ranged from 61.9% to 79.8% over 15 stimulus trials, requiring 36 s per command in offline processing. The P300 response in the parietal area yielded the highest average classification accuracy. The proposed method can guide the development of a brain–computer interface system for physically disabled people with visual or auditory impairments to control assistive and rehabilitative devices.

A Systematic Investigation Based on BCI and EEG Implemented using Machine Learning Algorithms

BCI is a strong tool that improves human-system communication. It improves the brain's ability to interact with its surroundings. Recent decades have seen substantial advances in neuroscience and computer science. This has made BCI a leader in computational neuroscience and intelligence research. Recent technological advances including wearable sensing devices, real-time data streaming, machine learning, and deep learning have raised the need for electroencephalographic (EEG)-based brain-computer interface (BCI) in clinical and translational applications. EEG-based Brain-Computer Interfaces (BCIs) detect cognitive state variations throughout laborious tasks, making them advantageous for individuals. To fill in the gaps in the wide overview of the past five years (2019-2024), we surveyed the newest research on EEG signal detection and computational intelligence in brain-computer interfaces. To provide a more accurate account, we will begin by reviewing Brain-Computer Interface (BCI) technology and its main challenges. Modern signal detection and enhancement techniques for EEG signal collection and refinement follow. We also provide advanced computational intelligence methods for tracking, maintaining, and monitoring human cognitive and operational performance in everyday applications. Combinations, interpretable fuzzy models, transfer learning, and deep learning are used. We conclude with a sample of cutting-edge BCI-driven healthcare applications and explore future EEG-based BCI research.

Ensemble strategies exploration for the calibration data optimized spatial filters based SSVEP recognition algorithms

Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) exhibit high information transfer rate (ITR) characteristics. However, the electroencephalogram (EEG) data encoding SSVEP patterns has a low signal-to-noise ratio, leading to limitations in applications. To enhance the application of SSVEP-BCIs, various SSVEP recognition algorithms have been developed by utilizing prior knowledge based on the calibration data optimized spatial filters (CDOSF). Yet, the process of combining spatial filters from multiple stimuli remains unexplored, resulting in performance bottlenecks for SSVEP recognition and application scenarios. In this study, we provide an overview of four popular CDOSF-based SSVEP recognition algorithms and introduce three ensemble strategies to extend these recognition algorithms. For comparison purposes, we selected three benchmark SSVEP datasets and conducted comparative experiments on the three ensemble strategies across the four recognition algorithms. The experimental results demonstrate that the ensemble strategies significantly enhance SSVEP recognition accuracy and ITR. Ablation studies also confirm that ensemble strategies possess characteristics of requiring less calibration data, fewer EEG channels, and insensitivity to parameters. The ensemble strategies extended CDOSF-based recognition algorithms offer a novel choice for constructing SSVEP-BCIs.

Deep learning in motor imagery EEG signal decoding: A Systematic Review

Thanks to the fast evolution of electroencephalography (EEG)-based brain–computer interfaces (BCIs) and computing technologies, as well as the availability of large EEG datasets, decoding motor imagery (MI) EEG signals is rapidly shifting from traditional machine learning (ML) to deep learning (DL) approaches. Furthermore, real-world MI-EEG BCI applications are progressively requiring higher generalization capabilities, which can be achieved by leveraging publicly available MI-EEG datasets and high-performance decoding models. Within this context, this paper provides a systematic review of DL approaches for MI-EEG decoding, focusing on studies that work on publicly available EEG-MI datasets. This review paper firstly provides a clear overview of these datasets that can be used for DL model training and testing. Afterwards, considering each dataset, related DL studies are discussed with respect to the four decoding paradigms identified in the literature, i.e., subject-dependent, subject-independent, transfer learning, and global decoding paradigms. Having analyzed the reviewed studies, the current trends and strategies, popular architectures, baseline models that are used for comprehensive analysis, and techniques to ensure reproducibility of the results in DL-based MI-EEG decoding are also identified and discussed. The selection and screening of the studies included in this review follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, leading to a comprehensive analysis of 394 papers published between January 1, 2017, and January 23, 2023.

Enhancing complex upper-limb motor imagery discrimination through an incremental training strategy

Motor Imagery (MI)-based Brain–Computer Interface (BCI) systems are a great technological advance for the recovery of lost movements in people with severe motor impairments. Different Artificial Intelligence (AI) techniques with supervised methods have been explored for MI task discrimination, especially static movements from left and right hands. Due to different factors affecting MI-based Electroencephalography (EEG) signals related to physical and cognitive conditions, the success rate of BCIs is still low. Currently, there is a need to explore the MI of complex movements associated with Activities of Daily Living (ADLs), which brings challenges to the scientific community. In this work, an incremental training methodology for Artificial Neural Networks (ANNs) is proposed for discrimination of complex MI tasks. MI-Rest and MI-Task related to the imagination of manipulating a drinking cup were discriminated by implementing an Action Observation (AO)-based protocol in a first-person 2D virtual reality. Thirty healthy individuals were recruited to evaluate our complex MI classification approach. The incremental training proposed achieves significantly higher performance (p<0.05) compared to the non-incremental training. Additionally, the proposed method is significantly superior compared to widely applied methods for MI task discrimination: Power Spectrum (PS), Common Spatial Patterns (CSP), Filter Bank Common Spatial Patterns (FBCSP), each using four baseline Machine Learning (ML) methods for classification. The results show an improvement between 5 and 20% according to both Accuracy (ACC) and False Positive Rate (FPR). The proposed methodology obtained promising results, useful for AI-based BCI training, which would allow the development of more robust systems for neurorehabilitation purposes.

High-frequency SSVEP-BCI system for detecting intermodulation frequency components using task-discriminant component analysis

Recently, steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has significantly progressed and is moving from the laboratory to practical application. However, the system performance and comfort of SSVEP-BCIs still need to be improved. In this study, five flicker frequencies (i.e., 30–34 Hz with an interval of 1 Hz) and eight scaling frequencies (i.e., 0.4–1.8 Hz with an interval of 0.2 Hz) were adopted to jointly encode forty visual stimulus targets using evoked intermodulation (IM) frequency components. Both luminance and shape changes are implemented by sinusoidal sampling stimulus coding methods. High-frequency flicker frequencies and green visual stimuli were chosen to improve the comfort of the proposed system. An extended version of a training algorithm named task-discriminant component analysis (TDCA) was proposed to detect the IM components of SSVEP signals. The average recognition accuracy of eleven subjects is 96.82 ± 0.01 % in the offline experiments for a data length of 5 s. Online validation experiments was constructed from the optimized parameters of offline analysis, and the average accuracy and ITR were 94.37 ± 1.17 % and 113.47 ± 2.60 bits/min, respectively. Furthermore, ten subjects who participated in the validation part also completed the online free-spell task successfully. These results showed that it is feasible to expand the number of stimulus targets by using IM frequency components of SSVEP signals for target coding, and that the system performance is superior.

Enhancing Domain Diversity of Transfer Learning-Based SSVEP-BCIs by the Reconstruction of Channel Correlation.

The application of transfer learning, specifically pre-training and fine-tuning, in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) has been demonstrated to effectively improve the classification performance of deep learning methods with limited calibration data. However, effectively learning task-related knowledge from source domains during the pre-training phase remains challenging. To address this issue, this study proposes an effective data augmentation method called Reconstruction of Channel Correlation (RCC) to optimize the utilization of the source domain data. Concretely, RCC reconstructs training samples using probabilistically mixed eigenvector matrices derived from covariance matrices across source domains. This process manipulates the channel correlation of training samples, implicitly creating novel synthesized domains. By increasing the diversity of source domains, RCC aims to enhance the domain generalizability of the pre-trained model. The effectiveness of RCC is validated through subject-independent and subject-adaptive classification experiments. The results of subject-independent classification demonstrate that RCC significantly improves the classification performance of the pre-trained model on unseen target subjects. Moreover, when compared to the fine-tuning process using the RCC-absent pre-trained model, the fine-tuning process using the RCC-enhanced pre-trained model yields significantly improved performance in the subject-adaptive classification. RCC proves to enhance the performance of transfer learning by optimizing the utilization of the source domain data. The RCC-enhanced transfer learning has the potential to facilitate the practical implementation of SSVEP-BCIs in real-world scenarios.

Decoding working-memory load during n-back task performance from high channel fNIRS data

Objective.Functional near-infrared spectroscopy (fNIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab and in practical occupational settings. fNIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, this research has largely relied on probes with channel counts from under ten to several hundred, although recently a new class of wearable NIRS devices featuring thousands of channels has emerged. This poses unique challenges for ML classification, as fNIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art or better performance can be achieved.Approach.To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that, to our knowledge, has not been used in previous fNIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches.Main results.We show that using the proposed methodology, it is possible to achieve state-of-the-art decoding performance with high-resolution fNIRS data. We also replicated several state-of-the-art approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing then-Back task and show that these existing methodologies struggle in the high-channel regime and are largely outperformed by the proposed pipeline.Significance.Our approach helps establish high-channel NIRS devices as a viable platform for state-of-the-art BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.

Distraction impact of concurrent conversation on event-related potential based brain-computer interfaces

Objective.This study investigates the impact of conversation on the performance of visual event-related potential (ERP)-based brain-computer interfaces (BCIs), considering distractions in real life environment. The research aims to understand how cognitive distractions from speaking and listening activities affect ERP-BCI performance.Approach.The experiment employs a dual-task paradigm where participants control a smart light using visual ERP-BCIs while simultaneously conducting speaking or listening tasks.Main results.The findings reveal that speaking notably degrades BCI accuracy and the amplitude of ERP components, while increases the latency variability of ERP components and occipital alpha power. In contrast, listening and simple syllable repetition tasks have a lesser impact on these variables. The results suggest that speaking activity significantly distracts visual attentional processes critical for BCI operationSignificance. This study highlights the need to take distractions by daily conversation into account of the design and implementation of ERP-BCIs.