Brain-computer Interface Studies Research Articles

An auditory selective attention brain-computer interface system based on auditory steady-state response

Auditory steady-state response (ASSR) is a brain steady-state response induced by periodic sound signals, which can be used to build an auditory brain-computer interface (BCI), thereby providing a pathway for visually impaired patients to communicate with the outside world. Most of existing ASSR-based BCI studies use linear discriminant classifier (LDA) and spatial coherence to detect ASSRs. Therefore, there is an urgent need for efficient electroencephalogram (EEG) decoding methods to improve the performance of ASSR-based BCI systems. In this study, we elicited ASSRs using sinusoidal amplitude modulated (SAM) tones that simultaneously delivered different modulation frequencies (i.e., 37 Hz for the left channel and 43 Hz for the right channel). Subjects were asked to focus their attention on the auditory stimulation on one side according to the auditory cue. Filter bank common spatial pattern (FBCSP) algorithm was innovatively introduced to detect the ASSRs. Offline results showed that the brain region with strong ASSRs was the central forehead area, and when subjects paid attention to the auditory stimulation at 37 Hz or 43 Hz, the ASSR response of 37 Hz or 43 Hz on the corresponding side would be enhanced compared to the no attention condition. Online results obtained from twelve healthy subjects showed that the mean recognition accuracy of the proposed ASSR-based BCI system achieved a mean accuracy of 82.22 ± 3.11 %. Moreover, the present study further verified that weak auditory stimuli with low stimulus intensity (i.e., 40 dB SPL) could also be used to build ASSR-based BCIs, and achieved an online mean accuracy of 78.89 ± 2.54 %. These results verified that the FBCSP algorithm could be used for detecting ASSRs and the feasibility of the proposed ASSR-based BCI system, providing a great idea for building a high-speed ASSR-based BCI system.

Review on the Use of Brain Computer Interface Rehabilitation Methods for Treating Mental and Neurological Conditions.

This review provides a comprehensive examination of recent developments in both neurofeedback and brain-computer interface (BCI) within the medical field and rehabilitation. By analyzing and comparing results obtained with various tools and techniques, we aim to offer a systematic understanding of BCI applications concerning different modalities of neurofeedback and input data utilized. Our primary objective is to address the existing gap in the area of meta-reviews, which provides a more comprehensive outlook on the field, allowing for the assessment of the current landscape and developments within the scope of BCI. Our main methodologies include meta-analysis, search queries employing relevant keywords, and a network-based approach. We are dedicated to delivering an unbiased evaluation of BCI studies, elucidating the primary vectors of research development in this field. Our review encompasses a diverse range of applications, incorporating the use of brain-computer interfaces for rehabilitation and the treatment of various diagnoses, including those related to affective spectrum disorders. By encompassing a wide variety of use cases, we aim to offer a more comprehensive perspective on the utilization of neurofeedback treatments across different contexts. The structured and organized presentation of information, complemented by accompanying visualizations and diagrams, renders this review a valuable resource for scientists and researchers engaged in the domains of biofeedback and brain-computer interfaces.

Brain-computer interfaces and human factors: the role of language and cultural differences-Still a missing gap?

Brain-computer interfaces (BCIs) aim at the non-invasive investigation of brain activity for supporting communication and interaction of the users with their environment by means of brain-machine assisted technologies. Despite technological progress and promising research aimed at understanding the influence of human factors on BCI effectiveness, some topics still remain unexplored. The aim of this article is to discuss why it is important to consider the language of the user, its embodied grounding in perception, action and emotions, and its interaction with cultural differences in information processing in future BCI research. Based on evidence from recent studies, it is proposed that detection of language abilities and language training are two main topics of enquiry of future BCI studies to extend communication among vulnerable and healthy BCI users from bench to bedside and real world applications. In addition, cultural differences shape perception, actions, cognition, language and emotions subjectively, behaviorally as well as neuronally. Therefore, BCI applications should consider cultural differences in information processing to develop culture- and language-sensitive BCI applications for different user groups and BCIs, and investigate the linguistic and cultural contexts in which the BCI will be used.

Neural Correlates of Motor/Tactile Imagery and Tactile Sensation in a BCI paradigm: A High-Density EEG Source Imaging Study.

Complementary to brain-computer interface (BCI) based on motor imagery (MI) task, sensory imagery (SI) task provides a way for BCI construction using brain activity from somatosensory cortex. The underlying neurophysiological correlation between SI and MI was unclear and difficult to measure through behavior recording. In this study, we investigated the underlying neurodynamic of motor/tactile imagery and tactile sensation tasks through a high-density electroencephalogram (EEG) recording, and EEG source imaging was used to systematically explore the cortical activation differences and correlations between the tasks. In the experiment, participants were instructed to perform the left and right hand tasks in MI paradigm, sensory stimulation (SS) paradigm and SI paradigm. The statistical results demonstrated that the imagined MI and SI tasks differed from each other within ipsilateral sensorimotor scouts, frontal and right temporal areas in α bands, whereas real SS and imagined SI showed a similar activation pattern. The similarity between SS and SI may provide a way to train the BCI system, while the difference between MI and SI may provide a way to integrate the discriminative information between them to enhance BCI performance. The combination of the tasks and its underlying neurodynamic would provide a new approach for BCI designation for a wider application. BCI studies concentrate on the hybrid decoding method combining MI or SI with SS, but the underlining neurophysiological correlates between them were unclear. MI and SI differed from each other within the ipsilateral sensorimotor cortex in alpha bands. This is a first study to investigate the neurophysiological relationship between MI and SI through an EEG source imaging approach from high-density EEG recording.

Pseudo-online framework for BCI evaluation: a MOABB perspective using various MI and SSVEP datasets

Objective. BCI (Brain–Computer Interfaces) operate in three modes: online, offline, and pseudo-online. In online mode, real-time EEG data is constantly analyzed. In offline mode, the signal is acquired and processed afterwards. The pseudo-online mode processes collected data as if they were received in real-time. The main difference is that the offline mode often analyzes the whole data, while the online and pseudo-online modes only analyze data in short time windows. Offline processing tends to be more accurate, while online analysis is better for therapeutic applications. Pseudo-online implementation approximates online processing without real-time constraints. Many BCI studies being offline introduce biases compared to real-life scenarios, impacting classification algorithm performance. Approach. The objective of this research paper is therefore to extend the current MOABB framework, operating in offline mode, so as to allow a comparison of different algorithms in a pseudo-online setting with the use of a technology based on overlapping sliding windows. To do this will require the introduction of a idle state event in the dataset that takes into account all different possibilities that are not task thinking. To validate the performance of the algorithms we will use the normalized Matthews correlation coefficient and the information transfer rate. Main results. We analyzed the state-of-the-art algorithms of the last 15 years over several motor imagery and steady state visually evoked potential multi-subjects datasets, showing the differences between the two approaches from a statistical point of view. Significance. The ability to analyze the performance of different algorithms in offline and pseudo-online modes will allow the BCI community to obtain more accurate and comprehensive reports regarding the performance of classification algorithms.

Effect of alpha range activity on SSVEP decoding in brain-computer interfaces.

Brain-computer interfaces (BCIs) facilitate direct communication between the brain and external devices. For BCI technology to be commercialized for wide scale applications, BCIs should be accurate, efficient, and exhibit consistency in performance for a wide variety of users. A core challenge is the physiological and anatomical differences amongst people, which causes a high variability amongst participants in BCI studies. Hence, it becomes necessary to analyze the mechanisms causing this variability and address them by improving the decoding algorithms. In this paper, a publicly available steady-state visual evoked potential (SSVEP) dataset is analyzed to study the effect of SSVEP flicker on the endogenous alpha power and the subsequent overall effect on the classification accuracy of the participants. It was observed that the participants with classification accuracy below 95% showed increased alpha power in their brain activities. Incorrect prediction in the decoding algorithm was observed a maximum number of times when the predicted frequency was in the range 9-12 Hz. We conclude that frequencies between 9-12 Hz may result in below par performance in some participants when canonical correlation analysis is used for classification.Clinical relevance-If alpha-band frequencies are used for SSVEP stimulation, alpha power interference in EEG may alter BCI accuracy for some users.

Intracortical brain-computer interfaces in primates: a review and outlook.

Brain-computer interfaces (BCI) translate brain signals into artificial output to restore or replace natural central nervous system (CNS) functions. Multiple processes, including sensorimotor integration, decision-making, motor planning, execution, and updating, are involved in any movement. For example, a BCI may be better able to restore naturalistic motor behaviors if it uses signals from multiple brain areas and decodes natural behaviors' cognitive and motor aspects. This review provides an overview of the preliminary information necessary to plan a BCI project focusing on intracortical implants in primates. Since the brain structure and areas of non-human primates (NHP) are similar to humans, exploring the result of NHP studies will eventually benefit human BCI studies. The different types of BCI systems based on the target cortical area, types of signals, and decoding methods will be discussed. In addition, various successful state-of-the-art cases will be reviewed in more detail, focusing on the general algorithm followed in the real-time system. Finally, an outlook for improving the current BCI research studies will be debated.

Non-human primate models and systems for gait and neurophysiological analysis.

Brain-computer interfaces (BCIs) have garnered extensive interest and become a groundbreaking technology to restore movement, tactile sense, and communication in patients. Prior to their use in human subjects, clinical BCIs require rigorous validation and verification (V&V). Non-human primates (NHPs) are often considered the ultimate and widely used animal model for neuroscience studies, including BCIs V&V, due to their proximity to humans. This literature review summarizes 94 NHP gait analysis studies until 1 June, 2022, including seven BCI-oriented studies. Due to technological limitations, most of these studies used wired neural recordings to access electrophysiological data. However, wireless neural recording systems for NHPs enabled neuroscience research in humans, and many on NHP locomotion, while posing numerous technical challenges, such as signal quality, data throughout, working distance, size, and power constraint, that have yet to be overcome. Besides neurological data, motion capture (MoCap) systems are usually required in BCI and gait studies to capture locomotion kinematics. However, current studies have exclusively relied on image processing-based MoCap systems, which have insufficient accuracy (error: ≥4° and 9 mm). While the role of the motor cortex during locomotion is still unclear and worth further exploration, future BCI and gait studies require simultaneous, high-speed, accurate neurophysiological, and movement measures. Therefore, the infrared MoCap system which has high accuracy and speed, together with a high spatiotemporal resolution neural recording system, may expand the scope and improve the quality of the motor and neurophysiological analysis in NHPs.

Sitting and Standing Intention Detection Based on Dynamical Region Connectivity and Entropy of EEG

Based on the brain signals, decoding and analyzing the gait features to make a reliable prediction of action intention are the core issues in the brain computer interface (BCI)-based hybrid rehabilitation and intelligent walking aid robot system. In order to realize the classification and recognition of the most basic gait processes such as standing, sitting, and quiet, this paper proposes a feature representation method based on the signal complexity and entropy of each brain region. Through the statistical analysis of these parameters between different conditions, these characteristics which sensitive to different actions are determined as a feature vector, and the classification and recognition of these actions are completed by combing support vector machine, linear discriminant analysis, and logistic regression. Experimental results show the proposed method can better realize the recognition of the aforementioned action intention. The recognition accuracy of standing, sitting, and quiet of 13 subjects is higher than 80.9%, and the highest one can reach 86.8%. Directed dynamic brain network analysis of the 8 brain regions shows that the occurrence of lower limb movement will weaken the dependence between brain regions, resulting in the weakening of network topological connection. The result has significant value for understanding human’s brain cognitive characteristics in the process of lower limb movement and carrying out the study of BCI based strategy and system for lower limb rehabilitation.

Impact of dataset size and long-term ECoG-based BCI usage on deep learning decoders performance.

In brain-computer interfaces (BCI) research, recording data is time-consuming and expensive, which limits access to big datasets. This may influence the BCI system performance as machine learning methods depend strongly on the training dataset size. Important questions arise: taking into account neuronal signal characteristics (e.g., non-stationarity), can we achieve higher decoding performance with more data to train decoders? What is the perspective for further improvement with time in the case of long-term BCI studies? In this study, we investigated the impact of long-term recordings on motor imagery decoding from two main perspectives: model requirements regarding dataset size and potential for patient adaptation. We evaluated the multilinear model and two deep learning (DL) models on a long-term BCI & Tetraplegia (ClinicalTrials.gov identifier: NCT02550522) clinical trial dataset containing 43 sessions of ECoG recordings performed with a tetraplegic patient. In the experiment, a participant executed 3D virtual hand translation using motor imagery patterns. We designed multiple computational experiments in which training datasets were increased or translated to investigate the relationship between models' performance and different factors influencing recordings. Our results showed that DL decoders showed similar requirements regarding the dataset size compared to the multilinear model while demonstrating higher decoding performance. Moreover, high decoding performance was obtained with relatively small datasets recorded later in the experiment, suggesting motor imagery patterns improvement and patient adaptation during the long-term experiment. Finally, we proposed UMAP embeddings and local intrinsic dimensionality as a way to visualize the data and potentially evaluate data quality. DL-based decoding is a prospective approach in BCI which may be efficiently applied with real-life dataset size. Patient-decoder co-adaptation is an important factor to consider in long-term clinical BCI.

A survey on encoding and decoding technology of non-invasive brain-computer interface

A survey on encoding and decoding technology of non-invasive brain-computer interface

Sound Target Detection Under Noisy Environment Using Brain-Computer Interface.

As an important means of environmental reconnaissance and regional security protection, sound target detection (STD) has been widely studied in the field of machine learning for a long time. Considering the shortcomings of the robustness and generalization performance of existing methods based on machine learning, we proposed a target detection method by an auditory brain-computer interface (BCI). We designed the experimental paradigm according to the actual application scenarios of STD, recorded the changes in Electroencephalogram (EEG) signals during the process of detecting target sound, and further extracted the features used to decode EEG signals through the analysis of neural representations, including Event-Related Potential (ERP) and Event-Related Spectral Perturbation (ERSP). Experimental results showed that the proposed method achieved good detection performance under noisy environment. As the first study of BCI applied to STD, this study shows the feasibility of this scheme in BCI and can serve as the foundation for future related applications.

Decoding the Continuous Motion Imagery Trajectories of Upper Limb Skeleton Points for EEG-Based Brain–Computer Interface

In the field of brain–computer interface (BCI), brain decoding using electroencephalography (EEG) is an essential direction, and motion imagery EEG-based BCI can not only help rehabilitation of patients with physical disabilities, but also enhance the endurance and power of people. Most of the existing MI-based BCI studies are limited to discrete EEG classification or 3-D directional limb trajectory reconstruction. To suitable for the requirements of BCI systems in practical applications, here, we explored the decoding of trajectories of continuous nondirectional motion imagination in 3-D space based on Chinese sign language. We propose a motion imagery trajectory reconstruction Transformer (MITRT) model to decode the EEG signals of the subjects performing motion imagery, and obtain the positional changes in the 3-D space of the shoulder, elbow, and wrist skeleton points in the neural activity. We add the geometric constraint features of upper limb skeleton points to the model, and the MITRT decoding model can obtain prior knowledge to improve the reconstruction accuracy of spatial positions. To verify the decoding performance of our proposed model, we collected motor imagery (MI) EEG signals of 20 subjects based on Chinese sign language for experiments. The experimental results show that the average Pearson correlation coefficient of the six skeleton points was 0.975, which was significantly higher than the contrast models. This study is the first attempt to reconstruct multidirectional continuous nondirectional upper limb MI trajectories based on Chinese sign language. The experimental results show that it is feasible to decode and reconstruct imagined 3-D trajectories of human upper limb skeleton points from scalp EEG.

NeuroGrasp: Real-Time EEG Classification of High-Level Motor Imagery Tasks Using a Dual-Stage Deep Learning Framework.

Brain-computer interfaces (BCIs) have been widely employed to identify and estimate a user's intention to trigger a robotic device by decoding motor imagery (MI) from an electroencephalogram (EEG). However, developing a BCI system driven by MI related to natural hand-grasp tasks is challenging due to its high complexity. Although numerous BCI studies have successfully decoded large body parts, such as the movement intention of both hands, arms, or legs, research on MI decoding of high-level behaviors such as hand grasping is essential to further expand the versatility of MI-based BCIs. In this study, we propose NeuroGrasp, a dual-stage deep learning framework that decodes multiple hand grasping from EEG signals under the MI paradigm. The proposed method effectively uses an EEG and electromyography (EMG)-based learning, such that EEG-based inference at test phase becomes possible. The EMG guidance during model training allows BCIs to predict hand grasp types from EEG signals accurately. Consequently, NeuroGrasp improved classification performance offline, and demonstrated a stable classification performance online. Across 12 subjects, we obtained an average offline classification accuracy of 0.68 (±0.09) in four-grasp-type classifications and 0.86 (±0.04) in two-grasp category classifications. In addition, we obtained an average online classification accuracy of 0.65 (±0.09) and 0.79 (±0.09) across six high-performance subjects. Because the proposed method has demonstrated a stable classification performance when evaluated either online or offline, in the future, we expect that the proposed method could contribute to different BCI applications, including robotic hands or neuroprosthetics for handling everyday objects.

A pediatric near-infrared spectroscopy brain-computer interface based on the detection of emotional valence.

Brain-computer interfaces (BCIs) are being investigated as an access pathway to communication for individuals with physical disabilities, as the technology obviates the need for voluntary motor control. However, to date, minimal research has investigated the use of BCIs for children. Traditional BCI communication paradigms may be suboptimal given that children with physical disabilities may face delays in cognitive development and acquisition of literacy skills. Instead, in this study we explored emotional state as an alternative access pathway to communication. We developed a pediatric BCI to identify positive and negative emotional states from changes in hemodynamic activity of the prefrontal cortex (PFC). To train and test the BCI, 10 neurotypical children aged 8–14 underwent a series of emotion-induction trials over four experimental sessions (one offline, three online) while their brain activity was measured with functional near-infrared spectroscopy (fNIRS). Visual neurofeedback was used to assist participants in regulating their emotional states and modulating their hemodynamic activity in response to the affective stimuli. Child-specific linear discriminant classifiers were trained on cumulatively available data from previous sessions and adaptively updated throughout each session. Average online valence classification exceeded chance across participants by the last two online sessions (with 7 and 8 of the 10 participants performing better than chance, respectively, in Sessions 3 and 4). There was a small significant positive correlation with online BCI performance and age, suggesting older participants were more successful at regulating their emotional state and/or brain activity. Variability was seen across participants in regards to BCI performance, hemodynamic response, and discriminatory features and channels. Retrospective offline analyses yielded accuracies comparable to those reported in adult affective BCI studies using fNIRS. Affective fNIRS-BCIs appear to be feasible for school-aged children, but to further gauge the practical potential of this type of BCI, replication with more training sessions, larger sample sizes, and end-users with disabilities is necessary.

The Dominance of Anticipatory Prefrontal Activity in Uncued Sensory-Motor Tasks.

Anticipatory event-related potentials (ERPs) precede upcoming events such as stimuli or actions. These ERPs are usually obtained in cued sensory–motor tasks employing a warning stimulus that precedes a probe stimulus as in the contingent negative variation (CNV) paradigms. The CNV wave has been widely studied, from clinical to brain–computer interface (BCI) applications, and has been shown to emerge in medial frontoparietal areas, localized in the cingulate and supplementary motor areas. Several dated studies also suggest the existence of a prefrontal CNV, although this component was not confirmed by later studies due to the contamination of ocular artifacts. Another lesser-known anticipatory ERP is the prefrontal negativity (pN) that precedes the uncued probe stimuli in discriminative response tasks and has been localized in the inferior frontal gyrus. This study aimed to characterize the pN by comparing it with the CNV in cued and uncued tasks and test if the pN could be associated with event preparation, temporal preparation, or both. To achieve these aims, high-density electroencephalographic recording and advanced ERP analysis controlling for ocular activity were obtained in 25 volunteers who performed 4 different visuomotor tasks. Our results showed that the pN amplitude was largest in the condition requiring both time and event preparation, medium in the condition requiring event preparation only, and smallest in the condition requiring temporal preparation only. We concluded that the prefrontal CNV could be associated with the pN, and this activity emerges in complex tasks requiring the anticipation of both the category and timing of the upcoming stimulus. The proposed method can be useful in BCI studies investigating the endogenous neural signatures triggered by different sensorimotor paradigms.

Closed-loop motor imagery EEG simulation for brain-computer interfaces.

In a brain-computer interface (BCI) system, the testing of decoding algorithms, tasks, and their parameters is critical for optimizing performance. However, conducting human experiments can be costly and time-consuming, especially when investigating broad sets of parameters. Attempts to utilize previously collected data in offline analysis lack a co-adaptive feedback loop between the system and the user present online, limiting the applicability of the conclusions obtained to real-world uses of BCI. As such, a number of studies have attempted to address this cost-wise middle ground between offline and live experimentation with real-time neural activity simulators. We present one such system which generates motor imagery electroencephalography (EEG) via forward modeling and novel motor intention encoding models for conducting sensorimotor rhythm (SMR)-based continuous cursor control experiments in a closed-loop setting. We use the proposed simulator with 10 healthy human subjects to test the effect of three decoder and task parameters across 10 different values. Our simulated approach produces similar statistical conclusions to those produced during parallel, paired, online experimentation, but in 55% of the time. Notably, both online and simulated experimentation expressed a positive effect of cursor velocity limit on performance regardless of subject average performance, supporting the idea of relaxing constraints on cursor gain in online continuous cursor control. We demonstrate the merits of our closed-loop motor imagery EEG simulation, and provide an open-source framework to the community for closed-loop SMR-based BCI studies in the future. All code including the simulator have been made available on GitHub.

Continuous Decoding of Hand Movement From EEG Signals Using Phase-Based Connectivity Features.

The principal goal of the brain-computer interface (BCI) is to translate brain signals into meaningful commands to control external devices or neuroprostheses to restore lost functions of patients with severe motor disabilities. The invasive recording of brain signals involves numerous health issues. Therefore, BCIs based on non-invasive recording modalities such as electroencephalography (EEG) are safer and more comfortable for the patients. The BCI requires reconstructing continuous movement parameters such as position or velocity for practical application of neuroprostheses. The BCI studies in continuous decoding have extensively relied on extracting features from the amplitude of brain signals, whereas the brain connectivity features have rarely been explored. This study aims to investigate the feasibility of using phase-based connectivity features in decoding continuous hand movements from EEG signals. To this end, the EEG data were collected from seven healthy subjects performing a 2D center-out hand movement task in four orthogonal directions. The phase-locking value (PLV) and magnitude-squared coherence (MSC) are exploited as connectivity features along with multiple linear regression (MLR) for decoding hand positions. A brute-force search approach is employed to find the best channel pairs for extracting features related to hand movements. The results reveal that the regression models based on PLV and MSC features achieve the average Pearson correlations of 0.43 ± 0.03 and 0.42 ± 0.06, respectively, between predicted and actual trajectories over all subjects. The delta and alpha band features have the most contribution in regression analysis. The results also demonstrate that both PLV and MSC decoding models lead to superior results on our data compared to two recently proposed feature extraction methods solely based on the amplitude or phase of recording signals (p < 0.05). This study verifies the ability of PLV and MSC features in the continuous decoding of hand movements with linear regression. Thus, our findings suggest that extracting features based on brain connectivity can improve the accuracy of trajectory decoder BCIs.

Feature selection of EEG signals in neuromarketing.

Brain–computer interface (BCI) technology uses electrophysiological (EEG) signals to detect user intent. Research on BCI has seen rapid advancement, with researchers proposing and implementing several signal processing and machine learning approaches for use in different contexts. BCI technology is also used in neuromarketing to study the brain’s responses to marketing stimuli. This study sought to detect two preference states (like and dislike) in EEG neuromarketing data using the proposed EEG-based consumer preference recognition system. This study investigated the role of feature selection in BCI to improve the accuracy of preference detection for neuromarketing. Several feature selection methods were used for benchmark testing in multiple BCI studies. Four feature selection approaches, namely, principal component analysis (PCA), minimum redundancy maximum relevance (mRMR), recursive feature elimination (RFE), and ReliefF, were used with five different classifiers: deep neural network (DNN), support vector machine (SVM), k-nearest neighbors (KNN), linear discriminant analysis (LDA), and random forest (RF). The four approaches were compared to evaluate the importance of feature selection. Moreover, the performance of classification algorithms was evaluated before and after feature selection. It was found that feature selection for EEG signals improves the performance of all classifiers.

Studies to Overcome Brain–Computer Interface Challenges

A brain–computer interface (BCI) is a promising technology that can analyze brain signals and control a robot or computer according to a user’s intention. This paper introduces our studies to overcome the challenges of using BCIs in daily life. There are several methods to implement BCIs, such as sensorimotor rhythms (SMR), P300, and steady-state visually evoked potential (SSVEP). These methods have different pros and cons according to the BCI type. However, all these methods are limited in choice. Controlling the robot arm according to the intention enables BCI users can do various things. We introduced the study predicting three-dimensional arm movement using a non-invasive method. Moreover, the study was described compensating the prediction using an external camera for high accuracy. For daily use, BCI users should be able to turn on or off the BCI system because of the prediction error. The users should also be able to change the BCI mode to the efficient BCI type. The BCI mode can be transformed based on the user state. Our study was explained estimating a user state based on a brain’s functional connectivity and a convolutional neural network (CNN). Additionally, BCI users should be able to do various tasks, such as carrying an object, walking, or talking simultaneously. A multi-function BCI study was described to predict multiple intentions simultaneously through a single classification model. Finally, we suggest our view for the future direction of BCI study. Although there are still many limitations when using BCI in daily life, we hope that our studies will be a foundation for developing a practical BCI system.