Field Of Brain Computer Interface Research Articles

Spatialspectral-Backdoor: Realizing backdoor attack for deep neural networks in brain–computer interface via EEG characteristics

In recent years, electroencephalogram (EEG) based on the brain–computer interface (BCI) systems have become increasingly advanced, with researcher using deep neural networks as tools to enhance performance. BCI systems heavily rely on EEG signals for effective human–computer interactions, and deep neural networks show excellent performance in processing and classifying these signals. Nevertheless, the vulnerability to backdoor attack is still a major problem. Backdoor attack is the injection of specially designed triggers into the model training process, which can lead to significant security issues. Therefore, in order to simulate the negative impact of backdoor attack and bridge the research gap in the field of BCI, this paper proposes a new backdoor attack method to call researcher attention to the security issues of BCI. In this paper, Spatialspectral-Backdoor is proposed to effectively attack the BCI system. The method is carefully designed to target the spectral active backdoor attack of the BCI system and includes a multi-channel preference method to select the electrode channels sensitive to the target task. Ultimately, the effectiveness of the comparison and ablation experiments is validated on the publicly available BCI competition datasets. The results show that the average attack success rate and clean sample accuracy of Spatialspectral-Backdoor in the BCI scenario are 97.12% and 85.16%, respectively, compared with other backdoor attack methods. Furthermore, by observing the infection ratio of backdoor triggers and visualization of the feature space, the proposed Spatialspectral-Backdoor outperforms other backdoor attack methods.

Joint hybrid recursive feature elimination based channel selection and ResGCN for cross session MI recognition

In the field of brain-computer interface (BCI) based on motor imagery (MI), multi-channel electroencephalography (EEG) data is commonly utilized for MI task recognition to achieve sensory compensation or precise human-computer interaction. However, individual physiological differences, environmental variations, or redundant information and noise in certain channels can pose challenges and impact the performance of BCI systems. In this study, we introduce a channel selection method utilizing Hybrid-Recursive Feature Elimination (H-RFE) combined with residual graph neural networks for MI recognition. This channel selection method employs a recursive feature elimination strategy and integrates three classification methods, namely random forest, gradient boosting, and logistic regression, as evaluators for adaptive channel selection tailored to specific subjects. To fully exploit the spatiotemporal information of multi-channel EEG, this study employed a graph neural network embedded with residual blocks to achieve precise recognition of motor imagery. We conducted algorithm testing using the SHU dataset and the PhysioNet dataset. Experimental results show that on the SHU dataset, utilizing 73.44% of the total channels, the cross-session MI recognition accuracy is 90.03%. Similarly, in the PhysioNet dataset, using 72.5% of the channel data, the classification result also reaches 93.99%. Compared to traditional strategies such as selecting three specific channels, correlation-based channel selection, mutual information-based channel selection, and adaptive channel selection based on Pearson coefficients and spatial positions, the proposed method improved classification accuracy by 34.64%, 10.8%, 3.25% and 2.88% on the SHU dataset, and by 46.96%, 5.04%, 5.81% and 2.32% on the PhysioNet dataset, respectively.

Building consensus on clinical outcome assessments for BCI devices. A summary of the 10th BCI society meeting 2023 workshop.

The 10th International Brain Computer Interface (BCI) Society Meeting, 'Balancing Innovation and Translation', was held from the 6th to 9th of June 2023 in Brussels, Belgium. This report provides a summary of the workshop 'Building Consensus on Clinical Outcome Assessments (COAs) for BCI Devices'. This workshop was intended to give participants an overview of the current state of BCI, future opportunities, and how different countries and regions provide regulatory oversight to support the BCI community to develop safe and effective devices for patients. Five presentations and a panel discussion including representatives from regulators, industry, and clinical research stakeholders focused on how various stakeholders and the BCI community might best work together to ensure studies provide data that is useful for evaluating safety and effectiveness, including reaching consensus on clinical outcome assessments (COAs) that represent clinically meaningful benefits and support regulatory and payor requirements. This report focuses on the regulatory and reimbursement requirements for medical devices and how to best measure safety and effectiveness and summarizes the presentations from five experts and the discussion between the panel and the audience. Consensus was reached on the following items specifically related to BCI: (i) the importance of and need for a new generation of COAs, (ii) the challenges facing the development of appropriate clinical outcome assessments, and (iii) that improvements in COAs should demonstrate obvious and clinically meaningful benefit(s). There was discussion on: (i) clinical trial design for BCIs and (ii) considerations for payor reimbursement and other funding. Whilst the importance of building community consensus on COAs was apparent, further collaboration will be required to reach consensus on which specific current and/or novel COAs could be used for the BCI field to evolve from research to market.

Efficient Multi-View Graph Convolutional Network with Self-Attention for Multi-Class Motor Imagery Decoding.

Research on electroencephalogram-based motor imagery (MI-EEG) can identify the limbs of subjects that generate motor imagination by decoding EEG signals, which is an important issue in the field of brain-computer interface (BCI). Existing deep-learning-based classification methods have not been able to entirely employ the topological information among brain regions, and thus, the classification performance needs further improving. In this paper, we propose a multi-view graph convolutional attention network (MGCANet) with residual learning structure for multi-class MI decoding. Specifically, we design a multi-view graph convolution spatial feature extraction method based on the topological relationship of brain regions to achieve more comprehensive information aggregation. During the modeling, we build an adaptive weight fusion (Awf) module to adaptively merge feature from different brain views to improve classification accuracy. In addition, the self-attention mechanism is introduced for feature selection to expand the receptive field of EEG signals to global dependence and enhance the expression of important features. The proposed model is experimentally evaluated on two public MI datasets and achieved a mean accuracy of 78.26% (BCIC IV 2a dataset) and 73.68% (OpenBMI dataset), which significantly outperforms representative comparative methods in classification accuracy. Comprehensive experiment results verify the effectiveness of our proposed method, which can provide novel perspectives for MI decoding.

Toward methodologies for motor imagery enhancement: a tDCS-BCI study

ABSTRACT Motor imagery (MI) becomes a powerful rehabilitation tool, particularly when combined with brain–computer interfaces (BCI). Therefore, methods to improve MI accuracy are a trending topic in the BCI field. Here, we examined the effects of transcranial direct current stimulation (tDCS) and MI priming on the MI signature in an EEG-based MI-BCI triple-blind study. Thirty healthy younger adults participated in this study and were designated to one of two priming groups: A bimanual tracking task and a MI task as primers for MI-BCI. During the performance of the primer task, participants received anodal and sham tDCS in two randomized sessions with a one-week wash-out period between sessions. Subsequently, participants performed an EEG-driven BCI-MI task. EEG time–frequency analyses revealed that desynchronization of the Beta Region precedes desynchronization in the Alpha Region, implying that the Beta frequency band might be best-suited to extract MI signatures as it could lead to faster MI-BCI. Contrary to our hypotheses, no effect of tDCS or priming task on EEG activity during the BCI-MI task was found. Future research should carefully consider the added value of tDCS and priming tasks BCI performance improvement. Electric field modeling studies and high-definition tDCS motor cortex stimulation might be promising avenues.

Band power feature part-based convolutional neural network with African vulture optimization fostered channel selection for EEG classification

The electroencephalogram-based motor imagery (MI-EEG) classification task is significant for brain–computer interface (BCI). EEG signals need a lot of channels to be acquired, which makes it difficult to use in real-world applications. Choosing the optimal channel subset without severely impacting the classification performance is a problem in the field of BCI. To overwhelm this problem, a band power feature part-based convolutional neural network with African vulture optimization fostered channel selection for EEG classification (PCNNC-AVOACS-EEG) is proposed in this article. Initially, the input EEG signals are taken from BCI competition IV, dataset 1. Then the input EEG signals are pre-processed by contrast-limited adaptive histogram equalization filtering. These pre-processed EEG signals are extracted by hexadecimal local adaptive binary pattern (HLABP) method. This HLABP method extracts the features of alpha and beta bands from the EEG segments. Each EEG channel’s band power data are utilized as features for a PCNNC to exactly classify the EEG into 3 classes: two MI states and idle state. The AVOA is applied within the band power feature PCNNC for channel selection, wherein channel selection aids to enhance the categorization accuracy on test set that is a vital indicator for real-time BCI applications. The proposed method is activated in python. From the experiment, the proposed technique attains 17.91%, 20.46% and 18.146% higher accuracy; 14.105%, 15.295% and 5.291% higher area under the curve and 70%, 60% and 65.714% lower computation time compared with the existing approaches.

Study of an Optimization Tool Avoided Bias for Brain-Computer Interfaces Using a Hybrid Deep Learning Model

ObjectiveThis study addresses the challenge of user-specific bias in Brain-Computer Interfaces (BCIs) by proposing a novel methodology. The primary objective is to employ a hybrid deep learning model, combining 2D Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) layers, to analyze EEG signals and classify imagined tasks. The overarching goal is to create a generalized model that is applicable to a broader population and mitigates user-specific biases. Materials and MethodsEEG signals from imagined motor tasks in the public dataset Physionet form the basis of the study. This is due to the need to use other databases in addition to the BCI competition. A model of arrays emulating the electrode arrangement in the head is proposed to capture spatial information using CNN, and LSTM algorithms are used to capture temporal information, followed by signal classification. ResultsThe hybrid model is implemented to achieve a high classification rate, reaching up to 90% for specific users and averaging 74.54%. Error detection thresholds are set to eliminate subjects with low task affinity, resulting in a significant improvement in classification accuracy of up to 21.34%. ConclusionThe proposed methodology makes a significant contribution to the BCI field by providing a generalized system trained on diverse user data that effectively captures spatial and temporal EEG signal features. This study emphasizes the value of the hybrid model in advancing BCIs, highlighting its potential for improved reliability and accuracy in human-computer interaction. It also suggests the exploration of additional advanced layers, such as transformers, to further enhance the proposed methodology.

Towards interactive reinforcement learning with intrinsic feedback

Reinforcement learning (RL) and brain–computer interfaces (BCI) have experienced significant growth over the past decade. With rising interest in human-in-the-loop (HITL), incorporating human input with RL algorithms has given rise to the sub-field of interactive RL. Adjacently, the field of BCI has long been interested in extracting informative brain signals from neural activity for use in human–computer interactions. A key link between these fields lies in the interpretation of neural activity as feedback such that interactive RL approaches can be employed. We denote this new and emerging medium of feedback as intrinsic feedback. Despite intrinsic feedback’s ability to be conveyed automatically and even unconsciously, proper exploration surrounding this key link has largely gone unaddressed by both communities. Thus, to help facilitate a deeper understanding and a more effective utilization, we provide a tutorial-style review covering the motivations, approaches, and open problems of intrinsic feedback and its foundational concepts.

Augmented-reality based brain-computer interface of robot control

Brain Computer Interface (BCI) is a new approach to human-computer interaction. It can control the external devices directly with the brain without words and body movements. Brain-controlled robot is a major research area in the field of BCI, which organically integrates BCI with robotic systems to achieve safe and effective real-time control of robots using the user's electroencephalogram (EEG). Currently, there are two types of control methods for brain-controlled robots. One is direct control and the other is shared control. Direct brain control has its shortcomings, namely, low control efficiency and easy user fatigue. Shared control technique can effectively improve the control of brain-controlled robots and reduce the thinking ability of brain-controlled robots, thus making it the main control method of brain-controlled robots. The brain-computer collaborative control system based on augmented reality (AR) technology studied in this paper is a human-computer shared control method. In the experimental analysis of virtual reality (VR) systems and AR systems, this paper processes polylines through a series of control vertices with specific coordinates, using the relative distance measured between each point and the starting point as the relative coordinates, and calculates the operational errors of the two types of systems. In the system error of machining broken lines, when the relative coordinates are (10, 20), (40, 50), and (70, 80), the error values of the VR system are 0.17 mm, 0.36 mm, and 0.55 mm, respectively, while the error values of the AR system are 0.11 mm, 0.24 mm, and 0.41 mm, respectively. Therefore, the studies have illustrated the importance of AR systems for the study of brain-computer collaborative control of robots.

A study on the combination of functional connection features and Riemannian manifold in EEG emotion recognition.

Affective computing is the core for Human-computer interface (HCI) to be more intelligent, where electroencephalogram (EEG) based emotion recognition is one of the primary research orientations. Besides, in the field of brain-computer interface, Riemannian manifold is a highly robust and effective method. However, the symmetric positive definiteness (SPD) of the features limits its application. In the present work, we introduced the Laplace matrix to transform the functional connection features, i.e., phase locking value (PLV), Pearson correlation coefficient (PCC), spectral coherent (COH), and mutual information (MI), to into semi-positive, and the max operator to ensure the transformed feature be positive. Then the SPD network is employed to extract the deep spatial information and a fully connected layer is employed to validate the effectiveness of the extracted features. Particularly, the decision layer fusion strategy is utilized to achieve more accurate and stable recognition results, and the differences of classification performance of different feature combinations are studied. What's more, the optimal threshold value applied to the functional connection feature is also studied. The public emotional dataset, SEED, is adopted to test the proposed method with subject dependent cross-validation strategy. The result of average accuracies for the four features indicate that PCC outperform others three features. The proposed model achieve best accuracy of 91.05% for the fusion of PLV, PCC, and COH, followed by the fusion of all four features with the accuracy of 90.16%. The experimental results demonstrate that the optimal thresholds for the four functional connection features always kept relatively stable within a fixed interval. In conclusion, the experimental results demonstrated the effectiveness of the proposed method.

A coarse-to-fine adaptive spatial–temporal graph convolution network with residuals for motor imagery decoding from the same limb

In the field of Brain Computer Interface (BCI) technology, Motor Imagery (MI) plays an important role as a paradigm. One of the primary focuses of this research area lies in exploring the MI of various upper limbs. Decoding MI signals from distinct joints within the same limb poses more intricate challenges in comparison to decoding MI signals originating from different upper limbs. In order to explore more efficient decoding methods, we propose a novel coarse-to-fine classification approach to investigate categorical decoding across three tasks, namely ‘rest’, ‘hand’, and ‘elbow’. This approach consists of two classification stages performed from coarse to fine. In the coarse classification stage, in order to capture the features of both resting state and the moving state in the temporal domain, the EEGNet network with temporal domain convolution is used to extract temporal domain features and classify the original samples into categories of ‘rest’ and ‘move’ (‘hand’, ‘elbow’). In the fine classification stage, the samples of ‘move’ category are segmented by time to form a graph sequence. Then, an adaptive spatial–temporal graph convolutional network with residuals is utilized to extract both temporal and spatial domains’ features from the graph sequence. The proposed algorithm has been validated experimentally on the MI-2 dataset and compared with contemporary methods. Its classification performance is quantified by the average accuracy which achieves a value of 72.21%. Extensive experimental results indicate that the novel coarse-to-fine classification approach is superior to the single classification approach.

Dual-Alpha: a large EEG study for dual-frequency SSVEP brain-computer interface.

The domain of brain-computer interface (BCI) technology has experienced significant expansion in recent years. However, the field continues to face a pivotal challenge due to the dearth of high-quality datasets. This lack of robust datasets serves as a bottleneck, constraining the progression of algorithmic innovations and, by extension, the maturation of the BCI field. This study details the acquisition and compilation of electroencephalogram data across 3 distinct dual-frequency steady-state visual evoked potential (SSVEP) paradigms, encompassing over 100 participants. Each experimental condition featured 40 individual targets with 5 repetitions per target, culminating in a comprehensive dataset consisting of 21,000 trials of dual-frequency SSVEP recordings. We performed an exhaustive validation of the dataset through signal-to-noise ratio analyses and task-related component analysis, thereby substantiating its reliability and effectiveness for classification tasks. The extensive dataset presented is set to be a catalyst for the accelerated development of BCI technologies. Its significance extends beyond the BCI sphere and holds considerable promise for propelling research in psychology and neuroscience. The dataset is particularly invaluable for discerning the complex dynamics of binocular visual resource distribution.

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition.

Electroencephalogram (EEG)-based emotion recognition has become a research hotspot in the field of brain-computer interface. Previous emotion recognition methods have overlooked the fusion of multi-domain emotion-specific information to improve performance, and faced the challenge of insufficient interpretability. In this paper, we proposed a novel EEG emotion recognition model that combined the asymmetry of the brain hemisphere, and the spatial, spectral, and temporal multi-domain properties of EEG signals, aiming to improve emotion recognition performance. Based on the 10-20 standard system, a global spatial projection matrix (GSPM) and a bi-hemisphere discrepancy projection matrix (BDPM) are constructed. A dual-stream spatial-spectral-temporal convolution neural network is designed to extract depth features from the two matrix paradigms. Finally, the transformer-based fusion module is used to learn the dependence of fused features, and to retain the discriminative information. We conducted extensive experiments on the SEED, SEED-IV, and DEAP public datasets, achieving excellent average results of 98.33/2.46 %, 92.15/5.13 %, 97.60/1.68 %(valence), and 97.48/1.42 %(arousal) respectively. Visualization analysis supports the interpretability of the model, and ablation experiments validate the effectiveness of multi-domain and bi-hemisphere discrepancy information fusion.

Classification of EEG Signals Based on Sparrow Search Algorithm-Deep Belief Network for Brain-Computer Interface.

In brain-computer interface (BCI) systems, challenges are presented by the recognition of motor imagery (MI) brain signals. Established recognition approaches have achieved favorable performance from patterns like SSVEP, AEP, and P300, whereas the classification methods for MI need to be improved. Hence, seeking a classification method that exhibits high accuracy and robustness for application in MI-BCI systems is essential. In this study, the Sparrow search algorithm (SSA)-optimized Deep Belief Network (DBN), called SSA-DBN, is designed to recognize the EEG features extracted by the Empirical Mode Decomposition (EMD). The performance of the DBN is enhanced by the optimized hyper-parameters obtained through the SSA. Our method's efficacy was tested on three datasets: two public and one private. Results indicate a relatively high accuracy rate, outperforming three baseline methods. Specifically, on the private dataset, our approach achieved an accuracy of 87.83%, marking a significant 10.38% improvement over the standard DBN algorithm. For the BCI IV 2a dataset, we recorded an accuracy of 86.14%, surpassing the DBN algorithm by 9.33%. In the SMR-BCI dataset, our method attained a classification accuracy of 87.21%, which is 5.57% higher than that of the conventional DBN algorithm. This study demonstrates enhanced classification capabilities in MI-BCI, potentially contributing to advancements in the field of BCI.

Wearable brain-computer interface technology and its application

Wearable Brain-Computer Interfaces (BCIs) signify a critical evolution in human-machine communication, driven by the convergence of neuroscience, engineering, and information technology. With applications that span across industrial, medical, and recreational domains, BCIs hold potential to redefine our interaction with the technological landscape. This manuscript elucidates this transformative juncture, bifurcating into passive and active BCIs. In passive BCIs, innovations leveraging Virtual Reality (VR) and Augmented Reality (AR) are delineated, progress has been demonstrated in the classification of passively induced emotional signals, highlighting the emergence of hands-free control systems like quadcopter control and industrial inspections. The discourse on active BCIs unveils advancements such as real-time handwriting and speech decoding, driver drowsiness detection, and emotion recognition, aided by machine learning techniques. Despite groundbreaking progress, challenges in algorithm optimization, adaptability, multimodal signal complexity, and ethics persist. Future directions emphasize the potential of deep learning and multimode input signals collaboration. The manuscript underscores the societal implications, particularly in rehabilitation, communication, and entertainment. The review, therefore, serves as both an appraisal and a roadmap for the burgeoning field of wearable BCIs, underlining its role as a pathway to enhance human capabilities and quality of life.

Signature methods for brain-computer interfaces

Brain-computer interfaces (BCIs) allow direct communication between one’s central nervous system and a computer without any muscle movement hence by-passing the peripheral nervous system. They can restore disabled people’s ability to interact with their environment, e.g. communication and wheelchair control. However, to this day their performance is still hindered by the non-stationarity of electroencephalography (EEG) signals, as well as their susceptibility to noise from the users’ environment and from their own physiological activity. Moreover, a non-negligible amount of users struggle to use BCI systems based on motor imagery. In this paper, a new method based on the path signature is introduced to tackle this problem by using features which are different from the usual power-based ones. The path signature is a series of iterated integrals computed from a multidimensional path. It is invariant under translation and time reparametrization, which makes it a robust feature for multichannel EEG time series. The performance can be further boosted by combining the path signature with the gold standard Riemannian classifier in the BCI field exploiting the geometric structure of symmetric positive definite (SPD) matrices. The results obtained on publicly available datasets show that the signature method is more robust to inter-user variability than classical ones, especially on noisy and low-quality data. Hence, this study paves the way towards the use of mathematical tools that until now have been neglected, in order to tackle the EEG-based BCI variability issue. It also sheds light on the lead-lag relationship captured by path signature which seems relevant to assess the underlying neural mechanisms.

Brain computer interfaces in computer science and engineering areas: a systematic study

<span>Brain-computer interfaces (BCI) are a channel that implements direct communication between the brain and some external unit. Developments of BCIs can provide new application opportunities in a large number of fields of use. In the development of BCI devices, the development of technology and digital technology represented a big change, as it provided the necessary computing power to implement and run the continuously developing signal processing algorithms that ensure processing and evaluation. The aim of this paper is to provide an overview of BCI research results which were published in the engineering field. In the present study, articles that had a greater impact, where the annual average number of citations is greater than 30, in the BCI field were reviewed and processed in a systematic way, in order to make individual research more comparable. The systematic processing was focused on the aims of application, used device/ dataset, applied data process and achieved best accuracy. This systematic study summarizes the most effective methods used in the BCI processing and highlights the future trends. The results showed an accuracy of 85% thanks to increasingly reliable, accurate and cost-effective signal detection and processing devices, as well as algorithms.</span>

IMH-Net: a convolutional neural network for end-to-end EEG motor imagery classification

As the main component of Brain-computer interface (BCI) technology, the classification algorithm based on EEG has developed rapidly. The previous algorithms were often based on subject-dependent settings, resulting in BCI needing to be calibrated for new users. In this work, we propose IMH-Net, an end-to-end subject-independent model. The model first uses Inception blocks extracts the frequency domain features of the data, then further compresses the feature vectors to extract the spatial domain features, and finally learns the global information and classification through Multi-Head Attention mechanism. On the OpenBMI dataset, IMH-Net obtained 73.90 ± 13.10% accuracy and 73.09 ± 14.99% F1-score in subject-independent manner, which improved the accuracy by 1.96% compared with the comparison model. On the BCI competition IV dataset 2a, this model also achieved the highest accuracy and F1-score in subject-dependent manner. The IMH-Net model we proposed can improve the accuracy of subject-independent Motor Imagery (MI), and the robustness of the algorithm is high, which has strong practical value in the field of BCI.

Current Trends, Challenges, and Future Research Directions of Hybrid and Deep Learning Techniques for Motor Imagery Brain–Computer Interface

The field of brain–computer interface (BCI) enables us to establish a pathway between the human brain and computers, with applications in the medical and nonmedical field. Brain computer interfaces can have a significant impact on the way humans interact with machines. In recent years, the surge in computational power has enabled deep learning algorithms to act as a robust avenue for leveraging BCIs. This paper provides an up-to-date review of deep and hybrid deep learning techniques utilized in the field of BCI through motor imagery. It delves into the adoption of deep learning techniques, including convolutional neural networks (CNNs), autoencoders (AEs), and recurrent structures such as long short-term memory (LSTM) networks. Moreover, hybrid approaches, such as combining CNNs with LSTMs or AEs and other techniques, are reviewed for their potential to enhance classification performance. Finally, we address challenges within motor imagery BCIs and highlight further research directions in this emerging field.

Multimodal Social Data Analytics on the Design and Implementation of an EEG-Mechatronic System Interface

The devices that can read Electroencephalography (EEG) signals have been widely used for Brain-Computer Interfaces (BCIs). Popularity in the field of BCIs has increased in recent years with the development of several consumer-grade EEG devices that can detect human cognitive states in real-time and deliver feedback to enhance human performance. Several previous studies have been conducted to understand the fundamentals and essential aspects of EEG in BCIs. However, the significant issue of how consumer-grade EEG devices can be used to control mechatronic systems effectively has been given less attention. In this article, we have designed and implemented an EEG BCI system using the OpenBCI Cyton headset and a user interface running a game to explore the concept of streamlining the interaction between humans and mechatronic systems with a BCI EEG-mechatronic system interface. Big Multimodal Social Data (BMSD) analytics can be applied to the high-frequency and high-volume EEG data, allowing us to explore aspects of data acquisition, data processing, and data validation and evaluate the Quality of Experience (QoE) of our system. We employ real-world participants to play a game to gather training data that was later put into multiple machine learning models, including a linear discriminant analysis (LDA), k-nearest neighbours (KNN), and a convolutional neural network (CNN). After training the machine learning models, a validation phase of the experiment took place where participants tried to play the same game but without direct control, utilising the outputs of the machine learning models to determine how the game moved. We find that a CNN trained to the specific user was able to control the game and performed with the highest activation accuracy from the machine learning models tested, along with the highest user-rated QoE, which gives us significant insight for future implementation with a mechatronic system.