Toward calibration-free motor imagery brain–computer interfaces: a VGG-based convolutional neural network and WGAN approach

Abstract

Objective. Motor imagery (MI) represents one major paradigm of Brain–computer interfaces (BCIs) in which users rely on their electroencephalogram (EEG) signals to control the movement of objects. However, due to the inter-subject variability, MI BCIs require recording subject-dependent data to train machine learning classifiers that are used to identify the intended motor action. This represents a challenge in developing MI BCIs as it complicates its calibration and hinders the wide adoption of such a technology. Approach. This study focuses on enhancing cross-subject (CS) MI EEG classification using EEG spectrum images. The proposed calibration-free approach employs deep learning techniques for MI classification and Wasserstein Generative Adversarial Networks (WGAN) for data augmentation. The proposed WGAN generates synthetic spectrum images from the recorded MI-EEG to expand the training dataset; aiming to enhance the classifier’s performance. The proposed approach eliminates the need for any calibration data from the target subject, making it more suitable for real-world applications. Main results. To assess the robustness and efficacy of the proposed framework, we utilized the BCI competition IV-2B, IV-2 A, and IV-1 benchmark datasets, employing leave one-subject out validation. Our results demonstrate that using the proposed modified VGG-CNN classifier in addition to WGAN-generated data for augmentation leads to an enhancement in CS accuracy outperforming state-of-the-art methods. Significance. This approach could represent one step forward towards developing calibration-free BCI systems and hence broaden their applications.