Abstract

In the rapid serial visual presentation (RSVP) classification task, the data from the target and non-target classes are incredibly imbalanced. These class imbalance problems (CIPs) can hinder the classifier from achieving better performance, especially in deep learning. This paper proposed a novel data augmentation method called balanced Wasserstein generative adversarial network with gradient penalty (BWGAN-GP) to generate RSVP minority class data. The model learned useful features from majority classes and used them to generate minority-class artificial EEG data. It combines generative adversarial network (GAN) with autoencoder initialization strategy enables this method to learn an accurate class-conditioning in the latent space to drive the generation process towards the minority class. We used RSVP datasets from nine subjects to evaluate the classification performance of our proposed generated model and compare them with those of other methods. The average AUC obtained with BWGAN-GP on EEGNet was 94.43%, an increase of 3.7% over the original data. We also used different amounts of original data to investigate the effect of the generated EEG data on the calibration phase. Only 60% of original data were needed to achieve acceptable classification performance. These results show that the BWGAN-GP could effectively alleviate CIPs in the RSVP task and obtain the best performance when the two classes of data are balanced. The findings suggest that data augmentation techniques could generate artificial EEG to reduce calibration time in other brain-computer interfaces (BCI) paradigms similar to RSVP.

Highlights

  • RAPID serial visual presentation (RSVP) based on electroencephalogram is a well-established brain-computer interface (BCI) paradigm for target recognition [1], [2], in which subjects must make decisions about target images from the image flow under high temporal sensitivity conditions [3], [4]

  • We compared a total of three methods of data augmentation: SMOTE [11], Wasserstein generative adversarial network (WGAN)-gradient penalty (GP)-RSVP [19], BWGAN-GP, and EEG signals without augmentation as a baseline—original

  • This study aimed to develop a novel data augmentation approach to address class imbalance problems (CIPs) in the RSVP task

Read more

Summary

Introduction

RAPID serial visual presentation (RSVP) based on electroencephalogram is a well-established brain-computer interface (BCI) paradigm for target recognition [1], [2], in which subjects must make decisions about target images from the image flow under high temporal sensitivity conditions [3], [4]. Lee and Wang considered class imbalance as a main bottleneck factor contributing to the poor performance of RSVP classification, and data augmentation methods can help lessen the effects of CIP [2], [5], [6]. Typical data augmentation methods are geometric transformations, such as cropping, flipping, and scaling. The geometric transformations that are useful for image data augmentation do not apply to EEG signals. Some methods are still available for data augmentation of EEG signals. The data augmentation methods used for EEG include adding Gaussian noise addition, segmentation, and a generation model [8]–[10]. The first two methods cannot meet artificial multi-channel EEG generation needs due to redundant noise or information loss.

Objectives
Methods
Results
Conclusion
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call