A Novel Multivariate-Multiscale Approach for Computing EEG Spectral and Temporal Complexity for Human Emotion Recognition

Abstract

This work proposes a novel multivariate-multiscale approach for computing the spectral and temporal entropies from the multichannel electroencephalogram (EEG) signal. This facilitates the recognition of three human emotions: positive, neutral, and negative. The proposed approach is based on the application of the Fourier-Bessel series expansion based empirical wavelet transform (FBSE-EWT). We have extended the existing FBSE-EWT method for multichannel signals and derived FBSE-EWT based multivariate Hilbert marginal spectrum (MHMS) for computing spectral Shannon and K-nearest neighbor (K-NN) entropies. The multivariate FBSE-EWT decomposes the multichannel EEG signals into narrow band subband signals. The multiscaling operation adapted in the spectral domain is based on the selection of successive joint instantaneous amplitude and frequency functions of the subband signals. On the other hand, the time domain multiscale K-NN entropy is computed from the cumulatively added multidimensional subband signals. The extracted spectral and temporal entropy features are smoothed and fed to the sparse autoencoder based random forest (ARF) classifier architecture for emotion classification. The proposed approach is tested using multichannel EEG signals available in a public database (SJTU emotion EEG dataset (SEED)). The bivariate EEG signals from different channel pairs with distinct spatial locations over the scalp are considered as input to our proposed system. The obtained overall classification accuracy of 94.4% reveals that the proposed approach is useful in classifying human emotions. The method is also validated using DREAMER emotion EEG public database. The method outperforms the existing state-of-the-art methods evaluated in these databases.