Core-Brain-Network-Based Multilayer Convolutional Neural Network for Emotion Recognition

Abstract

In this article, we propose a method for emotion classification based on multilayer convolutional neural network (MCNN) and combining differential entropy (DE) and brain network. First, we use continuous wavelet transform (CWT) to get the time-frequency representation (TFR) of electroencephalogram (EEG) signals on each channel and extract rich information from different frequency bands for subsequent analysis. Brain networks are then constructed in multiple bands to characterize the spatial connections hidden in the multichannel EEG signals. Based on brain networks, we further develop core brain networks through a set of key nodes determined by DE. These core brain networks are associated with brain activities and differ markedly between different emotional states. The final designed MCNN model takes DE features and core brain networks as inputs for emotion recognition. We evaluate our method on the SJTU emotion EEG dataset, and the average accuracy of 15 subjects achieves 91.45%. Utilizing the complementary features of DE and brain network, the proposed method provides an efficient framework for accurate emotion recognition from EEG signals.