Advanced functional connectivity analysis with integrated EEG signal enhancement and GTW-EEG-GAN for emotion detection

Abstract

Emotion recognition is crucial in human-computer interaction and psychological research, utilizing modalities such as facial expressions, voice intonations, and EEG signals. This research investigates AI-driven techniques by employing Graph Neural Networks (GNNs) on functional connectivity matrices derived from EEG data to advance emotion recognition. Our approach integrates sophisticated preprocessing methods, including Integrated EEG Signal Enhancement (IESE) and novel augmentation techniques such as Gaussian Time Warping Generative Adversarial Network (GTW-EEG-GAN). This integration aims at enhancing data quality and diversity. Signal decomposition using EMD-Wavelet Hybrid Decomposition further refines feature extraction, enabling robust analysis of EEG signals. Functional connectivity metrics capture critical neural interactions intended for precise emotion characterization. The GNN architecture effectively processes these features, achieving significant accuracy improvements. Evaluations on the DEAP dataset demonstrate promising results, attaining 94.5% accuracy before hyperparameter tuning and further improving to 98.6% after tuning, highlighting the system's efficacy. The methodology showcases the integration of advanced signal processing techniques with AI, offering a comprehensive framework for future studies. The findings advocate potential applications in areas such as personalized mental health monitoring, adaptive learning environments, and responsive gaming experiences, demonstrating the broad impact and versatility of AI-driven EEG-based emotion recognition.