Multi-Modal Physiological Signals Based Squeeze-and-Excitation Network With Domain Adversarial Learning for Sleep Staging

Abstract

Sleep staging is the basis of sleep medicine for diagnosing psychiatric and neurodegenerative diseases. However, the existing sleep staging methods ignore the fact that multi-modal physiological signals are heterogeneous, and different modalities contribute to sleep staging with distinct impacts on specific stages. Therefore, how to model the heterogeneity of multi-modal signals and adaptively utilize the multi-modal signals for sleep staging remains challenging. Moreover, existing methods suffer from the individual variance of physiological signals. How to generalize the sleep staging model for the variance among subjects is also challenging. To address the above challenges, we propose the multi-modal physiological signals based Squeeze-and-Excitation Network with Domain Adversarial Learning (SEN-DAL) to capture the features of electroencephalogram (EEG) and electrooculogram (EOG) for sleep staging. The SEN-DAL is made up of two independent feature extraction networks for modeling the heterogeneity, a Multi-modal Squeeze-and-Excitation feature fusion module for adaptively utilizing the multi-modal signals, and a Domain Adversarial Learning module to extract subject-invariant sleep feature. Experiments demonstrate that the SEN-DAL is superior to the baseline models on a public sleep staging dataset, reaching an F1-Score of 82.1%, which is similar to human experts. Through the ablation experiments, we found that the proposed mechanisms, including modal-independent feature extraction, adaptive utilization of multi-modal signals, and domain adversarial learning, are effective for sleep staging tasks. The code of SEN-DAL is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/xiyangcai/SEN-DAL</uri> .