InfoFlowNet: A multi-head attention-based self-supervised learning model with surrogate approach for uncovering brain effective connectivity

Abstract

Deciphering brain network topology can enhance the depth of neuroscientific knowledge and facilitate the development of neural engineering methods. Effective connectivity, which gauges the directional influences among brain regions, is pivotal for these studies. This research introduces InfoFlowNet, a novel self-supervised learning model designed to infer causal relationships in electroencephalogram (EEG) data, aiming at capturing the complex information flow among brain regions. Specifically, InfoFlowNet employs convolution operations and multi-head self-attention mechanisms with a masking feature, which ignores self-connections to focus on inter-regional dynamics. Additionally, a new causal magnitude estimation is introduced by assessing the impact of shuffled surrogate data on signal prediction to quantify causal influence. Experiments using synthetic data and real EEG datasets demonstrate that InfoFlowNet effectively uncovers time-varying causal relationships. Compared with the Granger causality model (GCM) and the temporal causal discovery framework (TCDF), InfoFlowNet shows superior sensitivity in detecting significant causal edges. For instance, in a psychomotor vigilance task, InfoFlowNet identified 8 out of 16 significant causal edges, significantly outperforming GCM and TCDF. Furthermore, InfoFlowNet successfully passes the whiteness test on the model's residuals, and advanced analyses illustrate the advantages of utilizing multi-head attention and masking mechanisms to capture effective connectivity. In sum, InfoFlowNet represents a significant advancement in the analysis of effective connectivity, offering a deeper understanding of brain network dynamics. The model's ability to discern complex causal interactions supports its potential application in broader neuroscientific research and applications.