The human brain exhibits spatio-temporally complex activity even in the absence of external stimuli, cycling through recurring patterns of activity known as brain states. Thus far, brain state analysis has primarily been restricted to unimodal neuroimaging data sets, resulting in a limited definition of state and a poor understanding of the spatial and temporal relationships between states identified from different modalities. Here, we applied hidden Markov model (HMM) to concurrent electroencephalography-functional magnetic resonance imaging (EEG-fMRI) eyes open (EO) and eyes closed (EC) resting-state data, training models on the EEG and fMRI data separately, and evaluated the models' ability to distinguish dynamics between the two rest conditions. Additionally, we employed a general linear model approach to identify the BOLD correlates of the EEG-defined states to investigate whether the fMRI data could be used to improve the spatial definition of the EEG states. Finally, we performed a sliding window-based analysis on the state time courses to identify slower changes in the temporal dynamics, and then correlated these time courses across modalities. We found that both models could identify expected changes during EC rest compared to EO rest, with the fMRI model identifying changes in the activity and functional connectivity of visual and attention resting-state networks, while the EEG model correctly identified the canonical increase in alpha upon eye closure. In addition, by using the fMRI data, it was possible to infer the spatial properties of the EEG states, resulting in BOLD correlation maps resembling canonical alpha-BOLD correlations. Finally, the sliding window analysis revealed unique fractional occupancy dynamics for states from both models, with a selection of states showing strong temporal correlations across modalities. Overall, this study highlights the efficacy of using HMMs for brain state analysis, confirms that multimodal data can be used to provide more in-depth definitions of state and demonstrates that states defined across different modalities show similar temporal dynamics.
Read full abstract