Constrained temporal parallel decomposition for EEG-fMRI fusion

Abstract

Objective. Multimodal neuroimaging has become a common practice in neuroscience research. Simultaneous EEG–fMRI is a popular multimodal recording approach due to the complementary spatiotemporal relationship between the two modalities. Several data fusion techniques have been proposed in the literature for EEG-fMRI fusion, including joint-ICA and parallel-ICA frameworks. Previous EEG–fMRI fusion approaches have used sensor-level EEG features. Recently, we introduced source-space ICA for EEG–MEG source reconstruction and component identification, which was shown to be a superior alternative to sensor-space ICA. Approach. Here, we extend source-space ICA to the fusion of EEG–fMRI data. Additionally, we incorporate the use of a paradigm signal (constrained) and a lag-based signal decomposition approach to accommodate recent findings demonstrating the potentially variable lag structure between electrophysiological and BOLD signals. We evaluated this method on simulated concurrent EEG–fMRI during a boxcar task design, as well as real concurrent EEG–fMRI data from three participants performing an N-Back working memory task. The block diagram of the algorithm and corresponding source codes are provided. Main results. Based on the results of the real working memory task, for all three subjects, one frontal theta component, and one right posterior alpha component had the highest contribution coefficients (~0.5) to the paradigm-related fused component. There were also two more alpha band components with contribution coefficients of 0.3. The highest contributing fMRI component (~0.8) was one known in the literature to be related to the attention network. The second fMRI component was related to the well-known default mode network, with a contribution coefficient of 0.3. Significance. The proposed EEG–fMRI fusion approach, is capable of estimating the brain maps of the EEG and fMRI for the fused components and account for the variable lag structure between electrophysiological and BOLD signals.