Abstract

Studies featuring multimodal neuroimaging data fusion for understanding brain function and structure, or disease characterization, leverage the partial information available in each of the modalities to reveal data variations not exhibited through the independent analyses. Similar to other complex syndromes, the characteristic brain abnormalities in schizophrenia may be better understood with the help of the additional information conveyed by leveraging an advanced modeling method involving multiple modalities. In this study, we propose a novel framework to fuse feature spaces corresponding to functional magnetic resonance imaging (functional) and gray matter (structural) data from 151 schizophrenia patients and 163 healthy controls. In particular, the features for the functional and structural modalities include dynamic (i.e., time-varying) functional network connectivity (dFNC) maps and the intensities of the gray matter (GM) maps, respectively. The dFNC maps are estimated from group independent component analysis (ICA) network time-courses by first computing windowed functional correlations using a sliding window approach, and then estimating subject specific states from this windowed data using temporal ICA followed by spatio-temporal regression. For each subject, the functional data features are horizontally concatenated with the corresponding GM features to form a combined feature space that is subsequently decomposed through a symmetric multimodal fusion approach involving a combination of multiset canonical correlation analysis (mCCA) and joint ICA (jICA). Our novel combined analyses successfully linked changes in the two modalities and revealed significantly disrupted links between GM volumes and time-varying functional connectivity in schizophrenia. Consistent with prior research, we found significant group differences in GM comprising regions in the superior parietal lobule, precuneus, postcentral gyrus, medial/superior frontal gyrus, superior/middle temporal gyrus, insula and fusiform gyrus, and several significant aberrations in the inter-regional functional connectivity strength as well. Importantly, structural and dFNC measures have independently shown changes associated with schizophrenia, and in this work we begin the process of evaluating the links between the two, which could shed light on the illness beyond what we can learn from a single imaging modality. In future work, we plan to evaluate replication of the inferred structure-function relationships in independent partitions of larger multi-modal schizophrenia datasets.

Highlights

  • Structural neuroimaging modalities evaluate anatomical brain structure and tissue type or brain tissue microstructure, whereas functional neuroimaging modalities indirectly estimate brain function/activity through respective characteristic “source signals” or “indicators” of the underlying neuronal, metabolic or hemodynamic activity

  • We propose exploring where and how gray matter (GM) corresponds to time-varying functional connections will improve our understanding of both structural and functional connectivity

  • A total number of 162 volumes of standard gradient echo planar imaging (EPI) blood-oxygen-level dependent (BOLD) fMRI data were captured with a repetition time (TR) of 2 s, echo time (TE) of 30 s, field of view (FOV) of 220 × 220 mm2 (64 × 64 matrix), flip angle (FA) of 77◦ and 32 sequential ascending axial slices of 4 mm thickness and 1 mm skip

Read more

Summary

Introduction

Structural neuroimaging modalities evaluate anatomical brain structure and tissue type (e.g., structural MRI or sMRI) or brain tissue microstructure (e.g., diffusion MRI or dMRI), whereas functional neuroimaging modalities indirectly estimate brain function/activity through respective characteristic “source signals” or “indicators” of the underlying neuronal (e.g., electroencephalography or EEG, magnetoencephalography or MEG), metabolic (e.g., positron emission tomography or PET) or hemodynamic (e.g., functional MRI or fMRI) activity. It would be important to simultaneously acquire EEG and fMRI data if the study goal is to identify potential correlates of time-varying functional connectivity measures in fMRI data to the EEG data. In this case, the acquired modalities could be analyzed through separate or collective pipelines using a variety of univariate or multivariate algorithm through a model-based or data-driven approach (Calhoun and Sui, 2016). There have been several interesting demonstrations of the potential of utilizing such cross-modality or joint information in understanding the human brain and its disorders, disease characterization or biomarker identification, and uncovering disrupted links in complex mental illness (see Calhoun and Sui, 2016 for a detailed review)

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call