Abstract

Semantic audiovisual stimuli have a facilitatory effect on behavioral performance and influence the integration of multisensory inputs across sensory modalities. Many neuroimaging and electrophysiological studies investigated the neural mechanisms of multisensory semantic processing and reported that attention modulates the response to multisensory semantic inputs. In the present study, we designed an functional magnetic resonance imaging (fMRI) experiment of semantic discrimination using the unimodal auditory, unimodal visual and bimodal audiovisual stimuli with semantic information. By manipulating the stimuli present on attended and unattended position, we recorded the task-related fMRI data corresponding to the unimodal auditory, unimodal visual and bimodal audiovisual stimuli in attended and unattended conditions. We also recorded the fMRI data in resting state. Then the fMRI method was used together with a graph theoretical analysis to construct the functional brain networks in task-related and resting states and quantitatively characterize the topological network properties. The aim of our present study is to explore the characteristics of functional brain networks that process semantic audiovisual stimuli in attended and unattended conditions, revealing the neural mechanism of multisensory processing and the modulation of attention. The behavioral results showed that the audiovisual stimulus presented simultaneously promoted the performance of semantic discrimination task. And the analyses of network properties showed that compared with the resting-state condition, the functional networks of processing semantic audiovisual stimuli (both in attended and unattended conditions) had greater small-worldness, global efficiency, and lower clustering coefficient, characteristic path length, global efficiency and hierarchy. In addition, the hubs were concentrated in the bilateral temporal lobes, especially in the anterior temporal lobes (ATLs), which were positively correlated to reaction time (RT). Moreover, attention significantly altered the degree of small-worldness and the distribution of hubs in the functional network for processing semantic audiovisual stimuli. Our findings suggest that the topological structure of the functional brain network for processing semantic audiovisual stimulus is modulated by attention, and has the characteristics of high efficiency and low wiring cost, which maintains an optimized balance between functional segregation and integration for multisensory processing efficiently.

Highlights

  • Successful human communication critically depends on efficient semantic comprehension, which refers to a collection of interactive cognitive mechanisms that support semantically derived behaviors (Lambon Ralph, 2014)

  • The aim of our present study is to explore the characteristics of functional brain networks that process semantic audiovisual stimuli in attended and unattended conditions, and provide new insights into the neural mechanisms of multisensory semantic processing and the modulation of attention in the human brain from a systemic perspective (Zhou et al, 2012; Zuo et al, 2012; Horn et al, 2014)

  • The results showed no significant differences in mean reaction times (RTs) (F = 1.724, p = 0.206, power = 99.99%), hit rates (HRs) (F = 0.050, p = 0.826, power = 99.38%), false alarm rates (FARs) (F = 2.461, p = 0.067, power = 94.91%), and d (F = 0.515, p = 0.482, power = 99.99%) based on stimulus location

Read more

Summary

Introduction

Successful human communication critically depends on efficient semantic comprehension, which refers to a collection of interactive cognitive mechanisms that support semantically derived behaviors (Lambon Ralph, 2014). The anterior temporal lobe (ATL) was found to be activated by semantically matched audiovisual stimuli (Lambon Ralph et al, 2010, 2017; Jackson et al, 2015). The event-related potential components related to semantic audiovisual stimuli in attended and unattended conditions have different temporal and spatial distributions (Donohue et al, 2011; Wang et al, 2016). These studies adopted direct or indirect methods to measure cerebral responses to semantic audiovisual stimuli to explore the neural mechanisms that process the bimodal audiovisual stimuli with congruent semantic information, as well as the effects of attention

Objectives
Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call