The effect of temporal asynchrony on audiovisual integration

Abstract

Many studies have shown that temporal asynchrony of visual-auditory stimuli can influence the integration between visual and auditory modality, however, the multisensory mechanisms of asynchronous inputs were not well understood. To investigate the effect of temporal asynchrony on audiovisual integration, we measured event-related potentials (ERPs) and behavior in human subjects. In this study, visual and auditory stimuli onset asynchronous (SOA= ±100 ms, ±50 ms, 0 ms), both the auditory and visual stimuli were attended. Using event-related potential, the differences of audiovisual integration elicited by asynchronous audiovisual stimuli were found at 140–200 ms over a wide parietal and occipital regions. These results revealed the asynchronous audiovisual stimuli enhanced the detection and elicited audiovisual integration. We expect that these results could helpful to process the audiovisual information of artificial intelligence.