Generalization of multisensory perceptual learning.

Mark T Wallace,Andrea Hillock-Dunn,Albert R Powers Iii

doi:10.1038/srep23374

Mark T Wallace, Andrea Hillock-Dunn + Show 1 more

Open Access

https://doi.org/10.1038/srep23374

Copy DOI

Abstract

Life in a multisensory world requires the rapid and accurate integration of stimuli across the different senses. In this process, the temporal relationship between stimuli is critical in determining which stimuli share a common origin. Numerous studies have described a multisensory temporal binding window—the time window within which audiovisual stimuli are likely to be perceptually bound. In addition to characterizing this window’s size, recent work has shown it to be malleable, with the capacity for substantial narrowing following perceptual training. However, the generalization of these effects to other measures of perception is not known. This question was examined by characterizing the ability of training on a simultaneity judgment task to influence perception of the temporally-dependent sound-induced flash illusion (SIFI). Results do not demonstrate a change in performance on the SIFI itself following training. However, data do show an improved ability to discriminate rapidly-presented two-flash control conditions following training. Effects were specific to training and scaled with the degree of temporal window narrowing exhibited. Results do not support generalization of multisensory perceptual learning to other multisensory tasks. However, results do show that training results in improvements in visual temporal acuity, suggesting a generalization effect of multisensory training on unisensory abilities.

Highlights

sound-induced flash illusion (SIFI) Assessment flash illusion (SIFI)[27], the degree to which these changes are driven by effects on unisensory or multisensory processing remain unclear
No change in SIFI illusion is seen after training, but improvements are seen in correctly recognizing two-flash conditions
The passive exposure group showed no difference in sensitivity at the two time points (Fig. 4c). In contrast to these changes, no significant changes in beta were noted among any of the three groups on initial or follow-up assessment (Fig. 4d–f). These results illustrate that while training on a multisensory simultaneity judgment task does not alter the perception of a temporally-dependent multisensory illusion (i.e., SIFI), it does result in an increased ability to correctly detect two flashes presented in close succession when compared with pre-training data

Summary

OPEN Generalization of multisensory perceptual learning

Because the environmental energies carrying information from the different senses (i.e., light, sound) propagate at different rates, the temporal relationship between these different inputs must be flexibly specified For this reason the construct of a temporal window of multisensory binding has been proposed–an interval spanning several hundred milliseconds and within which paired events in two different sensory modalities are likely to produce enhanced neural, perceptual, and behavioral responses[1,2,3,4,5,6,7,8,9]. Numerous questions remain about the perceptual changes induced by such training Foremost among these are questions of generalization - whether the improvements in multisensory temporal acuity brought about by training are capable of transferring to other tasks involving either multisensory or unisensory (i.e., visual alone, auditory alone) processing. One notable demonstration of these effects has described generalization of multisensory perceptual learning of a temporal order judgment (TOJ) task onto the sound-induced

SIFI Assessment

Results

Discussion

Additional Information