Phenomenology of the sound-induced flash illusion

Abstract

Past studies, using pairings of auditory tones and visual flashes, which were static and coincident in space but variable in time, demonstrated errors in judging the temporal patterning of the visual flashes-the sound-induced flash illusion. These errors took one of the two forms: under-reporting (sound-induced fusion) or over-reporting (sound-induced fission) of the flash numbers. Our study had three objectives: to examine the robustness of both illusions and to consider the effects of stimulus set and response bias. To this end, we used an extended range of fixed spatial location flash-tone pairings, examined stimuli that were variable in space and time and measured confidence in judging flash numbers. Our results indicated that the sound-induced flash illusion is a robust percept, a finding underpinned by the confidence measures. Sound-induced fusion was found to be more robust than sound-induced fission and a most likely outcome when high numbers of flashes were incorporated within an incongruent flash-tone pairing. Conversely, sound-induced fission was the most likely outcome for the flash-tone pairing which contained two flashes. Fission was also shown to be strongly driven by stimuli confounds such as categorical boundary conditions (e.g. flash-tone pairings with ≤2 flashes) and compressed response options. These findings suggest whilst both fission and fusion are associated with 'auditory driving', the differences in the occurrence and strength of the two illusions not only reflect the separate neuronal mechanisms underlying audio and visual signal processing, but also the test conditions that have been used to investigate the sound-induced flash illusion.