Our brains continuously bind information obtained through many sensory channels to form solid percepts of objects and events. Usually these pieces of information complement and confirm each other, thereby improving the reliability of our perception [1xStein, B and Meredith, M. See all References][1]. But incongruities between the sensory inputs may result in unexpected percepts due to intersensory interactions, as in the well-known audiovisual McGurk illusion [2xHearing lips and seeing voices. McGurk, H and MacDonald, J. Science. 1976; 264: 746–748See all References][2].Audiotactile interactions have remained largely unexplored [1xStein, B and Meredith, M. See all References][1], although Paul von Schiller [3xDie Rauhigkeit als intermodale Erscheinung. von Schiller, P. Z Psychol Bd. 1932; 127: 265–289See all References][3] noted in 1932 that sounds — noise bursts or tones repeated at regular intervals — may affect tactile perception of roughness. We describe here a novel audiotactile interaction, ‘parchment-skin illusion’, which demonstrates that sounds that are exactly synchronous with hand-rubbing may strongly modify the resulting tactile sensations.The subjects were seated with forearms supported on their thighs. A microphone close to the hands was recording the sounds produced when the subjects rubbed their palms together in a back-and-forth motion at 1–2 cycles per second. The sounds were played back to the subject through headphones. This audio feedback was either identical to the original sound or modified so that the high frequencies (above 2 kHz) were either dampened by or accentuated by 15 decibels (dB). In addition, the maximum sound intensity, which was adjusted to a comfortable listening level, was attenuated by either 20 or 40 dB, resulting in a randomized experiment of 3 ×3 block design, as shown in Table 1Table 1.Table 1 Tactile sensation of skin roughness. View Table in HTML Tactile sensation of relative skin roughness as a function of quality of the auditory feedback; mean ± SEMs of 11 subjects. The original estimates of skin roughness were given on a 0 (rough or moist) to 10 (smooth or dry) scale but as the individual ranges varied from 3.5 to 10, the values were normalized according to the range of each individual before averaging. The individual values were means of two repeated tests.During the pilot sessions several subjects spontaneously reported that the enhanced high-frequency feedback made the palmar skin feel drier, almost resembling parchment paper; this effect was found in 13 out of 17 healthy adults tested. Moisture on the palmar skin typically prevented the phenomenon.Eleven subjects (six males, five females; age range 25–49 years) who reported the phenomenon in a consistent manner were asked to quantify the tactile sensations on their palms during varying audio feedback conditions on a scale of 0 to 10, referring to a range rough/moist–smooth/dry, respectively. The audio feedback had a very clear effect on the tactile sensation as is evident from Table 1Table 1.When either the proportion of the high frequencies or the average sound level of the auditory feedback increased, the skin started to feel more paper-like, that is, the perceived roughness/moisture of the palmar skin decreased and the smoothness/dryness increased. The effects of both the high-frequency content and the average intensity of the feedback were statistically highly significant (by analysis of variance). Tactile sensitivity — tested with von Frey hairs in two subjects while they performed the task with audio feedback — was not modified during the illusion, as compared with the no-feedback condition with the hands at rest.An additional experiment with two experienced subjects showed that a delay of the audio feedback by more than 100 milliseconds clearly diminished the illusion. Efficient binding of multisensory inputs evidently requires accurate temporal coincidence, or a temporal window for multisensory integration (as discussed in [4xRepresentation and integration of multiple sensory inputs in primate superior colliculus. Wallace, MT, Wilkinson, LK, and Stein, BE. J Neurophysiol. 1996; 76: 1246–1266PubMedSee all References][4]), which naturally happens when the subjects hear the sounds produced by their own hand movements.We hypothesize that the parchment-skin illusion reflects an omnipresent intersensory integration phenomenon, which helps the subject to make accurate tactile decisions about the roughness and stiffness of different textures they manipulate.
Read full abstract