Cross-modal transfer of talker learning

Abstract

Observers can match unfamiliar faces to corresponding voices (Kamachi et al., 2003). Observers can also use dynamic point-light displays containing isolated visible articulations to match faces to voices (Rosenblum et al., 2006) and to sinewave versions of those voices (Lachs & Pisoni, 2004) suggesting that isolated idiolectic information can support this skill. Cross-modal skills also extend to facilitation of speech perception. Familiarity with a talker in one modality can facilitate speech perception in another modality (Rosenblum, Miller, & Sanchez, 2007; Sanchez, Dias, & Rosenblum, 2013). Using point-light and sinewave techniques, we tested whether talker learning transfers across modalities. If learning of idiolectic talker information can transfer across modalities, observers should better learn to auditorily recognize talkers they have previously seen. Sixteen subjects trained to recognize five point-light talkers. Eight of these subjects then trained to recognize sinewave voices of the five previ...