Audiovisual integration in fricative production and perception by non-native speakers

Abstract

Lip rounding enhances the distinction between the fricatives /s/ and /∫/ in English. How well can second-language (L2) learners of English utilize lip rounding to distinguish these two sounds in their production and perception? Is the ability to utilize lip rounding in fricative perception related to audiovisual integration as measured by the McGurk effect? Does the ability to use visual information for L2 speech perception evolve over time? Fourteen L2 learners and 14 native speakers of English participated in three tasks to explore these questions. A fricative production task and fricative perception task were used to evaluate the ability to use lip rounding to distinguish /s/ and /∫/. A McGurk task was utilized to determine the degree of audiovisual integration in speech perception. The L2 learners also completed a second test session to evaluate the development of fricative production and perception abilities over time. Overall, the learners showed high proficiency in both fricative production and perception, suggesting effective use of lip rounding in making the distinction. The production-perception correlation was significant only in the first test session, and no correlations were found between fricative perception and the McGurk effect. Nonetheless, accuracy and reaction time patterns differed between the L2 learners and native speakers, suggesting distinct strategies in dealing with audiovisual integration in speech perception.