Audiovisual speech perception of multilingual learners of Japanese

Abstract

ABSTRACT Due to the complex nature of languages and the way they are used, it is often difficult to research multilinguals because of the considerable variation in the ways their spoken languages may impact their perceptions. For this reason, foreign language education research has largely been focused on English L2 speakers, overlooking how different languages might impact perception in multilingual speakers. Focusing on Japanese as a Second Language (JSL) learners, this research investigated how multilinguals responded to audiovisual cues in Japanese and English. Utilising web-based eye-tracking technology facilitated by WebGazer.js. Participants were asked to complete a novel phonetic distinction task while their gaze behaviour was measured. Contrary to initial theoretical expectations, the findings did not reveal significant mediation by gaze behaviour on the relationship between multilingualism and task performance. However, the study found that when looking at the duration of fixation on the mouth, there's a significant difference between native English speakers and native speakers of Asian languages when listening to English or Japanese. These findings indicate that further research that explores the nuances of gaze behaviour among multilingual learners of non-English languages (such as Japanese) is necessary.