The Impact of Multimodal Ensembles on Audio-Visual Comprehension: Implementing Vodcasts in EFL Contexts

Abstract

Abstract The ever increasing worldwide use of Information and Communication Technologies (ICT) over the last decade, has not only contributed to the way people interact with each other, but also to how languages are taught and learnt. Language digital materials such as vodcasts bring together, in an innovative, attractive and motivating manner, diverse modes of communication which promote a multimodal approach of learning. This article explores the use of multimodal ensembles in audio-visual language learning materials designed to enhance students’ comprehension. This mixed methods (qualitative and quantitative) study, comprised a multimodal analysis of two language learning vodcasts from the British Council, using ELAN as the main multimodal annotation tool. The data obtained from the multimodal transcription was relevant to describe the different orchestrations of modes contained in both vodcasts. From this data, two comprehension tests, based on the ensembles found, were developed to check how each ensemble could benefit language students. The results confirmed that EFL students’ audio-visual comprehension improved when there was a greater number of orchestrated modes. These findings not only emphasise the potential of multimodal materials to improve foreign language comprehension, but also encourage teachers to adapt their methods to the pervasive digital era.