Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partners

Abstract

Novel technology can be a powerful tool for enhancing students' interest in many learning domains. However, the sustainability and overall impact of such interest is unclear. This study tests the longer-term effects of technology on students' task and course interest. The experimental study was conducted with students in foreign language classes (n = 122): a 12-week experimental trial that included pre- and post-course interest, and a sequence of task interest measures. Employing a counterbalanced design, at three week intervals students engaged in separate speaking tasks with each of a Human and “Chatbot” partner. Students' interest in successive tasks and in the course (pre-post), were used to assess differential partner effects and course interest development trajectories. Comparisons of task interest under different partner conditions over time indicated a significant drop in students' task interest with the Chatbot but not Human partner. After accounting for initial course interest, Structural Equation Modelling indicated that only task interest with the Human partner contributed to developing course interest. While Human partner task interest predicted future course interest, task interest under Chatbot partner conditions did not. Under Chatbot partner conditions there was a drop in task interest after the first task: a novelty effect. Implications for theory and practice are discussed.