The Role of AI Translators on Reading Comprehension

Abstract

This study aims to investigate reading comprehension and students’ perception in a university reading course using an AI translator, whether Google or Papago Translate. The subjects were comprised of 113 students divided into three groups: the control group analyzed reading texts traditionally, the first experimental group analyzed reading texts using Google or Papago Translate, while the second experimental group also analyzed reading texts using Google or Papago Translate, but then also revised the machine translator’s incorrect translations. Reading comprehension tests and a post-questionnaire were then administered to examine the effects of using AI translators. The findings showed that all three groups significantly improved their reading comprehension scores in the post-tests as compared to those in the pre-tests. However, there were no statistically significant differences between groups. Regarding students’ perception, the participants using an AI translator showed no statistical differences between the two experimental groups. However, in terms of sentence structure, students’ translations after using an AI translator were perceived to be of significantly higher quality compared with those that simply used the translator. Most participants stated that using AI translators was much more beneficial to get the main idea and for understanding the whole passage, rather than using it simply to learn vocabulary and expressions. Furthermore, using AI translators relieved the participants’ anxiety and burden while also satisfying them. However, such students also had lower mean scores in terms of interest and motivation for language learning in the post-questionnaire items. Based on the results of the study, pedagogical implications and future research are suggested.