What matters in AI-supported learning: A study of human-AI interactions in language learning using cluster analysis and epistemic network analysis

Abstract

This study investigates how students interact with artificial intelligence (AI) for English as a Foreign Language (EFL) learning and what matters in AI-supported EFL learning. It was conducted in naturalistic learning settings, involving sixteen primary school students and lasting approximately three months. The students' usage data of an AI agent and their reflection essays about the interactions with the AI agent were analyzed using cluster analysis and epistemic network analysis based on the frameworks of community of inquiry and students' approaches to learning. The results suggest four clusters of students, each with its distinct way of interacting with AI for language learning. More importantly, the comparisons of the four clusters of students reveal that even in AI-supported learning, not everyone can benefit from the potential promised by AI. The deep approach to AI-supported learning may amplify the benefits of AI's personalized guidance and strengthen the sense of the human-AI learning community. Passively or mechanically following AI's instruction, albeit with high levels of participation, may decrease the sense of the human-AI learning community and eventually lead to low performance. This study contributes to and has implications for the educational implementation of AI, as well as the facilitation and graphical representation of learner-AI interactions in educational settings.