An enhanced Elo-based student model for polychotomously scored items in adaptive educational system

Abstract

ABSTRACT The adaptive learning environment provides learning support that suits individual characteristics of students, and the student model of the adaptive learning environment is the key element to promote individualized learning. This paper provides a systematic overview of the existing student models, consequently showing that the Elo rating system has greater potential as compared to the other models regarding application in the online learning environment. Based on the Elo model, this study proposes the EELO, an enhanced Elo rating system, in consideration of the application scenarios of polychotomously scored items and multi-dimensional granularity evaluations not covered by the basic Elo rating system. The EELO model estimating students’ cognitive abilities and predicting their future performances on unknown questions is evaluated based on one public set (Assigment2) and one proprietary dataset (HSK), and achieved an AUC of 0.92 for Assigment2 and 0.84 for HSK, which shows that the EELO model has the best performance regarding the above-mentioned objectives as compared with the latest extensions of the IRT and BKT models. Subsequently, the EELO model was tested and applied successfully in a real large-scale online learning environment to demonstrate the potential of the EELO model in adaptive learning applications.