Using students’ cognitive, affective, and demographic characteristics to predict their understanding of computational thinking concepts: a machine learning-based approach

Abstract

ABSTRACT Logistic regression models have traditionally been used to identify the factors contributing to students’ conceptual understanding. With the advancement of the machine learning-based research approach, there are reports that some machine learning algorithms outperform logistic regression models in terms of prediction. In this study, we collected cognitive, affective, and demographic data from 4,142 primary students as features to predict their understanding of computational thinking (CT) concepts. We identified and used five popularly used machine learning models. All five machine learning models outperformed the logistic regression model, with the extreme gradient boosting (XGBoost) model achieving the highest predictive accuracy. We used these features and the K-means algorithm of the unsupervised clustering technique to identify four optimal clusters of students. By comparing the representative students from each of the four clusters, selected by the t-distributed stochastic neighbour embedding algorithm, we found that each cluster had its characteristics. For example, one cluster consisted of students who outperformed students in the other three clusters in mathematics, scored highest in prior experience in programming, and used computers and the Internet most frequently. By identifying the characteristics of these clusters, pedagogical design, and resource support can be proposed to support students’ learning of CT concepts.