LLTM모형과 LLTM-R모형을 이용한 Rasch 문항난이도 및 문항정답률에 영향을 미치는 요인 탐색: 초등학교 3R’s 셈하기를 중심으로

Abstract

This study aimed to predict the Rasch item difficulty and the proportion of correct responses for
 the 3R's math tests in the Diagnostic Tests of Basic Skills using the Linear Logistic Test Model
 (LLTM) and the Linear Logistic Test Model with error (LLTM-R). Q-matrices with 12 item attribute
 variables were derived, and the national samples were collected in 2018, 2019, 2022, and 2023.
 Findings reveal that, firstly, items requiring problem-solving with pictures and carrying/borrowing were
 challenging, while attributes like solving by reading numbers, single-digit, and constructed-response
 were prevalent. Secondly, correlations between Rasch difficulties and LLTM estimates varied between
 0.67-0.79, but approached 1.0 with LLTM-R. Thirdly, after predicting item responses with LLTM-R,
 correlations between the observed proportion of correct responses and the predicted proportions of
 correct responses were approximately 0.74 to 0.76. The percentages of items with less than a 5%
 difference between observed proportion of correct response and predicted proportion of correct responses
 over four years ranged from 68% to 92%, and there were no items with the difference of more than
 10%.