Abstract
Maximum deviation global discrimination index (MDGDI) is a new item selection method for cognitive diagnostic computerized adaptive testing that allows for attribute coverage balance. We developed the maximum limitation global discrimination index (MLGDI) from MDGDI, which allows for both attribute coverage balance and item exposure control. MLGDI can realize the attribute coverage balance and exposure control of the item. Our simulation study aimed to evaluate the performance of our new method against maximum global discrimination index (GDI), modified maximum GDI (MMGDI), standardized weighted deviation GDI (SWDGDI), and constraint progressive with SWDGDI (CP_SWDGDI). The results indicated that (1a) under the condition of realizing the attribute coverage balance, MDGDI had the highest attribute classification accuracy; (1b) when the selection strategy accommodated the practical constraints of the attribute coverage balance and item exposure control, MLGDI had the highest attribute classification accuracy; (2) adding the item exposure control mechanism to the item selection method reduces the classification accuracy of the attributes of the item selection method; and (3) compared with GDI, MMGDI, SWDGDI, CP_SWDGDI, and MDGDI, MLGDI can better achieve the attribute-coverage requirement, control item exposure rate, and attribute correct classification rate.
Highlights
Cognitive diagnostic assessment (CDA) is a recently popular assessment method in theoretical studies on psychological testing
We evaluated the methods with respect to six criteria: attribute correct classification rate (ACCR), average marginal match rate (AAMR), mastery pattern correct classification rate (PCCR), item-bank exposure rate χ2, test overlap rate (TOR), and maximum exposure rate
It is worth noting that, as the exposure control index was added to the maximum limitation global discrimination index (MLGDI), the decrease in PCCR was relatively small compared to Maximum deviation global discrimination index (MDGDI) which has the highest PCCR comparing to the other selection item methods, but result in a better item bank usage
Summary
Cognitive diagnostic assessment (CDA) is a recently popular assessment method in theoretical studies on psychological testing. When based on the classical test theory (CTT), CDA provides examinee scores. When based on the multidimensional item response theory, CDA provides. MDGDI and MLGDI Based Methods multidimensional ability scores, which details the advantages and disadvantages of the examinee in a given content domain, aiding the assessment of the examinees by administrators (Yao and Boughton, 2007; Lee et al, 2012). Computerized adaptive testing (CAT) combines test theory with computer technology to improve testing efficiency (Weiss, 1982), which has become a promising method in psychological and educational measurement. CD-CAT has received an increasing scholarly attention worldwide (Kang et al, 2017; Huebner et al, 2018)
Sign-in/Register to view highlights & summary 
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call