An Estimator of Examinee-Level Measurement Error Variance That Considers Test Form Difficulty Adjustments

Abstract

A model and estimator for examinee-level measure ment error variance are developed. Although the bi nomial distribution is basic to the modeling, the pro posed error model provides some insights into problems associated with simple binomial error, and yields estimates of error that are quite distinct from bi nomial error. By taking into consideration test form difficulty adjustments often used in standardized tests, the model is linked also to indices designed for identi fying unusual item response patterns. In addition, av erage error variance under the model is approximately that which would be obtained through a KR-20 estimate of reliability, thus providing a unique justification for this popular index. Empirical results using odd-even and alternate-forms measures of error variance tend to favor the proposed model over the binomial.