Abstract

Scores from computer-based tests are increasingly used to inform a variety of school- and student-level decisions. An underlying assumption is that the associated scores represent effortful responding by each student with respect to the tasks presented. An innovative method for examining evidence for this assumption involves an examination of item response times to detect rapid guessing behavior. If such behavior is present for a particular student across many items, the score is considered invalid due to low test-taking effort (TTE). Drawing on Eccles’ expectancy–value theory, this study explored the prevalence of low TTE among middle school students during a computer adaptive test in reading, as well as demographic and motivational correlates of low TTE. Results suggested a prevalence rate of low TTE of 7%. Low TTE was particularly common among males and those with high cost value perceptions. Implications for research and practice are discussed. Impact Statement Seven percent of middle school students were identified as engaging in rapid guessing behavior on a computer-based reading test, to the extent that the validity of their test scores should be questioned. This behavior was particularly common among males and those who perceived the test as requiring them to give up preferred activities. Further exploration into methods for increasing test-taking effort among those who display rapid guessing behavior is needed.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call