Discrepant performance on multiple‐choice and short answer assessments and the relation of performance to general scholastic aptitude

Abstract

We conducted correlational and performance discrepancy analyses on exam and achievement data taken from students in three psychology courses. Across courses, the same findings emerged. First, only a small fraction of students consistently performed more strongly on one type of assessment (e.g., multiple‐choice) than on another (e.g., short answer). Second, students’ multiple‐choice performance, above and beyond their short answer performance, accounted for variation in students’ standing on achievement measures unrelated to psychology (including high school class standing, American College Test score, and college grade point average). In contrast, students’ short answer performance, above and beyond their multiple‐choice performance, did not account for variation in students’ standing on those achievement measures. Our findings support the continued use of multiple‐choice items to assess student learning.