Knowing is Half the Battle, or Is It? A Randomized Experiment of the Impact of Supplemental Notification Letters on Placement Exam Participation, Preparation, and Performance

Abstract

Community college students often are unaware of the stakes involved in their performance on placement exams, used to sort the students into their first math and English courses. In our randomized experiment of approximately 13,000 newly admitted community college students, we test whether informing students, via a supplemental notification letter, about the implications of placement exam scores influences their placement exam participation, preparation, and performance. We also test whether message framing (loss-framed vs. gain-framed) alters the effect of the information on study outcomes. We find that neither type of message has an effect on placement exam preparation or performance. We find limited evidence to suggest that the loss-framed message may have a small effect on the avoidance of placement exams by increasing the likelihood of students’ submitting alternative evidence of academic preparation. Overall, our evidence suggests that students’ prior knowledge about the ramifications of placement exams is not enough to improve performance. Colleges should consider alternative means of assessing college readiness, such as measures of high school achievement, and should provide students who still have to take placement exams with detailed information about test content and study materials before testing.