Online Proctored Versus Unproctored Low-Stakes Internet Test Administration: Is There Differential Test-Taking Behavior and Performance?

Abstract

ABSTRACTOnline higher education institutions are presented with the concern of how to obtain valid results when administering student learning outcomes (SLO) assessments remotely. Traditionally, there has been a great reliance on unproctored Internet test administration (UIT) due to increased flexibility and reduced costs; however, a number of validity concerns have led some researchers to question its implementation and results. To mitigate the limitations of UIT, a relatively new approach, referred to as online proctoring, has been developed to mirror in-person proctoring remotely by capitalizing on technology to create verifiable and secure testing conditions. This study evaluated the comparability of online proctored and unproctored test administration in a low-stakes testing context on user-friendliness, examinee behavior, and mean scores. Results demonstrated improved user-friendliness (e.g., ease of logging in); however, no significant differences were observed in terms of keystroke information, rapid guessing, or aggregated scores between proctoring conditions. Overall, these results suggest that online institutions can implement UIT, which is a cost-effective approach to test administration, and obtain valid group-level inferences from SLO assessments.