Remote proctoring: Lessons learned from the COVID‐19 pandemic effect on the large scale on‐line assessment at Tel Aviv University

Abstract

AbstractBackgroundThe global COVID‐19 pandemic turned the adoption of on‐line assessment in the institutions for higher education from possibility to necessity. Thus, in the end of Fall 20/21 semester Tel Aviv University (TAU)—the largest university in Israel—designed and implemented a scalable procedure for administering proctored remote examinations. This procedure is applicable to different kinds of examinations in diverse disciplines and to disparate degree levels.ObjectivesThis study aims to deepen the knowledge with respect to the design and adoption of remote proctoring at an institutional levelMethodsFirst, based on lessons learned from the first semester of COVID‐19, we describe the development and implementation of an institution‐wide protocol for conducting on‐line proctored assessment. We show the large‐scale applicability of the protocol for administering examinations via Moodle with remote proctoring via Zoom. The accurately designed procedures that included careful consideration of all parties involved—academic staff members, students, administrative staff and proctors—enabled TAU to successfully assess the learning outcomes of its 25,000 students, while maintaining validity, compatibility and reliability of the assessment. Second, we report combined data from surveys of 4380 students and 188 faculty‐members (18% and 12% response rate respectively), conducted at TAU following these examinations.Results and ConclusionsWith over 90% of the students experiencing at least one, and 80% of faculty‐members administering at least one proctored remote examination, these heterogeneous sources of data allow us to investigate a unique and complementary perspective of the process. Some of the significant findings consist of the over‐all perception of the students' integrity by both groups surveyed; the discrepancy in the groups' perspectives of the adequate form of learning‐assessment—with the instructors preferring proctored examinations and the students—formative‐assessment; and the influence of the pedagogical challenges on the perception of validity that outweighed other factors, for example, the pandemic‐related stress, the on‐line assessment challenges and other.