Replicating an Educational OSCE Project for Skill Assessment of Junior Anesthesiology Residents at Multiple Institutions: A Qualitative Description

Abstract

Educational research projects are often developed and implemented at a single institution. However, the research project methods and results may not be generalizable and able to be replicated successfully at other institutions. The aim of this study was to investigate the process of replicating an effective educational Objective Structured Clinical Examination (OSCE) event at multiple other institutions. An OSCE event was initially designed and implemented at the primary institution to assess the skill level of junior residents on the performance of basic anesthesia tasks. After the initial implementation, additional institutions were recruited to participate in a replication of this OSCE event at their own institutions. The primary institution provided the OSCE scenarios, assessment tools, rater training, and resident participant instructions. The participating secondary institutions' (n = 4) event managers obtained Institutional Review Board [IRB] approval, developed the event schedule, assigned faculty evaluators, and organized the simulation space at their own medical centers. The events were assessed by the secondary institutions' resident and faculty participants via an anonymous survey regarding the event's content and their perception of its educational value. We replicated a complex educational OSCE event, developed and implemented at 1 institution, at 4 other institutions. Resident participants (n = 60), participating faculty (n = 24), and event directors (n = 4) indicated a high level of appreciation for the OSCE event. Using a structured approach, educational OSCE events can be successfully replicated at multiple institutions. Organization of multi-institutional studies and collaborative efforts is complex. This study illustrates 1 example of how to successfully approach multi-institutional educational projects.