Obstetric team simulation program challenges

Abstract

ObjectiveTo describe the challenges associated with the development and assessment of an obstetric emergency team simulation program. DesignThe goal was to develop a hybrid, in-situ and high fidelity obstetric emergency team simulation program that incorporated weekly simulation sessions on the labor and delivery unit, and quarterly, education protected sessions in the simulation center. All simulation sessions were video-recorded and reviewed. SettingLabor and delivery unit and simulation center. ParticipantsMedical staff covering labor and delivery, anesthesiology and obstetric residents and obstetric nurses. MeasurementsAssessments included an on-line knowledge multiple-choice questionnaire about the simulation scenarios. This was completed prior to the initial in-situ simulation session and repeated 3 months later, the Clinical Teamwork Scale with inter-rater reliability, participant confidence surveys and subjective participant satisfaction. A web-based curriculum comprising modules on communication skills, team challenges, and team obstetric emergency scenarios was also developed. Main resultsOver 4 months, only 6 labor and delivery unit in-situ sessions out of a possible 14 sessions were carried out. Four high-fidelity sessions were performed in 2 quarterly education protected meetings in the simulation center. Information technology difficulties led to the completion of only 18 pre/post web-based multiple-choice questionnaires. These test results showed no significant improvement in raw score performance from pre-test to post-test (P=.27). During Clinical Teamwork Scale live and video assessment, trained raters and program faculty were in agreement only 31% and 28% of the time, respectively (Kendall's W=.31, P<.001 and W=.28, P<.001). Participant confidence surveys overall revealed confidence significantly increased (P<.05), from pre-scenario briefing to after post-scenario debriefing. ConclusionProgram feedback indicates a high level of participant satisfaction and improved confidence yet further program refinement is required.