90 Quality assurance of debriefing practices using the paediatric osad tool for peer review: experience from a uk paediatric simulation network

Abstract

Background/context Debriefing is a core component of full patient simulation (FPS). Debriefing practices vary widely and quality assurance can help recognise variable practice and raise debriefing standards. The Paediatric Objective Structured Assessment of Debriefing (OSAD) tool is a validated tool developed to measure the quality of debriefing in paediatric FPS 1,2 This study assesses the usability of OSAD to peer review debriefing across a paediatric simulation network. Methodology Current debriefing and peer-review practices were assessed using electronic questionnaires (n = 17) and semi-structured interviews (n = 28) across 11 hospitals. Using OSAD, peer reviews of debriefing practices were facilitated across a range of clinical sites during paediatric and neonatal in-situ and centre-based FPS courses. The reviews were followed up with semi-structured interviews to assess the usability of OSAD and to identify barriers to the quality assurance process. Results The questionnaire study demonstrated variation in debriefing. 65% (n = 11) used a structured debriefing approach with 59% (n = 10) using OSAD. Peer review was rarely used for quality assurance (n = 3) but was deemed successful where used. Thematic analysis revealed themes including the importance of feedback on debriefing practices and the need for robust quality assurance by peer review. Barriers included unfamiliarity with the OSAD tool and reluctance to offer feedback to more experienced debriefers. Potential impact A peer-review approach to debriefing using the OSAD can enhance debriefing practices and promote quality assurance. Following this research, the paediatric OSAD will be adapted, and new user-friendly tools tested by users, to assist in peer review of debriefing practices across the network The new format will be re-evaluated and results will be available for the 2016 ASPiH conference. References Runnacles J, Thomas L, Sevdalis N, Kneebone R, Arora S, Cooper M. Development of a tool to improve performance debriefing and learning: the paediatric Objective Structured Assessment of Debriefing (OSAD) tool. Postgrad Med J 2014; 90 (1069):613–621. Runnacles J, Thomas L, Korndorffer J, Arora S, Sevdalis N. Validation evidence of the paediatric Objective Structured Assessment of Debriefing (OSAD) tool. BMJ Simulation and Technology Enhanced Learning 2016. Published online May 24, 2016.