Using the RETAIN Tabletop Simulator as a Summative Assessment Tool for Neonatal Resuscitation Healthcare Professionals: A Pilot Study.

Georg M. Schmölzer,Simran K. Ghoman,Maria Cutumisu

doi:10.3389/fped.2020.569776

Georg M. Schmölzer, Simran K. Ghoman + Show 1 more

Open Access

https://doi.org/10.3389/fped.2020.569776

Copy DOI

Abstract

Background: Frequent and objective summative assessment of neonatal healthcare providers is important to ensure high-quality care to patients during neonatal resuscitation. Currently, neonatal resuscitation providers are only individually assessed using an at-home online multiple-choice questionnaire. While simulation-based assessment is preferred, resource constraints limit its widespread uptake. An alternative approach to simulation-based summative assessment is needed. Simulation-based serious games may provide a solution.Objective: The aim of this study was to examine if individual performance on the RETAIN (REsuscitation TrAINing for healthcare professionals) tabletop simulator can be used as a summative assessment of neonatal resuscitation providers, regardless of their prior board game experience.Method: Neonatal healthcare providers were recruited from a tertiary perinatal center to complete a (1) demographic pre-survey, (2) neonatal resuscitation scenario using an open-answer written pre-test, (3) neonatal resuscitation scenario using the RETAIN tabletop simulator, and (4) post-survey measuring usage and attitudes toward board games. Multiple linear regression analyses using the Johnson–Neyman technique were conducted in R to probe the moderation effect of years of board game on the relationship between pre-test and game performance.Results: Twenty Neonatal Resuscitation Program-trained healthcare providers (nurses, nurse practitioners, respiratory therapists, and fellows) were recruited for this study (n = 19 females). Participants' mean (standard deviation) pre-test score was 8.35 (1.81) out of a total 16 possible points (52%) and a score of 18 (4.41) out of a total of 40 possible points (45%) using RETAIN. Overall board game experience was 22.5 (12.6) years. Finally, years of board game moderated significantly the relation between the pre-test and game performance (B = −0.13, SE = 0.05, beta = −0.48, t = −2.77, p < 0.05; 95% CI [−0.24, −0.03]). Thus, participants' performance on the two tests (written and simulator) was significantly positively associated, but only for those who reported fewer than 21.5 years of board game experience.Conclusion: This study reports the preliminary results of a pilot study, indicating that the RETAIN tabletop simulator could be used as a simulation-based summative assessment, an enjoyable, low-cost alternative to traditional assessment approaches. RETAIN offers a solution to the need for more frequent and continued assessment of neonatal resuscitation providers.

Highlights

Each year, over 13 million newborns around the world require cardiorespiratory intervention at birth, yet one million of these infants die [1, 2]
This study examined whether individual performance on the RETAIN (REsuscitation TrAINing for healthcare professionals) neonatal resuscitation tabletop simulator can be Abbreviations: healthcare professionals’ (HCP), Healthcare professional; interquartile range (IQR), Interquartile range; NRP, Neonatal Resuscitation Program; RETAIN, REsuscitation TrAINing for healthcare professionals; standard deviation (SD), Standard deviation
The results indicate that the better the HCPs performed on the pre-test, the better they performed on RETAIN, but only when they reported lower experience with board games

Summary

Introduction

Over 13 million newborns around the world require cardiorespiratory intervention at birth, yet one million of these infants die [1, 2]. In a report conducted by the Joint Commission, deficiencies in healthcare professionals’ (HCP) competence were identified as the root cause for half of newborn deaths and injuries during delivery [3]. To address this quality gap, ongoing training and assessment of HCPs’ neonatal resuscitation performance is needed to improve health outcomes [4]. During the in-class portion, learners practice their skills and participate in team-based simulations, facilitated by a trained instructor [2].

Results

Discussion

Conclusion