Validity of the Rezum Simulator for Trainees

Abstract

Background: Simulations have revolutionized surgical training and are an invaluable adjunct tool for augmenting the proficiency of surgeon and patient safety. Before being included in a practical assessment process, simulators need to be using various validity inference frameworks. Objective: We examine the construct validity and reliability of the Rezum simulator. Methods: Seventeen candidates of different professions voluntarily participated in the Rezum simulation workshop. The simulator provides a variety of variable metrics and challenges. Each candidate performed three cases of different difficulty levels with three trials of each case. Validity was measured statistically through a one-way analysis of variance (ANOVA) test, and a p-value of < 0.05 was considered significant. Additional reliability tests were provided, including intraclass correlation coefficients, a Cronbach test (0.7 is considered acceptable), and standard error of measurement. Results: The ANOVA of total scores among candidates was significant (p = 0.029). Senior registrars and consultants had the highest total scores. Procedure times did not differ significantly among candidates (p = 0.169). The reliability test for the total score was 0.899 (0.831–0.942), with a standard error value of 2.75, a standard deviation of 8.67, and a Cronbach alpha value of 0.915. Conclusion: We confer the primer evidence of Rezum simulation as a valid, reliable simulator of most of its metrics.