When Experts are Oceans Apart: Comparing Expert Performance Values for Proficiency-Based Laparoscopic Simulator Training

Abstract

Surgical training is moving away from the operating room toward simulation-based skills training facilities. This has led to the development of proficiency-based training courses in which expert performance data are used for feedback and assessment. However, few expert value data sets have been published, and no standard method for generating expert values has been adopted by the field. To investigate the effect of different proficiency value data sets on simulator training courses, we (1) compared 2 published expert performance data sets for the LapSim laparoscopic virtual-reality simulator (by van Dongen et al. and Heinrichs et al.) and (2) assessed the effect of using either set on LapSim training data obtained from 16 local residents in surgery and gynecology. Across all simulator tasks, the experts consulted by van Dongen et al. performed better on motion efficiency, but not on duration or damage control. Applying both proficiency sets to training data collected during a basic skills laparoscopic simulator course, residents would have graduated on an average in 1.5 fewer sessions using the Heinrichs expert values compared with the van Dongen expert values. The selection of proficiency values for proficiency-based simulator training courses affects training length, skills level assessment, and training costs. Standardized, well-controlled methods are necessary to create valid and reliable expert values for use in training and research.