Case Curve: A Novel Web-Based Platform and Mobile Phone Application to Evaluate Surgical Competence in Graduate Medical Education.

Abstract

Competency-based medical education is well established, yet methods to evaluate and document acquisition of surgical skill remain underdeveloped. We describe a novel web-based application for competency-based surgical education at a single neurosurgical department over a 3-year period. We used a web-based application to track procedural and cognitive skills acquisition for neurosurgical residents. This process included self-assessment, resident peer evaluations, evaluations from supervising attending physicians, and blinded video reviews. Direct observation by faculty and video recordings were used to evaluate surgical skill. Cases were subdivided into component skills, which were evaluated using a 5-point scale. The learning curve for each skill was continuously updated and compared with expectations. Progress was reviewed at a monthly surgical skills conference that involved discussion and analysis of recorded surgical performances. During an escalating 3-year pilot from 2019 to 2022, a total of 1078 cases in 39 categories were accrued by 17 resident physicians with 10 neurosurgical faculty who participated as evaluators. A total of 16 251 skill performances in 110 categories were evaluated. The most evaluated skills were those that were common to several types of procedures, such as positioning, hemostasis, and wound closure. The concordance between attending evaluations and resident self-evaluations was 76%, with residents underestimating their performance in 17% of evaluations and overestimating in 7%. We developed a method for evaluating and tracking surgical resident skill performance with an application that provides timely and actionable feedback. The data collected from this system could allow more accurate assessments of surgical skills and deeper insights into factors influencing surgical skill acquisition.