1498 AN OPERATIVE PERFORMANCE RATING SYSTEM FOR UROLOGY RESIDENTS

Abstract

You have accessJournal of UrologyTechnology & Instruments: Surgical Education & Skills Assessment1 Apr 20111498 AN OPERATIVE PERFORMANCE RATING SYSTEM FOR UROLOGY RESIDENTS Aaron Benson and Thomas Tarter Aaron BensonAaron Benson Springfield, IL More articles by this author and Thomas TarterThomas Tarter Springfield, IL More articles by this author View All Author Informationhttps://doi.org/10.1016/j.juro.2011.02.1456AboutPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissionsReprints ShareFacebookTwitterLinked InEmail INTRODUCTION AND OBJECTIVES The best methods to evaluate medical procedures recommended by the American College of Graduate Medical Education are 1) simulations and models, and 2) checklists. Simulators are valuable adjuncts to resident training, but have not been uniformly applied. Checklists, including end-of-rotation evaluations presently applied, do not provide specific or timely feedback. Through a grant from the Society of University Chairpersons and Program Directors of the American Urological Association (AUA), an operative performance rating system (OPRS) has been developed to provide objective assessment of resident performance in the operating room. METHODS An OPRS was developed for six of the most commonly performed urology procedures at our institution. Procedure-specific performance items were developed using evidence based literature, and through faculty focus group discussion. To measure internal consistency, one of each sentinel procedure was video-recorded and assessed by all faculty using the appropriate OPRS. The OPRS instruments were incorporated into internet-based urology residency management software (New Innovations). After a resident performed a procedure, the responsible faculty received an e-mail invitation to complete the corresponding OPRS. For completed evaluations, internal consistency, individual performance item-to-overall score correlations, and PGY-level performance variation was calculated using one-way analysis of variation and Eta statistics. RESULTS Preliminary results for minimum completed evaluations in cystoscopy with ureteral stent placement (37) and prostate biopsy (23) demonstrate high Cronbach's alpha values (0.93 and 0.92, respectively). Significantly improving performance variation was shown for advancing resident levels (p=0.0006 and p=0.0002, respectively). Individual item-overall score correlations are also high (0.90 and 0.93, respectively). Three procedures have been video-recorded thus far and demonstrate high Cronbach's alpha values (0.90, 0.88, and 0.77, respectively). CONCLUSIONS An OPRS specifically designed for urologic surgery may provide a consistent means for immediate and specific feedback for urology residents. Our findings could lead to the development of a validated checklist instrument for measuring urology resident surgical proficiency that can be broadly applied across programs. © 2011 by American Urological Association Education and Research, Inc.FiguresReferencesRelatedDetails Volume 185Issue 4SApril 2011Page: e601 Advertisement Copyright & Permissions© 2011 by American Urological Association Education and Research, Inc.MetricsAuthor Information Aaron Benson Springfield, IL More articles by this author Thomas Tarter Springfield, IL More articles by this author Expand All Advertisement Advertisement PDF downloadLoading ...