You have accessJournal of UrologySurgical Technology & Simulation: Training & Skills Assessment I (MP34)1 Apr 2020MP34-14 ASSESSMENT OF SURGICAL SKILLS OF UROLOGY RESIDENT APPLICANTS: FOUR-YEAR EXPERIENCE Rajiv Karani*, Francis Jefferson, Simone Vernez, Lillian Xie, Roshan M. Patel, Kathryn Osann, Shlomi Tapiero, Heidi Stephany, Jaime Landman, and Ralph V. Clayman Rajiv Karani*Rajiv Karani* More articles by this author , Francis JeffersonFrancis Jefferson More articles by this author , Simone VernezSimone Vernez More articles by this author , Lillian XieLillian Xie More articles by this author , Roshan M. PatelRoshan M. Patel More articles by this author , Kathryn OsannKathryn Osann More articles by this author , Shlomi TapieroShlomi Tapiero More articles by this author , Heidi StephanyHeidi Stephany More articles by this author , Jaime LandmanJaime Landman More articles by this author , and Ralph V. ClaymanRalph V. Clayman More articles by this author View All Author Informationhttps://doi.org/10.1097/JU.0000000000000878.014AboutPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissionsReprints ShareFacebookLinked InTwitterEmail Abstract INTRODUCTION AND OBJECTIVE: Urology residents are selected based on United States Medical Licensing Examination (USMLE) scores, interview performance, letters of recommendation, and academic achievement. Surgical skills testing is rarely performed when evaluating applicants. Our objective is to determine if surgical skills testing correlates with highly valued resident applicant metrics. METHODS: Over 4 years, 94 interviewees at UC Irvine Department of Urology, during their residency interview day performed 3 surgical tasks: open square knot tying, laparoscopic peg transfer, and robotic suture placement with square knot tie. Faculty and crowd-workers (Crowd-Sourced Assessment of Technical Skills [C-SATS], Seattle, Washington) assessed each applicant’s video-recorded performance using the Objective Structured Assessment of Technical Skills (OSATS), Global Evaluative Assessment of Robotic Skills (GEARS), and the Global Operative Assessment of Laparoscopic Skills (GOALS) scoring systems. Agreement between expert and crowd scores was assessed. Interviewees’ USMLE scores, interview scores, Jefferson Scale of Physician Empathy (JSPE) scores were assessed for correlation with skills testing scores. Additionally, a survey was distributed via email to all interviewees assessing the outcomes of the urology match to determine correlation to skills testing. RESULTS: Crowd and expert agreement of surgical skills assessment score was 0.323 for OSATS, 0.876 for GOALS, and 0.666 for GEARS. OSATS, GEARS, and GOALS correlated with one another but not with match rank, USMLE score, or JSPE. Match rank list correlated most closely with interview score (r =-0.715; p<0.001). Out of the three skills testing scores, GEARS most closely correlated with match rank (r=-0.154; p=0.182). In a general linear model, only interview score and GOALS significantly contributed to prediction of faculty match rank. Interviewees who were top 5 on the faculty match rank list had a significantly higher interview score than those who were not (89.32 vs 77.59; p<0.001) and those who reported matching into a top 3 choice of residency had significantly higher GOALS and average skills testing scores than those who did not (9.74 vs 11.88, p=.026; 9.69 vs 11.28, p=.029). CONCLUSIONS: Crowd-sourced skills assessment of urology resident applicants may be used in place of expert assessment, especially for laparoscopic peg transfer. Final match rank was most closely associated with interview performance and laparoscopic peg transfer skill. Source of Funding: N/A © 2020 by American Urological Association Education and Research, Inc.FiguresReferencesRelatedDetails Volume 203Issue Supplement 4April 2020Page: e508-e508 Advertisement Copyright & Permissions© 2020 by American Urological Association Education and Research, Inc.MetricsAuthor Information Rajiv Karani* More articles by this author Francis Jefferson More articles by this author Simone Vernez More articles by this author Lillian Xie More articles by this author Roshan M. Patel More articles by this author Kathryn Osann More articles by this author Shlomi Tapiero More articles by this author Heidi Stephany More articles by this author Jaime Landman More articles by this author Ralph V. Clayman More articles by this author Expand All Advertisement PDF downloadLoading ...