Diagnostic & interventional radiology residency program directors' perspectives on the USMLE step 1 exam shift to pass/fail scoring

Abstract

Rationale and objectivesAs of January 2022, Step 1 of the United States Medical Licensing Examination (USMLE) has changed to pass/fail grading. The purpose of this study was to share survey results and communicate changes Diagnostic (DR) and integrated Interventional (IR) Radiology residency program directors (PDs) will make and aspire to make, given this change. Materials and methodsAn online survey was sent to DR and IR PDs. Data was collected over four months. Custom R programming and MATLAB language scripts were used to evaluate the survey responses. Chi squared tests were used to determine statistical significance for multiple choice questions regarding PD views of Step 1 transitioning to pass-fail. Paired t-tests were used to differentiate pre- and post-values for questions in which PDs ranked criteria for resident selection. ResultsAfter USMLE Step 1 becomes pass/fail, most respondents will use Step 2 CK scores as a more important factor than previously, believe medical schools should share National Board of Medical Examiners (NBME) shelf exam scores, do not believe students will be better prepared clinically, and believe a student's medical school rank will be considered more. ConclusionThe added emphasis on Step 2 CK scores, NBME shelf exam scores, class rank, and a student's medical institution may negate the positive impacts of changing Step 1 to pass/fail. Alternatively, it may present an opportunity for programs to evaluate students more broadly.