Evaluating the Role of Competency-Based Behavioral Interviewing in Holistic Medical School Admissions.

Abstract

Holistic review is a multifaceted concept that aims to increase diversity and applicant fit with program needs by complementing traditional academic requirements with appraisal of a wider range of personal characteristics and experiences. Behavioral interviewing has been practiced and studied in human resources, business, and organizational psychology for over 50 years. Its premise is that future performance can be anticipated from past actions. However, many of the interview approaches within the holistic framework are resource intensive and logistically challenging. The Vanderbilt University School of Medicine instituted a competency-based behavioral interview (CBBI) to augment the selection process in 2012. Behavioral interviews are based on key competencies needed for entering students and require applicants to reflect on their actual experiences and what they learned from them. The authors reviewed 5 years of experience (2015-2019) to evaluate how CBBI scores contributed to the overall assessment of applicants for admission. The final admission committee decision for each applicant was determined by reviewing multiple factors, with no single assessment determining the final score. The CBBI and summary interview scores showed a strong association (P < .005), suggesting that the summary interviewer, who had access to the full applicant file, and the CBBI interviewer, who did not, assessed similar strengths despite the 2 different approaches, or that the strengths assessed tracked in the same direction. Students whose 2 interview scores were not aligned were less likely to be accepted to the school. The review raised awareness about the cultural aspects of interpreting the competencies and the need to expand our cultural framework throughout interviewer training. Findings indicate that CBBIs have the potential to reduce bias related to over-reliance on standardized metrics; however, additional innovation and research are needed.