Reliability and validity of the multiple mini interview (MMI) for admissions to an occupational therapy professional program

Abstract

Introduction Admissions decisions are among the most consequential assessment points in educating occupational therapists. Suboptimal measures of academic achievement and personal characteristics are often used to select candidates. The purpose of the study is to investigate reliability and validity evidence supporting the use of the multiple mini interview for selecting candidates to an occupational therapy master’s level program. Method The study used a prospective cohort design. Data sources included both archival data and prospective candidate-generated data (multiple mini interview scores, applicant file review scores and academic performance), analyzed using psychometric and correlational approaches. Results Seventy-seven of 80 candidates participated in the prospective component of the study. Overall reliability of a 10-station multiple mini interview was .72. Inter-rater reliability was reasonable. Weak interrelationships were found between multiple mini interview scores and other application components. Conclusion Multiple mini interview scores may be probing different attributes than the other components of the application package. Our study findings support the use of the multiple mini interview for selecting applicants to a professional master’s program in occupational therapy; however, future work should continue to investigate the predictive validity of the multiple mini interview.