Composite Reliability of Workplace Based Assessment of International Medical Graduates.

Balakrishnan Nair,Joyce M W Moonen-Van Loon,Mulavana Parvathy,Cees P M Van Der Vleuten

doi:10.15694/mep.2021.000104.1

Abstract

This article was migrated. The article was marked as recommended. Introduction All developed countries depend on International Medical Graduates (IMGs) to complement their workforce. However, the assessment of their fitness to practice and acculturation into the new system can be challenging. To improve this, we introduced Workplace Based Assessment (WBA), using a programmatic philosophy. This paper reports the reliability of this new approach. Method Over the past 10 years, we have assessed over 250 IMGs, each cohort assessed over a 6-month period. We used Mini-Cex, Case Based Discussions (CBD) and Multi-Source Feedback (MSF) to assess them. We analysed the reliability of each tool and the composite reliability of 12 Mini-Cex, 5 CBDs and 12 MSF assessments in the tool kit. Results A reliability coefficient of 0.78 with a SEM of 0.19 was obtained for the sample of 236 IMGs. We found the MSF to be the most reliable tool. By adding one more MSF to the assessment on two occasions, we can reach a reliability of 0.8 and SEM of 0.18. Conclusions The current assessment methodology has acceptable reliability. By increasing the MSF, we can improve the reliability. The lessons from this study are generalisable to IMG assessment and other medical education programs.

Highlights

Introduction All developed countries depend onInternational Medical Graduates (IMGs) to complement their workforce
18% of scientific publications are from International medical graduates (IMGs) and 18.3 % of professors are IMGs in the USA (Khullar et al, 2017)
To remediate some of these issues, we developed a Workplace Based Assessment (WBA) program for IMGs working in our hospitals

Summary

Introduction

International Medical Graduates (IMGs) to complement their workforce. International medical graduates (IMGs) make up to 30 % of the workforce in countries like Australia, United States, U.K. and Canada (Patel et al, 2018). All these countries have multicultural populations and their contribution to health care provision is culturally appropriate (Pinsky, 2017). 18% of scientific publications are from IMGs and 18.3 % of professors are IMGs in the USA (Khullar et al, 2017) They give excellent care to their patients in spite of concerns from some quarters. Other causes could be economic pressures with resettlement in the new country, lack of orientation to the new health system and lack of mentorship, and performance assessments (Hyder, 2017)

Methods

Results

Discussion

Conclusion