Abstract
This article was migrated. The article was not marked as recommended. Purpose: Non-Medical Expert or Intrinsic CanMEDS Roles, as outlined by the Royal College of Physicians and Surgeons of Canada, can be difficult to evaluate in an objective and specialty-specific manner. This study investigates an Objective Structured Clinical Examination (OSCE) evaluation tool to assess these competencies for Diagnostic Radiology Residents. Methods: A five station CanMEDS OSCE was developed for postgraduate year 3 and 4 Residents to evaluate the Communicator, Collaborator, Manager, Health Advocate, Scholar and Professional Roles. Performance was assessed by postgraduate year 5 Residents using standardized scoring rubrics. CanMEDS OSCE scores were correlated with American College of Radiology (ACR) scores and Medical Expert OSCEs. Results: Seventy Residents in three separate cohorts (n=21, 26, 23) participated in the CanMEDS OSCE. Mean station scores were consistent across cohorts. In general, one-way ANOVAs showed no effect of postgraduate year on station scores. There were no significant correlations between CanMEDS OSCE scores and ACR exam scores or CanMEDS OSCE scores and Medical Expert OSCE scores, demonstrating divergent construct validity. In turn, this indicates construct validity for the CanMEDS OSCE by demonstrating that unique competencies are being measured. In contrast, there was a correlation between ACR exam scores and Medical Expert OSCE scores, confirming that these both assess the same construct. Conclusions: An OSCE can be a useful assessment tool to assess Intrinsic CanMEDS Roles in a specialty-specific manner. Correlational analyses indicate that unique competencies are being evaluated that are not captured by other traditional assessment means.
Highlights
Residency programs are required to evaluate their Residents in the Intrinsic CanMEDS competencies as outlined in the CanMEDS 2005 Physician Competency Framework by the Royal College of Physicians and Surgeons of Canada (RCPSC) (Frank, 2005)
In order to address the challenge of assessing the Intrinsic CanMEDS Roles, a five station Objective Structured Clinical Examination (OSCE) was developed for Diagnostic Radiology Residents with the following objectives: to provide an assessment method that would engage learners as both examinee and examiner, to provide a formal assessment tool to assess Resident performance in a specialty-specific manner and to provide formative feedback for Residents
There was no correlation between the CanMEDS OSCE scores and the American College of Radiology (ACR) scores (Spearman correlation, -0.279 ≤ ρ ≤ 0.373)
Summary
Residency programs are required to evaluate their Residents in the Intrinsic CanMEDS competencies as outlined in the CanMEDS 2005 Physician Competency Framework by the Royal College of Physicians and Surgeons of Canada (RCPSC) (Frank, 2005). The Intrinsic CanMEDS Roles include Communicator, Collaborator, Manager, Health Advocate, Scholar and Professional. Residency program objectives for each CanMEDS Role have been outlined in a specialty-specific manner, including for Diagnostic Radiology ("Objectives in Training", 2000). In the United States, the Accreditation Council of Graduate Medical Education (ACGME) has outlined core specialty-specific clinical competencies that need to be integrated into the Diagnostic Radiology residency curriculum along with medical knowledge ("ACGME Program Requirement", 2016). These competencies are interpersonal and communication skills, patient care, systems-based practice, practice-based learning and improvement, and professionalism ("ACGME Program Requirement", 2016)
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
