Competency-based Medical Education Research Articles

Transformational learning and professional identity formation in postgraduate competency-based medical education.

Residency programmes are in transition to a framework for competency-based medical education (CBME). The intersection of CBME with transformational learning (TL) experiences and professional identity formation (PIF) - particularly within senior learners in transitional states - is unknown but important to understand in order to develop and implement strategies to support trainees' professional development. Through inductive qualitative methods, we conducted semi-structured interviews (n= 22) of current trainees and recent graduates from adult cardiology residency training programmes within Canada to explore the impact of TL experiences on residents' professional growth and identity formation. Interviews were analysed using thematic analysis informed by TL theory. CBME did not appear to influence trainees' experiences of disorienting dilemmas and TL. Important clinical encounters and interpersonal relationships - in particular, those between mentor and mentee - shaped trainees' professional development as cardiologists ('enabling factors' for TL and PIF). 'Imposter phenomenon' was widely prevalent in our sample study population even among graduates who had already completed their training. Requisite elements for transformation (disorienting dilemmas, critical reflection, discourse and action) also contributed to PIF. TL experiences influenced PIF in senior learners but infrequently intersected with CBME; these experiences were more commonly prompted by disorienting dilemmas relating to clinical outcomes or interpersonal interactions independent of CBME-specific architecture.

Developing Competencies and Milestones: Putting the Pieces Together for Student Success

Abstract Competency-based medical education has become a means in physician assistant (PA) education to ensure learner readiness for practice; align educational expectations; and assess knowledge, skills, and attitudes. Competency-based education may also serve to meet accreditation requirements. Creating program-defined competencies and associated milestones can help a PA program align with their mission and vision, developmentally guide learners through the curriculum, and ensure program assessments measure the tasks required of practice-ready graduates. This review provides an overview of a single program's process for developing program-defined competencies and associated milestones. Beginning with a literature search, the program was able to develop a working list of competencies that was then further refined into competencies with building block milestones that support the development of competency in various domains. Involving faculty in defining a program's competencies is an Accreditation Review Commission on Education for the Physician Assistant requirement that can be done from the ground up or by using previously published competencies that are refined and tailored for the program. The process of creating the competencies provides significant insight into a program's curriculum, goals and expectations for students, and assessment methods.

Precision surgical education

Information and data are accelerating the implementation of competency-based medical education. The adoption of precision education can contribute to this purpose. This article discusses the extent to which precision surgical education can be used in assessing the minimum reliability standards of future surgeons — given the advent of Entrustable Professional Activities — and as an option to strengthen the career trajectory of residents.

Time-based versus competency-based medical education: Opportunities and challenges.

Time-based versus competency-based medical education: Opportunities and challenges.

Redefining professionalism to improve health equity in competency based medical education (CBME): A qualitative study

Purpose There is a pressing need to address all forms of anti-oppression in medicine, given systemic harm and inequities in care and outcomes for patients and health care professionals from equity-deserving groups. Revising definitions of professionalism used in competency-based education can incorporate new professional competencies for physicians to identify and eliminate the root causes of these inequities. This study redefined the CanMEDS Professionalism definition to centre perspectives of equity-deserving groups. Methods In this qualitative study there were two phases. The authors conducted individual semi-structured interviews with participants representing equity-deserving population groups to understand their perspectives on and iteratively build a definition of medical professionalism. Then, the authors undertook a consensus-building process, a modified nominal group technique, using focus groups with community members from equity-deserving groups and healthcare providers to verify findings and arrive at an updated definition of medical professionalism. Results Four main themes were identified: 1) healthcare at the margins; 2) equity-oriented domains of professionalism; 3) structural professionalism; and 4) supporting improved professionalism. These themes were incorporated into a consensus-based definition of medical professionalism, with a focus on anti-oppression, anti-racism, accountability, safety, and equity. Conclusions The authors propose a new definition of medical professionalism that embeds anti-oppression, including anti-racism, as critical competencies in clinical practice and education.

Assessment of communication skills in health professions education; Ottawa 2024 consensus statement

Despite the increasing inclusion of communication skills in accreditation standards and an increase in time dedicated to teaching these skills, communication is often regarded as a separate skill and is therefore, not consistently represented in overall systems of assessment in Health Professions Education (HPE). The ascendence of competency-based medical education, programmatic assessment, artificial intelligence, and widespread use of telehealth, alongside changing patient expectations warrant an update in thinking about the assessment of communication skills in health professions education. This consensus statement draws on existing literature, expert pinion, and emerging challenges to situate the assessment of communication skills in the contemporary health professions education context. The statement builds on previous work to offer an update on the topic and include new developments related to assessment, particularly: the challenges and opportunities associated with systems of assessment; patient and peer perspectives in assessment; assessment of interprofessional communication, cross-cultural communication, digital communication; and assessment using digital technologies. Consensus was reached through extensive discussion among the authors and other experts in HPE, exploration of the literature, and discussion during an Ottawa 2024 conference workshop. The statement puts forward a summary of available evidence with suggestions for what educators and curriculum developers should consider in their planning and design of the assessment of communication.

Enhancing anatomy comprehension through competency-specific formative assessments: A study on the effectiveness of pre and post lecture multiple-choice questions in CBME

Modern medical education was required to include clear, tailored and regular formative assessments, especially for Millennials. Competency-Based Medical Education (CBME) emphasized the objective assessment of anatomical competencies. Question-answer and viva-voce tests were considered subjective and resource-intensive. This research was conducted to examine how competency-specific formative assessments using multiple-choice questions and photos before and after competency-based medical lectures improved anatomy comprehension.: The research involved 150 first-year MBBS students who were enrolled in online anatomy courses. Competency-specific, picture-based, clinical scenario-based and multiple-choice pre-questionnaires were distributed. The questions were reviewed and attempted by students before attending the theory classes. Lecture classes were conducted according to the curriculum and competencies of the National Medical Council. After the lecture, the questions and answers were reviewed and a feedback questionnaire was administered. The feedback survey included Likert scale responses and open-ended questions to gauge students' opinions on the teaching and learning methodology.: It was observed that the method was effective, stimulating curiosity, motivation and engagement. Participants expressed that the approach facilitated memorization, imparted clinical knowledge and reinforced theory. Clinical scenario-based multiple-choice questions were found to enhance memory, spark interest and improve understanding of anatomy's clinical relevance. Students believed that this method would benefit them in university exams. Overall, 89.7% of participants found the methods highly satisfactory, 50% satisfactory and 10.3% unsatisfactory.: Competency-specific formative assessments using multiple-choice questions and photos before and after lectures were found to improve anatomy knowledge. The strategy was found to promote engagement, memory and clinical understanding, reinforcing anatomical concepts. The results of this study suggested that competency-specific formative assessments added value to the current CBME-based medical education by increasing learning and practical application.

Innovations in ultrasound training in obstetrics.

Ultrasound technology is critical in obstetrics, enabling detailed examination of the fetus and maternal anatomy. However, increasing complexity demands specialised training to maximise its potential. This study explores innovative approaches to ultrasound training in obstetrics, focussing on enhancing diagnostic skills and patient safety. This review examines recent innovations in ultrasound training, including competency-based medical education (CBME), simulation technologies, technology-based resources, artificial intelligence (AI), and online-learning platforms. Traditional training methods such as theoretical learning, practical experience, and peer learning are also discussed to provide a comprehensive view of current practises. Innovations in ultrasound training include the use of high-fidelity simulators, virtual reality (VR), augmented reality (AR), and hybrid-learning platforms. Simulation technologies offer reproducibility, risk-free learning, diverse scenarios, and immediate feedback. AI and machine learning facilitate personalised-learning paths, real-time feedback, and automated-image analysis. Online-learning platforms and e-learning methods provide flexible, accessible, and cost-effective education. Gamification enhances learning motivation and engagement through educational games and virtual competitions. The integration of innovative technologies in ultrasound training significantly improves diagnostic skills, learner confidence, and patient safety. However, challenges such as high costs, the need for comprehensive instructor training, and integration into existing programs must be addressed. Standardisation and certification ensure high-quality and consistent training. Future developments in AI, VR, and 3D printing promise further advancements in ultrasound education. Innovations in ultrasound training in obstetrics offer significant improvements in medical education and patient care. The successful implementation and continuous development of these technologies are crucial to meet the growing demands of modern obstetrics.

(Mis)Alignment in resident and advisor co-regulated learning in competency-based training.

In implementing competence-based medical education (CBME), some Canadian residency programmes recruit clinicians to function as Academic Advisors (AAs). AAs are expected to help monitor residents' progress, coach them longitudinally, and serve as sources of co-regulated learning (Co-RL) to support their developing self-regulated learning (SRL) abilities. Implementing the AA role is optional, meaning each residency programme must decide whether and how to implement it, which could generate uncertainty and heterogeneity in how effectively AAs will "monitor and advise" residents. We sought to clarify how AA-resident dyads collaboratively interpret assessment data from multiple sources, co-create learning goals and action plans and attempt to enhance residents' SRL skills. Shortly after each of their six meetings during two years of Internal Medicine residency, we conducted individual, brief interviews with AAs (N = 10) and residents (N = 10). We analysed transcripts using an abductive framework with theory-based and evidence-based sensitizing concepts. We collected 49 residents and 36 AA 'meeting debriefs', which produced rich data on how dyads variably engaged in SRL and Co-RL. Residents and AAs adopted "learning stances" that oriented their perceptions and approaches to Co-RL. Their stances did not always align within dyads. We found unique patterns in how stances evolved or devolved over time, and in how these changes impacted dyads' Co-RL processes. While some dyads evolved to engage in proactive co-regulation, most stayed consistent or oscillated reactively in their relationships, with little apparent Co-RL focused on helping residents to develop clinical competencies through SRL. We catalogued multiple influential sources of regulation of learning. The conceptually ideal form of Co-RL was not consistently achieved in this well-intended implementation of AA-resident dyads. To better translate 'coaching over time' from intention to practice, we recommend that residency programmes use Co-RL principles to refine CBME processes, including refining assessment tools, resident orientation sessions and faculty development practices.

The Next Era of Assessment Within Medical Education: Exploring Intersections of Context and Implementation.

In competency-based medical education (CBME), which is being embraced globally, the patient-learner-educator encounter occurs in a highly complex context which contributes to a wide range of assessment outcomes. Current and historical barriers to considering context in assessment include the existing post-positivist epistemological stance that values objectivity and validity evidence over the variability introduced by context. This is most evident in standardized testing. While always critical to medical education the impact of context on assessment is becoming more pronounced as many aspects of training diversify. This diversity includes an expanding interest beyond individual trainee competence to include the interdependency and collective nature of clinical competence and the growing awareness that medical education needs to be co-produced among a wider group of stakeholders. In this Eye Opener, we wish to consider: 1) How might we best account for the influence of context in the clinical competence assessment of individuals in medical education? and by doing so, 2) How could we usher in the next era of assessment that improves our ability to meet the dynamic needs of society and all its stakeholders? The purpose of this Eye Opener is thus two-fold. First, we conceptualize - from a variety of viewpoints, how we might address context in assessment of competence at the level of the individual learner. Second, we present recommendations that address how to approach implementation of a more contextualized competence assessment.

Sharing Is Caring: Helping Institutions and Health Organizations Leverage Data for Educational Improvement.

Competency-based medical education (CBME) has produced large collections of data, which can provide valuable information about trainees and medical education systems. Many organizations continue to struggle with accessing, collecting, governing, analyzing, and visualizing their clinical and/or educational data. This hinders data sharing efforts within and across organizations, which are foundational in supporting system-wide improvements. Challenges to data sharing within medical education include variability in legislation, existing data policies, heterogeneity of data, inadequate data infrastructure, and various intended purposes or uses. In this eye opener, the authors describe four case studies to illustrate some of the aforementioned challenges and characterize the complexity of data sharing within medical education along two dimensions: organizational (single vs. multiple) and data type (clinical and/or educational). With the goal of better supporting data sharing initiatives, the authors introduce an action-oriented blueprint that includes a three-stage process (i.e., preparation, execution, and iteration) to highlight crucial aspects of data sharing. This evidence-informed model incorporates current best practices and aims to support data sharing initiatives within their own organizations and across multiple organizations. Finally, organizations can use this model to conceptually guide and track their progression throughout the data sharing process.

Entrustable Professional Activities in Medical Education: SELECT Leadership, Values-Based Patient-Centered Care, Health Systems, and Scholarly Excellence

Entrustable Professional Activities (EPAs) represent a concept in medical education that has gained significant traction over the last few years, particularly in the context of competency-based medical education. An EPA refers to a specific task or responsibility that can be entrusted to a trainee once they have demonstrated the necessary competence. EPAs provide concrete tasks that a trainee should be able to complete at various stages of training in order to clarify expectations and responsibilities they should master. The University of South Florida Morsani College of Medicine (USFMCOM), Scholarly Excellence, Leadership Experiences, Collaborative Training (SELECT) MD program pairs a unique four-year longitudinal leadership program including the domains of leadership, values-based patient-centered care, health systems, and scholarly excellence with an innovative medical degree program. Students in the SELECT program spend the first two years on the campus in Tampa, Florida, and the clinical years on the regional campus in Allentown, Pennsylvania. These additional threads of curriculum call for a unique set of EPAs. A working group of faculty, students, and administrators within the college from both the main and regional campus developed EPAs for each of the above listed areas of focus within the curriculum. In this paper, the authors describe how Entrustable Professional Activities were developed at MCOM to assess the SELECT curriculum in the areas of leadership, values-based patient-centered care, health systems, and scholarly excellence.

Effectiveness of video making to enhance infection control skills by undergraduate MBBS students

Background: Competency-based medical education (CBME) Microbiology second MBBS curriculum, infection control practices are core competencies for certification of the second MBBS student. E-learning through video making can help students to achieve these infection control skills upto certifiable level. Educational videos which are of short duration, created in a step wise manner have shown to improve skill acquisition and augment observational learning. The aim and objectives were to study the effectiveness of video making as a teaching learning tool, to enhance infection control skills in undergraduate second MBBS students through video making and to evaluate the students’ infection control skills by giving them a prior checklist. Methods: Second MBBS students after taking informed consent were enrolled for the study. Ten infection control and prevention topics were included in the study for video making. All the 100 second MBBS students in 5 groups of 20 students had made all the 10 videos of duration 2 minutes. A self-administered, validated pre-test and post-test, multiple choice question (MCQ) test and objective structured practical examination (OSPE) checklist were used. Results: Mean post-test marks improved by a mean of 5.91 with significant p value (<0.001, using statistical package for the social sciences (SPSS) software version 29). Mean MCQ and OSPE scores also improved. In almost all the questions on feedback of student’s perception and assessment feedback, percentage of students who agreed and strongly agreed were far more than those who disagreed. Conclusions: Second phase MBBS students learning and performance of infection control skills greatly improved when they created their own videos.

Postgraduate Training: eLogbook, Entrustable Professional Activities & Co.

The transformation of time-bound and procedure-oriented specialist medical postgraduate training towards a competency-based approach (competency-based medical education, CBME) has been demanded for several years. Many frameworks, like the CANMEDs (Canadian Medical Education Directives for Specialists) describe competencies that should be acquired by each physician. In Germany, the medical council has recently obligated a competency-based postgraduate training. Although the idea of CBME emphasizes the learning process at the working place, CBME has also been criticized to be too theoretical and detached from the clinical working practice. To close this gap, the concept of Entrustable Professional Activities (EPA) has been introduced. An EPA describes concrete clinical tasks that are successively entrusted to the trainee. The decision to entrust a task is supported by the sum of workplace-based assessments.Sustainable implementation of competency-based training requires close collaboration among all involved individuals and institutions. Furthermore, continuous feedback and open dialogue are crucial for identifying challenges and areas for improvement. The success of CBME hinges on the collective effort of all stakeholders to create a framework to enhance specialty training and an overall advancement in the field. This cooperative approach is essential to successfully translate the theoretical foundations of competency-based teaching into clinical practice and ensure high-quality specialty training.

Effect of students’ seminar as a revision strategy in biochemistry among I MBBS students in a medical college in Tamil Nadu

Background: Small group teaching is one of the components of competency-based medical education which was implemented in 2019 by NMC. Seminar is one of the methods of small group teaching which increases the engagement of students, self-directed learning, communication skills, and peer discussion. Aims and Objectives: The present idea is to study the effect of students’ seminar as a revision strategy in Biochemistry among I MBBS students. Materials and Methods: After obtaining the IEC approval, I MBBS students who are 250 in number will be divided into small groups. Each group will be given a particular seminar topic. All the students in the particular group will be instructed to present the topic on random basis. A total of 15 seminars will be conducted on particular topics. Pre-tests and post-tests (immediately after the seminar) will be conducted after the seminars along with pre-test and post-test questionnaires will be obtained and collated to understand how far the student’s acceptance of students’ seminar and its effectiveness. Results: Our study results showed that that there is an increase in the percentage of marks in the post-evaluation and also more than 70% of the students responded positively to most of the queries in the feedback questionnaire. Conclusion: Our study results showed that there is an increase in the percentage of marks in the post-evaluation and also more than 70% of the students responded positively to most of the queries in the feedback questionnaire.

Professional Behavior Assessment During Residency Training: Can We Identify Outliers?

The American Board of Orthopaedic Surgery (ABOS) Knowledge, Skills, and Behavior (KSB) project sets up a framework for competency-based medical education for orthopaedic surgery residency training. The Behavior aspect of KSB includes use of the American Board of Orthopaedic Surgery Behavior Tool (ABOSBT) to assess 5 domains of professional behavior. The purpose of this study was to analyze the results of 2 years of ABOSBT assessments and to characterize the low score ratings. All ABOSBT assessments from January 1, 2022, to December 31, 2023, were reviewed totaling 51,678 completed assessments with 48,648 (94%) assessments from a 360° process and 3,030 (6%) as end-of-rotation assessments. Distribution of 51,678 ABOSBT assessments with 258,390 scores demonstrated low scores (disagree or strongly disagree) in 0.9% of assessments. All 5 domains identified low scores in a small percentage at all years-in-training with the greatest number in second- and third-year residents. Comparison of scores from 360° vs. end-of-rotation requests demonstrated a higher percentage of low scores given during the 360° process (p < 0.0001). Three thousand seven hundred seven unique evaluators completed ABOSBT assessments, with attending physicians as the most frequent evaluator type (44%); inpatient nurses assessed residents with low ABOSBT scores more frequently (4.5%) than any other evaluator type. Residents with 2 or more low scores by 2 or more different evaluators were analyzed for each of the 5 domains; low scores were most frequently observed in the reliability domain. The ABOSBT was originally validated 5 years ago in 18 programs with 9,892 assessments; this article updates results using the ABOSBT across 95 programs assessing 2,397 residents with 3,707 evaluators. The ABOSBT demonstrates that most residents demonstrate professional behavior across 5 domains of assessment; the ABOSBT identifies residents with low scores. A strength of KSB is the ability to identify professionalism deficiencies while residents are in training and can focus on individualized educational improvement. Tracking residents with low scores on the ABOSBT assessment over time will help determine its effectiveness in identifying unprofessional behavior.

Gender Differences in Clinical Performance Assessment of Internal Medicine Residents: A Longitudinal Analysis of the Influence of Faculty and Trainee Gender.

Competency-based medical education relies on equitable assessment. This study examined the influence of faculty and trainee gender on assessments of internal medicine (IM) resident performance over time. A longitudinal analysis of clinical performance assessments from 7 U.S. IM residency programs (July 2014-June 2019) was conducted. Core competency scores (patient care [PC], medical knowledge [MK], practice-based learning and improvement [PBLI], systems-based practice [SBP], professionalism [PROF], and interpersonal and communication skills [ICS]) were standardized across programs. Cross-classified mixed-effects linear regression evaluated the relationship between gender and standardized competency scores within training programs, while adjusting for multiple variables including IM In Training Examination percentile rank. Data included 9,346 evaluations by 1,011 faculty (552 [55%] men, 459 [45%] women) for 664 residents (358 [54%] men, 306 [46%] women). Initially, women residents' scores were significantly lower than men's in PC (estimated difference [standard error ] -0.097 [0.033], P = .004), MK (-0.145 [0.034], P < .001), and PBLI -0.090 [0.040], P = .022). PC, MK, PBLI, and SBP scores increased more over time for women residents than men (PC: 0.050 [0.015], P = .001; MK: 0.052 [0.015], P = .001; PBLI: 0.036 [0.018], P = .048; SBP: 0.036 [0.016], P = .027). PROF and ICS scores were comparable across gender. There was a significant interaction between faculty gender and postgraduate year (PGY) across all competencies but none between resident gender, faculty gender, and PGY, indicating that men and women faculty rated residents differently over time but were consistent in how they rated men and women residents. Gender-based assessment differences were variable across competencies and time. Women residents had lower scores initially but greater gains in "hard skill" (MK, PC, and PBLI) than in "soft skill" (ICS and PROF) competencies, suggesting assessment inequities. Efforts to ensure equitable assessment are needed.

Advances in Psychiatry Training and Faculty Development in India

Background: This review examines the historical developments, current state of training, existing challenges, and opportunities for undergraduate, postgraduate, and super specialty psychiatry education in India. Methods: For this narrative review, we examined information from the published literature, along with key documents from the Indian Psychiatric Society, the National Medical Commission, and other relevant sources. Conclusions: In India, psychiatry training has seen significant advancements since independence, particularly in the past decade, driven by the recommendations of the Indian Psychiatric Society and the introduction of competency-based medical education by the National Medical Commission. This transformation has redefined undergraduate and postgraduate training across all medical disciplines, including psychiatry. The shift has moved away from traditional, time-bound frameworks toward a focus on acquiring specific competencies essential for effective clinical practice. This approach ensures that trainees gain theoretical knowledge and develop practical skills and professional attitudes crucial for patient care. However, a major challenge highlighted in this review is the transition of senior residents to faculty roles without adequate training in teaching, research, academia, and leadership. Despite this, they are expected to excel in these areas upon assuming faculty positions. To address this gap, we emphasize the urgent need for a comprehensive faculty development program for early career faculty. Our proposed initiative aims to bridge these gaps and support the development of future leaders and educators in psychiatry. The recommendations outlined in this review seek to create a robust educational environment that will cultivate the next generation of psychiatrists in India.

Improving access in medical physics residency programs for physicists with disabilities.

Within the landscape of medical physics education, residency programs are instrumental in imparting hands-on training and experiential knowledge to early-career physicists. Ensuring access to educational opportunities for physicists with disabilities is a legal, ethical, and pragmatic requirement for programs, considering that a significant proportion of the United States population has a disability. Grounded in conceptual frameworks of competency-based medical education and the social model of disability, this work provides an introduction to some practical recommendations for medical physics residency programs. Strategies include embracing universal design principles, fostering partnerships with disability service offices, using inclusive language, developing and publicizing clear procedures for disclosing disabilities and requesting accommodations, and maintaining an overall commitment to equitable access to education. This work urges medical physics residency leadership to proactively move towards training environments that support the needs of residents across the spectrum of disability, highlighting why disability inclusion fundamentally enriches diversity.

Starting with the end in mind: Transformative curriculum development in Competency-based medical education (CBME)

Starting with the end in mind: Transformative curriculum development in Competency-based medical education (CBME)