Development Of Entrustable Professional Activities Research Articles

Development of entrustable professional activities for family medicine in South Africa.

South Africa is undergoing a significant shift towards implementing enhanced workplace-based assessment methodologies across various specialist training programmes, including family medicine. This paradigm involves the evaluation of Entrustable Professional Activities (EPAs) through comprehensive portfolios of evidence, which a local and national clinical competency committee then assesses. The initial phase of this transformative journey entails the meticulous development of EPAs rooted in discrete units of work. Each EPA delineates the registrar's level of entrustment for autonomous practice, along with the specific supervision requirements. This concise report details the collaborative effort within the discipline of family medicine in South Africa, culminating in the consensus formation of 22 meticulously crafted EPAs for postgraduate family medicine training. The article intricately outlines the systematic structuring and rationale behind the EPAs, elucidating the iterative process employed in their development. Notably, this marks a groundbreaking milestone as the first comprehensive documentation of EPAs nationally for family medicine training in Africa.

Development of entrustable professional activities for emergency medicine medical education fellowships: A modified Delphi study.

It is essential that medical education (MedEd) fellows achieve desired outcomes prior to graduation. Despite the increase in postgraduate MedEd fellowships in emergency medicine (EM), there is no consistently applied competency framework. We sought to develop entrustable professional activities (EPAs) for EM MedEd fellows. From 2021 to 2022, we used a modified Delphi method to achieve consensus for EPAs. EM education experts generated an initial list of 173 EPAs after literature review. In each Delphi round, panelists were asked to make a binary choice of whether to include the EPA. We determined an inclusion threshold of 70% agreement a priori. After the first round, given the large number of EPAs meeting inclusion threshold, panelists were instructed to vote whether each EPA should be included in the "20 most important" EPAs for a MedEd fellowship. Modifications were made between rounds based on expert feedback. We calculated descriptive statistics. Seventeen experts completed four Delphi rounds each with 100% response. After Round 1, 87 EPAs were eliminated and two were combined. Following Round 2, 46 EPAs were eliminated, seven were combined, and three were included in the final list. After the third round, one EPA was eliminated and 13 were included. After the fourth round, 11 EPAs were eliminated. The final list consisted of 16 EPAs in domains of career development, education theory and methods, research and scholarship, and educational program administration. We developed a list of 16 EPAs for EM MedEd fellowships, the first step in implementing competency-based MedEd.

Entrustable professional activities (EPAs) for undergraduate medical education – development and exploration of social validity

BackgroundThe development of entrustable professional activities (EPAs) as a framework for work-based training and assessment in undergraduate medical education has become popular. EPAs are defined as units of a professional activity requiring adequate knowledge, skills, and attitudes, with a recognized output of professional labor, independently executable within a time frame, observable and measurable in its process and outcome, and reflecting one or more competencies. Before a new framework is implemented in a specific context, it is valuable to explore social validity, that is, the acceptability by relevant stakeholders.AimThe aim of our work was to define Core EPAs for undergraduate medical education and further explore the social validity of the constructs.Method and materialIn a nationwide collaboration, EPAs were developed using a modified Delphi procedure and validated according to EQual by a group consisting of teachers nominated from each of the seven Swedish medical schools, two student representatives, and an educational developer (n = 16). In the next step, social validity was explored in a nationwide survey. The survey introduced the suggested EPAs. For each EPA, the importance of the EPA was rated, as was the rater’s perception of the present graduates’ required level of supervision when performing the activity. Free-text comments were also included and analyzed.ResultsTen Core EPAs were defined and validated. The validation scores for EQual ranged from 4.1 to 4.9. The nationwide survey had 473 responders. All activities were rated as “important” by most responders, ranging from 54 to 96%. When asked how independent current graduates were in performing the ten activities, 6 to 35% reported “independent”. The three themes of the free text comments were: ‘relevant target areas and content’; ‘definition of the activities’; and ‘clinical practice and learning’.ConclusionTen Core EPAs were defined and assessed as relevant for Swedish undergraduate medical education. There was a consistent gap between the perceived importance and the certainty that the students could perform these professional activities independently at the time of graduation. These results indicate that the ten EPAs may have a role in undergraduate education by creating clarity for all stakeholders.

Exploring Interprofessional Development of Entrustable Professional Activities For Pediatric Intensive Care Fellows: A Proof-of-Concept Study

Phenomenon : Entrustable professional activities (EPAs) delineate major professional activities that an individual in a given specialty must be “entrusted” to perform, ultimately without supervision, to provide quality patient care. Until now, most EPA frameworks have been developed by professionals within the same specialty. As safe, effective, and sustainable health care ultimately depends on interprofessional collaboration, we hypothesized that members of interprofessional teams might have clear and possibly additional insight into which activities are essential to the professional work of a medical specialist. Approach : We recently employed a national modified Delphi study to develop and validate a set of EPAs for Dutch pediatric intensive care fellows. In this proof-of-concept study, we explored what pediatric intensive care physicians’ non-physician team members (physician assistants, nurse practitioners, and nurses) constitute as essential professional activities for PICU physicians and how they regarded the newly developed set of nine EPAs. We compared their judgments with the PICU physicians’ opinions. Findings : This study shows that non-physician team members share a mental model with physicians about which EPAs are indispensable for pediatric intensive care physicians. Despite this agreement however, descriptions of EPAs are not always clear for non-physician team members who have to work with them on a daily basis. Insights : Ambiguity as to what an EPA entails when qualifying a trainee can have implications for patient safety and trainees themselves. Input from non-physician team members may add to the clarity of EPA descriptions. This finding supports the involvement of non-physician team members in the developmental process of EPAs for (sub)specialty training programs.

La formation médicale continue en Suisse - un récit

Postgraduate Medical Education in Switzerland - A Narrative Abstract: Medical education has to respond to new challenges such as digitalisation, increase of chronic and complex diseases, economisation. The concept of Competency-Based Medical Education (CBME) has been implemented in undergraduate education in Switzerland. Postgraduate medical education has undergone a fundamental reformation, among other things with the development of Entrustable Professional Activities (EPAs), the adaptation of training programmes or "Teach the Teachers" classes. For the associated cultural change to be successful, the commitment of the professional societies, the training institutions, the hospitals is needed, but also the support of the health and education policy is of utmost importance.

Family-Educator Partnership in the Development of Entrustable Professional Activities in Complex Care.

Incorporating patient and family voices in the development of entrustable professional activities (EPAs) is not standard practice. Care of children with medical complexity (CMC) is an area of pediatrics that relies on family partnership, and families of CMC are ideal partners in EPA development given their expertise in their child's care and experience interacting with the health care system. The authors describe their model for partnering with families to develop EPAs and reflect on the unique contributions of family leaders to the process. After recruitment of family leaders from a national organization of families and friends of children with special health care needs, the authors used a multistage process for EPA development from June 2019 to February 2021. Family leaders were integrated throughout the process, including creating EPA descriptions, revising content across all EPAs, appraising EPAs through virtual focus groups with other key stakeholders, and finalizing and publishing EPAs. The authors used content analysis to identify recommendations for patient- and family-integrated EPA development. Family leaders and educators partnered in every phase of developing EPAs for the care of CMC, including as content experts, editors, focus group facilitators, and coauthors. Family leaders recommended substantive changes to all EPAs, including revising language, augmenting content, and modifying scope of practice. In addition, content analysis of family leaders' revisions yielded 10 recommendations to ensure that written EPA descriptions are patient- and family-centered. The described process of EPA development for the care of CMC models how families can be integrated into competency framework development and highlights their contributions. Family leader recommendations for embedding patient and family voices in EPA descriptions can serve as a guide for EPA development in other specialties.

Development of entrustable professional activities for post-doctorate pediatric dentistry education.

To identify the core components of pediatric dentistry defining entrustable professional activities (EPAs) representing the profession. Potential core components of pediatric dentistry and corresponding domains were identified through review of literature and existing pediatric dentistry standards. A modified Delphi technique was utilized to rate these candidate EPAs to achieve consensus around prioritized EPAs. Eleven participants participated in all three rounds of the Delphi. After three rounds, 16 candidate EPAs reached consensus for pediatric dentistry. Each EPA fell into one of four domains: "assessment and planning," "provision of care," "behavior guidance," and "professional development." An original candidate EPA focused on non-pharmacological behavior guidance was deemed too broad by the Delphi. This EPA was subsequently developed into three separate components on nitrous oxide analgesia, moderate sedation, and general anesthesia. Prioritized EPAs will help define the essential activities of the profession and provide a framework for creating assessments to ensure that graduating pediatric residents are ready for unsupervised practice.

Development of entrustable professional activities for regional anesthesia and pain medicine fellowship training

IntroductionThe Accreditation Council for Graduate Medical Education (ACGME) offers descriptions of competencies and milestones but does not provide standardized assessments to track trainee competency. Entrustable professional activities (EPAs) and special...

Development of entrustable professional activities for advanced practice nurses education

BackgroundEntrustable professional activity (EPA) framework has gained popularity within competency-based healthcare education programmes across disciplines, professions, and countries. As opposed to traditional time-based approach, EPAs bridge the gaps between competency framework and clinical practice, however, limited information on nursing EPAs highlights a need to develop EPAs specific to graduate nursing education to promote patient safety and quality patient care. ObjectivesThis paper described comprehensively the four-stage approach used to develop and pilot test a set of core EPAs for advanced practice nurse (APN) education. MethodThe four-stage approach used to develop and pilot the EPAs included: 1) team formation, 2) development of conceptual framework, 3) identifying and reviewing core EPAs, and 4) pilot testing the EPAs. Post pilot test and surveys were conducted for the EPA developers, APN preceptors and interns to explore their perceptions and experiences using the EPAs. ResultsA framework of nine core EPAs was developed for APN education, including: 1) perform an initial assessment and formulate management plans, 2) manage follow-up care for a clinical encounter, 3) plan, perform and evaluate care procedures, 4) recognise and manage patients requiring urgent care, 5) manage care transitions within and between health care organisations, 6) recognise and manage pharmacological needs of patients, 7) collaborate with patients, families, and community to improve health through disease prevention and health promotion, 8) participate in health quality improvement initiative, and 9) develop self and others for professional practice. ConclusionDespite the stakeholders having generally positive attitudes towards the use of EPAs, it has its drawbacks. More research is needed to examine the psychometric properties of the EPA assessment tools and evaluate the effectiveness of EPAs in graduate nursing education. Additionally, the described set of core APN EPAs needs more refinement and rigorous testing before it can be implemented on a larger scale.

Development of Entrustable Professional Activities for Specialist Hospice and Palliative Care Pharmacists.

Entrustable professional activities (EPAs) translate competencies into explicit, practical terms that clearly state the expected roles and responsibilities of clinicians who have achieved proficiency and expertise in a field. EPAs are defined for Hospice and Palliative Medicine physicians but not for other members of Hospice and Palliative Care (HAPC) interprofessional teams, including pharmacists. The objective of this study was to develop EPAs for HAPC pharmacists. An 11-member workgroup of HAPC pharmacists was convened to develop candidate EPAs using nominal group and modified-Delphi methods. Content validity index was used as a measure of consensus, defined a priori at ≥ 60%. Vetting occurred via intra- and interprofessional stakeholder reactor groups and a national survey of HAPC pharmacists. Following an iterative process of workgroup and stakeholder consensus-building, 15 HAPC pharmacist EPAs were developed. Among the workgroup, all 15 EPAs reached ≥ 70% consensus, indicating appropriate internal validity. In a national survey of 185 HAPC pharmacists with a 20% response rate, 13 EPAs were rated by most respondents as "essential" and 2 were rated by most respondents as "important but not essential." Respondents indicated the 15 EPA set represented the core professional activities of HAPC pharmacists well (median rating of 5 on a Likert-like scale, IQR 1). Fifteen consensus EPAs describe essential activities of HAPC pharmacists in direct patient care, leadership, education, and scholarship. These EPAs will further guide pharmacist training programs, HAPC services seeking to incorporate a specialized pharmacist on the team, and currently practicing HAPC pharmacists.

A Multistakeholder Approach to the Development of Entrustable Professional Activities in Complex Care.

Care of children with medical complexity (CMC) involves unique knowledge, skills, and attitudes. Previous work has identified curricular priorities in complex care for pediatricians yet there are no established competency frameworks to guide curriculum development. We aimed to develop and appraise Entrustable Professional Activities (EPAs) for the care of CMC with multistakeholder involvement. We recruited complex care practitioners to develop EPAs using a template for elaborating descriptive elements. A team of clinicians, educators, trainees, and family leaders refined EPAs and mapped content to the Accreditation Council for Graduate Medical Education Milestones. We conducted virtual focus groups to assess whether EPAs represented the essential skills of pediatricians caring for CMC. Focus group data were analyzed using content analysis. Content experts developed 11 EPAs for the care of CMC describing knowledge, skills, and attitudes required for attaining competency. EPAs were mapped to 21 of the 21 (100%) reporting pediatric milestones. Focus group participants endorsed and refined EPA content. Categories of feedback included clarifying medical knowledge, expanding on interpersonal communication skills, emphasizing systems-based practice, and affirming family partnership. A systematic approach to developing EPAs for the care of CMC provides a guide for curriculum development and assessment in complex care.

Abordagem dialógica de competência: pressupostos e percurso metodológico para a construção de perfis na área da Saúde

This theoretical investigation presents the dialogic approach to competence, its principles, and methods for the construction of professional profiles. Unlike conceptions that focus on isolated elements of competence, the dialogic approach is based on an integrative framework and proposes areas of competence that characterize core and field in professional practice. This approach recognizes the existence of different views on professional competence that must be analyzed and discussed. A set of strategies, devices, and methods capable of triangulating these views and systematizing professional activities is presented. The competent profile, built as a meta point of view, translates contextualized combinations of knowledge, skills, attitudes, and values that express excellence in professional performance, with a view to training, certification, and continuing education of health professionals. The text analyzes the coherence between practices systematized in the way proposed here and the development of entrustable professional activities.

Evaluating Medical Decision-Making: Using the EHR to Assess and Structure Resident Autonomy.

Evaluating Medical Decision-Making: Using the EHR to Assess and Structure Resident Autonomy.

Firsthand Experience in Graduating Three Cohorts of Forensic Pathologists Trained With Competency by Design (CBD) Curriculum.

The University of Toronto experienced graduating three cohorts of forensic pathologists trained with Competency by Design (CBD) curriculum. We achieved this as a result of multiyear development of Entrustable Professional Activities (EPAs), Required Training Experience (RTEs), and Specialty Competency Requirements (SCRs) by the Royal College of Physicians and Surgeons of Canada's Forensic Pathology Speciality Committee, the Ontario Forensic Pathology Service, and the University of Toronto. Our academic year is comprised of 13 blocks. We divided the 13-block period into 4 stages to map all the EPAs and RTEs. The first stage, Transition to Discipline, is 1 block, the second stage, Foundation of Discipline, consists of 3 blocks; the third stage, Core of Discipline, consists of 6 blocks, and the final fourth stage, Transition to Practice, consists of 3 blocks. Board-certified faculty members in Forensic Pathology with more than five years of experience supervised the trainees. We graduated 5 Canadian and 4 international trainees at the end of the third cycle of CBD-based training program. Using the Royal College Speciality Committee blueprint, the University of Toronto started in 2016 planning the CBD curriculum in the forensic pathology training program. By the end of June 2021, we graduated nine trainees from our CBD-based Forensic Pathology training program. We are training the fourth cohort, and they will be graduating at the end of June 2022. This article aims to share our firsthand experiencing in CBD training in forensic pathology.

Development of entrustable professional activities for residents rotating nephrology department in a Japanese university hospital: a Delphi study

ObjectivesTraining strategies regarding entrustable professional activities (EPAs) vary from country to country; one such strategy is for residents. However, there are no reports of EPAs developed for residents who rotate...

Development of entrustable professional activities for a physiotherapy undergraduate programme in Singapore

BackgroundThe concept of entrustable professional activities (EPAs) as an assessment framework is new to undergraduate physiotherapy training in Singapore. The physiotherapy community was tasked to develop EPAs to reflect the core professional activities of an entry-level physiotherapist for its undergraduate programme. MethodsA qualitative participatory approach was used to develop entry-level EPAs for undergraduate physiotherapy students. Four phases occurred; (1) formation and training of the EPA writing workgroup from different sectors of the physiotherapy industry in Singapore; (2) conceptualization of the framework; (3) writing EPAs and; (4) iteration of EPAs through reflection, revision and consensus building. ResultsFive core activities were identified for undergraduate physiotherapy students to perform upon graduation and were developed into entry-level EPAs. These entry-level EPAs were subsequently termed as core EPAs to reflect the core practices expected at entry level across specialties and sectors in Singapore. These EPAs were mapped to five competency domains and 12 competency descriptors. The sources of information to support entrustment decisions were (1) short practice observation, (2) entrustment-based discussion and (3) case notes evaluation. Remote supervision was selected as the level of entrustment that physiotherapy students must attain at graduation. ConclusionThe development of EPAs utilized a ground-up and cross-sector approach to define entry-level EPAs as core physiotherapy activities expected to be performed and assessed during clinical training by undergraduate physiotherapy students. Future research is needed to validate the use of EPAs as an assessment framework for undergraduate physiotherapy education.

Development of entrustable professional activities for paediatric intensive care fellows: A national modified Delphi study.

Entrustable professional activities (EPAs), as a focus of learner assessment, are supported by validity evidence. An EPA is a unit of professional practice requiring proficiency in multiple competencies simultaneously, that can be entrusted to a sufficiently competent learner. Taken collectively, a set of EPAs define and inform the curriculum of a specialty training. The goal of this study was to develop a set of EPAs for Dutch PICU fellows. A multistage methodology was employed incorporating sequential input from task force members, a medical education expert, PICU fellowship program directors, and PICU physicians and fellows via a modified three-round Delphi study. In the first modified Delphi round, experts rated indispensability and clarity of preliminary EPAs. In the subsequent rounds, aggregated scores for each EPA and group comments were provided. In round two, respondents rated indispensability and clarity of revised EPAs. Round three was used to gain explicit confirmation of suitability to implement these EPAs. Based on median ratings and content validity index (CVI) analysis for indispensability in the first two rounds, all nine preliminary EPAs covered activities that were deemed essential to the clinical practice of PICU physicians. Based on median ratings and CVI analysis for clarity however, four EPAs needed revision. With an agreement percentage of 93–100% for all individual EPAs as well as the set as a whole, a high degree of consensus among experts was reached in the third round. The resulting nine PICU EPAs provide a succinct overview of the core tasks of Dutch PICU physicians. These EPAs were created as an essential first step towards developing an assessment system for PICU fellows, grounded in core professional activities. The robust methodology used, may have broad applicability for other (sub)specialty training programs aiming to develop specialty specific EPAs.

Development of Entrustable Professional Activities for Training of Hospice and Palliative Care Pharmacists (SCI961)

1.Compare and contrast HAPC Pharmacist EPAs with EPAs and competencies of other interprofessional HAPC team members and non-HAPC specialist pharmacists.2.List 3 tools to facilitate multi-centered research during a pandemic. Pharmacists with specialized training in hospice and palliative care (HAPC) improve outcomes for patients and health systems. Given the absence of board certification for and the diverse training of HAPC pharmacists, entrustable professional activities (EPAs) would be useful in distinguishing the roles and responsibilities of pharmacists specializing in HAPC. EPAs are used to describe the roles and work of HAPC physicians. EPAs translate competencies into explicit, practical terms that clearly state the expected roles and responsibilities of clinicians who have achieved and integrated multiple competencies in a specialty. Develop consensus EPAs for HAPC specialist pharmacists. A workgroup of 10 pharmacists, representing diverse, national training and HAPC practice settings, was selected to develop HAPC pharmacists EPAs through an iterative, facilitated process. The workgroup used nominal group and modified Delphi methods to create and refine EPA statements through 4 consensus-building rounds. Interprofessional HAPC team members and additional pharmacy stakeholder groups provided feedback on the draft EPAs. This research was supported by Cambia Health Foundation. Round 1 yielded 113 draft EPA statements. Round 2 identified 45 statements that were deemed specific, assignable, and observable. At the end of round three, 14 draft statements achieved consensus to be essential entrustable activities for HAPC specialist pharmacists. These were further peer-reviewed and refined in round 4. Eleven EPAs achieved ≥ 80% consensus as essential when reviewed by an interprofessional panel representing 6 HAPC disciplines. The remaining 3 EPAs were deemed essential by 50% of the interprofessional reviewers. Fourteen EPAs describe the essential activities of HAPC specialist pharmacists.

Simulation as a Platform for Development of Entrustable Professional Activities: A Modular, Longitudinal Approach.

BackgroundThe Association of American Medical Colleges (AAMC) has recently identified a list of integrated activities to be expected of all medical school graduates entering residency: the core Entrustable Professional Activities (EPAs). Direct observation and deliberate practice of individual EPA behaviors in the clinical setting has multiple challenges, and there is limited literature describing a comprehensive, longitudinal curriculum dedicated to formative EPA assessment. ApproachWe present a model curriculum to develop and provide formative assessment of EPA skills longitudinally throughout the clinical years. Each EPA-focused training session includes a simulation case followed by several small group activities with content related to the clinical vignette in the initial simulation. We have designed this curriculum to be longitudinal and modular, and present the general framework here. OutcomesStep-wise implementation began in 2013. Over 450 medical students have participated in the third year (MS3) clerkship sessions, 30 in the MS4 sub-internship sessions, and over 300 thus far in the fourth year (MS4) capstone course, including students from 10 different medical schools. MS3 sessions focused on EPAs 4, 7, 8, 9, 10, and MS4 sessions had an additional focus on EPA 8. The capstone course encompassed nearly all 13 EPAs in active simulation-based learning. Opportunities to provide formative assessment through on-the-spot feedback exist throughout the curriculum. Student feedback was overwhelmingly positive.Next stepsWe found that simulations are an effective method of providing formative assessment of EPAs that are exceptionally well-received by medical students. We have demonstrated that these can be implemented for medical students from multiple educational backgrounds. We believe that deliberate practice and longitudinal formative assessment is of utmost importance in effectively developing core EPAs prior to final entrustment decisions.

Development of Entrustable Professional Activities and Standards in Training in Pediatric Neurogastroenterology and Motility: North American Society for Pediatric Gastroenterology, Hepatology and Nutrition and American Neurogastroenterology and Motility Society Position Paper.

Neurogastroenterology and motility (NGM) disorders are common in childhood and are often very debilitating. Although pediatric gastroenterology fellows are expected to obtain training in the diagnosis and management of patients with these disorders, there is an ongoing concern for unmet needs and lack of exposure and standardized curriculum. In the context of tailoring training components, outcome and expressed needs of pediatric gastroenterology fellows and programs, members of the North American Society for Pediatric Gastroenterology, Hepatology and Nutrition (NASPGHAN) and American Neurogastroenterology and Motility Society (ANMS) developed guidelines for NGM training in North America in line with specific expectations and goals of training as delineated through already established entrustable professional activities (EPAs). Members of the joint task force applied their expertise to identify the components of knowledge, skills, and management, which are expected of NGM consultants. The clinical knowledge, skills and management elements of the NGM curriculum are divided into domains based on anatomic regions including esophagus, stomach, small bowel, colon and anorectum. In addition, dedicated sections on pediatric functional gastrointestinal (GI) disorders, research and collaborative approach, role of behavioral health and surgical approaches to NGM disorders and transition from pediatric to adult neurogastroenterology are included in this document. Members of the NASPGHAN-ANMS task force anticipate that this document will serve as a resource to break existing barriers to pursuing a career in NGM and provide a framework towards uniform training expectations at 3 hierarchical tiers corresponding to EPA levels.