Use Of Entrustable Professional Activities Research Articles

Entrustable Professional Activities in Postgraduate General Surgery Training: A Scoping Review.

To provide an overview of the current use of Entrustable Professional Activities (EPAs) in postgraduate general surgery training internationally. Entrustable Professional Activities (EPAs) were introduced to connect clinical competencies and the professional activities to be entrusted to trainees on graduation. The popularity of EPAs as a framework for assessment is growing globally, including in general surgery. Anecdotally, there appears to be substantial variation in how they are implemented, yet a formal comparison of their use in postgraduate general surgery training is lacking. A scoping review was performed, based on the original five-stage approach described by Arksey and O'Malley with the addition of protocol-specific items from the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols extension for scoping reviews (PRISMA-ScR). Twenty-nine published and grey literature sources were included in the review. Entrustable Professional Activity use in postgraduate general surgery training was identified in 11 unique contexts, including from North America, South America, Europe, Asia, Africa, and Australia. There were substantial differences in the scope and number of EPAs, tools used for EPA assessment, and how EPAs were sequenced through training. Despite wide variation, eight distinct EPAs were common to the majority (>80%) of countries. Several articles described findings of EPA use in postgraduate general surgery training, allowing identification of multiple barriers and facilitators to integration. This review provides guidance for certification and regulatory bodies, program directors, and institutions with ambitions to implement EPAs for assessment and curricular design. In settings where EPAs are already used, the data may facilitate refinement of programs and strategies.

Current use of simulation for EPA assessment in emergency medicine.

Approximately five years ago, the Royal College emergency medicine programs in Canada implemented a competency-based paradigm and introduced the use of Entrustable Professional Activities (EPAs) for assessment of units of professional activity to assess trainees. Many competency-based medical education (CBME) based curricula, involve assessing for entrustment through observations of EPAs. While EPAs are frequently assessed in clinical settings, simulation is also used. This study aimed to characterize the use of simulation for EPA assessment. A study interview guide was jointly developed by all study authors and followed best practices for survey development. A national interview was conducted with program directors or assistant program directors across all the Royal College emergency medicine programs across Canada. Interviews were conducted over Microsoft Teams, interviews were recorded and transcribed, using Microsoft Teams transcribing service. Sample transcripts were analyzed for theme development. Themes were then reviewed by co-authors to ensure they were representative of the participants' views. A 64.7% response rate was achieved. Simulation has been widely adopted by EM training programs. All interviewees demonstrated support for the use of simulation for EPA assessment for many reasons, however, PDs acknowledged limitations and thematic analysis revealed certain themes and tensions for using simulation for EPA assessment. Thematic analysis revealed six major themes: widespread support for the use of simulation for EPA assessment, concerns regarding the potential for EPA assessment to become a "tick- box" exercise, logistical barriers limiting the use of simulation for EPA assessment, varied perceptions about the authenticity of using simulation for EPA assessment, the potential for simulation for EPA assessment to compromise learner psychological safety, and suggestions for the optimization of use of simulation for EPA assessment. Our findings offer insight for other programs and specialties on how simulation for EPA assessment can best be utilized. Programs should use these findings when considering using simulation for EPA assessment.

Proposed use of entrustable professional activities (EPAs) in genetic counseling for clinical training and assessment.

We introduce Entrustable Professional Activities (EPAs) as a potential framework for clinical training and assessment in genetic counseling. We discuss advantages of this approach, review how EPAs complement Practice-Based Competencies (PBCs), describe our process of generating proposed "core" EPAs, provide examples of specialty-specific EPAs, discuss the concept of entrustment in clinical training, and propose an approach to implementation.

A national training course for clinical trainers in family medicine.

Quality vocational training is important to ensure that family physicians can strengthen the district health system. Competent clinical trainers and supervisors, with the necessary educational knowledge and skills, are required for this job. In 2014, a formal Train the Clinical Trainer (TCT) course was introduced in South Africa as a collaborative effort between the Royal College of General Practitioners (RCGP) and the South African Academy of Family Physicians (SAAFPs). To make the training relevant, the course was aligned with the National Unit Standards for Family Medicine, as these defined the learning outcomes for registrars. The aim of the TCT course was to equip workplace-based clinical trainers with an essential set of educational skills, which could be further developed through mentoring and support. Accredited trainers present the face-to-face course yearly to two family physicians from each of the nine departments of family medicine in South Africa. The TCT course is built around the educational principles of learner-centredness and andragogy. During these 5 days of training the roles and responsibilities of trainers and learners, the learning environment, alignment with the curriculum, assessment for and of learning, and leadership are covered. Recently online assessment, the e-portfolio and the use of entrustable professional activities were added to the course content. In the future we would like to accredit more clinical trainers through a process of workplace-based self-evaluation and 360-degree feedback from peers and students. Lastly, we want to expand the training course in the African region.Contribution: The Train the Clinical Trainer (TCT) course, established in 2014 through RCGP and SAAFP collaboration in South Africa, ensures family physicians have essential educational skills. Aligned with national standards, the course embraces learner-centered principles. Ongoing enhancements include online assessments and future plans involve accrediting more trainers through self-evaluation and expanding across the African region.

Determining preceptor perceptions of APPE readiness through the use of entrustable professional activities

IntroductionPharmacy programs are required to demonstrate that students are advanced pharmacy practice experience (APPE) ready, but neither a professionally recognized definition of nor a consistent approach to assess APPE readiness exists. MethodsAPPE preceptors were surveyed about the relationship of EPAs to APPE readiness in three domains, including: (1) each EPA's relative importance, (2) indicators that a student is not ready to begin APPEs, and (3) each EPA's expected level of entrustment on the first day of the first APPE. We determined consensus of EPA importance and expected level of entrustment by adapting previously published thresholds. We analyzed the association between preceptor or practice setting characteristics with ranking of EPA importance. ResultsOf the 431 preceptors queried, 31% responded. Ten EPAs, primarily those reflecting the first three steps of the Pharmacists' Patient Care Process (PPCP), were identified as important with strong consensus. Ambulatory care preceptors placed higher importance on EPAs, primarily in the final steps of the PPCP and within the public health domain. Professionalism issues were most often cited as reasons for a lack of APPE readiness. There was considerable variability (weak or moderate consensus) in preceptors' expected level of entrustment per EPA. ConclusionsPharmacy programs can consider prioritizing EPAs in the domains of patient care and information master when developing APPE readiness plans; professionalism should also be emphasized. Further work is needed to better understand what level of entrustment preceptors expect of an APPE ready student.

Defining entrustable professional activities for first year anesthesiology residents: A Delphi study

IntroductionThe use of entrustable professional activities (EPAs) as a basis for assessment may bridge the gap between the theory of competency-based education and clinical practice. The purpose of this study was to develop and validate EPAs for United States (US) first-year clinical anesthesia (CA-1) residents for anesthesiology residency programs to use as the basis for curriculum development and workplace assessment. MethodsFrom a list of EPAs abstracted from the literature, an expert panel through a modified Delphi consensus process established EPAs for the CA1 curriculum. ResultsThe final list of EPAs after group consensus had 28 EPAs, with 14 (50%) considered to be applicable to the CA-1 year. An 80% consensus rate was used to accept or reject the final list. ConclusionThis study applied a construct validity lens to EPA development providing assurance that the EPAs adopted are appropriate for use in workplace-based assessment and entrustment decision-making.

A consortium's approach to developing an EPA-based community IPPE curriculum

Introduction: Currently, there are limited data on the use of entrustable professional activities (EPAs) within introductory pharmacy practice experiences (IPPEs). The objective of this study was to identify supporting EPA tasks community IPPE students should perform at the “Competent with Support” level to prepare them for advanced pharmacy practice experiences (APPEs).Methods: The Southeastern Pharmacy Experiential Education Consortium utilized a modified Delphi process to incorporate EPAs into community IPPE curricula to mirror the consortium's community APPE curricula. Community IPPE and APPE preceptors (N = 140) were invited to participate in focus groups and two surveys to identify and build consensus on EPA-based activities community IPPE students should perform to prepare them for APPEs. The primary outcome was development of an EPA-based community IPPE curriculum.Results: Nine preceptors (6.43%) participated in a focus group, 34 preceptors completed survey one (24.29%), and 20 preceptors completed survey two (14.29%). The initial list of 62 tasks for 14 EPAs was tailored to reflect an IPPE student skill set. Survey consensus led to a community IPPE curricula with 12 required EPAs and 54 tasks (40 required and 14 suggested).Conclusions: The modified Delphi process provided a mechanism for preceptor collaboration with experiential programs to build consensus on community IPPE curricula redesigned around EPAs and supporting tasks. A unified IPPE curriculum adds value to colleges and schools of pharmacy with shared preceptors by improving continuity of experience, expectations, and evaluation of student learners and allows for targeted regional preceptor development.

A Qualitative Study on How Entrustable Professional Activities Support Medical Students in Their Transitions across Clerkships.

Medical students regularly transition between clerkships. These transitions can lead to discontinuity in their development because of the need to adapt to a new environment. The use of entrustable professional activities (EPAs) might facilitate less disruptive transitions across clerkships, as they could provide support at the start of a clerkship. This study aims to shed light on how an EPA-based curriculum contributes to medical students' learning processes during transitions. The authors used a constructivist rapid ethnographic design. They conducted observations and interviews with 11 medical students in their Pediatrics clerkship; six of them were in clerkships not utilizing EPAs, and five were using EPAs. Data collection was followed by template analysis such that all data were coded with a template that was continually updated until the authors all agreed upon a definitive template. Four themes proved important when considering the impact of EPAs during transitions between clerkships: transitions as a learning opportunity, building relationships in context, taking leadership in the landscape of practice and feedback-seeking behavior. EPAs smooth clerkship transitions, as they establish continuity in the student's development and facilitate navigating discontinuity in transitions. Students build skills and confidence in order to grow and work with increasing independence within the clerkships. Transitions offer important learning opportunities for students, which can be fully exploited by using EPA guidance.

Entrustable professional activities versus competencies and skills: Exploring why different concepts are often conflated

Despite explanations in the literature, a returning question in the use of entrustable professional activities (EPAs) is how to distinguish them from competencies and skills. In this article, we attempt to analyze the causes of the frequent confusion and conflation of EPAs with competencies and skills, and argue why the distinction is important for education, qualification and patient safety. ‘Tracheotomy’, ‘lumbar puncture’, ‘interprofessional collaboration’ for example are colloquially called ‘skills’, but its is a person’s ability to perform these activities that is the actual skill; the EPA is simply the activity itself. We identify two possible causes for the confusion. One is a tendency to frame all educational objectives as EPAs. Many objectives of medical training can be conceptualized as EPAs, if ‘the ability to do X’ is the corresponding competency; but that does not work for all. We offer ways to deal with objectives of training that are not usefully conceptualized as EPAs. A more fundamental cause relates to entrustment decisions. The permission to contribute to health care reflects entrustment. Entrustment decisions are the links or pivots between a person’s readiness for the task and the actual task execution. However, if entrustment decisions do not lead to increased autonomy in the practice of health care, but only serve to decide upon the advancement to a next stage of training, EPAs can become the tick boxes learners feel they need to collect to ‘pass’. Gradually, then, EPAs can loose their original meaning of units of practice for which one becomes qualified.

S939 #MondayNightIBD: Social Media, Continuing Medical Education, and the Use of Entrustable Professional Activities in IBD Education

S939 #MondayNightIBD: Social Media, Continuing Medical Education, and the Use of Entrustable Professional Activities in IBD Education

Frameworks to Guide Faculty Development for Health Professions Education: A Scoping Review.

The authors explored the existence of explicit definitions, guiding competency frameworks, and learning theory to inform health professions education faculty development (FD) programs. The authors analyzed identified frameworks based on thematic focus, scope of targeted faculty, and design structure. A scoping review was used to identify health professions education literature between 2005 and 2020. Frameworks were characterized according to the scope of the faculty targeted and design structure, and then, domains were grouped into topical categories for analysis. Twenty-three articles met the criteria for data extraction, of which only one (4.3%) described the explicit use of a learning theory and three (13%) included an explicit definition of FD. One (4.3%) used a recognized framework, whereas 12 (52.2%) developed a novel framework based on an existing outline. Ten (43.5%) described de novo framework development. Only three (13.0%) used entrustable professional activities or similar constructs. Five (21.7%) programs targeted multiple health professions, 11 (47.8%) targeted a single health profession, and seven (30.5%) targeted a specific specialty within a health profession. Only two frameworks included a developmental component. Few authors describe an explicit definition, learning theory, or use a pre-established framework when framing their FD programs. The use of entrustable professional activities to structurally link competencies to work practices is also uncommon, as well as the use of developmental structures designed to support progressive FD over time.

Validity Evidence for Assessing Entrustable Professional Activities During Undergraduate Medical Education.

To explore validity evidence for the use of entrustable professional activities (EPAs) as an assessment framework in medical education. Formative assessments on the 13 Core EPAs for entering residency were collected for 4 cohorts of students over a 9- to 12-month longitudinal integrated clerkship as part of the Education in Pediatrics Across the Continuum pilot at the University of Minnesota Medical School. The students requested assessments from clinical supervisors based on direct observation while engaging in patient care together. Based on each observation, the faculty member rated the student on a 9-point scale corresponding to levels of supervision required. Six EPAs were included in the present analyses. Student ratings were depicted as curves describing their performance over time; regression models were employed to fit the curves. The unit of analyses for the learning curves was observations rather than individual students. (1) Frequent assessments on EPAs provided a developmental picture of competence consistent with the negative exponential learning curve theory; (2) This finding was true across a variety of EPAs and across students; and (3) The time to attain the threshold level of performance on the EPA for entrustment varied by student and EPA. The results provide validity evidence for an EPA-based program of assessment. Students assessed using multiple observations performing the Core EPAs for entering residency demonstrate classic developmental progression toward the desired level of competence resulting in entrustment decisions. Future work with larger data samples will allow further psychometric analyses of assessment of EPAs.

Entrustable Professional Activity-Based Assessments in Undergraduate Medical Education: A Survey of Pediatric Educators.

To explore the use of entrustable professional activities (EPAs) in undergraduate medical education (UME), characterization of EPAs by pediatric educators, and opportunities and challenges with an EPA framework. In 2020, 9 survey questions were administered to members of the Council on Medical Student Education in Pediatrics, a national pediatric UME group. Clark's Commitment and Necessary Effort model on motivation served as the theoretical framework for our study. Quantitative and qualitative data were analyzed using descriptive statistics and conventional content analysis, respectively. One hundred and sixty-seven (31%) of 479 recipients, representing 75% of accredited schools responded. Eigty-three percent agreed that they understood what EPAs were, yet a minority reported using EPAs. Eighty-five percent of EPA users expressed satisfaction with EPAs in providing a shared framework and an opportunity to track student competence; dissatisfaction was expressed toward faculty resource needs. Among nonusers, barriers hindering implementation included faculty development challenges and faculty time. Qualitative analyses revealed a rich understanding of EPAs: that they offer a framework to measure learner competence by assessing performance in workplace-based tasks that can be used for entrustment decisions and for program evaluation. Although most pediatric UME educators report understanding EPAs (contributing to self-efficacy) and recognize their benefits (value), a minority report actually using EPAs. EPAs, while providing a valuable framework, pose challenges from contextual factors affecting personal agency, which could affect educator commitment in implementation. For more widespread adoption of the EPAs, efforts should focus on minimizing these perceived barriers.

The ingredients of a rich entrustment decision

Entrustment decision-making has become a topic of interest in workplace-based assessment in the health professions and is germane to the use of entrustable professional activities. Entrustment decisions stem from judgments of a trainee’s competence and include the permission to act with a higher level of responsibility or autonomy and a lower level of supervision. Making entrustment decisions differs from regular assessment of trainees, which usually has no consequences beyond marking trainee progress. Studies show that clinicians generally weigh more factors in making an entrustment decision than when merely assessing trainee competence or performance without direct consequences for patient care. To synthesize the varying factors reported in literature, the authors performed a thematic analysis of key qualitative studies that investigated trainee features clinical supervisors find important when making entrustment decisions. Five themes emerged from the 13 publications: Capability (specific knowledge, skills, experience, situational awareness), Integrity (truthful, benevolent, patient-centered), Reliability (conscientious, predictable, accountable, responsible), Humility (recognizes limits, asks for help, receptive to feedback), Agency (proactive toward work, team, safety, personal development). Thoughtful entrustment decisions, made either by individual clinical supervisors or by clinical competency committees, may be enriched by taking into account these five features.

E-portfolios and Entrustable Professional Activities to support competency-based education in dietetics.

The concept of Entrustable Professional Activities, recently pioneered in medical education, has emerged to support the implementation of competency-based education. Although competency-based frameworks are widely used in healthcare professional education to develop outcomes-based curricula, assessment of student competency in professional placement settings remains challenging. The novel concept of Entrustable Professional Activities together with established methods of competency assessment, namely e-portfolios and self-assessment, was implemented in the "[La Trobe University Dietetic program in 2015-2016. This study aimed to appraise the e-portfolio and evaluate the use of Entrustable Professional Activities to assess competence. A mixed-methods evaluation, using qualitative and quantitative surveys with follow-up structured consultations, was conducted with final year dietetics students and their supervisors. Dietetics students were comfortable with Entrustable Professional Activities and competency-based assessment, whereas supervisors preferred Entrustable Professional Activity based assessment. All stakeholders valued student self-assessment and the ongoing use of structured e-portfolios to develop and document competency. The use of structured e-portfolios, student self-assessment, and the emerging concept of Entrustable Professional Activities are useful tools to support dietetics student education in professional placement settings.

Entrustment decisions: Implications for curriculum development and assessment

With increased interest in the use of entrustable professional activities (EPAs) in undergraduate and postgraduate medical education, comes questions about their implications for curriculum development and assessment. This paper addresses some of those questions, discussed at a symposium of the 2017 conference of AMEE, by presenting the components of an EPA, describing their importance and application, identifying their implications for assessment, and pinpointing some of challenges they pose in undergraduate and postgraduate settings. It defines entrustment, describes the three levels of trust, and presents trainee and supervisor factors that influence it as well as perceived benefits, and risks. Two aspects of EPAs have implications for assessment: units of professional practice and decisions based on entrustment, which impact an assessment’s blueprint, test methods, scores, and standards. In an undergraduate setting EPAs have great appeal, but work is needed to identify and develop a robust assessment system for core EPAs. At the postgraduate level, there is tension between the granularity of the competencies and the integrated nature of the EPAs. Even though work remains, EPAs offer an important step in the evolution of competency-based education.

Assessment of inhaler technique among fourth-year pharmacy students: Implications for the use of entrustable professional activities

IntroductionIt is unknown when and how often competency assessments should occur in pharmacy education. Using inhaler technique as an example competency, the study objectives were to measure the proportion of near-graduation students demonstrating correct technique approximately one year after initial training and to measure reliability between assessors. MethodsA sample of 45 near-graduation pharmacy students with prior education on correct inhaler technique participated in this direct observation study at the University of Otago. Five trained assessors simultaneously rated each participant's inhaler technique demonstration using a checklist. ResultsOf 37 participants demonstrating a pressurized metered dose inhaler, 21.62% demonstrated correct technique. No participants among eight volunteers demonstrated proper use of a dry powder inhaler. On average, two steps were performed correctly for each inhaler type. Steps with the highest error rate were “hold the inhaler upright and shake well,” “breath out gently, away from the inhaler,” and “keep breathing in slowly and deeply”. The intraclass correlation coefficient for any inhaler type was excellent (0.91), suggesting assessors had strong reliability. ConclusionsStudents did not retain ability to correctly demonstrate inhaler technique one year after initial instruction. This finding supports the notion that demonstrable tasks may need to be frequently assessed to ensure the task is mastered and becomes a routine part of a student's practice. It also suggests that assessment of milestones and/or entrustable professional activities may need to occur at different time points throughout a program, rather than allowing for “signing off” prematurely.

Identifying entrustable professional activities for surgical skills training in companion animal health

BackgroundVeterinary medical education is increasingly moving towards outcome-based training based on competency frameworks. A source of concern is the translation of competencies into the practice of clinical teaching, for example,...

A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011-2018.

This review aimed to synthesise some of the extant work on the use of entrustable professional activities (EPAs) for postgraduate physicians, to assess the quality of the work and provide direction for future research and practice. Systematic searches were conducted within five electronic databases (Medline, Scopus, Web of Science, PsycINFO and CINAHL) in September 2018. Reference lists, Google Scholar and Google were also searched. Methodological quality was assessed using the Quality Assessment Tool for Studies with Diverse Designs (QATSDD). In total, 49 studies were included, classified as Development of EPAs (n = 37; 76% of total included), Implementation and/or assessment of EPAs (n = 10; 20%), or both (n = 2; 4%). EPAs were described for numerous specialties, including internal medicine (n = 14; 36%), paediatrics (n = 8; 21%) and psychiatry (n = 4; 10%). Of the development studies, 92% utilised more than one method to generate EPAs. The two most commonly used methods were developing initial EPAs in a working group, (n = 27; 69%) and revising through deliberation (n = 21; 54%). Development papers were of variable quality (mean QATSDD score = 20, range 6-41). Implementation and assessment studies utilised methods that included observing trainee performance (n = 6; 50%) and enrolling trainees in competency-based curricula, which included EPAs (n = 4; 33%). The methodological quality of these implementation studies varied (mean QATSDD score = 19.5, range = 6-32). This review highlighted a need for: (i) consideration of best practice guidelines for EPA development; (ii) focus on the methodological quality of research on EPA development and of EPAs, and (iii) further work investigating the implementation of EPAs in the curriculum.

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency

Competency-based assessments of surgical resident performance require metrics of entrustable autonomy. To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents. This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities. Differences in mean ratings were assessed across 7 comparison domains. Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P < .01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P < .12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2). Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.