Entrustment Decisions Research Articles

Narrative Performance Level Assignments at Initial Entrustment and Graduation: Integrating EPAs and Milestones to Improve Learner Assessment.

To determine which narrative performance level for each general pediatrics entrustable professional activity (EPA) reflects the minimum level clinical competency committees (CCCs) felt should be associated with graduation as well as initial entrustment and compare expected narrative performance levels (ENPLs) for each EPA with actual narrative performance levels (ANPLs) assigned to residents at initial entrustment. A series of 5 narratives, corresponding to the 5 milestone performance levels, were developed for each of the 17 general pediatrics EPAs. In academic year (AY) 2015-2016, the CCCs at 22 Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network member sites reported ENPLs for initial entrustment and at time of graduation. From AYs 2015-2016 to 2017-2018, programs reported ANPLs for initial entrustment decisions. ENPLs and ANPLs were compared using a logistic mixed effects model. ENPLs for graduation and entrustment were most often level 3 (competent) followed by level 4 (proficient). For 8 EPAs, the ENPLs for graduation and entrustment were the same. For the remaining 9, some programs would entrust residents before graduation or graduate them before entrusting them. There were 4,266 supervision level reports for initial entrustment for which an ANPL was provided. ANPLs that were lower than the ENPLs were significantly more likely to be assigned to the medical home-well child (OR = 0.39; 95% CI: 0.26-0.57), transition to adult care (OR = 0.43; 95% CI: 0.19-0.95), behavioral or mental health (OR = 0.36; 95% CI: 0.18-0.71), make referrals (OR = 0.31; 95% CI: 0.17-0.55), lead a team (OR = 0.34; 95% CI: 0.22-0.52), and handovers (OR = 0.18; 95% CI: 0.09-0.36) EPAs. CCCs reported lower ENPLs for graduation than for entrustment for 5 EPAs, possibly indicating curricular gaps that milestones and EPAs could help identify.

Entrustment decisions: Implications for curriculum development and assessment

With increased interest in the use of entrustable professional activities (EPAs) in undergraduate and postgraduate medical education, comes questions about their implications for curriculum development and assessment. This paper addresses some of those questions, discussed at a symposium of the 2017 conference of AMEE, by presenting the components of an EPA, describing their importance and application, identifying their implications for assessment, and pinpointing some of challenges they pose in undergraduate and postgraduate settings. It defines entrustment, describes the three levels of trust, and presents trainee and supervisor factors that influence it as well as perceived benefits, and risks. Two aspects of EPAs have implications for assessment: units of professional practice and decisions based on entrustment, which impact an assessment’s blueprint, test methods, scores, and standards. In an undergraduate setting EPAs have great appeal, but work is needed to identify and develop a robust assessment system for core EPAs. At the postgraduate level, there is tension between the granularity of the competencies and the integrated nature of the EPAs. Even though work remains, EPAs offer an important step in the evolution of competency-based education.

Entrustment trends in orthotic and prosthetic residencies.

Orthotic and prosthetic residency preceptors have little guidance transitioning residents between observing and performing patient care. Understanding current entrustment trends and factors can help guide resident progression during residency. To identify entrustment trends and factors within an orthotics and prosthetics residency affecting a supervisor's decision to entrust residents with independent patient care. Cross-sectional study. In this cross-sectional study, 831 National Commission of Orthotic and Prosthetic Education preceptors were invited to complete a 26-question, online questionnaire that examined possible entrustment factors. A total of 77 preceptors completed the questionnaire. The top-reported behavioral qualities impacting entrustment were recognition of limitations and willingness to ask for help (n = 45) and competence (n = 37). Preceptors ranked evaluation (n = 27) as the professional skill which most affected entrustability; technical skill least affected entrustability (n = 4). Preceptors of 12-month residencies entrust residents to indirect supervision when they have completed approximately 75% (i.e. 9 months) of the program. Preceptors of 18-month residencies reported that they entrust their residents by the time they reach 50% (i.e. 9 months) of their training. A small number of preceptors (n = 19) never allow a resident to independently perform practice management. Residency supervisors value interpersonal and evaluation skills when making entrustment decisions. Residency mentors can use these findings to inform their entrustment decisions and support a resident's progression toward independent practice. This study presents information which can inform clinical preceptors and residents on what factors contribute to the decision to progress a resident from observation to independent patient care. These findings may influence clinical education standards which aim to promote both resident training and patient access to quality care.

Surgery clerkship offers greater entrustment of medical students with supervised procedures than other clerkships

BackgroundMedical student procedural participation is increasingly limited, creating concerns over poor preparation for internship. Inadequate experiences may also compromise patient safety. This study explores variances in procedural entrustment of medical students between core clerkships during the first clinical year. MethodsStudents completing their first clinical year were surveyed on procedure participation. Holistic entrustment decisions are complex, thus participation was used as an objective proxy for entrustment. Results138 students responded (66% response rate); 89% (123/138) wished they had performed more procedures. Students had higher participation rates during procedural clerkships (surgery, obstetrics/gynecology). Entrustment was highest during surgery, and lowest during pediatrics. Surgery gave statistically significantly higher entrustment for subcuticular suturing (compared to obstetrics/gynecology) and nasogastric tube removal (compared to internal medicine). Entrustment was generally inversely proportional to procedure complexity within each specialty. ConclusionsStudents encounter higher entrustment during procedural clerkships, especially surgery. Targeted areas for increased procedural involvement can be identified in all specialties.

A138 CONCEPTUALIZING ENTRUSTMENT IN ENDOSCOPIC TRAINING

Abstract Background Competency-based medical education (CBME), an educational paradigm that prioritizes development of measurable skills over time in training, is currently being instituted across North American residency training programs. A fundamental goal of CBME is entrustment – the process whereby supervisors come to trust trainees to perform specific tasks without supervision. How entrustment decisions are made with respect to endoscopic training has not been elucidated. Aims We aimed to: (1) identify the factors trainers consider in making endoscopic entrustment decisions and (2) characterize this entrustment decision-making process. Methods A qualitative, interview-based study was conducted using a constructivist grounded theory approach. A purposive sample of endoscopic trainers from across North America were recruited with representation from adult and pediatric gastroenterology, general surgery, and family medicine. Consenting trainers undertook audio-recorded, semi-structured interviews designed to elicit how they make endoscopic entrustment decisions and the factors they consider in making these decisions. Interview transcripts were analyzed using constant comparison, and themes were identified iteratively, working toward an explanatory framework that highlighted relationships among themes. Recruitment continued alongside analysis until theoretical saturation, determined as the point at which no new insights arose from the data. Results Twenty-three trainer interviews were conducted, comprising 8 (34.8%) with adult gastroenterologists, 7 (30.4%) with general surgeons, 6 (26.1%) with pediatric gastroenterologists, and 2 (8.7%) with family physicians. Of those interviewed, 10 (43.5%) practiced in Canada and 13 (56.5%) practiced in the United States. Interviewees conceptualized entrustment as a continuum rather than a binary (yes/no) decision. Entrustment decision-making was found to be a complex process, involving factors related to the: (1) trainee (insight into their own abilities, technical skills, nontechnical skills); (2) trainer (perceived self-competence, disposition, prioritization of trainee learning relative to competing demands); (3) trainer-trainee relationship (duration of exposure); (4) patient (acuity, comorbidity, comfort); (5) procedure (complexity); and (6) environment (time constraints, equipment, presence of anesthesiologist). These factors directly and indirectly contributed to the themes of trainee readiness, trainer comfort, and patient safety, which collectively predicted endoscopic entrustment decisions. Conclusions Entrustment in endoscopic training is a complex process incorporating multiple factors. Clarification of this process and identification of predictive factors informs the development of endoscopic assessment tools and curricula uniquely suited to CBME. Funding Agencies CAG

Resident-Sensitive Quality Measures in the Pediatric Emergency Department: Exploring Relationships With Supervisor Entrustment and Patient Acuity and Complexity.

This study explores the associations between resident-sensitive quality measures (RSQMs) and supervisor entrustment as well as between RSQMs and patient acuity and complexity for encounters in the pediatric emergency department (PED) in which residents are caring for patients. Pediatric residents rotating through Cincinnati Children's Hospital Medical Center PED as well as supervising pediatric emergency medicine faculty and fellows were recruited during the 2017-2018 academic year for the purpose of collecting the following data from the residents' patient encounters for 3 illnesses (acute asthma exacerbation, bronchiolitis, and closed head injury [CHI]): supervisor entrustment decision rating, RSQMs relevant to the care provided, and supervisor patient acuity and complexity ratings. To measure the association of RSQM composite scores with the other variables of interest, mixed models were used. A total of 83 residents cared for 110 patients with asthma, 112 with bronchiolitis, and 77 with CHI. Entrustment decision ratings were positively associated with asthma RSQM composite scores (beta coefficient = 0.03; P < .001). There was no significant association between RSQM composite scores and entrustment decision ratings for bronchiolitis or CHI. RSQM composite scores were significantly higher when acuity was also higher and significantly lower when acuity was also lower for both asthma (P < .001) and bronchiolitis (P = .01). However, RSQM composite scores were almost identical between levels of acuity for CHI (P = .94). There were no significant differences in RSQM composite scores when complexity varied. This study found limited associations between RSQM composite scores and entrustment decision ratings but offers insight into how RSQMs could be used for the purposes of resident assessment and feedback.

It's a matter of trust: exploring the basis of program directors' decisions about whether to trust a resident to care for a loved one.

There has been increased attention to and emphasis on competency-based medical education and the transformation from highly supervised medical students towards independent, entrustable physicians. We explored how program directors (PDs) justify decisions about whether they would trust finishing Post Graduate Year 1 (PGY1) residents to care for the PD or a loved one. Using an end of year survey with validity evidence, we assessed PDs' responses (Yes, No, Not Sure) and written comments about this entrustment decision for USUHS medical students from graduating classes of 2013-2015 (PGY1). We performed a qualitative inductive content analysis to identify themes in how PDs justified their decisions as well as descriptive statistics and a contingency table analysis to examine associations between trust decisions and election to membership in Alpha Omega Alpha (AOA), or conversely, referral to the Student Promotions Committee (SPC) for remediation. Qualitative analyses revealed five themes related to this trust decision about medical residents: personal, interpersonal, knowledge, competence, and developmental. Neither AOA status, nor SPC referral status was significantly associated with the trust measure, overall, but positive trust decisions were significantly higher among those elected to AOA than in those who were not. Positive trust decisions were significantly associated with AOA status but negative trust decisions were not significantly associated with referral to the SPC. This study offers insights into what attributes may underpin trust decisions by PDs. Our findings suggest that PDs' frequent use of personal and interpersonal characteristics to justify trust decisions contrasts with the use of clinical and knowledge based assessments during undergraduate medical education (UME), and emphasize the importance of critical intrinsic abilities.

Implementation of Entrustable Professional Activities into a General Surgery Residency

Concerns over resident ability to practice effectively after graduation have led to the competency-based medical education movement. Entrustable professional activities (EPAs) may facilitate competency-based medical education in surgery, but implementation is challenging. This manuscript describes 1 strategy used to implement EPAs into an academic general surgery residency. A mobile application was developed incorporating 5 EPAs developed by the American Board of Surgery; residents and faculty from the Departments of Surgery, Emergency Medicine, and Hospital Medicine at a single tertiary care center were trained in its use. Entrustment levels and free text feedback were collected. Self-assessment was paired with supervisor assessment, and faculty assessments were used to inform clinical competency committee entrustment decisions. Feedback was regularly solicited from app users and results distributed on a monthly basis. One thousand seven hundred and twenty microassessments were collected over the first 16 months of implementation; 898 (47.8%) were performed by faculty with 569 (66.0%) matched pairs. Engagement was skewed with small numbers of high performers in both resident and faculty groups. Continued development of resident and faculty was required to sustain engagement with the program. Nonsurgical specialties contributed significantly to resident assessments (496, 28.8%). EPAs are being successfully integrated into the assessment framework at our institution. EPA implementation in surgery residency is a long-term process that requires investment, but may address limitations in the current assessment framework.

Developing an Entrustment Process: Insights from the AAMC CoreEPA Pilot.

One of the main goals of the CoreEPA pilot has been to determine the feasibility of developing a process to make summative entrustment decisions regarding entrustable professional activities (EPAs). Five years into the pilot, we report results of a research study we conducted to explore approaches to the entrustment process undertaken by our ten participating schools. We sought to identify the choices that participating schools made regarding the entrustment process and why these decisions were made. We are sharing these results, highlighting ongoing challenges that were identified with the intent of helping other medical schools that are moving toward EPA-based assessment. We conducted semi-structured interviews with representatives of all 10 medical schools in the CoreEPA pilot to understand their choices in designing the entrustment process. Additional information was obtained through follow-up communication to ensure completeness and accuracy of the findings. Several common themes are described. Our results indicate that, while approaches to the entrustment process vary considerably, all schools demonstrated consistent adherence to the guiding principles of the pilot. Several common barriers to the entrustment process emerged, and there was a consensus that more experience is needed with the process before consequential entrustment decisions can be made. The CoreEPA pilot schools continue to address challenges identified in implementing entrustment processes and making entrustment decisions for our students graduating in the Class of 2020.

Understanding Entrustment Decision-Making by Surgical Program Directors

BackgroundThe process of entrustment—placing trust in a trainee to independently execute a task—has been proposed as a complementary metric to assess competence. However, entrustment decision-making by trainee supervisors is not well understood in surgical training. We aim to explore processes underlying entrustment decision-making (EDM) by general surgery program directors. Materials and methodsPurposive sampling was used to recruit 20 program directors from Accreditation Council for Graduate Medical Education–accredited general surgery training programs to participate in a one-hour semistructured interview. We analyzed interviews using an iterative and inductive approach to identify novel themes associated with the process of trainee entrustment. ResultsQualitative analysis identified that program directors rely on a network of faculty to make entrustment decisions regarding trainees. Perceived trainee competence to perform independent clinical tasks varies significantly in and out of the operating room (OR), with a strong emphasis on entrustment for technical competencies to the exclusion of cognitive competencies. In the OR, entrustment is informed by an attending's reflexive trust and physical presence, trainee labels, and presumed discernment. Outside of the OR, trainee labels, presumed discernment, and transference of competence were identified as critical themes. ConclusionsModifiable components of entrustment are equally dependent on trainee and faculty behavior. Entrustment is more heavily informed by trainee performance in the OR, despite program directors uniformly stating that judgment outside of the OR is the most critical component of resident training. The inclusion of EDM to evaluate trainee progression should be considered as an important adjunct to established Accreditation Council for Graduate Medical Education milestones.

The viability of interprofessional entrustable professional activities.

Interprofessional education (IPE) and entrustable professional activities (EPAs) represent two topics in health professions education that have attracted significant attention in recent years. IPE (when different health professionals learn with, from and about each other with the aim of optimal care) has an inherent focus on the collective. EPAs (units of professional practice that can be fully entrusted to a trainee, once he or she has demonstrated the necessary competence to execute this activity unsupervised) have a focus on the individual. Attempts to relate the two may cause friction and the question is: can they be reconciled? Are interprofessional EPAs or team-EPAs useful concepts and if so what should they look like? The authors argue that most work in modern healthcare involves interprofessional collaboration. Some EPAs have an inherent strong interprofessional nature, such as emergency teamwork, running multidisciplinary team meetings, and surgery. Other EPAs are less inherently dependent on interprofessional collaboration. The authors conclude that neither interprofessional team-EPAs (for which a team can or should be certified), nor IP-EPAs for individuals, as opposed to other EPAs, are viable concepts. However, the authorsdo not question that certifying health care professionals and entrusting trainees with most clinical tasks will require to ascertain their competence in interprofessional collaboration. This must be included when assessing learners for most EPAs and making entrustment decisions. This can help to strengthen interprofessional competence in the clinical workplace.

Emergency Medicine Oral Case Presentations: Evaluation of a Novel Curriculum.

Oral case presentation (OCP) is recognized as a central educational and patient care activity, yet has not been well studied in the emergency medicine (EM) setting. The purpose of this study was to evaluate the effect of a novel curriculum on medical students' EM-OCP skills. An EM-OCP assessment tool and novel blended curriculum were developed based on results from a Canadian survey of emergency physicians and focus groups with key stakeholders. We conducted a randomized controlled trial of 96 clerkship students between 2017 and 2018. Students were randomly assigned into an intervention group where they completed a novel EM-OCP curriculum or a control group without the curriculum. A pretest baseline assessment of students' OCP skills was performed using a standardized patient case at the beginning of their EM rotation. Similarly, all students completed a posttest assessment with a different standardized patient case at the end of their 6-week EM rotation. Audio recordings of pre- and posttests were assessed using the EM-OCP assessment tool by two blinded assessors. Using the Kruskal-Wallis test, all students demonstrated improvement in EM-OCP skills between their pretest and posttest; however, those who received the curriculum (intervention group) showed significantly greater improvement in "synthesis of information," "management," and "overall entrustment decision" scores. Implementation of a novel EM-OCP curriculum resulted in improved clinical reasoning and higher entrustment scores. This curriculum could improve OCP performance not only in EM settings but also across specialties where medical students and residents manage critically ill patients.

Development and inclusion of an entrustable professional activity (EPA) scale in a simulation-based medicine dispensing assessment

Background and purposeEffective, safe, and patient-centred dispensing is a core task of community pharmacists. Entrustable professional activities (EPAs) offer a way of defining and assessing these daily practice activities. Although EPAs have become popular within competency-based medical education programs, their use is new to pharmacy education and assessment. Educational activity and settingA simulation-based assessment framework containing a scale of entrustment was developed to evaluate the readiness of Year 4 undergraduate pharmacy students to safely manage the supply of prescribed medicine(s) in a community pharmacy. The assessment framework was piloted in a fourth year “Transition to Practice” course with 28 simulation-based assessments conducted. FindingsAn entrustment framework was developed and implemented successfully with Year 4 undergraduate pharmacy students. The EPA for medicine dispensing integrates competency domains that include information gathering, providing patient-centred care, clinical reasoning, medicine dispensing, and professional communications. On a scale ranging from level 1 to level 5, the majority (73%) of entrustment ratings were level 2 or level 3; and of the students who achieved different ratings between clinical scenarios, 75% of students improved on their second simulation attempt. There was a strong correlation between the global EPA ratings with the total score achieved across the domains. SummaryUsing simulation-based assessment, entrustment decision making can be incorporated in “entry to profession” undergraduate and postgraduate pharmacy courses to assess students' readiness to transition between learning and professional practice.

Design of an entrustable professional activity for adult extracorporeal membrane oxygenation

BackgroundExtracorporeal membrane oxygenation supports severe cardiac or pulmonary failure. There are currently no competency-based standards for extracorporeal membrane oxygenation training. MethodsExtracorporeal membrane oxygenation experts were interviewed using a structured interview. Responses were audio recorded, transcribed, and validated by respondents. Interviews were coded using grounded theory with a constant comparison method. Themes were developed and used to construct the entrustable professional activity, which was reviewed by the extracorporeal membrane oxygenation experts. ResultsNine experts were interviewed; all had experience with trainees. Interview themes identified include patient selection, circuit and medical management, multidisciplinary communication, problem-based learning and simulation, and entrustment decisions. Essential functions of the entrustable professional activity were patient selection, circuit management, cannula selection, responding to circuit emergencies/complications, anticoagulation management, weaning, and family/team communication. ConclusionsEssential functions of an extracorporeal membrane oxygenation entrustable professional activity were defined using data from structured interviews. The resultant entrustable professional activity could be implemented by critical-care programs as a scaffolding for competency-based fellow training.

Entrustable professional activities (EPAs) for postgraduate competency based intensive care medicine training in the Netherlands: The next step towards excellence in intensive care medicine training

IntroductionThe Competency Based Training in Intensive Care Education (CoBaTrICE) programme developed common standards of ICM training by describing competencies of an intensivist. Entrustable Professional Activities (EPAs) of Intensive Care Medicine (ICM) (EPAsICM) are presented as a new workplace-based assessment tool in competency-based training of intensivists. EPAs are activities to be entrusted to a trainee once he (or she) has attained competence. EPAs emphasise the role of trust between trainees and supervisors. EPAs bridge the gap between competencies and competence. MethodsAn expert panel of ICM (vice)programme directors and intensivists in The Netherlands integrated the CoBaTrICE and CanMEDS competencies into EPAsICM. Comment and feedback was sought from other ICM programme directors and educational experts and processed in the final version of EPAsICM before implementation in the Dutch ICM training programme. ResultsA list of 15 EPAsICM are considered to reflect the spectrum of clinical practice while incorporating the competencies of CoBaTrICE and CanMEDS. The grading system is designed as a 5-point entrustment scale based on the amount of supervision a trainee needs, aligning with daily judgement of trainees by intensivists. ConclusionEPAsICM is an assessment tool that formalises entrustment decisions and can be a valuable addition in international ICM training.

Mitigating “Educational Groundhog Day” – The Role of Learner Handoffs Within Clinical Rotations: A Survey of Pediatric Educational Leaders

BackgroundMedical students decry frequent changes in faculty supervision, leading to the experience of “educational groundhog day.” The discontinuity in supervision, cursory relationships, and uncoordinated feedback impede students’ skill acquisition and delay entrustment decisions. Whereas patient handoff bundles are common, little is known about similarly structured approaches to learner handoffs (LHs). ObjectiveTo describe current LH procedures and practices within pediatric clerkships and subinternships and to gauge interest in a future LH bundle. MethodsNine items included in the 2016 Council on Medical Student Education in Pediatrics annual member survey were analyzed using mixed-methods. ResultsThe response rates were 66% (101 of 152) and 40% (165 of 411) for institutions and individuals, respectively. After limiting data to complete responses to programs with traditional block rotations, 54% of individual respondents (76 of 141) identified as inpatient faculty and about a quarter endorsed providing LHs. Inpatient faculty most commonly supervise medical students for 5 to 7 days. Most endorsed needing 1 to 3 days to determine a student's baseline performance and 5 days or more to make entrustment decisions. Three-quarters of inpatient faculty endorsed interest in LHs, while fewer than 16% of course directors currently provide LH expectations. Four themes emerged: instrument features, stakeholder buy-in, impact, and utility. ConclusionsTypical inpatient faculty service days approximate the time required for making entrustment decisions about clinical students. While most inpatient faculty desire a LH bundle for use within a clinical rotation, few institutions and faculty currently use LHs. LHs could accelerate entrustment decisions by allowing coordinated feedback that might hasten learner clinical-skill development.

Workplace-Based Assessments Using Pediatric Critical Care Entrustable Professional Activities.

Workplace-based assessment (WBA) is critical to graduating competent physicians. Developing assessment tools that combine the needs of faculty, trainees, and governing bodies is challenging but imperative. Entrustable professional activities (EPAs) are emerging as a clinically oriented framework for trainee assessment. We sought to develop an EPA-based WBA tool for pediatric critical care medicine (PCCM) fellows. The goals of the tool were to promote learning through benchmarking and tracking entrustment. A single PCCM EPA was iteratively subdivided into observable practice activities (OPAs) based on national and local data. Using a mixed-methods approach following van der Vleuten's conceptual model for assessment tool utility and Messick's unified validity framework, we sought validity evidence for acceptability, content, internal structure, relation to other variables, response process, and consequences. Evidence was gathered after 1 year of use. Items for assessment were based on correlation between the number of times each item was assessed and the frequency professional activity occurred. Phi-coefficient reliability was 0.65. Narrative comments demonstrated all factors influencing trust, identified by current literature, were cited when determining level of entrustment granted. Mean entrustment levels increased significantly between fellow training years (P = .001). Compliance for once- and twice-weekly tool completion was 50% and 100%, respectively. Average time spent completing the assessment was less than 5 minutes. Using an EPA-OPA framework, we demonstrated utility and validity evidence supporting the tool's outcomes. In addition, narrative comments about entrustment decisions provide important insights for the training program to improve individual fellow advancement toward autonomy.

58. ASSESSMENT THAT MATTERS FOR PATIENTS: POSITIVE ASSOCIATION BETWEEN ENTRUSTMENT DECISIONS AND QUALITY CARE MEASURES FOR RESIDENTS CARING FOR PATIENTS WITH ASTHMA

Background Recent focus has been placed on the entrustment construct for assessing residents; specifically, how much supervision is needed to provide safe care. This method of assessment puts the patient at its core. However, whether entrustment decisions are related to quality care is not known. Objective Determine the association between entrustment decisions made about pediatric residents in the pediatric emergency department (PED) caring for patients presenting with acute asthma exacerbations and resident quality measures for those patient encounters. Methods During the 2016-2017 academic year, we obtained the following for encounters of patients presenting with asthma exacerbation to the Cincinnati Children's PED: 1) 6 question resident entrustment score based on Chen's supervision scale and Kennedy's trustworthiness construct (6 item total score: 0-6), and 2) resident quality measure score (proportion of 21 quality measures achieved). Supervising faculty and fellows completed the entrustment questions for each encounter. Quality measures were developed through expert consensus to meet two criteria (importance to asthma care and likelihood the resident, and not another team member, completes the measure) and were manually extracted from the electronic medical record. To account for nested data within residents, association of entrustment with quality was evaluated using mixed models adjusting for patient acuity and complexity. Results 59 residents provided care for 110 unique patients. Table 1 summarizes measurement descriptive statistics. Entrustment scores exhibited a significant positive linear relationship with quality scores (p-value = 0.04), with entrustment scores increasing by 0.16 (95% CI: 0.01, 0.31) for every 0.10 increase in quality. Conclusion This study demonstrates a statistically significant association between resident performance assessments and quality of care for the patients treated by those residents. This offers initial validity evidence for the use of entrustment decisions as well as quality measures as resident performance assessment frameworks.

A National Process to Enhance the Validity of Entrustment Decisions for Dutch Pediatric Residents.

Postgraduate medical education (PGME) has become increasingly individualized, and entrustable professional activities (EPAs) have been adopted to operationalize this. At the same time, the process and content to determine residents' progress using high-stakes summative entrustment decisions by clinical competency committees (CCCs) is not yet well established. We evaluated the experiences with a structured process for assessment of EPAs to attain uniform summative entrustment decisions for a national sample of pediatric residents. An EPA-based national PGME program for pediatric residents was introduced in the Netherlands, including a process of uniform summative entrustment decisions, termed the Evaluation and Assessment of Residents by Supervisors (EARS) procedure. To evaluate the program, we assessed survey data and information from invitational conferences. Beginning in January 2017, 125 pediatric residents in all 8 Dutch residency regions started training in the EARS program. The program enabled robust summative entrustment decisions. Preliminary data suggested that faculty, despite increased preparation time, appreciated the comprehensive appraisal of resident qualifications. The EPA-based program was well accepted by residents. Fifty-one percent (57 of 112) had at least 2 EARS procedures per year, and for 75% (84 of 112) the level of supervision was often or always adjusted to their level of training. A national EPA-based program provided a structured process for summative entrustment decisions by CCCs and enabled individualized stepwise progression of residents toward unsupervised practice. Broader application of these concepts may require adaptations to accommodate different health care systems and specialties.

Design of an Entrustable Professional Activity for Adult Extracorporeal Membrane Oxygenation

Background: Extracorporeal membrane oxygenation (ECMO) supports severe cardiac or pulmonary failure. There are currently no competency-based standards for ECMO training. Methods: ECMO experts were interviewed using a structured interview. Responses were audio recorded,transcribed, and validated by respondents. Interviews were coded using grounded theory with a constant comparison method. Themes were developed and used to construct the entrustable professional activity (EPA), which was reviewed by the ECMO-experts. Results: Nine experts were interviewed; all had experience with trainees. Interview themes identified include: patient selection; circuit and medical management; multidisciplinary communication; problem based learning and simulation; and entrustment decisions. Essential functions of the EPA were: patient selection; circuit management; cannula selection; responding to circuit emergencies/complications; anticoagulation management; weaning; and family/team communication. Conclusions: Essential functions of an ECMO EPA were defined using data from structured interviews.The resultant EPA could be implemented by critical-care programs as a scaffolding for competency based fellow training.