Emergency Medicine Residency Training Research Articles

Sued, Subpoenaed or Sworn in: Use of a Flipped-Classroom Style Medicolegal Workshop for Emergency Medicine Residents

Background: It is an unfortunate truth that Emergency Medicine (EM) physicians will, at some point, have contact with the medicolegal system. However, most EM residency training programs lack education on the legal system in their curriculum, leaving EM physicians unprepared for litigation. To fill this gap, we designed a high-yield and succinct medical legal workshop highlighting legal issues commonly encountered by EM physicians. We aimed to determine the effectiveness of this curriculum by measuring pre and post knowledge questions. Methods: A two-hour session included a case-based discussion of common misconceptions held by physicians about the legal system, proper steps when interacting with the legal system and review of legal documents. This session was developed with the involvement of our hospital legal counsel and discussed real encounters. The effectiveness of the session was determined using pre- and post-session surveys assessing participant knowledge and comfort approaching the scenarios. Results: A total of 34 EM residents had the opportunity to complete this workshop as a part of their conference curriculum. A total of 26 participants completed the pre-survey and 19 participants completed the post-survey. No participants had previous training in the legal aspects of medicine, including handling a subpoena, serving as a witness, or giving a deposition. The pre-survey demonstrated that there was significant uncertainty surrounding the processes, definitions, and the legal system interaction. Many participants stated they would not know what to do if they received a subpoena (85.71%), were called as a witness in a trial (96.43%) or receive correspondence from a lawyer (96.43%). The post survey revealed an increased knowledge base and confidence following the session. 100% of residents reported knowing what to do after receiving a subpoena, being called as a witness and understanding the process involved in giving a deposition. All residents reported that the session was beneficial and provided crucial information. Conclusion: EM residents have limited baseline understanding of how to approach common legal scenarios. Educational materials available for this curriculum topic are limited. Based on the rapid knowledge increase observed in our residents, we believe our workshop could be adapted for use at other residency programs.

Current gaps in emergency medicine core content education for oncologic emergencies: A targeted needs assessment.

The core content of emergency medicine (EM) residency training includes the management of oncologic emergencies; however, documented knowledge gaps continue to exist in this subtopic. This study represents a targeted needs assessment as indicated by Step 2 of Kern's curriculum design to determine the specific training gaps to be addressed within the oncologic EM curriculum. A multi-institutional cross-sectional survey of oncologists (surgical and medical) and emergency physicians (attendings and residents) was conducted during 2023 at five institutions. The voluntary survey consisted of general and specialty-specific questions exploring gaps in oncologic emergency-specific training/education topics. Descriptive statistics reported responses as frequencies and percentages. Of the 833 surveys sent across the five sites, 302 (36.3%) were accessed by link; of these, 271 (89.7%) surveys were completed. There were no differences in the responses between early and later respondents and no differences in the characteristics of respondents between sites. A vast majority of the oncologist and EM groups (91.2% and 83.0%, respectively) reported a belief that emergency physicians would benefit from additional oncologic emergency training. Our survey identified 16 important topics for inclusion in an oncologic EM curriculum, including five topics not present on the 2022 Model of Clinical Practice of Emergency Medicine. Based on this needs assessment, an oncologic EM curriculum should include the topics listed under oncologic emergencies in the 2022 Model of the Clinical Practice of Emergency Medicine along with our respondent-identified topics of radiation therapy adverse effects, stem cell transplant complications, and the management of cancer-specific postsurgical complications, pain, and common diseases in patients with cancer.

Educational concepts: A longitudinal interleaved curriculum for emergency medicine residency training.

Traditionally, emergency medicine (EM) residency programs teach non-adult emergency department activities (such as pediatric EM, point-of-care ultrasound [PoCUS], emergency medical services, and others) in a block format. In this way, a resident may have a 1-month pediatric EM rotation and then not have any further pediatric EM exposure until their next pediatric rotation 6‒9 months later. Furthermore, some rotations are only allotted for 1-month during the entire residency. A first-year EM resident may have their only formal PoCUS rotation early in the first year of training when their overall skills are developing, and their level of understanding and retention of information may not be optimal at that juncture of their residency training. This is far from ideal from an educational perspective. Learning scientists have now suggested that a longitudinal interleaved curriculum has substantial advantages over the traditional block format. This curriculum allows for a "spaced retrieval" practice that enhances retention of material and develops thinking processes that are important in clinical practice. The increased continuity of clinical experience has been shown to improve educational outcome and learner satisfaction. We developed a novel longitudinal interleaved curriculum for our EM resident trainees. This curriculum encompasses the entire 3 years of residency training and has the goals of increasing EM knowledge and clinical skills and being excellent preparation for board certification examinations. This concept has clear educational benefits. While adapting an existing medical training program would be challenging, a longitudinal curriculum could be phased in to replace a traditional EM curriculum.

Comparing Leadership Skills of Senior Emergency Medicine Residents in 3-Year Versus 4-Year Programs During Simulated Pediatric Resuscitation: A Pilot Study.

The majority of pediatric patients in the United States (US) are evaluated and treated at general emergency departments. It is possible that discrepancies in length of emergency medicine (EM) residency training may allow for variable exposure to pediatric patients, critical resuscitations, and didactic events. The goal of this pilot study was to compare leadership skills of graduating EM residents from 3- to 4-year programs during simulated pediatric resuscitations using a previously validated leadership assessment tool, the Concise Assessment of Leader Management (CALM). This was a prospective, multicenter, simulation-based cohort pilot study that included graduating 3rd- and 4th-year EM resident physicians from 6 EM residency programs. We measured leadership performance across 3 simulated pediatric resuscitations (sepsis, seizure, cardiac arrest) using the CALM tool and compared leadership scores between the 3rd- and 4th-year resident cohorts. We also correlated leadership to self-efficacy scores. Data was analyzed for 47 participating residents (24 3rd-year residents and 23 4th-year residents). Out of a total possible CALM score of 66, residents from 3-year programs scored 45.2 [SD ± 5.2], 46.8 [SD ± 5.0], and 46.6 [SD ± 4.7], whereas residents from 4-year programs scored 45.5 [SD ± 5.2], 46.4 [SD ± 5.0], and 48.2 [SD ± 4.3] during the sepsis, seizure, and cardiac arrest cases, respectively. The mean leadership score across all 3 cases for the 3-year cohort was 46.2 [SD ± 4.8] versus 46.7 [SD ± 4.5] (P = 0.715) for the 4-year cohort. These data show feasibility for a larger cohort project and, while not statistically significant, suggest no difference in leadership skills between 3rd- and 4th-year EM residents in our study cohort. This pilot study provides the basis of future work that will assess a larger multicenter cohort with the hope to obtain a more generalizable dataset.

Development, implementation and evaluation of a novel quality improvement and patient safety curriculum in an emergency medicine residency training program.

Proficiency in Quality Improvement and Patient Safety (QIPS) methodologies has been identified as a standard of residency training. However, there is no consensus on how to achieve these competencies. We used Kern's model of curricular development to create a QIPS curriculum for the local Emergency Medicine (EM) residency training program. The curriculum was designed following best practice recommendations for QIPS education and took the form of a 10-h educational experience including two in-person live sessions. The curriculum was delivered to a mix of local transition to practice residents and faculty members. Participants reported favorable outcomes and objectively demonstrated QIPS knowledge acquisition. This curriculum serves as a model that could be adapted by other residency training programs seeking to implement their own QIPS curricula.

Immersive distance simulation: Exploring the educational impact of stereoscopic extended reality (XR) video in remote learning environments

What was the educational challenge? There is a growing need for healthcare simulation options when local expertise or resources are not available. To connect instructors with remote learners, current options for distance simulation are typically limited to videoconferencing on desktop computers or mobile devices, which may not fully capture the complexity of clinical scenarios. What was the solution? Extended reality (XR) technology may provide a more immersive and realistic distance healthcare simulation experience compared to traditional videoconferencing options. Unlike computer- or phone-based video calls, stereoscopic video in XR provides a sense of depth that may increase spatial understanding and engagement in distance simulation. How was the solution implemented? We investigated the impact of XR for synchronous distance simulation compared to traditional desktop-based videoconferencing in Emergency Medicine (EM) resident training for an obstetrical emergency. A randomized controlled experiment was conducted with half of the residents using XR and half using computers to participate in the simulation. What lessons were learned that are relevant to a wider global audience? There was an unanticipated interaction between postgraduate year and condition such that performance in the XR condition was superior for first year residents, while this was reversed for more experienced residents. This indicates that the benefits of XR might be dependent on participant characteristics, such as learner level. What are the next steps? We plan to extend this research to clarify characteristics of learners and tasks that are important determinants of differences in outcomes between stereoscopic XR versus traditional videoconference displays.

Applying simulation learning theory to identify instructional strategies for Generation Z emergency medicine residency education

AbstractIntroductionGeneration Z learners are entering emergency medicine (EM) residency training, bringing unique learning preferences that influence their engagement with residency education. To optimally teach and motivate this incoming generation of learners, EM educators must understand and adapt to the changing instructional landscape.MethodologyThe Simulation Leaders Advancing the Next Generation in Emergency Medicine (SLANG‐EM) Workgroup was created to identify effective educational strategies for Generation Z learners entering EM. Members were faculty in the Society for Academic Emergency Medicine (SAEM) Simulation Academy, well versed in learning theory supporting simulation‐based education (SBE) and actively involved in EM residency education.Unique treatment/analysisThrough primary and secondary literature searches, the SLANG‐EM Workgroup identified four distinctive learning preferences of Generation Z learners: (1) individualized and self‐paced learning, (2) engaging and visual learning environments, (3) immediate and actionable feedback, and (4) combined personal and academic support. Workgroup members evaluated these learning preferences using a novel conceptual framework informed by the theoretical principles underpinning SBE, recommending instructional strategies for Generation Z EM residency learners across multiple educational environments.Implications for educatorsInstructional strategies were described for the didactic, simulation, and clinical learning environments. In the didactic environment, identified instructional strategies included meaningful asynchronous education, interactive small‐group learning, and improved multimedia design. In the simulation environment, educational innovations particularly suitable for Generation Z learners included learner‐centered debriefing, rapid‐cycle deliberate practice, and virtual simulation. In the clinical environment, described instructional strategies involved setting learner‐centered goals and delivering facilitative feedback in the context of an educational alliance. Overall, these instructional strategies were clustered around themes of student‐centered education and the educator as facilitator, which align well with Generation Z learning preferences. These findings were synthesized and presented as an advanced workshop, “Delivering Effective Education to the Next Generation,” at the 2023 SAEM Annual Meeting.

The state of emergency medicine in Greece: at critical momentum

Greece is a parliamentary republic in southeastern Europe populated by over 10 million permanent residents: 9 million reside on the mainland, with almost 4 million in the greater Athens area. The remaining 1 million populate the over 1200 Greek islands. In addition, more than 160,000 asylum-seekers reached Greece in 2022, and more than 25 million tourists have visited Greece in the last two years. Modern Greek Emergency Medicine (EM) is now in its 4th decade. The Greek government has focused the last few years on enhancing the quality of emergency services provided in public hospitals. Emergency Departments (EDs) are being modernized, undergraduate medical education gradually incorporates EM, and a specialty training program in emergency nursing has been established. However, the late recognition of the critical importance of EM as a specialty in Greece has resulted in the subsequent need to create three alternative pathways to EM, none of which are direct from residency. The first is a 24-month Emergency Medicine fellowship after completing a residency in another specialty and then passing the national exam. The second is for physicians who have worked in a public hospital ED (Gr: Ethniko Systima Ygeias (ESY) ESY for at least three years and successfully passed the national exam. The third, which no longer exists, is a ‘grandfather’ pathway for those physicians who worked in an ESY ED for five years prior to the creation of the fellowship training program. As a result, there is a critical shortage of EM-trained physicians, resulting in most care being provided by physicians without formal training in EM. This is further confounded by the country’s challenging geography, with frequent air transfers from the islands to mainland hospitals. Creating an EM Residency training program is a critical next step to overcoming many of the challenges facing EM provision in Greece today: it would address the shortage of EM-trained providers, decrease the need for costly ground and air transfers, and improve the quality of emergency care throughout Greece.

Modification of an Airway Training Mannequin to Teach Engagement of the Hyoepiglottic Ligament.

This airway trainer modification is designed to instruct all levels of training in emergency medicine in order to familiarize trainees with airway anatomy and obtain superior views of the glottic inlet. During intubation with a standard geometry laryngoscope, such as the Macintosh blade, placement of the distal end of the blade within the vallecula and engagement of the median glossoepiglottic fold, also referred to as the midline vallecular fold (MVF), has long been championed by experts in airway management for its ability to improve glottic inlet visualization. This notion was further supported by the recent publication of a retrospective video review by Driver et al.1 Unfortunately, airway anatomy, including engagement of the MVF, does not receive the emphasis it deserves during intubation training of emergency medicine residents. Emergency physicians often have limited time to perform complete airway examinations, but a sound recognition and appreciation of the laryngeal inlet can serve as a roadmap to optimal laryngoscopy.2Recent advancements in airway education emphasize visualization of airway anatomy with review of video laryngoscopy (VL) recordings to identify routine VL errors in vallecula manipulation, such as failure to engage the MVF. 3 Simulation can continue to play an essential role in enhancing trainees' airway skills. Current airway trainers lack functional fidelity components, such an engageable MVF, resulting in a missed opportunity to teach airway skills and anatomy in a safe and controlled setting.4, 5 To address these concerns, we modified an existing airway task trainer with the addition of a simulated MVF to expose trainees to airway anatomy and adequate MVF engagement resulting in epiglottic elevation. By the end of this education session, participants should be able to:Identify relevant airway anatomy during intubation, including base of the tongue, epiglottis, midline vallecular fold, anterior arytenoids.Appreciate the value of a stepwise anatomically guided approach to intubation.Become familiar with the midline vallecular fold and underlying anatomy, including the hyoepiglottic ligament, and how proper placement of the laryngoscope can result in improved glottic visualization. The TrueCorp AirSim airway task trainer was modified with the addition of a simulated MVF. Prior to the modification described here, there were no dynamic trainers with the functional fidelity needed to teach trainees how to engage the MVF with proper placement of the distal tip of the laryngoscope. Once the trainer was created, learners are introduced to relevant anatomy through the initial lecture to unsure baseline knowledge. During the lecture, videos and images are reviewed to demonstrate the importance of an anatomical roadmap to successful intubation. Learners then practiced with the modified task trainer to gain hands-on experience with laryngoscope placement and improved glottic visualization. A short verbal debriefing was performed at the end of the skills session to address any remaining questions. Pre- and post-simulation surveys were completed by attendees of a weekly didactic session, ranging from medical students, PGY 1-4 emergency medicine residents, and emergency medicine attending physicians. Pre- and post-simulation familiarity with airway anatomy and comfortability with MVF engagement was assessed using a 5-point Likert scale. Twenty-six participants ranging from medical students to attending physicians completed a pre- and post-simulation survey. Overall, feedback from leaners was positive. Learners were excited to learn new airway management techniques and requested an expansion of current airway curriculum based on the success of this implementation. This modified task trainer places an emphasis on teaching airway anatomy to trainees with the addition of functional fidelity by adding an engageable element providing the trainee with feedback on successful placement of the laryngoscope. This simple and cost-effective modification can add value to existing airway management curriculums by serving as a visual cue of airway anatomy and instructing trainees on proper placement of the laryngoscope. Our results showed participants experienced increased comfort with airway anatomy recognition and engagement of MVF for difficult intubations. Participants found the trainer effective with the simulated MVF resulting in glottic elevation and recommended this for future simulation. Participants were eager to learn additional airway techniques to improve their laryngoscopy skills, suggesting an area of growth for emergency medicine didactic curriculums. Airway, midline vallecular fold, anatomy, difficult airway, education.

Determination, categorization, and hierarchy of content for a pediatric emergency medicine curriculum designed for emergency medicine residents.

Currently, the Accreditation Council of Graduate Medical Education requires time-based pediatric experiences for emergency medicine (EM) residents in both pediatric emergency medicine (PEM) and critical care settings. The American Board of Emergency Medicine has published the Model of the Clinical Practice of Emergency Medicine, which is a list of content an EM resident should learn. However, this list is large and without prioritization and therefore can be difficult to incorporate into time-limited curricula. The primary objective of this study was to develop comprehensive categorization of PEM content using an EM lens. The second objective was to suggest a prioritization for the EM learner of the enumerated PEM elements. We first assembled a comprehensive list of PEM concepts, diagnoses, and procedures that might be taught to EM residents. We then convened focus groups composed of key stakeholders to help formulate content and concept themes important for EM resident training. Once the themes were identified, we divided the list of PEM topics into appropriate themes and then carried out a second round of focus groups expanded to include more diverse expert input for prioritizing the elements of the comprehensive list within each theme. We prioritized 168 important PEM concepts from previous standards and emerging PEM literature among 10 identified themes: the pediatric normal, the bottom-line boil-it-down approach, common presentations, high-acuity pediatric cases and procedures, differences between children and adults, same between children and adults, red flags, infrequency of caring for a child compared with an adult, keep breadth but promote self-directed depth, and triage and disposition. Based on input from stakeholders in EM resident education, we identified key themes within PEM education and created a framework for the hierarchical categorization of PEM content for within an EM residency.

Better together: A multistakeholder approach to developing specialty-wide entrustable professional activities in emergency medicine.

Entrustable professional activities (EPAs) are a widely used framework for curriculum and assessment, yet the variability in emergency medicine (EM) training programs mandates the development of EPAs that meet the needs of the specialty as a whole. This requires eliciting and incorporating the perspectives of multiple stakeholders (i.e., faculty, residents, and patients) in the development of EPAs. Without a shared understanding of what a resident must be able to do upon graduation, we run the risk of advancing ill-prepared residents that may provide inconsistent care. In an effort to address these challenges, beginning in February 2020, the authors assembled an advisory board of 25 EM faculty to draft and reach consensus on a final list of EPAs that can be used across all training programs within the specialty of EM. Using modified Delphi methodology, the authors came to consensus on an initial list of 22 EPAs. The authors presented these EPAs to faculty supervisors, residents, and patients for refinement. The authors collated and analyzed feedback from focus groups of residents and patients using thematic analysis. The EPAs were subsequently refined based on this feedback. Stakeholders in EM residency training endorsed a final revised list of 22 EPAs. Stakeholder focus groups highlighted two main thematic considerations that helped shape the finalized list of EM EPAs: attention to the meaningful nuances of EPA language and contextualizing the EPAs and viewing them developmentally. To foreground all key stakeholders within the EPA process for EM, the authors chose within the development process to draft; come to consensus; and refine EPAs for EM in collaboration with relevant faculty, patient, and resident stakeholders. Each stakeholder group contributed meaningfully to the content and intended implementation of the EPAs. This process may serve as a model for others in developing stakeholder-responsive EPAs.

Emergency medicine residency pathways for MD/PhD trainees: A national cross-sectional study of physician-scientist training programs.

Combined clinical and research training is common in residency programs outside emergency medicine (EM), and these pathways are particularly valuable for combined MD/PhD graduates planning to pursue a career as a physician-scientist. However, EM departments may not know what resources to provide these trainees during residency to create research-focused, productive, future faculty, and trainees may not know which programs support their goal of becoming a physician-scientist in EM. The objective of this study was to describe research training and resources available to MD/PhD graduates in EM residency training with a focus on dedicated research pathways. This study was a cross-sectional inventory conducted through an electronic survey of EM residency program directors. We sought to identify dedicated MD/PhD research training pathways, with a focus on both resources and training priorities. Descriptive statistics were used to summarize survey responses. We collected 192 survey responses (69.6% response rate). Among respondents, 41 programs (21.4%) offered a research pathway/track, 52 (27.4%) offered a research fellowship, 22 (11.5%) offered both a residency research pathway/track and a research fellowship, and two (1.0%) offered a dedicated EM physician-scientist training pathway. Most programs considered research a priority and were enthusiastic about interviewing applicants planning a research career, but recruitment of physician-scientist applicants was not generally prioritized. Some EM residency programs offer combined clinical and mentored research training for prospective physician-scientists, and nearly all residency programs considered research important. Future work will focus on improving the EM physician-scientist pipeline by optimizing pathways available to trainees during residency and fellowship.

Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance.

The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.

(121) Utilizing ChatGPT for Urology Trainee Simulation of Peyronie’s Disease Counseling

Abstract Introduction Peyronie’s disease is a medical issue with significant psychological overtones. However, trainee exposure to initial counseling and management can be limited and therefore understanding both the disease state and its psychological effects can be difficult to master. Institutions have incorporated simulation-based education to augment resident skills and knowledge in topics such as transgender health and SICU patient management. The gold standard of assessing trainees in simulated clinical interaction has been objective structured clinical examinations (OSCE). However, novel AI-based technologies like ChatGPT offer a promising alternative for resident education and assessment. ChatGPT, developed by OpenAI, utilizes natural language processing technology to provide human-like responses to open-ended questions posed by users. Preliminary reports have already described its use in training emergency medicine residents in delivering bad news. Objective To simulate a realistic clinical scenario utilizing ChatGPT to improve resident and student confidence in Peyronie’s disease evaluation and treatment, and to assess ChatGPT’s ability to deliver actionable feedback to trainees on both knowledge base and patient interaction compared to evaluation by a sexual medicine specialist. Methods ChatGPT Plus was utilized to roleplay the patient in an initial consultation for Peyronie’s disease. A detailed input was composed to establish the rules of the simulation (Figure 1). ChatGPT was prompted to conduct a final assessment of trainee performance with standardized scales in accuracy, comprehensiveness, and empathy (A, C, E). ChatGPT was prompted to use the 2015 AUA Peyronie’s Disease Diagnosis and Treatment Guidelines when formulating its assessment and feedback. Three trainees with different experience levels performed the simulation. At completion, a fellowship-trained sexual medicine specialist separately graded each trainee’s performance using the same scale. Cohen’s kappa was calculated to assess inter-rater reliability. Results Three urology trainees performed the simulation: a 3rd year medical student, a PGY2 resident, and a PGY4 resident. Trainee performance scores are shown in Table 1. Mean ChatGPT ratings were 8.7, 8.0, and 9.0 (A, C, E), while andrologists ratings were 7.0, 4.7, and 6.3 (A, C, E). Progressive improvement was demonstrated as trainee experience increased. ChatGPT generally rated trainees at higher competency levels than andrologists. Cohen’s kappa was calculated to be -0.125, -0.125, and 0.0 (A, C, E), indicating an overall low level of agreement between ChatGPT and andrologists assessment of trainees. Conclusions Our findings demonstrate that ChatGPT has potential to be a successful tool for urology resident and medical student education on Peyronie’s disease counseling. However, there was disagreement in trainee ratings between ChatGPT and the sexual medicine specialist. ChatGPT provided trainees constructive, actionable feedback referencing current guidelines (Figure 2). When given defined parameters for a clinical scenario, ChatGPT can be effective in designing a realistic standardized patient simulation. However, ChatGPT has not appeared to master the competency and accuracy of that expected from a sexual medicine specialist. Tweaking the initial input can allow for testing competency in various alternative clinical vignettes. Further collection of real-world data is needed to better assess ChatGPT’s rating of the learner’s performance, ideally in conjunction with national/international guidelines. Disclosure Any of the authors act as a consultant, employee or shareholder of an industry for: Fellow, Posterity Health, Coloplast, Hims, Genentech.

Using Natural Language Processing to Evaluate the Quality of Supervisor Narrative Comments in Competency-Based Medical Education.

Learner development and promotion rely heavily on narrative assessment comments, but narrative assessment quality is rarely evaluated in medical education. Educators have developed tools such as the Quality of Assessment for Learning (QuAL) tool to evaluate the quality of narrative assessment comments; however, scoring the comments generated in medical education assessment programs is time intensive. The authors developed a natural language processing (NLP) model for applying the QuAL score to narrative supervisor comments. Samples of 2,500 Entrustable Professional Activities assessments were randomly extracted and deidentified from the McMaster (1,250 comments) and Saskatchewan (1,250 comments) emergency medicine (EM) residency training programs during the 2019-2020 academic year. Comments were rated using the QuAL score by 25 EM faculty members and 25 EM residents. The results were used to develop and test an NLP model to predict the overall QuAL score and QuAL subscores. All 50 raters completed the rating exercise. Approximately 50% of the comments had perfect agreement on the QuAL score, with the remaining resolved by the study authors. Creating a meaningful suggestion for improvement was the key differentiator between high- and moderate-quality feedback. The overall QuAL model predicted the exact human-rated score or 1 point above or below it in 87% of instances. Overall model performance was excellent, especially regarding the subtasks on suggestions for improvement and the link between resident performance and improvement suggestions, which achieved 85% and 82% balanced accuracies, respectively. This model could save considerable time for programs that want to rate the quality of supervisor comments, with the potential to automatically score a large volume of comments. This model could be used to provide faculty with real-time feedback or as a tool to quantify and track the quality of assessment comments at faculty, rotation, program, or institution levels.

Integration of Geriatric Education Within the American Board of Emergency Medicine Model.

Emergency medicine (EM) resident training is guided by the American Board of Emergency Medicine Model of the Clinical Practice of Emergency Medicine (EM Model) and the EM Milestones as developed based on the knowledge, skills, and abilities (KSA) list. These are consensus documents developed by a collaborative working group of seven national EM organizations. External experts in geriatric EM also developed competency recommendations for EM residency education in geriatrics, but these are not being taught in many residency programs. Our objective was to evaluate how the geriatric EM competencies integrate/overlap with the EM Model and KSAs to help residency programs include them in their educational curricula. Trained emergency physicians independently mapped the geriatric resident competencies onto the 2019 EM Model items and the 2021 KSAs using Excel spreadsheets. Discrepancies were resolved by an independent reviewer with experience with the EM Model development and resident education, and the final mapping was reviewed by all team members. The EM Model included 77% (20/26) of the geriatric competencies. The KSAs included most of the geriatric competencies (81%, 21/26). All but one of the geriatric competencies mapped onto either the EM Model or the KSAs. Within the KSAs, most of the geriatric competencies mapped onto necessary level skills (ranked B, C, D, or E) with only five (8%) also mapping onto advanced skills (ranked A). All but one of the geriatric EM competencies mapped to the current EM Model and KSAs. The geriatric competencies correspond to knowledge at all levels of training within the KSAs, from beginner to expert in EM. Educators in EM can use this mapping to integrate the geriatric competencies within their curriculums.

Emergency Medicine Resident Needs Assessment and Preferences for a High-value Care Curriculum.

Consideration of the cost of care and value in healthcare is now a recognized element of physician training. Despite the urgency to educate trainees in high-value care (HVC), educational curricula and evaluation of these training paths remain limited, especially with respect to emergency medicine (EM) residents. We aimed to complete a needs assessment and evaluate curricular preferences for instruction on HVC among EM residents. This was a qualitative, exploratory study using content analysis of two focus groups including a total of eight EM residents from a single Midwestern EM residency training program. Participants also completed a survey questionnaire. There were two themes. Within the overall theme of resident experience with and perception of HVC, we found five sub-themes: 1)understanding of HVC focuses on diagnosis and decision-making; 2)concern about patient costs, including the effects on patients' lives and their ability to engage with recommended outpatient care; 3)conflict between internal beliefs and external expectations, including patients' perceptions of value; 4)approach to HVC changes with increasing clinical experience; and 5)slow-moving, political discussion around HVC. Within the overall theme of desired education and curricular design, we identified four sub-themes: 1)limited prior education on HVC and health economics; 2)motivation to receive training on HVC and health economics; 3)desire for discussion-based format for HVC curriculum; and 4)curriculum targeted to level of training. Respondents indicated greatest acceptability of interactive, discussion-based formats. We conducted a targeted needs assessment for HVC among EM residents. We identified broad interest in the topic and limited self-reported baseline knowledge. Curricular content may benefit from incorporating resident concerns about patient costs and conflict between external expectations and internal beliefs about HVC. Curricular design may benefit from a focus on interactive, discussion-based modalities and tailoring to the learner's level of training.

Fostering Proficiency in Essential Skills among Emergency Medicine Residents through Simulation-Based Education

Introduction: Simulation-based education has become a crucial element within emergency medicine (EM) residency programs. Medical education places great emphasis on competency-based assessments, and high-fidelity simulation has emerged as an effective methodology to support these assessments. Objective: The Accreditation Council for Graduate Medical Education (ACGME) defines a set of core competencies that healthcare professionals must acquire to ensure the delivery of safe and effective patient care. In our study, we sought to investigate the impact of simulation-based education on the enhancement of ACGME core competencies among emergency medicine residents. Method: We conducted a prospective observational study at our institute, involving all current EM residents. Each month, we conducted a high-fidelity immersive simulation session, featuring three separate scenarios for both first year (R1) and second year (R2) residents. From August 2020 to April 2023, a total of 36 simulation sessions were conducted, encompassing 108 scenarios. To assess performance in clinical and non-technical skills, the expert faculty used our custom-designed objective structured assessment tool, the Emergency Medicine Simulation Assessment Tool (EMSAT). This tool evaluated performance across 15 sub-tasks (9 (60%) clinical and 6 (40%) non-technical skills). Each sub-task was mapped to the ACGME core competency; Patient Care (PC), Medical Knowledge (MK), Practice Based Learning (PBL), Systems Based Practice (SBP), Interpersonal and Communication Skills (ICS), and Professionalism (P). The achieved scores for each competency were converted into percentages for analysis. The data was divided into two groups. The first 18 sessions (54 scenarios) formed phase-I, while the last 18 sessions (54 scenarios) constituted phase-II. A two-tailed paired T-test was utilized to compare the two phases. Our primary outcome measure focused on the improvement observed across all six ACGME core competencies. Results: The paired T-test results revealed a significant and substantial difference in all six core competencies between phase-I and phase-II. The mean scores demonstrated a significant improvement between two phases i.e., PC (M=55.1, M=84.4), MK (M=57.2, M=83.6), PBL (M=60.5, M=88.4), SBP (M=62.2, M=89.7), ICS (M=61.8, M=89.7), and P (M=64, M=89.9). Conclusion: The implementation of high-fidelity immersive simulations in the training of emergency medicine residents yielded remarkable advancements across all six ACGME core competencies.

Gaps in pediatric emergency medicine education of emergency medicine residents: A needs assessment of recent graduates.

More than 90% of pediatric patients presenting to emergency departments (EDs) in the United States are evaluated and treated in community-based EDs. Recent evidence suggests that mortality outcomes may be worse for critically ill pediatric patients treated at community EDs. The disparate mortality outcomes may be due to inconsistency in pediatric-specific education provided to emergency medicine (EM) trainees during residency training. There are few studies surveying recently graduated EM physicians assessing perceived gaps in the pediatric emergency medicine (PEM) education they received during residency. This was a prospective, survey-based, descriptive cohort study of EM residency graduates from 10 institutions across the United States who were <5 years out from residency training. Deidentified surveys were distributed via email. A total of 222 responses were obtained from 570 eligible participants (39.1%). Non-ED pediatric rotations during residency training included pediatric intensive care (60%), pediatric anesthesia (32.4%), neonatal intensive care unit (26.1%), and pediatric wards (17.1%). A large percentage (42.8%) of respondents felt uncomfortable managing neonates and performing tube thoracostomy on pediatric patients (56.3%). The EM graduate's satisfaction with pediatric simulation-based training during residency was positively associated with comfort caring for neonates and infants (p < 0.0070 and p < 0.0002) and performing endotracheal intubation (p < 0.0027), lumbar puncture (p < 0.0004), and Pediatric Advanced Life Support resuscitation (p < 0.0001). This survey-based cohort study found considerable variation in pediatric-specific experiences during EM residency training and in perceived comfort managing pediatric patients. In general, participants were more comfortable managing older children. This study suggests that the greatest perceived knowledge gaps in PEM were neonatal medicine/resuscitation and pediatric cardiac arrest. Future research will continue to address larger cohorts, representative of the PEM education provided to EM physicians in the United States to promote future educational initiatives.

Emergency medicine in Nepal: are we going the right way and fast enough?

Nepal is a landlocked country with variable topography including the world’s tallest mountains, tropical forests, and Gangetic plains. This topography leads to diverse healthcare needs, from tropical diseases in plains, to road traffic accidents in hills, and to disaster-related emergencies from floods and landslides during monsoon season and unpredictable earthquakes. Emergency medicine care is underdeveloped and is currently being provided by general practitioners. The capital city Kathmandu has a few tertiary healthcare centers with emergency medicine fellowship-trained general practitioners staffing them, but most of the hospitals outside of Kathmandu are staffed by minimally trained or untrained medical officers. Even though emergency medicine is recognized as a specialty, Nepal still does not have an emergency medicine residency training program. To improve emergency care in the country, the government of Nepal should be focused on facilitating the start of emergency medicine residency in Nepal.Graphical