American Board Of Emergency Medicine Research Articles

Can USMLE and COMLEX-USA Scores Predict At-Risk Emergency Medicine Residents' Performance on In-Training Examinations?

The United States Medical Licensing Examination (USMLE) and Comprehensive Osteopathic Medical Licensing Examination (COMLEX) scores are standard methods used to determine residency candidates' medical knowledge. The authors were interested in using the USMLE and COMLEX part 2 scores in our emergency medicine (EM) residency program to identify at-risk residents who may have difficulty on the in-training exam (ITE) and to determine the cutoff values under which an intern could be given an individualized study plan to ensure medical knowledge competency. The authors abstracted the USMLE and COMLEX part 2 scores and the American Board of Emergency Medicine (ABEM) ITE scores for a cohort of first-year EM residents graduating years 2010-2022, converting raw scores to percentiles, and compared part 2 and ABEM ITE scores with Pearson's correlation, a Bland-Altman analysis of bias and 95% limits of agreement, and ROC analysis to determine optimal the cut-off values for predicting ABEM ITE < 50th percentile and the estimated test characteristics. Scores were available for 152 residents, including 93 USMLE and 88 COMLEX exams. The correlations between part 2 scores and ABEM ITE were r = 0.36 (95%CI: 0.17, 0.52; p < 0.001) for USMLE and r = 0.50 (95%CI: 0.33, 0.64; p < 0.001) for COMLEX. Bias and limits of agreement for both part 2 scores were -14 ±63% for USMLE and 13 ± 50% for COMLEX in predicting the ABEM ITE scores. USMLE < 37th percentile and COMLEX < 53rd percentile identified 42% (N = 39) and 27% (N = 24) of EM residents, respectively, as at risk, with a sensitivity of 61% and 49% and specificity of 71% and 92%, respectively. USMLE and COMLEX part 2 scores have a very limited role in identifying those at risk of low ITE performance, suggesting that other factors should be considered to identify interns in need of medical knowledge remediation.

Determination, categorization, and hierarchy of content for a pediatric emergency medicine curriculum designed for emergency medicine residents.

Currently, the Accreditation Council of Graduate Medical Education requires time-based pediatric experiences for emergency medicine (EM) residents in both pediatric emergency medicine (PEM) and critical care settings. The American Board of Emergency Medicine has published the Model of the Clinical Practice of Emergency Medicine, which is a list of content an EM resident should learn. However, this list is large and without prioritization and therefore can be difficult to incorporate into time-limited curricula. The primary objective of this study was to develop comprehensive categorization of PEM content using an EM lens. The second objective was to suggest a prioritization for the EM learner of the enumerated PEM elements. We first assembled a comprehensive list of PEM concepts, diagnoses, and procedures that might be taught to EM residents. We then convened focus groups composed of key stakeholders to help formulate content and concept themes important for EM resident training. Once the themes were identified, we divided the list of PEM topics into appropriate themes and then carried out a second round of focus groups expanded to include more diverse expert input for prioritizing the elements of the comprehensive list within each theme. We prioritized 168 important PEM concepts from previous standards and emerging PEM literature among 10 identified themes: the pediatric normal, the bottom-line boil-it-down approach, common presentations, high-acuity pediatric cases and procedures, differences between children and adults, same between children and adults, red flags, infrequency of caring for a child compared with an adult, keep breadth but promote self-directed depth, and triage and disposition. Based on input from stakeholders in EM resident education, we identified key themes within PEM education and created a framework for the hierarchical categorization of PEM content for within an EM residency.

Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance.

The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.

Foundations of Emergency Medicine: Impact of a Standardized, Open-access, Core Content Curriculum on In-Training Exam Scores.

Learners frequently benefit from modalities such as small-group, case-based teaching and interactive didactic experiences rather than passive learning methods. These contemporary techniques are features of Foundations of Emergency Medicine (FoEM) curricula, and particularly the Foundations I (F1) course, which targets first-year resident (PGY-1) learners. The American Board of Emergency Medicine administers the in-training exam (ITE) that provides an annual assessment of EM-specific medical knowledge. We sought to assess the effect of F1 implementation on ITE scores. We retrospectively analyzed data from interns at four EM residency programs accredited by the Accreditation Council for Graduate Medical Education. We collected data in 2021. Participating sites were geographically diverse and included three- and four-year training formats. We collected data from interns two years before (control group) and two years after (intervention group) implementation of F1 at each site. Year of F1 implementation ranged from 2015-2018 at participating sites. We abstracted data using a standard form including program, ITE raw score, year of ITE administration, US Medical Licensing Exam Step 1 score, Step 2 Clinical Knowledge (CK) score, and gender. We performed univariable and multivariable linear regression to explore differences between intervention and control groups. We collected data for 180 PGY-1s. Step 1 and Step 2 CK scores were significant predictors of ITE in univariable analyses (both with P < 0.001). After accounting for Step 1 and Step 2 CK scores, we did not find F1 implementation to be a significant predictor of ITE score, P = 0.83. Implementation of F1 curricula did not show significant changes in performance on the ITE after controlling for important variables.

Association between the American Board of Emergency Medicine Oral Certifying Examination and Future State Medical Board Disciplinary Actions.

The American Board of Emergency Medicine (ABEM) requires a written examination (the Qualifying Examination) followed by the Oral Certifying Examination (OCE) to obtain ABEM certification. Maintaining ABEM certification is associated with fewer state medical board (SMB) disciplinary actions. We sought to determine the association between poor initial performance on the OCE and subsequent severe SMB disciplinary action. We included physicians who completed US categorical emergency medicine residencies in 2016 and earlier. We classified OCE performance as good (passed on first attempt) and poor (never passed or required>1 attempt to pass). We obtained data on physician SMB disciplinary actions from the National Practitioner Data Bank that were limited to actions that denied licensure or altered the status of a medical license (eg, suspension). We determined the association between poor OCE performance and subsequent severe SMB disciplinary action. Of 34,871, 93.5% passed the OCE on the first attempt, 6.1% required multiple attempts, and 0.3% never passed. Of the physicians (93.5%) with good OCE performance, 1.0% received a severe SMB action. Among physicians with poor OCE performance, 2.3% received a severe action; and of those who never passed, 1.7% received a severe action (Table 1). Poor OCE performance was associated with an increased odds of severe SMB disciplinary action (OR 2.21, 95% CI: 1.57-3.12). Physicians with poor OCE performance exhibited higher odds of experiencing a subsequent severe SMB disciplinary action. The OCE may have utility as a predictor of future professionalism or clinical performance.

Emergency Medicine Obstetrics and Gynecology: A Case-Based Curriculum for Residents.

Millions of patients present to US emergency departments every year with OB/GYN concerns. Emergency medicine trainees must be adequately prepared to care for this population, regardless of how commonly they appear in the training environment. We used active learning and gamification principles in this curriculum to increase learner engagement and participation in the material. We chose OB/GYN topics based on review of Tintinalli's OB/GYN content and the American Board of Emergency Medicine's Model of Clinical Practice. Each session comprised a case-based lecture and review questions using the game-based Kahoot! online software. Pre- and postcurriculum surveys assessed residents' confidence in caring for emergent OB/GYN pathologies on a 5-point Likert scale. We designed survey questions assessing the first level of Kirkpatrick's levels of training evaluation; these questions were reviewed and revised by the department's Medical Education Scholarship Committee for validity. A mean of 18 residents attended each session. Seventy-six percent of residents (26 of 34) completed the precurriculum survey, 67% (23 of 34) completed the postcurriculum survey, and 44% (15 of 34) completed both. For all respondents, mean reported confidence with curriculum topics increased from 3.5 to 4.0 (p < .05). For residents completing both surveys, confidence increased from 3.4 to 4.0 (p < .01). Application of this curriculum significantly improved learner confidence in targeted OB/GYN topics. Future directions could include evaluating curricular impact at higher levels in the Kirkpatrick model, extending sessions to include more time for interaction, and adding suggested readings.

Attrition From the US Emergency Medicine Workforce During Early Stages of the COVID-19 Pandemic.

Attrition From the US Emergency Medicine Workforce During Early Stages of the COVID-19 Pandemic.

The 2023 Core Content of advanced emergency medicine ultrasonography

AbstractIn February 2023, the American Board of Emergency Medicine (ABEM) approved modifications to the Advanced Emergency Medicine Ultrasonography (AEMUS) Core Content, which defines the areas of knowledge considered essential for the practice of AEMUS. This manuscript serves as a revision of the AEMUS Core Content originally published in 2014. The revision of the Core Content for AEMUS training aims to establish standardized education and qualifications necessary for AEMUS fellowship program leadership, clinical application, administration, quality improvement, and research. The Core Content provides the organizational framework and serves as the basis for the development of content for the Focused Practice Examination (FPE) administered by ABEM. AEMUS fellowship directors may reference the Core Content when designing AEMUS fellowship curricula to help prepare graduates for the autonomous practice of AEMUS and the FPE. In this article, an updated revision of the previously published AEMUS Core Content is detailed, and the entire development of the Core Content is presented.

American Board of Emergency Medicine Report on Residency and Fellowship Training Information (2022-2023).

The American Board of Emergency Medicine gathers extensive background information on the Accreditation Council of Graduate Medical Education-accredited emergency medicine residency and fellowship programs and the residents and fellows training in those programs. We present the 2023 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.

Emergency medicine physician workforce attrition differences by age and gender.

Emergency care workforce concerns have gained national prominence given recent data suggesting higher than previously estimated attrition. With little known regarding characteristics of physicians leaving the workforce, we sought to investigate the age and number of years since residency graduation at which male and female emergency physicians (EPs) exhibited workforce attrition. We performed a repeated cross-sectional analysis of EPs reimbursed by Medicare linked to date of birth and residency graduation date data from the American Board of Emergency Medicine for the years 2013-2020. Stratified by gender, our primary outcomes were the median age and number of years since residency graduation at the time of attrition, defined as the last year during the study time frame that an EP provided clinical services. We constructed a multivariate logistic regression model to examine the association between gender and EP workforce attrition. A total of 25,839 (70.2%) male and 10,954 (29.8%) female EPs were included. During the study years, 5905 male EPs exhibited attrition at a median (interquartile range [IQR]) age of 56.4 (44.5-65.4) years, and 2463 female EPs exhibited attrition at a median (IQR) age of 44.0 (38.0-53.9) years. Female gender (adjusted odds ratio 2.30, 95% confidence interval 1.82-2.91) was significantly associated with attrition from the workforce. Male and female EPs had respective median (IQR) post-residency graduation times in the workforce of 17.5 (9.5-25.5) years and 10.5 (5.5-18.5) years among those who exhibited attrition and one in 13 males and one in 10 females exited clinical practice within 5 years of residency graduation. Female physicians exhibited attrition from the EM workforce at an age approximately 12 years younger than male physicians. These data identify widespread disparities regarding EM workforce attrition that are critical to address to ensure stability, longevity, and diversity in the EP workforce.

Improving Hazardous Material Incident Preparedness for Emergency Medicine Physician Trainees: A Quality Improvement Project

Introduction:Hazardous materials (HazMat) training is not a requirement for accreditation of US Emergency Medicine (EM) residencies, nor for EM board certification by the American Board of Emergency Medicine (ABEM). However, the US Occupational Safety and Health Administration (OSHA) requires hospitals train all personnel expected to deal with contaminated patients. This QI project aimed to develop an EM physician-specific HazMat course and evaluate the physician comfort level with HazMat personal protective equipment (PPE) donning and doffing, triage, procedural skills, and decontamination.Method:A four-hour “HazMat for Docs” course was designed at a large urban academic trauma center and offered to second-year EM residents. Additionally, we performed a quantitative survey of a cohort of 72 current and recently graduated EM residents (classes 2019-2024), some of whom had taken the course in person. Our primary outcome was to measure improvement in comfort level with essential HazMat tasks after completing the course. Our secondary outcome was to evaluate the current or recently graduated EM physician's overall comfort levels with managing a HazMat incident, as well as HazMat skills and knowledge retention.Results:A total of 53 responses (73.6%) were obtained. 45.3% of the respondents were male and 54.7% female. 37.8% of the respondents were recent EM graduates, with 20.8% PGY-4, 13.2% PGY-3, 15.1% PGY-2, 13.2% PGY-1. 16/53 (30.2%) had prior EMS experience. EM Physicians were most comfortable with donning and doffing PPE (4.92 on a 7-point scale) and least comfortable with decontamination procedures (2.98/7). After completing the HazMat course, EM physicians increased their comfort level with HazMat decontamination procedures by 8.6% and with organizing a multi-disciplinary ED HazMat response by 10.5%.Conclusion:EM Physician comfort levels with HazMat procedures are low. Increased training aimed at improving physician knowledge, preparedness, and comfort level for such events is necessary and can be accomplished through a short course.

What to know about 2.0: Revisions to the pediatric emergency medicine milestones.

The Accreditation Council for Graduate Medical Education (ACGME) adopted educational milestones for trainee assessment in 2013, as a key component of the Next Accreditation System. Two years later, the ACGME, American Board of Pediatrics (ABP), and American Board of Emergency Medicine (ABEM) collaborated to create specialty-specific subcompetencies in pediatric emergency medicine (PEM). Since that time, emerging data have demonstrated the need to revise specialty milestones. Consequently, the ACGME summoned a working group to revise the original PEM milestones. The PEM Milestones 2.0 Working Group convened in April 2021, comprising diverse representation from ACGME staff, PEM and EM attendings, PEM fellowship program directors, PEM fellows, and community members, overseen by the ACGME's vice president for milestones development. The group met virtually six times over 3 months, with concurrent independent and subgroup work, to draft the PEM Milestones 2.0 and supplemental guide. The working group's revisions generated concise descriptions of behavioral anchors to define skill acquisition more accurately; attention to the transition from residency to fellowship training; incorporation of harmonized milestones for non-patient care and non-medical knowledge domains; and increased emphasis on diversity, equity, and inclusion. A supplemental guide was also designed to aid programs in designing programmatic assessment related to specialty-specific milestones. The PEM Milestones 2.0 provide an updated, specialty-specific framework to guide the development and assessment of PEM fellows and training programs. Future work may focus on faculty and learner development, advancing validity evidence, strengthening content expertise, and integrating milestones with specialty-specific entrustable professional activities.

Factors associated with emergency physician income.

Income fairness is important, but there are limited data that describe income equity among emergency physicians. Understanding the magnitude of and factors associated with income differences may be helpful in eliminating disparities. This study analyzed the associations of demographic factors, training, practice setting, and board certification with emergency physician income. We distributed a survey to professional members of the American College of Emergency Physicians. The survey included questions on annual income, educational background, practice characteristics, gender, age, race, ethnicity, international medical graduate status, type of medical degree (MD vs DO), completion of a subspecialty fellowship, job characteristics, and board certification. Respondents also reported annual income. We used linear regression to determine the respondent characteristics associated with reported annual income. From 45,961 members we received 3407 responses (7.4%); 2350 contained complete data for regression analysis. The mean reported annual income was $315,306 (95% confidence interval [CI], $310,649 to $319,964). The mean age of the respondents was 47.4 years, 37.4% were women, 3.2% were races underrepresented in medicine (Black, American Indian, or Alaskan Native), and 4.8% were Hispanic or Latino. On linear regression, female gender was associated with lower reported annual income; difference -$43,565, 95% CI, -$52,217 to -$34,913. Physician age, degree (MD vs DO), underrepresented racial minority status, and underrepresented ethnic minority status were not associated with annual income. Fellowship training was associated with lower income; Accreditation Council for Graduate Medical Education (ACGME) program difference -$30,048; 95% CI, -$48,183 to -$11,912, non-ACGME-program difference -$27,640, 95% CI, -$40,970 to -$14,257. Working at a for-profit institution was associated with higher income; difference $12,290, 95% CI, $3693 to $20,888. Board certification was associated with higher income; difference, $43,267, 95% CI, $30,767 to $55,767. This study identified income disparities associated with gender, practice setting, fellowship completion, and American Board of Emergency Medicine or American Osteopathic Board of Emergency Medicine certification.

Early validity and reliability evidence for the American Board of Emergency Medicine Virtual Oral Examination.

The American Board of Emergency Medicine (ABEM) in-person Oral Certification Examination (OCE) was halted abruptly in 2020 due to the COVID-19 pandemic. The OCE was reconfigured to be administered in a virtual environment starting in December 2020. The purpose of this investigation was to determine whether there was sufficient validity and reliability evidence to support the continued use of the ABEM virtual Oral Examination (VOE) for certification decisions. This retrospective, descriptive study used multiple data sources to provide validity evidence and reliability data. Validity evidence focused on test content, response processes, internal structure (e.g., internal consistency and item response theory), and the consequences of testing. A multifaceted Rasch reliability coefficient was used to measure reliability. Study data were from two 2019 in-person OCEs and the first four VOE administrations. There were 2279 physicians who took the 2019 in-person OCE examination and 2153 physicians who took the VOE during the study period. Among the OCE group, 92.0% agreed or strongly agreed that the cases on the examination were cases that an emergency physician should be expected to see; 91.1% of the VOE group agreed or strongly agreed. A similar pattern of responses given to a question about whether the cases on the examination were cases that they had seen. Additional evidence of validity was obtained by the use of the EM Model, the process for case development, the use of think-aloud protocols, and similar test performance patterns (e.g., pass rates). For reliability, the Rasch reliability coefficients for the OCE and the VOE during the study period were all >0.90. There was substantial validity evidence and reliability to support ongoing use of the ABEM VOE to make confident and defensible certification decisions.

A case for lifelong learning in emergency medicine: The perspective from a rural state.

The expansive practice of emergency medicine cannot be fully taught or learned in 3 or 4 years. Lifelong learning, self-assessment,1 and ongoing skill acquisition and retention are necessary. How do we teach and acknowledge this during residency training and how do we support our isolated, rural colleagues? Importantly, there is a growing shortage of rural emergency physicians and many of our trainees may work in these environments.2 As educators, we must study potential solutions and bridge these gaps for our trainees entering independent practice and for our colleagues far removed from formal training. Recent cases, and many like them, illustrate this point. A rural emergency physician expertly places a small-bore chest tube for an atraumatic pneumothorax, the pneumothorax resolved, they requested transfer to a larger center for ongoing management. The tertiary care center is at full capacity. A phone consultation with a specialist recommends removal of the chest tube in the emergency department (ED) and discharge home if a follow up chest x-ray shows sustained resolution. The emergency physician has never removed a chest tube before and the patient is transferred to a larger regional ED for uncomplicated removal. In a second case, a patient is transferred from an hour away, during a snowstorm, for a peritonsillar abscess. The procedure is within an emergency physician's scope of practice. The referring physician had never performed this procedure in their decades of practice. The patient is transferred to the tertiary care center where it is drained by the attending emergency physician and emergency medicine resident. On a winter night, an emergency physician intubates a patient with a head injury in their critical-access emergency department. They request lifesaving medications and the respiratory therapist to set the ventilator. It is nighttime; there is no respiratory therapist or pharmacist. The physician must assist in mixing the medications and setting up the ventilator. The skills required for an emergency physician are ever expanding, particularly as access to tertiary care becomes more difficult. Lifelong learning and practice development to best serve our patients is a necessity in our specialty. Solutions may include regional conferences, collaborative case reviews, real-time peer-based decision support with telemedicine, maintenance of board certification, asynchronous, self-directed learning through free open-access medical education (FOAM), podcasts, textbooks or journal articles, and academic–rural partnerships that create shared faculty positions between rural and tertiary sites and rural rotations for trainees. Each of these has its limitations and time represents a major barrier.3-5 The American Board of Emergency Medicine requires continuous learning for maintenance of certification; this is beneficial but is not tailored to the physician's practice environment.6, 7 Our own work in the rural state of Vermont and upstate New York has led us to offer high-acuity, low occurrence (HALO) courses at the regional academic center twice a year for both residents and practicing emergency physicians within our region and create a rural-specific simulation lab at one of our critical-access sites. Additionally, we established a tele-emergency medicine program to offer a virtual resource from the tertiary care center in times of high-acuity, high-complexity care, or volume surge. The skill of delivering and accepting tele-emergency medicine assistance must also be learned and taught. Our education must continue to adapt to meet the needs of our unique and evolving practice environments. We must also acknowledge that many scenarios cannot be predicted. Instilling the motivation for lifelong learning, self-assessment1 and exposure to resource limited settings during training may help prepare trainees for these challenges. Although these issues are not unique to emergency medicine, we are a specialty that prides itself on adaptability. We must confront this challenge with creative solutions. Skyler Lentz, Ashley Weisman, Jordan Ship, and Matthew S. Siket conceived the idea for this manuscript and contributed substantially to the content, design, writing and editing of the commentary. The authors declare no conflicts of interest.

The impact of fellowship-trained medical toxicology faculty on emergency medicine resident in-training examination scores.

The American Board of Emergency Medicine (ABEM) In Training Exam (ITE) gauges residents' medical knowledge and has been shown to correlate with subsequent performance on the ABEM board qualifying examination. It is common for emergency medicine (EM) residencies to employ subspecialty-trained faculty members with the expectation of improved resident education and subspecialty knowledge. We hypothesized that the presence of subspecialty faculty in toxicology would increase residents' scores on the toxicology portion of the ITE. We assessed ABEM ITE scores at our institution from 2013-2022 and compared these to national data. The exposure of interest was the absence or presence of fellowship-trained toxicology faculty. The primary outcome was performance on the toxicology portion of the ITE, and secondary outcome was overall performance on the exam. Residents who had ≥1 toxicology faculty were 37% (95% CI: 1.01-1.87) more likely to surpass the national average for toxicology scores, and those who had ≥2 toxicology faculty were 77% (95% CI: 1.28-2.44) more likely to surpass the national average for toxicology scores on the ABEM ITE. With the presence of ≥2 toxicology faculty, there was also an increase in toxicology score by years in training, with residents being 63% (95% CI: 1.01-2.64), 68% (95% CI: 1.08-2.61), and 92% (95% CI: 1.01-3.63) more likely to surpass the national average for toxicology score in first, second, and third years of residency, respectively. There was no significant relationship between the presence of toxicology faculty and the overall ABEM ITE scores. The presence of fellowship-trained toxicology faculty positively impacted residents' performance on the toxicology portion of the ABEM ITE but did not significantly impact the overall score. With the presence of ≥2 toxicology faculty we noted an improvement in toxicology scores throughout the 3 years of training, indicating that an individual rotation or educational block is probably less important than spaced repetition through a longitudinal curriculum.

An Evaluation of Emergency Medicine Core Content Covered by Podcasts

Podcasts are used broadly for learning in emergency medicine (EM); however, there is concern about the potential for knowledge gaps for learners who rely on podcasts for their learning. The extent to which EM podcasts cover the core curriculum of EM is not known; thus, we sought to quantify the extent to which podcasts represent the core content of our specialty. We performed a retrospective review of all EM podcast episodes published in 2019. All podcasts were given credit for the content they covered as it related to the 2016 American Board of Emergency Medicine (ABEM) Model of Clinical Practice in Emergency Medicine (EM Model). The primary outcome was a description of how podcasts represented the ABEM EM Model content topics compared to the topic representation of the ABEM Qualifying Exam. We included 54 unique EM podcast programs and 1,193 podcast episodes. They covered 2,965 total EM Model core content topics. The topics most covered were "other" (which includes interpersonal skills and professionalism), procedures, and signs and symptoms. Musculoskeletal, hematology, and environmental each accounted for less than 1% of all topics covered. Almost three-quarters of podcast episodes covered other core competencies of the practice of EM. Podcasts had a broad yet imbalanced coverage of the ABEM EM Model core content subtopics in 2019, with a notable coverage of other core competencies of the practice of EM. Learners, educators, and scholars should be mindful of these gaps and focus future work on exploring how podcasts should best be used in EM education.

Number of Patient Encounters in Emergency Medicine Residency Does Not Correlate with In-Training Exam Domain Scores

Emergency medicine (EM) residents take the American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) every year. This examination is based on the ABEM Model of Clinical Practice (Model). The purpose of this study was to determine whether a relationship exists between the number of patient encounters a resident sees within a specific clinical domain and their ITE performance on questions that are related to that domain. Chief complaint data for each patient encounter was taken from the electronic health record for EM residents graduating in three consecutive years between 2016-2021. We excluded patient encounters without an assigned resident or a listed chief complaint. Chief complaints were then categorized into one of 20 domains based on the 2016 Model. We calculated correlations between the total number of encounters seen by a resident for all clinical years and their ITE performance for the corresponding clinical domain from their third year of training. Available for analysis were a total of 232,625 patient encounters and 69 eligible residents who treated the patients. We found no statistically significant correlations following Bonferroni correction for multiple analyses. There was no correlation between the number of patient encounters a resident has within a clinical domain and their ITE performance on questions corresponding to that domain. This suggests the need for separate but parallel educational missions to achieve success in both the clinical environment and standardized testing.

Emergency medical services Milestones 2.0: What has changed?

Since 2015, development of competencies by emergency medical services (EMS) fellows have been evaluated using the EMS Milestones 1.0 developed by a working group consisting of relevant stakeholders convened by the Accreditation Council for Graduate Medical Education (ACGME). Feedback from users and data collected from the milestones assessments in the interim indicated a need for revision of the original milestones. In May 2021, the Milestones 2.0 working group was convened for the purpose of revising this specialty-specific assessment tool. A working group consisting of representatives from American Board of Emergency Medicine, the Review Committee for Emergency Medicine, and volunteers selected by the ACGME Milestones Committee, chaired by the ACGME vice president for milestones development, was convened using a virtual platform to revise the milestones and develop a supplemental guide for use along with the Milestones 2.0. There were no in-person meetings of this working group due to the COVID-19 pandemic. Data from milestones reporting, discussion within the working group, stakeholder input, and public commentary were used to revise the original milestones. A new supplemental guide to enhance milestone usability and provide recommended resource materials was also developed for use alongside the milestones. The EMS Milestones 2.0 and accompanying supplemental guide provide an updated framework for fellowship programs to use as a guide for developing the competencies necessary for independent practice as EMS physicians and in the formal, competency-based evaluation of trainees as required by the ACGME.

Creation of a novel course for the advanced emergency medicine ultrasound focused practice designation examination.

The American Board of Emergency Medicine recently established a new certification pathway in advanced emergency medicine ultrasound (AEMUS). Eligible applicants come from a wide range of experience but must pass the same examination to become certified. This study sought to evaluate a novel review course targeting a wide range of learners for a new examination. This was a cross-sectional study evaluating the outcomes of the American College of Emergency Physicians (ACEP) AEMUS review course. The program evaluation survey was designed to collect outcomes across multiple Kirkpatrick levels, including overall satisfaction, topic-specific satisfaction, topic-specific coverage, topic-specific confidence before and after the course, topic-specific perceived knowledge before and after the course, and changes in practice. Seventy-four of 79 participants (93.7%) completed the survey. Mean course satisfaction was 4.59/5.00 (95% CI 4.47-4.72). Confidence to pass examination components increased for the following topics: administration, advanced left ventricle (LV), education, head and neck, hepatobiliary, male genitourinary, musculoskeletal, nonobstetric gynecology, pediatrics, physics, procedures, research, right ventricle, and venous/arterial. Perceived knowledge increased for the following topics: administration, advanced LV, education, head and neck, male genitourinary, musculoskeletal, pediatrics, physics, procedures, renal/bladder, research, right ventricle, and venous/arterial. Fifty-three of 74 participants (71.6%) stated they would change their practice based on the course. Examples of changes in practice include increased use of ultrasound for advanced abdominal, musculoskeletal, pediatric, and procedural applications. Future work will determine the impact on longer-term outcomes and focused practice designation (FPD) examination pass rates. The ACEP AEMUS FPD review course demonstrated high levels of satisfaction, increased participant confidence, increased perceived knowledge, and several self-reported changes in participants' ultrasound practice.