Society For Academic Emergency Medicine Research Articles

Building a framework to decolonize global emergency medicine.

Global emergency medicine (GEM) is situated at the intersection of global health and emergency medicine (EM), which is built upon a history of colonial systems and institutions that continue to reinforce inequities between high-income countries (HICs) and low- and middle-income countries (LMICs) today. These power imbalances yield disparities in GEM practice, research, and education. The Global Emergency Medicine Academy (GEMA) of the Society for Academic Emergency Medicine formed the Decolonizing GEM Working Group in 2020, which now includes over 100 worldwide members. The mission is to address colonial legacies in GEM and catalyze sustainable changes and recommendations toward decolonization at individual and institutional levels. To develop recommendations to decolonize GEM, the group conducted a nonsystematic review of existing literature on decolonizing global health, followed by in-depth discussions between academics from LMICs and HICs to explore implications and challenges specific to GEM. We then synthesized actionable solutions to provide recommendations on decolonizing GEM. Despite the rapidly expanding body of literature on decolonizing global health, there is little guidance specific to the relatively new field of GEM. By applying decolonizing principles to GEM, we suggest key priorities for improving equity in academic GEM: (1) reframing partnerships to place LMIC academics in positions of expertise and power, (2) redirecting research funding toward LMIC-driven projects and investigators, (3) creating more equitable practices in establishing authorship, and (4) upholding principles of decolonization in the education of EM trainees from LMICs and HICs. Understanding the colonial roots of GEM will allow us to look more critically at current health disparities and identify inequitable institutionalized practices within our profession that continue to uphold these misguided concepts. A decolonized future of GEM depends on our recognition and rectification of colonial-era practices that shape structural determinants of health care delivery and scientific advancement.

Applying the master adaptive learner framework to just‐in‐time training of procedures

AbstractBackgroundJust‐in‐time training (JITT) occurs in the clinical context when learners need immediate guidance for procedures due to a lack of proficiency or the need for knowledge refreshment. The master adaptive learner (MAL) framework presents a comprehensive model of transforming learners into adaptive experts, proficient not only in their current tasks but also in the ongoing development of lifelong skills. With the evolving landscape of procedural competence in emergency medicine (EM), trainees must develop the capacity to acquire and master new techniques consistently. This concept paper will discuss using JITT to support the development of MALs in the emergency department.MethodsIn May 2023, an expert panel from the Society for Academic Emergency Medicine (SAEM) Medical Educator's Boot Camp delivered a comprehensive half‐day preconference session entitled “Be the Best Teacher” at the society's annual meeting. A subgroup within this panel focused on applying the MAL framework to JITT. This subgroup collaboratively developed a practical guide that underwent iterative review and refinement.ResultsThe MAL‐JITT framework integrates the learner's past experiences with the educator's proficiency, allowing the educational experience to address the unique requirements of each case. We outline a structured five‐step process for applying JITT, utilizing the lumbar puncture procedure as an example of integrating the MAL stages of planning, learning, assessing, and adjusting. This innovative approach facilitates prompt procedural competence and cultivates a positive learning environment that fosters acquiring adaptable learning skills with enduring benefits throughout the learner's career trajectory.ConclusionsJITT for procedures holds the potential to cultivate a dynamic learning environment conducive to nurturing the development of MALs in EM.

Guidelines for Reasonable and Appropriate Care in the Emergency Department (GRACE-4): Alcohol use disorder and cannabinoid hyperemesis syndrome management in the emergency department.

The fourth Society for Academic Emergency Medicine (SAEM) Guidelines for Reasonable and Appropriate Care in the Emergency Department (GRACE-4) is on the topic of the emergency department (ED) management of nonopioid use disorders and focuses on alcohol withdrawal syndrome (AWS), alcohol use disorder (AUD), and cannabinoid hyperemesis syndrome (CHS). The SAEM GRACE-4 Writing Team, composed of emergency physicians and experts in addiction medicine and patients with lived experience, applied the Grading of Recommendations Assessment Development and Evaluation (GRADE) approach to assess the certainty of evidence and strength of recommendations regarding six priority questions for adult ED patients with AWS, AUD, and CHS. The SAEM GRACE-4 Writing Team reached the following recommendations: (1) in adult ED patients (over the age of 18) with moderate to severe AWS who are being admitted to hospital, we suggest using phenobarbital in addition to benzodiazepines compared to using benzodiazepines alone [low to very low certainty of evidence]; (2) in adult ED patients (over the age of 18) with AUD who desire alcohol cessation, we suggest a prescription for one anticraving medication [very low certainty of evidence]; (2a) in adult ED patients (over the age of 18) with AUD, we suggest naltrexone (compared to no prescription) to prevent return to heavy drinking [low certainty of evidence]; (2b) in adult ED patients (over the age of 18) with AUD and contraindications to naltrexone, we suggest acamprosate (compared to no prescription) to prevent return to heavy drinking and/or to reduce heavy drinking [low certainty of evidence]; (2c) in adult ED patients (over the age of 18) with AUD, we suggest gabapentin (compared to no prescription) for the management of AUD to reduce heavy drinking days and improve alcohol withdrawal symptoms [very low certainty of evidence]; (3a) in adult ED patients (over the age of 18) presenting to the ED with CHS we suggest the use of haloperidol or droperidol (in addition to usual care/serotonin antagonists, e.g., ondansetron) to help with symptom management [very low certainty of evidence]; and (3b) in adult ED patients (over the age of 18) presenting to the ED with CHS, we also suggest offering the use of topical capsaicin (in addition to usual care/serotonin antagonists, e.g., ondansetron) to help with symptom management [very low certainty of evidence].

Applying simulation learning theory to identify instructional strategies for Generation Z emergency medicine residency education

AbstractIntroductionGeneration Z learners are entering emergency medicine (EM) residency training, bringing unique learning preferences that influence their engagement with residency education. To optimally teach and motivate this incoming generation of learners, EM educators must understand and adapt to the changing instructional landscape.MethodologyThe Simulation Leaders Advancing the Next Generation in Emergency Medicine (SLANG‐EM) Workgroup was created to identify effective educational strategies for Generation Z learners entering EM. Members were faculty in the Society for Academic Emergency Medicine (SAEM) Simulation Academy, well versed in learning theory supporting simulation‐based education (SBE) and actively involved in EM residency education.Unique treatment/analysisThrough primary and secondary literature searches, the SLANG‐EM Workgroup identified four distinctive learning preferences of Generation Z learners: (1) individualized and self‐paced learning, (2) engaging and visual learning environments, (3) immediate and actionable feedback, and (4) combined personal and academic support. Workgroup members evaluated these learning preferences using a novel conceptual framework informed by the theoretical principles underpinning SBE, recommending instructional strategies for Generation Z EM residency learners across multiple educational environments.Implications for educatorsInstructional strategies were described for the didactic, simulation, and clinical learning environments. In the didactic environment, identified instructional strategies included meaningful asynchronous education, interactive small‐group learning, and improved multimedia design. In the simulation environment, educational innovations particularly suitable for Generation Z learners included learner‐centered debriefing, rapid‐cycle deliberate practice, and virtual simulation. In the clinical environment, described instructional strategies involved setting learner‐centered goals and delivering facilitative feedback in the context of an educational alliance. Overall, these instructional strategies were clustered around themes of student‐centered education and the educator as facilitator, which align well with Generation Z learning preferences. These findings were synthesized and presented as an advanced workshop, “Delivering Effective Education to the Next Generation,” at the 2023 SAEM Annual Meeting.

Implementation of a workshop for mass casualty incident triage training using an immersive virtual reality simulation.

We offered a workshop at the 2023 annual meeting of the Society for Academic Emergency Medicine to teach the Sort-Assess-Lifesaving Interventions-Treatment/Transport (SALT) triage protocol for responding to mass casualty incidents (MCIs) using an immersive virtual reality (VR) simulator. Here, we report workshop outcomes. After a 1-h didactic on the basics of triage protocols, workshop participants rotated through three skill stations at which learners learned how to use the VR headset and controllers, practiced applying SALT triage skills through a tabletop exercise, and then finally used our VR simulator for training responses to MCIs. During their encounter with VR, participants applied their new knowledge to triaging and treating the victims of an explosion in a virtual subway station. After a brief orientation, participants entered the scene to treat and triage virtual patients who had various life-threatening (e.g., acute arterial bleed, penetrating injury, pneumothorax, amputations) and non-life-threatening injuries (lacerations, sprains, hysteria, confusion). The simulator generated a performance report for each workshop attendee to be used for debriefing by a skilled facilitator. Participants were mostly trainees (residents), all of whom properly initiated their encounter with global sort commands (walk and wave) to identify the most critically injured. On average, participants correctly treated 92% of 18 injuries, with all bleeding injuries being properly controlled (tourniquets or wound packing). On average, participants correctly tagged 87.7% of 11 patients, but only took the pulse of 67% of the 11 patients. Learners had difficulty with cases involving embedded shrapnel and properly tagging patients who were stable after treatments. Our VR simulator provided a practical, portable, reproducible training and assessment system for preparing future emergency medical systems (EMS) medical directors to teach their EMS professionals the triage and lifesaving intervention treatment skills needed to save lives.

Identifying the prevalence and characteristics of diversity, equity, and inclusion leaders in academic emergency medicine.

Our study aims to better understand and describe the current state of diversity, equity, and inclusion (DEI) leadership in emergency medicine (EM) by identifying the prevalence of department DEI leadership positions, their demographics, and their job duty characteristics. We disseminated an electronic survey from April to July 2022 to Society for Academic Emergency Medicine (SAEM) Association of Academic Chairs of Emergency Medicine, Academy for Diversity and Inclusion in Emergency Medicine, and the Equity and Inclusion Committee to identify department DEI leads. From July to August 2022, a 45-question survey was sent to all identified DEI leaders on individual characteristics, DEI experience, and DEI lead job description. We received a response from 79 out of 120 academic EM departments identified (65.8%). Of the responding institutions, 59 (74.7%) reported a DEI leader. A total of 74.6% of these DEI leaders responded at least partially to our survey and 57.6% responded in full. The most common titles were vice/associate chair of DEI (34.4%), director of DEI (28.1%), and DEI committee chair (18.8%). Most respondents (84.4%) were the inaugural DEI lead in their department and 84.4% of respondents did not have a formal DEI role in their department previously. On average, respondents have had their DEI title for 2 years (range 0-7 years) with an average of 7 years (range 0-30 years) of experience performing DEI work. Many (63.4%) do not receive any funded effort for their DEI roles. Most DEI leads were not tenure track (72.2%) and most commonly at the rank of assistant professor (47.2%) followed by associate professor (33.3%), full professor (16.7%), and instructor (2.8%). This is the first known study to assess the characteristics of DEI department leaders in EM. EM DEI leadership positions are new, common, and led by diverse personal identities and are often not funded. Future directions could gain qualitative insight into this workforce to guide best practices in EM DEI leadership.

Clinical duties and compensation for U.S. emergency medicine fellows at academic centers: A descriptive, cross-sectional survey.

Fellowship training is increasingly popular among residency graduates and critical to the advancement of academic emergency medicine (EM). Little is known about the clinical hours worked and financial compensation received by fellows during training. We sought to describe the clinical duties and financial compensation of EM fellows at U.S. academic centers. This cross-sectional study surveyed U.S. academic EM department administrators who were members of the Society for Academic Emergency Medicine's Academy of Administrators in Academic Emergency Medicine (AAAEM) regarding their fellowship programs and fellows. We electronically distributed the validated survey instrument to 73 member sites between October 2022 and January 2023. Survey domains included fellow and fellowship demographics, base and total annual clinical hours, and base and total annual compensation. We calculated descriptive statistics and compared fellows by accreditation (Accreditation Council for Graduate Medical Education [ACGME] or non-ACGME) using chi-square and Wilcoxon rank-sum testing. We conducted a secondary analysis of base and total salary by gender and accreditation using Wilcoxon rank-sum testing. We received 38 institutional responses (response rate 52%), which represented 217 individual fellows. Nearly three-fourths (n = 158, 72.8%) of fellows enrolled in non-ACGME fellowships, worked 33% more base hours annually than ACGME fellows (median 571 h vs. 768 h, p < 0.001), and received base compensation 20% higher than ACGME fellows ($88,540 vs. $70,777, p < 0.001). Accounting for additional compensation, the median total annual compensation for non-ACGME fellows remained 11% higher than ACGME fellows ($105,000 vs. $93,853, p = 0.004). We observed no significant differences salary when stratified by gender. Most EM fellows at U.S. academic institutions enrolled in non-ACGME fellowships with significantly higher base hours and financial compensation than ACGME fellowships. These results represent the first description of the clinical hours and financial compensation of academic EM fellows and should be considered in ongoing benchmarking efforts by AAAEM.

"I don't want to be the squeaky wheel": Addressing bias as a leader in emergency medicine.

Implicit bias poses a barrier to inclusivity in the health care workforce and is detrimental to patient care. While previous studies have investigated knowledge and training gaps related to implicit bias, emergency medicine (EM) leaders' self-awareness and perspectives on bias have not been studied. Using art to prompt reflections on implicit bias, this qualitative study explores (1) the attitudes of leaders in EM toward implicit bias and (2) individual or structural barriers to navigating and addressing bias in the workplace. Investigators facilitated an hour-long workshop in May 2022 for those with leadership positions in the Society for Academic Emergency Medicine (SAEM), a leading national EM organization, including 62 attending physicians, eight residents/fellows, and four medical students. The workshop utilized arts-based methods to generate a psychologically supportive space to lead conversations around implicit bias in EM. The session included time for individual reflection, where participants used an electronic platform to respond anonymously to questions regarding susceptibility, fears, barriers, and experiences surrounding bias. Two independent coders compiled, coded, and reviewed the responses using an exploratory constructivist approach. A total of 125 responses were analyzed. Four major themes emerged: (1) acceptance that bias exists; (2) individual barriers, including fear of negative reactions, often due to power dynamics between respondents and other members of the ED; (3) institutional barriers, such as insufficient funding and unprotected time committed to addressing bias; and (4) ambiguity about defining and prioritizing bias. This qualitative analysis of reflections from an arts-based workshop highlights perceived fears and barriers that may impact EM physicians' motivation and comfort in addressing bias. These results may help guide interventions to address individual and structural barriers to mitigating bias in the workplace.

Development and evaluation of a novel knowledge assessment tool for pediatric emergency medicine clerkships.

This study seeks to determine validity evidence for a newly developed multiple-choice examination (MCE) tool to assess retention and application of medical knowledge of students enrolled in a pediatric emergency medicine (PEM) clerkship. A team of PEM physicians created a 110-item MCE covering the range of clinical topics in PEM relevant for medical students. The researchers determined examination content using the report of Clerkship Directors in Emergency Medicine and PEM Interest Group of the Society for Academic Emergency Medicine (SAEM). The authors administered the MCE to fourth-year medical students at the end of their PEM rotation from May 2020 to April 2023 at four institutions and then analyzed the examination using four of Messick's five sources of validity evidence: content, response process, internal structure, and relation to other variables. A total of 158 students took the test. In academic year (AY)20-21, 47 students took the test and scored, on average, 81%. After revision of poor and indeterminate questions, the 111 medical students who took the revised version of the test in AY21-AY23 scored on average 77.3% with a standard deviation of 5.7% with a normal distribution in scores. The revised questions were rated as excellent (10.0%), good (26.4%), fair (34.5%), poor (24.5%), or indeterminate (4.5%) based on test item discrimination. There was a positive correlation between MCE scores and students' clinical evaluations but no correlation between MCE scores and scores that students received on their clinical notes or patient presentations during case conference. This novel PEM clerkship examination is a reliable test of medical knowledge. Future directions involve evaluating consequences of the MCE and offering the test to medical students in a dedicated PEM rotation at the national level.

A Teach-the-Teacher Module for Human Trafficking Bedside Instruction.

Human trafficking (HT) is a public health issue that adversely affects patients' well-being. Despite the prevalence of trafficked persons in health care settings, a lack of educational modules exists for use in clinical contexts. We developed a 50-minute train-the-trainer module on HT. After piloting the workshop for faculty, fellows, and residents (n = 19) at the Society for Academic Emergency Medicine (SAEM) national conference, we implemented it in medical students' curricula during their emergency medicine clerkship at the University of Iowa (n = 162). We evaluated the worskhop by (a) a retrospective pre-post survey of self-reported ability to (1) define HT, (2) recognize high-risk signs, (3) manage situations with trafficked persons, and (4) teach others about HT, and (b) a 3-month follow-up survey to assess longitudinal behavior change. In both contexts, results demonstrated improvement across all learning outcomes (pre-post differences of 1.5, 1.3, 1.9, and 1.7 on a 4-point Likert-type scale for each learning objective above, respectively, at the SAEM conference and 1.2, 1.0, 1.3, and 1.3 at the University of Iowa; p < .001 for all). In the 3-month follow-up, we observed statistically significant changes in self-reported consideration of and teaching about HT during clinical encounters among learners who had previously never done either (p < .001 and p = .006, respectively). This train-the-trainer module is a brief and effective clinical tool for bedside teaching about HT, especially among people who have never previously considered HT in a clinical context.

Variability in Interpretation of Echocardiographic Signs of Tamponade: A Survey of Emergency Physician Sonographers

BackgroundCardiac tamponade is associated with high mortality, and making the diagnosis is a core skill of emergency physicians. Proper diagnosis relies on specific clinical and echocardiographic findings. It is not known whether expert sonographers consistently recognize echocardiographic signs of tamponade. ObjectivesTo assess whether expert sonographers agree on echocardiographic signs of tamponade. MethodsA 20-question survey consisting of 18 cine loops and 2 still images was distributed to the Academy of Emergency Ultrasound Section of the Society for Academic Emergency Medicine. Respondents answered “yes” or “no” to whether there was echocardiographic evidence of tamponade. Subgroup analyses of demographics and echocardiographic views were reported. The data were analyzed using Krippendorff's alpha (α) to assess interrater reliability (IRR) between respondents. ResultsEighty-four physicians responded and 56 completed the survey. All partial and completed surveys were analyzed. The overall IRR was poor (α = 0.60, 95% confidence interval [CI] 0.44–0.76). Residency graduation within 5 years (α = 0.66, 95% CI 0.5–0.8) was associated with higher IRR compared with those > 5 years (α = 0.53, 95% CI 0.37–0.69). The highest IRR was observed when images of mitral valve inflow pulse-wave Doppler (α = 0.81, CI 0.70–0.92) were used and the poorest IRR was on images from the parasternal short view (α = 0.28, 95% CI 0.05–0.49). ConclusionThere was poor agreement among expert emergency medicine sonographers in identifying echocardiographic signs of cardiac tamponade from a single cine loop or clip without clinical context. Further investigation is warranted to understand differences in recognition of clinical tamponade.

Trauma-Informed Care for Acute Care Settings: A Novel Simulation Training for Medical Students.

Physicians often care for patients who have experienced traumatic events including abuse, discrimination, and violence. Trauma-informed care (TIC) is a framework that recognizes the prevalence of trauma, promotes patient empowerment, and minimizes retraumatization. There are limited education curricula on how to apply TIC to acute care settings, with simulation-based training presenting a novel educational tool for this aim. Students participated in a didactic on TIC principles and its applications in acute care settings. Learners participated in three simulation cases where they performed physical exams and gathered history on patients with urgent medical needs related to intimate partner violence, transgender health, and health care discrimination. Debriefing followed each simulation. Seventeen medical students participated across four sessions. The sessions were evaluated with pre- and postparticipation surveys, including Likert scales and free-response questions. After participation, individuals' self-assessed confidence improved across multiple domains, including identifying situations for trauma screenings, inquiring about trauma, and responding as a bystander. Learners also felt more familiar with TIC-specific history taking and physical exam skills. Finally, simulation was perceived as a beneficial educational tool. All findings were statistically significant (p ≤ .01). Our simulation-based training enabled students to practice conversations and interventions related to trauma. This novel training represents a feasible and effective means for teaching TIC for acute care settings, including in the emergency department and in-patient settings. Development and evaluation were supported by the Society for Academic Emergency Medicine.

The role of emergency physicians in the fight against health misinformation: Implications for resident training.

Emergency physicians on the frontlines of the COVID-19 pandemic are first-hand witnesses to the direct impact of health misinformation and disinformation on individual patients, communities, and public health at large. Therefore, emergency physicians naturally have a crucial role to play to steward factual information and combat health misinformation. Unfortunately, most physicians lack the communications and social media training needed to address health misinformation with patients and online, highlighting an obvious gap in emergency medicine training. We convened an expert panel of academic emergency physicians who have taught and conducted research about health misinformation at the Society for Academic Emergency Medicine (SAEM) Annual Meeting in New Orleans, LA, on May 13, 2022. The panelists represented geographically diverse institutions including Baystate Medical Center/Tufts University, Boston Medical Center, Northwestern University, Rush Medical College, and Stanford University. In this article, we describe the scope and impact of health misinformation, introduce methods for addressing misinformation in the clinical environment and online, acknowledge the challenges of tackling misinformation from our physician colleagues, demonstrate strategies for debunking and prebunking, and highlight implications for education and training in emergency medicine. Finally, we discuss several actionable interventions that define the role of the emergency physician in the management of health misinformation.

2022 consensus conference on diversity, equity, and inclusion: Developing an emergency medicine research agenda for addressing racism through health care research.

Racism in emergency medicine (EM) health care research is pervasive but often underrecognized. To understand the current state of research on racism in EM health care research, we developed a consensus working group on this topic, which concluded a year of work with a consensus-building session as part of the overall Society for Academic Emergency Medicine (SAEM) consensus conference on diversity, equity, and inclusion: "Developing a Research Agenda for Addressing Racism in Emergency Medicine," held on May 10, 2022. In this article, we report the development, details of preconference methods and preliminary results, and the final consensus of the Healthcare Research Working Group. Preconference work based on literature review and expert opinion identified 13 potential priority research questions that were refined through an iterative process to a list of 10. During the conference, the subgroup used consensus methodology and a "consensus dollar" (contingent valuation) approach to prioritize research questions. The subgroup identified three research gaps: remedies for racial bias and systematic racism, biases and heuristics in clinical care, and racism in study design, and we derived a list of six high-priority research questions for our specialty.

Guidelines for reasonable and appropriate care in the emergency department 3 (GRACE‐3): Acute dizziness and vertigo in the emergency department

This third Guideline for Reasonable and Appropriate Care in the Emergency Department (GRACE-3) from the Society for Academic Emergency Medicine is on the topic adult patients with acute dizziness and vertigo in the emergency department (ED). A multidisciplinary guideline panel applied the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach to assess the certainty of evidence and strength of recommendations regarding five questions for adult ED patients with acute dizziness of less than 2 weeks' duration. The intended population is adults presenting to the ED with acute dizziness or vertigo. The panel derived 15 evidence-based recommendations based on the timing and triggers of the dizziness but recognizes that alternative diagnostic approaches exist, such as the STANDING protocol and nystagmus examination in combination with gait unsteadiness or the presence of vascular risk factors. As an overarching recommendation, (1) emergency clinicians should receive training in bedside physical examination techniques for patients with the acute vestibular syndrome (AVS; HINTS) and the diagnostic and therapeutic maneuvers for benign paroxysmal positional vertigo (BPPV; Dix-Hallpike test and Epley maneuver). To help distinguish central from peripheral causes in patients with the AVS, we recommend: (2) use HINTS (for clinicians trained in its use) in patients with nystagmus, (3) use finger rub to further aid in excluding stroke in patients with nystagmus, (4) use severity of gait unsteadiness in patients without nystagmus, (5) do not use brain computed tomography (CT), (6) do not use routine magnetic resonance imaging (MRI) as a first-line test if a clinician trained in HINTS is available, and (7) use MRI as a confirmatory test in patients with central or equivocal HINTS examinations. In patients with the spontaneous episodic vestibular syndrome: (8) search for symptoms or signs of cerebral ischemia, (9) do not use CT, and (10) use CT angiography or MRI angiography if there is concern for transient ischemic attack. In patients with the triggered (positional) episodic vestibular syndrome, (11) use the Dix-Hallpike test to diagnose posterior canal BPPV (pc-BPPV), (12) do not use CT, and (13) do not use MRI routinely, unless atypical clinical features are present. In patients diagnosed with vestibular neuritis, (14) consider short-term steroids as a treatment option. In patients diagnosed with pc-BPPV, (15) treat with the Epley maneuver. It is clear that as of 2023, when applied in routine practice by emergency clinicians without special training, HINTS testing is inaccurate, partly due to use in the wrong patients and partly due to issues with its interpretation. Most emergency physicians have not received training in use of HINTS. As such, it is not standard of care, either in the legal sense of that term ("what the average physician would do in similar circumstances") or in the common parlance sense ("the standard action typically used by physicians in routine practice").

ACEP-SAEM response to the National Institutes of Health (NIH) proposal to simplify the review framework for research project grant applications.

The Society for Academic Emergency Medicine (SAEM) and American College of Emergency Physicians (ACEP) are responding jointly to this request for information. SAEM and ACEP promote innovative and imaginative strategy development that will transform prehospital and emergent patient care. The National Institutes of Health (NIH) proposal to modify the current grant scoring system to prioritize these principles is a welcome change and we are supportive of these efforts. Focusing on research importance, feasibility, and scientific rigor will make it easier to interpret reviewer critiques and provide investigators with clearer information on score driving factors related to the science itself. While investigator and environment are important factors for successfully conducting research, reducing their overall importance may help with reducing bias and expanding the pool of meritorious applications. We also support combining significance and innovation into a single “importance” score, as the current format gives equal weight to innovation even though related sections tend to be brief. Furthermore, the existing significance section focuses largely on perceived need and scientific rationale with lesser consideration of the true magnitude of impact. Our societies are hopeful that by broadening the concept of overall importance, this new section can better weight funding decisions toward injuries and illnesses where improved outcomes would benefit the greatest number of people. We also agree that the current scoring system overly emphasizes an investigator's prior grant success and institutional reputation in determining an application's merit. Reliance on these factors detracts from the proposal's true “importance” and may perpetuate existing and ongoing challenges with the development and retention of junior investigators, including investigators from historically underrepresented groups. The proposed changes in this area will allow for increased emphasis on the development of highly novel or paradigm-shifting approaches to problems. Nonetheless, consideration of the capacity to execute the proposed work remains a critically important factor. The proposed method of scoring using a descriptive range of “fully capable” to “additional resources needed” deemphasizes quantitative scoring and we believe accomplishes the stated goals. However, we recommend specific clarification that the proposed scale reflects the entirety of the investigatory team (with due consideration of experience with prior collaboration). An important component of the current scoring system not addressed in the proposed changes is the handling of grant resubmissions. It is not clear why resubmissions have a written narrative that is score-driving and subject to bias. We recommend amending this process for each additional criteria to be marked yes or no as to “all major/moderate concerns appropriately addressed.” Reviewers could also have the option of describing “any new major/moderate concerns identified” in the resubmission process. Finally, while we recognize that these scoring revisions are important, we suggest that the NIH consider a more direct acknowledgment of our nation's need to fund a diverse pool of grant applicants. We believe the approach of the three-factor scoring system that emphasizes capability to perform the work is well aligned with this goal, but we would encourage the NIH to consider an explicit acknowledgment of ongoing disparities in our nation's health research programs addressed by these changes.

Changes in application of the Society for Academic Emergency Medicine's abstract scoring criteria, 2020 versus 2021.

Changes in application of the Society for Academic Emergency Medicine's abstract scoring criteria, 2020 versus 2021.

Executive summary of the SAEM 2022 consensus conference to address racism in emergency medicine clinical research, training, and leadership.

Racism has not only contributed to disparities in health care outcomes, but also has negatively impacted the recruitment, retention, and promotion of historically excluded groups in academic medicine. The 2022 Society for Academic Emergency Medicine (SAEM) consensus conference, "Diversity, Equity, and Inclusion: Developing a Research Agenda for Addressing Racism in Emergency Medicine," convened a diverse group of researchers, educators, administrative leaders, and health care providers to help address the impact of racism in three domains in academic emergency medicine: clinical research, education and training, and academic leadership. The main goals of the consensus process were to identify current knowledge gaps and create a research agenda within each domain using an iterative consensus-building methodology. The planning committee identified three fundamental domains to develop a research agenda and created workgroups who completed a literature search to identify gaps in knowledge. After a consensus building process, potential questions were presented at the in-person consensus conference. Ninety SAEM members representing faculty and trainees participated in breakout groups in each domain to generate consensus recommendations for priority research. For clinical research, three research gaps with six questions (n) were identified: remedies for bias and systematic racism (3), biases and heuristics in clinical care (2), and racism in study design (1). For education and training, three research gaps with seven questions were identified: curriculum and assessment (2), recruitment (1), and learning environment (4). For academic leadership, three research gaps with five questions were identified: understanding the current diversity, equity, and inclusion (DEI) landscape and culture (1), analyzing programs that improve DEI and identifying factors that lead to improved diversity (3), and quantifying the value of professional stewardship activities (1). This article reports the results of the consensus conference with the goal of influencing emergency care research, education, and policy and facilitating collaborations, grant funding, and publications in these domains.

Taking More Society for Academic Emergency Medicine Practice Tests Does Not Lead to Improved National EM-M4 Exam Scores

Emergency medicine (EM) is a required clerkship for third-year medical students, and an elective EM acting internship (AI) is available to fourth-year students at our institution. The Society for Academic Emergency Medicine's (SAEM) National Emergency Medicine M4 Examination (EM-M4) is administered to students at the end of the EM AI experience. To prepare for the exam, students gain access to 23 practice tests available from SAEM. In this study we investigate the correlation between the number of practice tests taken and EM-M4 performance. We collected data for EM-M4 and the US Medical Licensing Exam (USMLE) Step 2 Clinical Knowledge (CK) from students completing a MS4 EM clerkship in consecutive medical school classes from 2014-2017 at a private medical school. In addition, we collected data during the clerkship on the number of practice exams taken and whether a comprehensive practice exam was taken. We analyzed the study population three ways to determine whether the number of practice tests impacted final exam results: a binary distribution (1-11 or 12-23 tests taken); quaternary distribution (1-6, 7-12, 13-18, or 19-23 tests taken); and individual test variability (1,2,3,…22,23 tests taken). Complete data for 147 students was used for data analysis. The EM-M4 showed moderate (r = 0.49) correlations with USMLE Step 2 CK. There was no significant difference in EM-M4 performance in the binary analysis (P ≤ 0.09), the quaternary analysis (P ≤ 0.09), or the continuous variable analysis (P ≤ 0.52). Inclusion of a comprehensive practice test also did not correlate with EM-M4 performance (P ≤ 0.78). Degree of utilization of SAEM practice tests did not seem to correlate with performance on the EM-M4 examination at our institution. This could be due to many factors including that the question bank is composed of items that had poor item discrimination, possible inadequate coverage of EM curriculum, and/or use of alternative study methods. While further investigation is needed, if our conclusions prove generalizable, then using the SAEM practice tests is an extraneous cognitive load from a modality without proven benefit.

Trends in female first-author abstracts at the Society for Academic Emergency Medicine Annual Meeting, 1990–2020

ObjectivesTo describe first author gender differences and characteristics in 1) Society for Academic Emergency Medicine (SAEM) Annual Meeting abstracts and 2) resulting manuscript publications. MethodsWe performed cross-sectional evaluation of SAEM abstracts from 1990, 1995, 2000, 2005, 2010, 2015, and 2020, compiling and reviewing a random sample of 100 abstracts for each year (total n = 700 abstracts). We documented abstract characteristics, including first author gender, and used the 2020 SAEM scoring rubric. We then searched PubMed to identify manuscript publications resulting from abstracts from 1990 to 2015 (n = 600). Finally, among abstracts that resulted in manuscript publication, we identified first and last author gender on both the abstracts and the resulting publication. ResultsOverall, 29% (202/695; n = 5 missing gender) of abstracts had female first authors. Female first authors increased over time (e.g., 17% in 1990 to 35% in 2020). Abstract quality scores were similar (both median [interquartile range] of 11 ([9–12]). Overall, 42% (n = 254/600) of abstracts resulted in a manuscript publication, 39% (n = 65/202) with female and 44% (n = 189/493) with male first authors (p = 0.26). The median time (IQR) from abstract to manuscript publication was longer for abstracts with female first authors vs. those with male first authors (2 [1–3] years and 1 [1, 2] years, p < 0.02); 77% and 78% of publications resulting from abstracts with female and male first authors, respectively, had the same first author. Female first author abstracts more often converted to a male first author manuscript publication (18%, n = 12/65) compared to male first author abstracts converting to female first author publications (7%, n = 14/189). ConclusionsA minority of SAEM abstracts, and manuscript publications resulting from them, had female first authors. Abstracts with female first authors took longer to achieve manuscript publication, and almost a fifth of female first author abstracts resulted in male first author manuscript publication.