Education Research In Emergency Medicine Research Articles

Editorial introductions.

Editorial introductions.

Editorial introductions.

Editorial introductions.

Leveling the field: Development of reliable scoring rubrics for quantitative and qualitative medical education research abstracts.

Research abstracts are submitted for presentation at scientific conferences; however, criteria for judging abstracts are variable. We sought to develop two rigorous abstract scoring rubrics for education research submissions reporting (1) quantitative data and (2) qualitative data and then to collect validity evidence to support score interpretation. We used a modified Delphi method to achieve expert consensus for scoring rubric items to optimize content validity. Eight education research experts participated in two separate modified Delphi processes, one to generate quantitative research items and one for qualitative. Modifications were made between rounds based on item scores and expert feedback. Homogeneity of ratings in the Delphi process was calculated using Cronbach's alpha, with increasing homogeneity considered an indication of consensus. Rubrics were piloted by scoring abstracts from 22 quantitative publications from AEM Education and Training "Critical Appraisal of Emergency Medicine Education Research" (11 highlighted for excellent methodology and 11 that were not) and 10 qualitative publications (five highlighted for excellent methodology and five that were not). Intraclass correlation coefficient (ICC) estimates of reliability were calculated. Each rubric required three rounds of a modified Delphi process. The resulting quantitative rubric contained nine items: quality of objectives, appropriateness of methods, outcomes, data analysis, generalizability, importance to medical education, innovation, quality of writing, and strength of conclusions (Cronbach's α for the third round=0.922, ICC for total scores during piloting=0.893). The resulting qualitative rubric contained seven items: quality of study aims, general methods, data collection, sampling, data analysis, writing quality, and strength of conclusions (Cronbach's α for the third round=0.913, ICC for the total scores during piloting=0.788). We developed scoring rubrics to assess quality in quantitative and qualitative medical education research abstracts to aid in selection for presentation at scientific meetings. Our tools demonstrated high reliability.

Identifying the Gaps: Needs Assessment to Guide Development of a Dedicated Toxicology Curriculum for Emergency Medicine Residents

The American Board of Emergency Medicine identifies medical toxicology as an essential curricular element for emergency medicine (EM) residencies; however, access to medicaltoxicology education varies widely by institution. We hypothesized thatEM residents areuncomfortable with core toxicology content and would be interested in a dedicated toxicology curriculum. An electronic needs assessmentsurvey developed by experts in EM and medical toxicology was sent to residents and program leadership at nine EM programs participating in the Emergency Medicine Education Research Alliance (EMERA), a geographically diverse sampling ofacademic EM residency programs. We queried the presence of a current toxicology curriculum, interest in a dedicated toxicology curriculum, and comfort with core toxicology concepts for board examinations and in clinical practice. RESULTS: A total of 148 residents and 8facultyleadership completed the survey. Only 29% ofresidentrespondents felt comfortable with toxicology concepts, and only 66% of respondents reported access to a toxicology curriculum. Of those without a known toxicology curriculum, mostwere interested in a formal curriculum. Faculty respondents reported 6/8 programs offered a toxicology curriculum. Faculty at the two programs without a formal curriculum expressed interest in a dedicated curriculum. Emergency medicineresidents remain uncomfortable with the core toxicology content in clinical practice. The majority of residents without a known toxicology curriculum would be interested in a dedicated toxicology curriculum.

The Impact of a Medical Education Research Faculty Development Program on Career Development, Through the Lens of Social Cognitive Career Theory.

The Medical Education Research Certificate at the Council of Residency Directors in Emergency Medicine (MERC at CORD), a specialized adaptation of the Association of American Medical Colleges MERC program, provides faculty development in education research in emergency medicine. However, its long-term influence on career development remains unknown. Our study explored the impact of MERC at CORD on career development through the lens of social cognitive career (SCC) theory. This was a prospective qualitative study using a constructivist/interpretivist paradigm to assess long-term career development outcomes. A purposeful randomized stratified sampling strategy of MERC at CORD graduates (2011-2014) ensured diversity of representation (sex, region, number of research publications, and project group leadership). Subjects were invited by e-mail to participate in semistructured phone interviews. Thematic analysis by two independent reviewers followed an iterative process until saturation was reached. Twelve graduates were interviewed. All engaged with MERC at CORD early in their careers with minimal previous education research experience. Currently, all hold medical education leadership positions. Graduates had a mean of 19.3 publications (range= 9-43). Themes explaining reasons for participating in MERC at CORD include: desire for education research skills, recommendation of mentors/colleagues, and accessibility. Themes citing the program's value to career development include networking/collaboration, mentorship, informational framework to build upon, and the application of theoretical knowledge through experiential learning. MERC at CORD impacted career development aligning with the core domains of SCC theory including self-efficacy, outcome expectations, and goals. MERC at CORD enhanced the long-term career development of participants by providing a core knowledge framework in a mentored, experiential learning environment. Participants identified themes aligned with SCC theory as influential in their long-term career advancement in medical education including the development of education research skills, successful completion of education research, career acceleration, promotion, niche development, and formulation of professional goals.

Emergency Medicine Education Research Since the 2012 Consensus Conference: How Far Have We Come and What's Next?

In 2012, the Society for Academic Emergency Medicine convened a consensus conference on the state of medical education research with goals of defining and advancing a future research agenda. Since that time, emergency medicine (EM) education research has grown significantly. A task force of EM education experts was assembled and sought to understand the current state of EM education research and future directions. Among the advances are increases in medical education fellowships, advanced degree and certification programs, faculty development programs, publication venues, and funding. These findings are discussed in light of the prior objectives from the 2012 consensus conference, and recommendations for future directions are provided.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016.

The objectives were to critically appraise the emergency medicine (EM) medical education literature published in 2016 and review the highest-quality quantitative and qualitative studies. A search of the English language literature in 2016 querying MEDLINE, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified 510 papers related to medical education in EM. Two reviewers independently screened all of the publications using previously established exclusion criteria. The 25 top-scoring quantitative studies based on methodology and all six qualitative studies were scored by all reviewers using selected scoring criteria that have been adapted from previous installments. The top-scoring articles were highlighted and trends in medical education research were described. Seventy-five manuscripts met inclusion criteria and were scored. Eleven quantitative and one qualitative papers were the highest scoring and are summarized in this article. This annual critical appraisal series highlights the best EM education research articles published in 2016.

The Uphill Battle of Performing Education Scholarship: Barriers Educators and Education Researchers Face.

IntroductionEducators and education researchers report that their scholarship is limited by lack of time, funding, mentorship, expertise, and reward. This study aims to evaluate these groups’ perceptions regarding barriers to scholarship and potential strategies for success.MethodsCore emergency medicine (EM) educators and education researchers completed an online survey consisting of multiple-choice, 10-point Likert scale, and free-response items in 2015. Descriptive statistics were reported. We used qualitative analysis applying a thematic approach to free-response items.ResultsA total of 204 educators and 42 education researchers participated. Education researchers were highly productive: 19/42 reported more than 20 peer-reviewed education scholarship publications on their curricula vitae. In contrast, 68/197 educators reported no education publications within five years. Only a minority, 61/197 had formal research training compared to 25/42 education researchers. Barriers to performing research for both groups were lack of time, competing demands, lack of support, lack of funding, and challenges achieving scientifically rigorous methods and publication. The most common motivators identified were dissemination of knowledge, support of evidence-based practices, and promotion. Respondents advised those who seek greater education research involvement to pursue mentorship, formal research training, collaboration, and rigorous methodological standards.ConclusionThe most commonly cited barriers were lack of time and competing demands. Stakeholders were motivated by the desire to disseminate knowledge, support evidence-based practices, and achieve promotion. Suggested strategies for success included formal training, mentorship, and collaboration. This information may inform interventions to support educators in their scholarly pursuits and improve the overall quality of education research in EM.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015.

The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples. A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed. Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article. This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2015.

The objectives were to critically appraise the medical education research literature of 2015 and review the highest-quality quantitative and qualitative examples. A total of 434 emergency medicine (EM)-related articles were discovered upon a search of ERIC, PsychINFO, PubMED, and SCOPUS. These were both quantitative and qualitative in nature. All were screened by two of the authors using previously published exclusion criteria, and the remaining were appraised by all authors using a previously published scoring system. The highest scoring articles were then reviewed. Sixty-one manuscripts were scored, and 10 quantitative and two qualitative papers were the highest scoring and are reviewed and summarized in this article. This installment in this critical appraisal series reviews 12 of the highest-quality EM-related medical education research manuscripts published in 2015.

What's the Evidence: Self-Assessment Implications for Life-Long Learning in Emergency Medicine

BackgroundThe 2012 Academic Emergency Medicine Consensus Conference, “Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success” noted that emergency medicine (EM) educators often rely on theory and tradition when molding their approaches to teaching and learning, and called on the EM education community to advance the teaching of our specialty through the performance and application of research in teaching and assessment methods, cognitive function, and the effects of education interventions. ObjectiveThe purpose of this article was to review the research-based evidence for the effectiveness of self-assessment and to provide suggestions for its use in clinical teaching and practice in EM. DiscussionThis article reviews hypothesis-testing research related to self-assessment behaviors and learning. Evidence indicates that self-assessment is inherently flawed when used in isolation. We review a multi-dimensional approach to informed self-assessment that can serve as the basis for life-long learning and development. ConclusionsAdvancing EM education will require that high-quality education research results be translated into actual curricular, pedagogical, assessment, and professional development changes. The informed self-assessment framework is a method that is applicable to teaching and practice in EM.

An Analysis of the Top-cited Articles in Emergency Medicine Education Literature.

IntroductionDissemination of educational research is critical to improving medical education, promotion of faculty and ultimately patient care. The objective of this study was to identify the top 25 cited education articles in the emergency medicine (EM) literature and the top 25 cited EM education articles in all journals, as well as report on the characteristics of the articles.MethodsTwo searches were conducted in the Web of Science in June 2016 using a list of education-related search terms. We searched 19 EM journals for education articles as well as all other literature for EM education-related articles. Articles identified were reviewed for citation count, article type, journal, authors, and publication year.ResultsWith regards to EM journals, the greatest number of articles were classified as articles/reviews, followed by research articles on topics such as deliberate practice (cited 266 times) and cognitive errors (cited 201 times). In contrast in the non-EM journals, research articles were predominant. Both searches found several simulation and ultrasound articles to be included. The most common EM journal was Academic Emergency Medicine (n = 18), and Academic Medicine was the most common non-EM journal (n=5). A reasonable number of articles included external funding sources (6 EM articles and 13 non-EM articles.)ConclusionThis study identified the most frequently cited medical education articles in the field of EM education, published in EM journals as well as all other journals indexed in Web of Science. The results identify impactful articles to medical education, providing a resource to educators while identifying trends that may be used to guide EM educational research and publishing efforts.

What's the Evidence: A Review of the One-Minute Preceptor Model of Clinical Teaching and Implications for Teaching in the Emergency Department

BackgroundThe 2012 Academic Emergency Medicine Consensus Conference, “Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success” noted that emergency medicine (EM) educators often rely on theory and tradition in molding their approaches to teaching and learning, and called on the EM education community to advance the teaching of our specialty through the performance and application of research in teaching and assessment methods, cognitive function, and the effects of education interventions. ObjectiveThe purpose of this article is to review the research-based evidence for the effectiveness of the one-minute preceptor (OMP) teaching method, and to provide suggestions for its use in clinical teaching and learning in EM. DiscussionThis article reviews hypothesis-testing education research related to the use of the OMP as a pedagogical method applicable to clinical teaching. Evidence indicates that the OMP prompts the teaching of higher level concepts, facilitates the assessment of students' knowledge, and prompts the provision of feedback. Students indicate satisfaction with this method of clinical case–based discussion teaching. ConclusionAdvancing EM education will require that high quality education research results be translated into actual curricular, pedagogical, assessment, and professional development changes. The OMP is a pedagogical method that is applicable to teaching in the emergency department.

Critical Appraisal of Emergency Medicine Education Research: The Best Publications of 2014.

The objective was to critically appraise and highlight rigorous education research study articles published in 2014 whose outcomes advance the science of emergency medicine (EM) education. A search of the English language literature in 2014 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 243 EM-related articles using either quantitative (hypothesis-testing or observational investigations of educational interventions) or qualitative (exploring important phenomena in EM education) methods. Two reviewers independently screened all of the publications using previously established exclusion criteria. Six reviewers then independently scored the 25 selected publications using either a qualitative or a quantitative scoring system. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems use parallel scoring metrics and have been used previously within this annual review. Twenty-five medical education research papers (22 quantitative, three qualitative) met the criteria for inclusion and were reviewed. Five quantitative and two qualitative studies were ranked most highly by the reviewers as exemplary and are summarized in this article. This annual critical appraisal series highlights seven excellent EM education research studies, meeting a priori criteria and published in 2014. Methodologic strengths in the 2014 papers are noted, and current trends in medical education research in EM are discussed.

Critical appraisal of emergency medicine education research: the best publications of 2013.

The objective was to critically appraise and highlight methodologically superior medical education research articles published in 2013 whose outcomes are pertinent to teaching and education in emergency medicine (EM). A search of the English-language literature in 2013 querying Education Resources Information Center (ERIC), PsychINFO, PubMed, and Scopus identified 251 EM-related studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. Six reviewers then independently scored the remaining 43 publications using either a qualitative a or quantitative scoring system, based on the research methodology of each article. Each scoring system consisted of nine criteria. Selected criteria were based on accepted educational review literature and chosen a priori. Both scoring systems used parallel scoring metrics and have been used previously within this annual review. Forty-three medical education research papers (37 quantitative and six qualitative studies) met the a priori criteria for inclusion and were reviewed. Six quantitative and one qualitative study were scored and ranked most highly by the reviewers as exemplary and are summarized in this article. This annual critical appraisal article aims to promote superior research in EM-related education, by reviewing and highlighting seven of 43 major education research studies, meeting a priori criteria, and published in 2013. Common methodologic pitfalls in the 2013 papers are noted, and current trends in medical education research in EM are discussed.

Critical Appraisal of Emergency Medicine Education Research: The Best Publications of 2012

The objective was to critically appraise and highlight medical education research published in 2012 that was methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM). A search of the English language literature in 2012 querying Education Resources Information Center (ERIC), PsychInfo, PubMed, and Scopus identified EM studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. This year, publications limited to a single-site survey design that measured satisfaction or self-assessment on unvalidated instruments were not formally reviewed. Six reviewers then independently ranked all remaining publications using one of two scoring systems depending on whether the study methodology was primarily qualitative or quantitative. Each scoring system had nine criteria, including four related to methodology, that were chosen a priori, to standardize evaluation by reviewers. The quantitative study scoring system was used previously to appraise medical education published annually in 2008 through 2011, while a separate, new qualitative study scoring system was derived and implemented consisting of parallel metrics. Forty-eight medical education research papers met the a priori criteria for inclusion, and 33 (30 quantitative and three qualitative studies) were reviewed. Seven quantitative and two qualitative studies met the criteria for inclusion as exemplary and are summarized in this article. This critical appraisal series aims to promote superior education research by reviewing and highlighting nine of the 48 major education research studies with relevance to EM published in 2012. Current trends and common methodologic pitfalls in the 2012 papers are noted.

Education Research: Priority Designs and Common Misperceptions

In this commentary, common misperceptions about education research, and specifically for emergency medicine education research, are addressed. Recommendations for designing and publishing high-quality projects are also provided.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2011

The objective was to critically appraise and highlight medical education research studies published in 2011 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM). A search of the English language literature in 2011 querying PubMed, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified EM studies that used hypothesis-testing or observational investigations of educational interventions. Six reviewers independently ranked all publications based on 10 criteria, including four related to methodology, that were chosen a priori to standardize evaluation by reviewers. This method was used previously to appraise medical education published in 2008, 2009, and 2010. Forty-eight educational research papers were identified. Comparing the literature of 2011 to that of 2008 through 2010, the number of published educational research papers meeting the criteria increased over time from 30, to 36, to 41, and now to 48. Five medical education research studies met the a priori criteria for inclusion as exemplary and are reviewed and summarized in this article. The number of funded studies remained fairly stable over the past 3 years, at 13 (2008), 16 (2009), 9 (2010), and 13 (2011). As in past years, research involving the use of technology accounted for almost half (n = 22) of the publications. Observational study designs accounted for 28 of the papers, while nine studies featured an experimental design. Forty-eight EM educational studies published in 2011 and meeting the criteria were identified. This critical appraisal reviews and highlights five studies that met a priori quality indicators. Current trends and common methodologic pitfalls in the 2011 papers are noted.

Ethical Considerations in Education Research in Emergency Medicine

The 2012 Academic Emergency Medicine consensus conference on education research in emergency medicine (EM) addressed various issues, including that of ethics in medical education research for EM. Education research in EM is essential to patient care and safety, and with recent advances in simulation and the advent of the Milestones project, it will become even more vital. Education research in EM is guided by the same principles that guide the ethical conduct of all human subjects' research: respect for persons, beneficence, and justice. Regulatory provisions and widely accepted ethical standards provide a framework for research in EM education; however, special considerations exist for education research. To ensure patient and trainee safety and to maintain the integrity of new knowledge, ethical considerations should remain at the forefront of EM education research. For EM education researchers, recognition of the vulnerability of residents, medical students, and others as research subjects is paramount. This article fills an important gap by outlining the principles guiding education research in EM, exploring the ethical challenges and approaches to education research, and offering a framework and future directions for the ethical conduct of education research in EM.

Executive Summary: Education Research in Emergency Medicine—Opportunities, Challenges, and Strategies for Success

The 2012 Academic Emergency Medicine (AEM) consensus conference "Education Research In Emergency Medicine: Opportunities, Challenges, and Strategies for Success" convened a diverse group of stakeholders in medical education to target gaps in emergency medicine (EM) education research and identify priorities for future study. A total of 175 registrants collaborated in preparatory and conference-day activities to explore subtopics in educational interventions, learner assessment, faculty development, and research funding and infrastructure. The conference was punctuated by didactic sessions led by key international medical education experts and ended with consensus formation in many domains. This issue of AEM presents the exciting results of this process.