Evidence-based Medicine Competency Research Articles

Competency in evidence-based medicine and associated factors among medical radiology technologists in Addis Ababa, Ethiopia.

Evidence-based medicine integrates clinical expertise, patient values and best research evidence in clinical decision-making. This study aimed to assess evidence-based medicine knowledge, attitudes, practices and associated factors among medical radiology technologists in Addis Ababa, Ethiopia. A cross-sectional study was conducted among 392 medical radiology technologists from May to August 2022 using a self-administered questionnaire. Bivariate and multivariate logistic regression identified factors associated with evidence-based medicine practice. Most medical radiology technologists (57.7%) had moderate evidence-based medicine knowledge and 94.9% had favourable attitudes. However, 64.8% demonstrated poor evidence-based medicine practice. Factors significantly associated with better evidence-based medicine practice were moderate knowledge (AOR 1.949, 95% CI 1.155-3.291), good statistical understanding (AOR 1.824, 95% CI 1.135-2.930), sufficient time for evidence-based medicine (AOR 1.892, 95% CI 1.140-3.141), institutional support (AOR 2.093, 95% CI 1.271-3.440) and evidence-based medicine resource access (AOR 1.653, 95% CI 1.028-2.656). Despite moderate knowledge and positive attitudes towards evidence-based medicine, most medical radiology technologists had suboptimal utilisation. Strategies to improve knowledge, ensure dedicated time, provide institutional support and resources could enhance evidence-based radiology practice.

Librarian-Led Assessment of Medical Students' Evidence-Based Medicine Competency: Facilitators and Barriers.

We must ensure, through rigorous assessment that physicians have the evidence-based medicine (EBM) skills to identify and apply the best available information to their clinical work. However, there is limited guidance on how to assess EBM competency. With a better understanding of their current role in EBM education, Health Sciences Librarians (HSLs), as experts, should be able to contribute to the assessment of medical student EBM competence. The purpose of this study is to explore the HSLs perspective on EBM assessment practices, both current state and potential future activities. We conducted focus groups with librarians from across the United States to explore their perceptions of assessing EBM competence in medical students. Participants had been trained to be raters of EBM competence as part of a novel Objective Structured Clinical Examination (OSCE). This OSCE was just the starting point and the discussion covered topics of current EBM assessment and possibility for expanded responsibilities at their own institutions. We used a reflexive thematic analysis approach to construct themes from our conversations. We constructed eight themes in four broad categories that influence the success of librarians being able to engage in effective assessment of EBM: administrative, curricular, medical student, and librarian. Our results inform medical school leadership by pointing out the modifiable factors that enable librarians to be more engaged in conducting effective assessment. They highlight the need for novel tools, like EBM OSCEs, that can address multiple barriers and create opportunities for deeper integration of librarians into assessment processes.

Observing and Assessing Competence in Evidence-Based Medicine in Graduating Medical Students: A 5-Year Multi-Institution Report.

Observing and Assessing Competence in Evidence-Based Medicine in Graduating Medical Students: A 5-Year Multi-Institution Report.

Association between self-reported evidence-based medicine competencies and prescribing of drugs without scientific evidence against mild COVID-19 among recently graduated physicians in Peru

ObjectiveTo evaluate the association between self-rated evidence-based medicine (EBM) competencies and the prescription of drugs without scientific evidence against mild COVID-19 (present with any of the signs and symptoms of COVID-19 but who do not have shortness of breath, dyspnea, or abnormal chest imaging) among recently graduated physicians in Peru. MethodsWe conducted an analytical cross-sectional study where we evaluated a non-probability sample of recently graduated physicians during June and July 2021 (end of second wave of COVID-19 in Peru). Self-rated EBM competencies were assessed by four domains (formulation of a clinical question, search, analysis, and application) using a Likert scale with scores from zero to four (“Very inadequate” = 0, to “Very Adequate” = 4), it was considered as “Adequate” if the score was three or four. In addition, the variable “General competence on EBM” was rated as “Adequate” if in all domains evaluated it presented an adequate self-rating. For the outcome, drug prescription, we considered the use of ivermectin, azithromycin, other antibiotics, hydroxychloroquine, dexamethasone, and anticoagulants (drugs with no efficacy demonstrated for patients with mild COVID-19). To assess the association, we used Poisson regression models with robust variances and obtaining crude (cPR) and adjusted (aPR) prevalence ratios with their 95% confidence intervals (95%CI). ResultsOf a total of 239 physicians included 70.7% prescribed at least one drug without scientific evidence. A total of 51.1% reported adequate ratings in all evaluated domains of EBM. Self-rating the “Clinical Question Formulation” competency as adequate was associated with a lower frequency of prescribing medications for mild COVID-19 (aPR: 0.93; 95% CI: 0.91–0.95). While self-rating as adequate the competency of “Identify possible implications of investigations” was associated with an increase in the prescription of such drugs (aPR: 1.14; 95% CI: 1.09–1.20). Additionally, self-rating all domains as adequate were associated with less prescription (aPR: 0.93; 95% CI: 0.90–0.96). ConclusionSeven out of ten recently graduated physicians prescribed some type of medication without scientific evidence to treat patients with mild COVID-19. Having adequate self-perceived EBM competencies was associated with a lower frequency of prescribing medications without scientific evidence to manage patients with mild COVID-19.

Undergraduate courses of evidence-based medicine in Peruvian medical schools: Characteristics and addressed topics

BackgroundMedical schools are increasingly including evidence-based medicine (EBM) courses in their curricula. However, little is known about the characteristics of these courses in Peru. Therefore, the present study aimed to describe the characteristics and topics addressed by undergraduate courses on EBM in Peruvian medical schools, and to compare the content of these courses with predefined EBM competencies. MethodsWe conducted a cross-sectional study. We obtained the syllabi of undergraduate EBM courses from all medical schools for the latest year available. We extracted their characteristics and categorized the topics they included according to the five steps necessary to apply EBM, divided into 22 competencies. ResultsIn 2021, Peru had 47 universities with active undergraduate medical schools, of which 9 (19.1%) had EBM courses. These courses were not mandatory in three of the universities, and were typically offered between the 2nd and 5th year of the degree program. When analysing the topics covered in the syllabi, we found that they addressed 7 to 13 of the 22 core competencies evaluated. The least addressed topics belonged to steps 4 (apply) and 5 (evaluate) of the EBM process. ConclusionWe found that few Peruvian universities offer EBM courses, and that these courses have heterogeneous characteristics, with syllabi that do not include all essential topics for applying the five steps of EBM.

Evaluating Critical Appraisal Skills by Introducing Journal Clubs to Preclinical Dental Students Using the Assessing Competency in Evidence-Based Medicine (ACE) Tool Through Pre and Post-testing.

Background The ineffective utilization of journal clubs (JCs) for pre-clinical dental students has led to a lack of research into their effectiveness in developing skills such as critical reasoning and evidence-based medicine (EBM) practice. Therefore, we have implemented JCs in first-year undergraduate dental students and measured their effectiveness using the integrated Assessing Competency in Evidence-Based Medicine (ACE) tool. Methodology We conducted a quasi-experimental study where EBM was included in the curriculum for pre-clinical students as a hybrid model with a year-long blended learning approach. The 50-student class was divided into five groups of 10 students, with each group participating in seven JCs related to the physiology curriculum. After conducting critical analysis in self-directed learning sessions, students created interactive PowerPoint presentations followed by discussion. Instructors offered feedback after each session based on 1-2 levels in Kirkpatrick's training evaluation model. Inferential statistics were used for comparative analysis of the ACE tool pre- and post-test using SPSS version 26 (IBM Corp., Armonk, NY, USA). Results A linear trend in median score from 6 in the pre-test to 9 in the post-test was detected using the box and whisker plot. Using paired sample t-test, the mean difference (95% confidence interval) between the pre-test and post-test responses was -3.14 (-2.32 to -3.96) (p < 0.001). In terms of the post-test responses, each item's difficulty index ranged from 0.3 to 0.9. Internal reliability was in the acceptable range of >0.15 (range = 0.5-0.18). The item discriminatory index was in the range of 0.8 to >0.2. Cronbach's alpha was 0.64, which was deemed acceptable. Conclusions Our results show that pre-clinical dentistry students appreciated the use of JCs to improve active learning, critical appraisal, analytical, and decision-making skills. The 15-item ACE measure is a useful and reliable tool for assessing dentistry students' EBM proficiency in Pakistan.

Validity and reliability of the Spanish version of the ACE tool for assessing competencies in evidence-based medicine in medical students

ObjectiveTo translate and culturally adapt the tool ‘Assessing Competency in evidence-based medicine (EBM)’ (ACE) to Spanish and to implement it in a cohort of medical students for the evaluation of...

Reliability and validity of the Persian version of the ACE tool: assessing medical trainees’ competency in evidence-based medicine

BackgroundEvidence-based medicine (EBM) allows users to integrate evidence into decision-making alongside clinical expertise and patient values. This study aimed to evaluate the reliability and validity of the Persian version of the Assessing Competency in EBM (ACE) tool across knowledge, skills, and attitude.MethodsThis cross-sectional study was performed on medical residents (first-year residents and junior residents) of Shiraz University of Medical Sciences in 2019. The study instrument was the ACE tool which consists of 15 two-choice questions (yes–no) and each of these questions measures one of four steps in evidence-based medicine (1- asking the answerable question, 2- searching the literature, 3- critical appraisal, and 4- applying the evidence to scenario). This tool was translated into Persian according to international standards. To ensure that the original and translated ACE questionnaire can be matched accurately and conceptuality, content validity index (CVI) and content validity ratio (CVR) were determined. Cronbach’s alpha was applied to determine the internal consistency for each scale and Confirmatory factor analysis (CFA) was used to survey the factor structure validity.ResultsOne hundred sixty-three questionnaires were studied, selecting 59 first-year medical residents and 104 s-year medical residents. The results showed that using the Persian translation of the ACE tools, the content validity index (CVI) values were equal to or above 0.8 for all items. The content validity ratio (CVR) value was 0.90 for the total scale. The indicators of the confirmatory factor analysis (CFA) for the ACE tool revealed that this model had an acceptable fit. Cronbach’s alpha for the overall score was 0.79.ConclusionThe Persian translated version of the ACE tool is a valid and reliable instrument for assessing medical trainees’ competency in EBM.

Implementing a flipped classroom model in an evidence-based medicine curriculum for pre-clinical medical students: evaluating learning effectiveness through prospective propensity score-matched cohorts

BackgroundIn a flipped classroom (FC) model, blended learning is used to increase student engagement and learning by having students finish their readings at home and work on problem-solving with tutors during class time. Evidence-based medicine (EBM) integrates clinical experience and patient values with the best evidence-based research to inform clinical decisions. To implement a FC and EBM, students require sufficient information acquisition and problem-solving skills. Therefore, a FC is regarded as an excellent teaching model for tutoring EBM skills. However, the effectiveness of a FC for teaching EBM competency has not been rigorously investigated in pre-clinical educational programs. In this study, we used an innovative FC model in a pre-clinical EBM teaching program.MethodsFC’s teaching was compared with a traditional teaching model by using an assessment framework of prospective propensity score matching, which reduced the potential difference in basic characteristics between the two groups of students on 1:1 ratio. For the outcome assessments of EBM competency, we used an analysis of covariance and multivariate linear regression analysis to investigate comparative effectiveness between the two teaching models. A total of 90 students were prospectively enrolled and assigned to the experimental or control group using 1:1 propensity matching.ResultsCompared with traditional teaching methods, the FC model was associated with better learning outcomes for the EBM competency categories of Ask, Acquire, Appraise, and Apply for both written and oral tests at the end of the course (all p-values< 0.001). In particular, the “appraise” skill for the written test (6.87 ± 2.20) vs. (1.47 ± 1.74), p < 0.001), and the “apply” skill for the oral test (7.34 ± 0.80 vs. 3.97 ± 1.24, p < 0.001) had the biggest difference between the two groups.ConclusionsAfter adjusting for a number of potential confunding factors, our study findings support the effectiveness of applying an FC teaching model to cultivate medical students’ EBM literacy.

Nurse-led decision coaching by specialized nurses for healthy BRCA1/2 gene mutation carriers\xa0- adaptation and pilot testing of a curriculum for nurses: a qualitative study

BackgroundWomen with BRCA1/2 mutations are at high risk to develop breast and ovarian cancer. To support these women to participate in shared decision-making, structured nurse-led decision coaching combined with an evidence-based decision aid may be employed.In preparation of the interprofessional randomized controlled trial to evaluate a decision coaching program to support preventive decisions of healthy female BRCA 1/2 gene mutation carriers (EDCP-BRCA), we adapted and piloted an existing training program for specialized nurses and included elements from an existing physician communication training.MethodsThe training was adapted according to the six-step-approach for medical curriculum development. The educational design is based on experience- and problem-based learning.Subsequently, we conducted a qualitative pilot study. Nurses were recruited from six German centers for familial breast and ovarian cancer. The acceptability and feasibility were assessed by structured class observations, field notes and participants’ feedback. Data were analyzed using qualitative content analysis. The training was revised according to the results.Due to the COVID-19 pandemic, the patient intervention was adapted as a virtual coaching and a brief additional training for nurses was added.ResultsThe training consists of two modules (2 + 1 day) that teach competences in evidence-based medicine and patient information, (risk) communication and decision coaching. One pilot test was conducted with six nurses of which three were specialized and experienced in patient counselling. A final set of eight main categories was derived from the data: framework conditions; interaction; schedule, transparency of goals, content, methods, materials and practical relevance and feasibility. Overall, the training was feasible and comprehensible. Decision coaching materials were awkward to handle and decision coaching role plays were set too short. Therefore, materials will be sent out in advance and the training was extended.ConclusionsSpecialized nurses are rarely available and nurse-led counselling is not routinely implemented in the centers of familial breast and ovarian cancer. However, training of less qualified nurses seems feasible. Decision coaching in a virtual format seems to be a promising approach. Further research is needed to evaluate its feasibility, acceptability and effectiveness.Trial registrationThe main trial is registered under DRKS-ID: DRKS00015527.

Effectiveness of evidence-based medicine instruction in medical school clerkships

Introduction: The instruction of evidence-based medicine (EBM) in health sciences institutions is increasing. As used in medical schools, it looks to implement research-oriented approaches to clinical interventions and further develop the skills of medical students in evaluating and applying research.Objectives: This study aimed to identify the effectiveness of an evidence-based medicine clerkship offered at a single institution to third-year medical students during their surgery rotation. Methods: Two surveys were used to assess the quality of education provided during the third-year clerkship. The first was sent to practicing residents who had completed the clerkship as medical students. The second was sent to residency directors overseeing residents with prior enrollment in the clerkship.Results: Twelve former students (out of total email list of 125) and six residency program directors (out of an email list of 13) completed this survey. Previous students felt confident about EBM fundamentals like question formulation and database navigation and, to a lesser degree, attributed their knowledge of databases and critical appraisal to their clerkship experience. Residency program directors acknowledged that residents had good EBM-related skills, but it was inconclusive as to whether this could be attributed to prior clerkship experience.Conclusion: Both questionnaires attested to the retention of some EBM competencies and the effectiveness of librarian-led instruction. Feedback was particularly positive in areas such as navigating information resources and evaluating peer-reviewed research.Keywords: Evidence-based medicine, libraries, clerkships, residents

Self-perceived competencies on evidence-based medicine in medical students and physicians registered in a virtual course: a cross-sectional study

ABSTRACT Background Evidence-based medicine (EBM) is defined as the integration of the best available evidence from scientific studies with clinical experience (and context) and with patients’ values and preferences. The objective of the present study was to describe self-perceived EBM competencies in physicians and medical students enrolled in a massive virtual EBM course. Methods Analytical cross-sectional study. People interested in a free virtual EBM course fulfilled their data in a virtual form for their registration in September 2020. In this form, 22 competencies related to four dimensions of EBM were evaluated: asking a clinical question, search, analysis, and application; using a 5-option Likert scale. The resulting database was analyzed, selecting people who claimed to be physicians or medical students of 18 years or more. Results 1793 participants were included: 1130 medical students and 663 physicians; more than 80% lived in Peru. The frequency of participants who agreed or strongly agreed with feeling qualified in each competence ranged: from 39.2% to 57.8% for the competencies of the ‘Asking a clinical question’ dimension, from 39.2% to 56.1% for ‘Search,’ from 19.9% to 32.0% for ‘Analysis,’ and from 19.6% to 29.9% for ‘Application.’ Both in physicians and students, the lowest frequencies were for the competencies of interpretation of impact measures, graphs, and results of systematic reviews; as well as shared decision making and calculation of expected benefit. Physicians who graduated more recently scored better on competencies from search and analysis dimensions. Conclusion Among physicians and medical students enrolled in the course, self-perception of competencies was lower in the dimensions of analysis and application. More recently graduated physicians seem to have a greater self-perception of their research and analysis skills, probably due to curricular updates. List of abbreviations: EBM: Evidence-based medicine; CIMBE, for its acronym in Spanish: International Course on Evidence-Based Medicine; SOCIMEP, for its acronym in Spanish: Peruvian Medical Student Scientific Society

Face-to-face versus online clinically integrated EBM teaching in an undergraduate medical school: a pilot study

ObjectivesThe aim of this study was to test the feasibility and effectiveness of two models (face-to-face vs online teaching) of clinically integrating evidence-based medicine (EBM) teaching in an undergraduate medical...

Thirty years of teaching evidence-based medicine: have we been getting it all wrong?

Evidence based medicine (EBM) has been synonymous to delivery of quality care for almost thirty years. Since the movement's inception, the assumption has been that decisions based on high quality evidence would translate to better care for patients. Despite EBM's many attractive features and the substantive attention it has received in the contemporary clinical and medical education literature, how it is defined and operationalized as a component of training is often unclear and problematic. How to practice EBM is not well articulated in the literature; therefore, it becomes difficult to teach and equally challenging to assess. In this paper, we put forward a call for deeper consideration of how EBM is taught, and for clarification on how it is defined and operationalized in medical education. In preparing this paper, we considered questions such as what it means to practice EBM, the role that medical education plays in helping realize EBM, how the teaching of EBM can change to reflect recent developments in clinical practice and education, and whether transformations in the practice of medicine necessitate a change inhow we teach EBM. We end with four avenues that may be pursued to advance the teaching of EBM in medical education: (1) consensus on what we mean by EBM; (2) clear articulation of EBM-associated competencies; (3) empirically and theoretically supported means of promoting EBM competencies; (4) ways to assess both skill acquisition and use of EBM. We discuss implications for educators of EBM.

Development and evaluation of a spiral model of assessing EBM competency using OSCEs in undergraduate medical education

BackgroundMedical students often struggle to understand the relevance of Evidence Based Medicine (EBM) to their clinical practice, yet it is a competence that all students must develop prior to graduation. Objective structured clinical examinations (OSCEs) are a valued assessment tool to assess critical components of EBM competency, particularly different levels of mastery as they progress through the course. This study developed and evaluated EBM based OSCE stations with an aim to establish a spiral approach for EBM OSCE stations for undergraduate medical students.MethodsOSCE stations were developed with increasingly complex EBM tasks. OSCE stations were classified according to the classification rubric for EBP assessment tools (CREATE) framework and mapped against the recently published core competencies for evidence-based practice (EBP). Performance data evaluation was undertaken using Classical Test Theory analysing mean scores, pass rates, and station item total correlation (ITC) using SPSS.ResultsSix EBM based OSCE stations assessing various stages of EBM were created for use in high stakes summative OSCEs for different year groups across the undergraduate medical degree. All OSCE stations, except for one, had excellent correlation coefficients and hence a high reliability, ranging from 0.21–0.49. The domain mean score ranged from 13.33 to 16.83 out of 20. High reliability was demonstrated for the each of the summative OSCE circuits (Cronbach’s alpha = 0.67–0.85).In the CREATE framework these stations assessed knowledge, skills, and behaviour of medical students in asking, searching, appraising, and integrating evidence in practice. The OSCE stations were useful in assessing six core evidence-based practice competencies, which are meant to be practiced with exercises. A spiral model of OSCEs of increasing complexity was proposed to assess EBM competency as students progressed through the MBChB course.ConclusionsThe use of the OSCEs is a feasible method of authentically assessing leaner EBM performance and behaviour in a high stakes assessment setting. Use of valid and reliable EBM-based OSCE stations provide evidence for continued development of a hierarchy of assessing scaffolded learning and mastery of EBM competency. Further work is needed to assess their predictive validity.

Auswirkungen eines Wahlfachs zur evidenzbasierten klinischen Entscheidungsfindung auf die Kompetenzen und Einstellungen von Medizinstudierenden: Eine Pilotstudie

Evidence-based medicine (EbM) as a teaching subject is increasingly taken into account in the Master Plan 2020. To date, neither theoretical requirements nor practical applications of EbM have been consistently implemented in the clinical curriculum. To fill this gap, a digital and tutor-based EbM course has been developed. The aim is to identify the student characteristics (statistical competence, Need for Cognition (NFC), work and experience patterns (AVEM), diagnostic uncertainty) of the first cohort in order to ensure successful course implementation and to prepare future doctors for their role as mediators of health literacy using EbM methods. The long-term study started in the summer term 2019 with 10 medical students during their clinical training. The measurements were conducted before (t0) and after course attendance (t1). Socio-demographic variables were taken at t0, the Quick Risk Test, PRU questionnaire, the NFC scale and the AVEM were collected at t0 and t1. Half of the students started their doctoral thesis before attending the course. The first test results of the Quick Risk Test (t0) were between 50% and 90% and at t1 between 60% and 100%. The students showed high scores on the NFC scale (X¯=4.6, SD=0.52, Δ X¯ t0 - t1=0.1) and medium scores on the Perfectionism scale (X¯=3.8, SD=0.51, Δ X¯ t0 - t1=0.1), Resignation Tendency (X¯=3.8, SD=1.17, Δ X¯ t0 - t1=0.1) and on the scale Aggressive Problem Solving (X¯=3.9, SD=1.06, Δ X¯ t0 - t1=0.2). They achieved high levels of Anxiety Due to Diagnostic Uncertainty (X¯=4.8, SD=0.69, Δ X¯ t0 - t1=0.4) and on the scale Concern about Poor Outcomes (X¯=3.9, SD=1.54, Δ X¯ t0 - t1=0.6). The scale Restraint in Disclosing Uncertainty to Patients was more pronounced than the scale Restraint in Disclosing Errors to Physicians (X¯=3.5, SD=0.93, Δ X¯ t0 - t1=-0.3 compared to X¯=2.3, SD=1.20, Δ X¯ t0 - t1=0.1). Statistical competence improved with course attendance, with only one student being able to correctly answer all items at t1. NFC and AVEM were strongly expressed and were not very sensitive to change in the sample. The greatest changes were observed on the scales of concern about poor results and fear of diagnostic uncertainty, both of which decreased with course participation. In the long term, the development of a new measuring instrument to assess EbM competencies instead of the Quick Risk Test is conceivable. The longitudinal design will also enable us to make causal interpretations and to track changes in students' competence feelings, behaviour and attitudes.

Effects of Teaching Evidence-Based Medicine on Physician Assistant Students' Critical Appraisal, Self-Efficacy, and Clinical Application: A Randomized Controlled Trial.

To use a randomized controlled design to explore the effects of evidence-based medicine (EBM) education on physician assistant (PA) students' EBM knowledge, self-efficacy, and evidence-seeking behavior in a simulated clinical situation and to present a model of EBM competence. Sixty-one didactic-year PA students from one Midwestern University (2 sequential cohorts) were randomized to receive the standard PA curriculum plus EBM training (intervention) or the standard PA curriculum only (control). Evidence-based medicine knowledge was measured with a validated Fresno test. Self-efficacy was measured with a validated Likert scale. Clinical application of EBM skills was measured with an objective structured clinical examination (OSCE). Evidence-based medicine education led to significant improvements on the Fresno and self-efficacy tests, both within and between groups. On the OSCE, the intervention group performed no better than the control group. Higher Fresno pretest scores were significantly related to decreasing improvements in the posttest scores: R = -0.634. Teaching EBM to PA students improved their EBM knowledge and self-efficacy but not their clinical application. Future research should focus on enhancing EBM evaluation and application in the clinical setting.

Implementation of an evidence-based medicine curriculum in a fellowship program: Can it influence clinical practice?

ABSTRACT While evidence-based medicine (EBM) curricula improves knowledge scores, correlation with physician behavior, and patient outcomes are not clear. We established an EBM curriculum for Geriatrics and Palliative Medicine fellows that included didactic teaching, opportunity for deliberate practice and presentation, and coaching and feedback from faculty experts, to determine the impact on self-assessed confidence in teaching EBM, Practice-Based Learning and Improvement (PBLI) competency rating and patient care decisions. Seventeen fellows at a New York City academic medical center participated during 2014–2015 academic year. We analyzed pre-/posttest surveys for self-assessed confidence in teaching EBM concepts, EBM worksheets for content of clinical questions and impact on patient care, and PBLI competency ratings for overall impact. Posttest survey indicated that fellows’ self-assessed confidence in teaching EBM increased significantly. While most found Journal Club discussions and EBM case conferences valuable, only 36% of fellows found EBM worksheets completion to be good use of time (average completion time 89 minutes). EBM worksheets helped reinforce or change plan of care in 32 out of 50 cases. There was no impact on end-of-the-year PBLI ratings. This curriculum, integrating didactic, self-directed and peer learning with objective feedback, increased self-assessed confidence in teaching EBM, and influenced patient care plans.

Efficacy of a training programme to support the application of the guideline evidence-based health information: study protocol of a randomised controlled trial

BackgroundThe evidence-based guideline entitled guideline evidence-based health information emerged from the German Network for Evidence-based Medicine (DNEbM) and was published in February 2017. The guideline addresses providers of health information and its goal is to improve the quality of health information. In addition, we explored the competences of providers of health information and developed a training programme.The aim of this study is to evaluate the efficacy of a training programme addressing providers of health information to support the application of the guideline evidence-based health information. We expected the intervention to improve the quality of health information in comparison to the provision of the guideline on its own.Methods/designThe trial uses a superiority randomised control group design with 10 months’ follow-up. Twenty-six providers of health information (groups with up to ten members) will be enrolled to compare the intervention (guideline and training programme) with usual care (a publicly available guideline). The 5-day training programme comprises an evidence-based medicine training module and a module to prepare the application of the guideline. The primary outcome parameter is the quality of the health information. Quality is operationalised as the extent of adherence to the guideline’s recommendations. Each provider will prepare a single health information item informing a health-related decision on a topic freely chosen before randomisation. The quality of this information will be rated using the Mapping Health Information Quality (MAPPinfo) Checklist. An accompanying process evaluation will then be conducted.DiscussionThe study results should show whether the efficacy of the intervention justifies implementation of the training programme to enhance health information developers’ competences in evidence-based medicine and to ensure high-quality evidence-based health information (EBHI) in the long term.Trial registrationISRCTN registry, ID: ISRCTN96941060. Registered on 7 March 2019.

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education

BackgroundThe importance of teaching the skills and practice of evidence-based medicine (EBM) for medical professionals has steadily grown in recent years. Alongside this growth is a need to evaluate the effectiveness of EBM curriculum as assessed by competency in the five ‘A’s’: asking, acquiring, appraising, applying and assessing (impact and performance). EBM educators in medical education will benefit from a compendium of existing assessment tools for assessing EBM competencies in their settings. The purpose of this review is to provide a systematic review and taxonomy of validated tools that evaluate EBM teaching in medical education.MethodsWe searched MEDLINE, EMBASE, Cochrane library, Educational Resources Information Centre (ERIC), Best Evidence Medical Education (BEME) databases and references of retrieved articles published between January 2005 and March 2019. We have presented the identified tools along with their psychometric properties including validity, reliability and relevance to the five domains of EBM practice and dimensions of EBM learning. We also assessed the quality of the tools to identify high quality tools as those supported by established interrater reliability (if applicable), objective (non-self-reported) outcome measures and achieved ≥ 3 types of established validity evidence. We have reported our study in accordance with the PRISMA guidelines.ResultsWe identified 1719 potentially relevant articles of which 63 full text articles were assessed for eligibility against inclusion and exclusion criteria. Twelve articles each with a unique and newly identified tool were included in the final analysis. Of the twelve tools, all of them assessed the third step of EBM practice (appraise) and four assessed just that one step. None of the twelve tools assessed the last step of EBM practice (assess). Of the seven domains of EBM learning, ten tools assessed knowledge gain, nine assessed skills and-one assessed attitude. None addressed reaction to EBM teaching, self-efficacy, behaviours or patient benefit. Of the twelve tools identified, six were high quality. We have also provided a taxonomy of tools using the CREATE framework, for EBM teachers in medical education.ConclusionsSix tools of reasonable validity are available for evaluating most steps of EBM and some domains of EBM learning. Further development and validation of tools that evaluate all the steps in EBM and all educational outcome domains are needed.Systematic review registrationPROSPERO CRD42018116203.