Evidence-based Medicine Competency Research Articles

Clinicians’ self-perceived competency in evidence-based practice at Zagazig University Hospitals, Egypt

Evidence-based medical practice has gained worldwide attention and is an emerging must-know topic for today's physicians. Yet, it continues to puzzle physicians either in its understanding or in its practice, and gaps continue to exist between research-based evidence and clinical practice. This study aimed to evaluate the self perceived EBM competency of the clinicians and staff of Zagazig University Hospital. A cross-sectional study was carried out on a sample of 184 clinicians during the period of March-July 2012 at five randomly chosen special medicine departments (tropical medicine, rheumatology, neurology, dermatology, and hematology-oncology) using a self-administered, specifically tailored questionnaire. Sampled clinicians were dichotomized according to their self-reported frequency of evidence-based practice into evidence-based medicine (EBM) nonusers (62.5%) and EBM users (37.5%). There was no significant difference between users and nonusers in total mean scores (21.37±1.86 vs. 21.34±2.2, P=0.119). Users had significantly higher mean score for self-perceived EBM competency compared with nonusers (P=0.000), although both users and nonusers had unsatisfactory mean score for EBM competency (38.33±2.87 vs. 32.96±3.026, respectively) (median, 39 vs. 33, respectively). Users of EBM had a significantly higher score in competencies related to the use of a bibliographic database, understanding of methodological terminology, confidence in their skills in EBM steps, and consequently in cumulative EBM competency (P=0.000). Our findings support some important facts: first, there is discrepancy between clinicians' perceptions and their competency, as they considered themselves practicing EBM although they were not; second, strategies to promote a change in clinical practice are more likely to be successful if they are based on an analysis of problems. All findings in this study highlighted the importance of training in EBM.

Doctors’ Perceptions and Use of Evidence-Based Medicine

Many primary qualitative studies of barriers and facilitators for doctors' use of evidence-based medicine (EBM) are available, but knowledge remains fragmented. This study sought to synthesize the results of these qualitative studies, taking the variability across context (i.e., medical disciplines, career stages, practice settings, and time of study) into account. The authors searched PubMed through April 26, 2012, and independently selected studies according to prespecified criteria for relevance and methodological quality. Additionally, they performed a thematic synthesis through line-by-line interpretation, coding, and thematic arrangement of information. The search resulted in 1,211 publications, of which 30 studies were included. Five major themes emerged on barriers and facilitators for doctors' use of EBM: individual mind-set, professional group norms, EBM competencies, balance between confidence and critical reflection, and managerial collaboration. The authors found particular barriers and facilitators across career stages. Although clinical experience and professional status were perceived to be helpful, they could also prevent doctors from identifying information needs and adopting new evidence. Although residents' lack of clinical experience raised awareness of information needs, residents perceived lack of clinical experience and their hierarchical dependence on staff as barriers to articulating information needs and to translating and introducing evidence to patient care. Encouragement of group norms for safe communication and shared learning across career stages is perceived as the most prominent facilitator for EBM.

Validation of an Evidence-Based Medicine Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET)

Competence in evidence-based medicine (EBM) is an important clinical skill. Pediatrics residents are expected to acquire competence in EBM during their education, yet few validated tools exist to assess residents' EBM skills. We sought to develop a reliable tool to evaluate residents' EBM skills in the critical appraisal of a research article, the development of a written EBM critically appraised topic (CAT) synopsis, and a presentation of the findings to colleagues. Instrument development used a modified Delphi technique. We defined the skills to be assessed while reviewing (1) a written CAT synopsis and (2) a resident's EBM presentation. We defined skill levels for each item using the Dreyfus and Dreyfus model of skill development and created behavioral anchors using a frame-of-reference training technique to describe performance for each skill level. We evaluated the assessment instrument's psychometric properties, including internal consistency and interrater reliability. The EBM Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET) is composed of 14 items that assess residents' EBM and global presentation skills. Resident presentations (N = 27) and the corresponding written CAT synopses were evaluated using the EBM C-PET. The EBM C-PET had excellent internal consistency (Cronbach α = 0.94). Intraclass correlation coefficients were used to assess interrater reliability. Intraclass correlation coefficients for individual items ranged from 0.31 to 0.74; the average intraclass correlation coefficients for the 14 items was 0.67. We identified essential components of an assessment tool for an EBM CAT synopsis and presentation with excellent internal consistency and a good level of interrater reliability across 3 different institutions. The EBM C-PET is a reliable tool to document resident competence in higher-level EBM skills.

Teaching Scholarly Activity in Psychiatric Training: Years 6 and 7

To address nationally recognized needs for increased numbers of psychiatric clinician-scholars and physician-scientists, the American Association of Directors of Psychiatric Residency Training (AADPRT) has provided a series of full-day conferences of psychiatry residency training directors designed to increase their competence in evidence-based medicine, enhance their research literacy, and aid them in transmitting that knowledge to their programs. These conferences take place on the day before AADPRT's annual meeting. Each year's pre-meeting conference includes a series of morning plenary sessions covering new information pertaining to a contemporary clinical theme. The clinical theme serves as a vehicle to teach evidence-based practice and research and neuroscience literacy. The theme is carried into the afternoon with a series of highly interactive small-group teaching sessions designed to consolidate knowledge and provide pragmatic teaching tools appropriate for residents. A detailed report of the first 5 years documented the excellent attendance, perceived satisfaction, and usefulness of the material. This report highlights the evolution of the program from the first 5 years to Years 6 and 7, details how new pedagogic and funding challenges have been approached, discusses the strengths and weaknesses of the revised format, and describes plans for the future.

Factors influencing the EBM behaviour of GP trainers: A mixed method study

Background: General practitioner (GP) trainees state that their trainers are not consistent in using evidence-based medicine (EBM) or are even dismissive of it. As trainers are important role models in the Dutch GP training system this could have a large influence on the EBM training of GP trainees.Aim: To establish the motivations and barriers of Dutch GP trainers in using EBM.Methods: A questionnaire on personal characteristics, knowledge, skills (Berlin, score 0–15) and attitude (McColl, VAS score 0–100), and statements about EBM barriers were presented to 106 GP trainers. Additionally, three focus group sessions with trainers (n = 30) were held.Results: Knowledge and skills were less than half correct (mean 6.1, standard deviation (SD) 2.9); the overall score on attitude was 58.8 (SD 9.4). Factor analysis showed four categories of barriers: EBM competence (mean 3.5 (SD 0.8)), search activities (mean 3.5 (SD 0.8)), motivation (mean 3.8 (SD 0.7)) and time (mean 2.5 (SD 0.9)).After analysis of the focus group sessions, five categories of motivations and barriers predominated: EBM competence, attitude and behaviour, sources, time and logistics.Conclusion: GP trainers experience motivations in EBM; however, these motivations can also be barriers, depending on the trainer's level of knowledge and attitude.

Teaching evidence-based medicine literature searching skills to medical students during the clinical years: a randomized controlled trial

Constructing an answerable question and effectively searching the medical literature are key steps in practicing evidence-based medicine (EBM). This study aimed to identify the effectiveness of delivering a single workshop in EBM literature searching skills to medical students entering their first clinical years of study. A randomized controlled trial was conducted with third-year undergraduate medical students. Participants were randomized to participate in a formal workshop in EBM literature searching skills, with EBM literature searching skills and perceived competency in EBM measured at one-week post-intervention via the Fresno tool and Clinical Effectiveness and Evidence-Based Practice Questionnaire. A total of 121 participants were enrolled in the study, with 97 followed-up post-intervention. There was no statistical mean difference in EBM literature searching skills between the 2 groups (mean difference = 0.007 (P = 0.99)). Students attending the EBM workshop were significantly more confident in their ability to construct clinical questions and had greater perceived awareness of information resources. A single EBM workshop did not result in statistically significant changes in literature searching skills. Teaching and reinforcing EBM literature searching skills during both preclinical and clinical years may result in increased student confidence, which may facilitate student use of EBM skills as future clinicians.

Scientific research as a service for our patients: utopia or necessity?

Clinical research has led to great progress in the care of patients. Scientific research principles have been applied to medical research, nevertheless the results of this human activity are somehow more discussed than in other fields of science. Evidence-based medicine (EBM) is a concept and a function used in human medicine since the 90s to apply research results to medical practice. This concept refers to the careful, transparent and wise use of current best evidence from research for the individual care of patients [1]. After an early enthusiastic welcome, the real value of EBM in clinical practice has been recently questioned. Pro. According to supporters, the aim of EBM is to provide new tools to assist clinicians, and new challenges to practitioners. Therefore, EBM represents a highly individualised, patient-centered approach to clinical decision making. Using EBM clinicians should be able to care at best their patients, looking for, and interpreting the quality of scientific evidence. Furthermore, clinicians should always take into account patients’ values and preferences in the decision-making process [2]. These supporters recognise that there is the need to integrate different types of evidence from a range of sources to improve decisions about individual patients, to include guidelines in personal clinical practice of the individual patient [1]. Supporters conclude that effective teaching of EBM to medical students is important for lifelong self-directed learning [3]. Nevertheless, there is evidence that at the undergraduate level, self-perceived does not correlate well with objectively assessed competence in EBM [4]. Con. The objection of EBM less enthusiastic supporters is that a wise physician should make individually tailored decisions on a background of scientific theory which might be seen as a source of medical certainty [5].

Assessing Undergraduate Competence in Evidencebased Medicine: A Preliminary Study on the Correlation Between Two Objective Instruments

The Fresno test and the Berlin Questionnaire are two validated instruments for objectively assessing competence in evidence-based medicine (EBM). Although both instruments purport to assess a comprehensive range of EBM knowledge, they differ in their formats. We undertook a preliminary study using the adapted version of the two instruments to assess their correlations when administered to medical students. The adaptations were made mainly to simplify the presentation for our undergraduate students while preserving the contents that were assessed. We recruited final-year students from a Malaysian medical school from September 2006 to August 2007. The students received a structured EBM training program within their curriculum. They took the two instruments concurrently, midway through their final six months of training. We determined the correlations using either the Pearson's or Spearman's correlation depending on the data distribution. Of the 120 students invited, 72 (60.0%) participated in the study. The adapted Fresno test and the Berlin Questionnaire had a Cronbach's alfa of 0.66 and 0.70, respectively. Inter-rater correlation (r) of the adapted Fresno test was 0.9. The students scored 45.4% on average [standard deviation (SD) 10.1] on the Fresno test and 44.7% (SD 14.9) on the Berlin Questionnaire (P = 0.7). The overall correlation between the two instruments was poor (r = 0.2, 95% confidence interval: -0.07 to 0.42, P = 0.08), and correlations remained poor between items assessing the same EBM domains (r = 0.01-0.2, P = 0.07-0.9). The adapted versions of the Fresno test and the Berlin Questionnaire correlated poorly when administered to medical students. The two instruments may not be used interchangeably to assess undergraduate competence in EBM.

How learning style affects evidence-based medicine: a survey study

BackgroundLearning styles determine how people manage new information. Evidence-based medicine (EBM) involves the management of information in clinical practice. As a consequence, the way in which a person uses EBM can be related to his or her learning style. In order to tailor EBM education to the individual learner, this study aims to determine whether there is a relationship between an individual's learning style and EBM competence (knowledge/skills, attitude, behaviour).MethodsIn 2008, we conducted a survey among 140 novice GP trainees in order to assess their EBM competence and learning styles (Accommodator, Diverger, Assimilator, Converger, or mixed learning style).ResultsThe trainees' EBM knowledge/skills (scale 0-15; mean 6.8; 95%CI 6.4-7.2) were adequate and their attitudes towards EBM (scale 0-100; mean 63; 95%CI 61.3-64.3) were positive. We found no relationship between their knowledge/skills or attitudes and their learning styles (p = 0.21; p = 0.19). Of the trainees, 40% used guidelines to answer clinical questions and 55% agreed that the use of guidelines is the most appropriate way of applying EBM in general practice. Trainees preferred using evidence from summaries to using evidence from single studies. There were no differences in medical decision-making or in EBM use (p = 0.59) for the various learning styles. However, we did find a link between having an Accommodating or Converging learning style and making greater use of intuition. Moreover, trainees with different learning styles expressed different ideas about the optimal use of EBM in primary care.ConclusionsWe found that EBM knowledge/skills and EBM attitudes did not differ with respect to the learning styles of GP trainees. However, we did find differences relating to the use of intuition and the trainees' ideas regarding the use of evidence in decision-making.

The practice of evidence-based medicine (EBM) in gastroenterology: discrepancies between EBM familiarity and EBM competency

Evidence-based medicine (EBM) has become increasingly important in the practice of gastroenterology and endoscopy, and the training of future gastroenterology physicians. The objectives were to assess the attitudes/opinions of gastroenterology specialists towards EBM, and evaluate possible gaps in education for certain EBM-related concepts. An internet-based survey was emailed to 4073 gastroenterology specialists. The main outcome measurements were physicians' endorsement of EBM, impact of EBM on clinical practice, utilization of EBM-specific resources, self-assessed understanding of EBM concepts (EBM familiarity score), and actual knowledge of EBM concepts (EBM competency score). A total of 337 gastroenterology specialists participated. On a sale of 1-10, there was widespread agreement that EBM improves patient care (median score = 9, interquartile range (IQR) = 7-10), and physicians should be familiar with techniques for critical appraisal of studies (median = 9, IQR = 8-10). Most (64.0%) utilized the EBM-related resource UpToDate™ regularly, as opposed to PubMed™ (47.1%) or Clinical Evidence™ (5.4%). The mean EBM familiarity score was 3.4 ± 0.6 on a scale of 1-4. Out of a maximum 49 points, the mean EBM competency score was 35 ± 4.9. There was poor concordance among EBM familiarity and competency scores (r = 0.161; p = 0.005). Academic practice (p < 0.001), research/teaching (p < 0.001), advanced degree (p = 0.012), and recent EBM training (p = 0.001) were all associated with improved EBM competency. The attitudes and opinions of EBM are extremely favorable among gastroenterology physicians. Although gastroenterology physicians report familiarity with most EBM-related concepts, there is poor correlation with their actual knowledge of EBM. Further educational initiatives should be undertaken to address methods in which EBM skills are reinforced among all gastroenterology practitioners.

Teaching evidence based medicine literature searching skills to medical students during the clinical years - a protocol for a randomised controlled trial

BackgroundTwo of the key steps in evidence based medicine (EBM) are being able to construct a clinical question and effectively search the literature to source relevant information. No evidence currently exists that informs whether such skills should be taught to medical students during their pre-clinical years, or delivered to include both the pre-clinical and clinical years of study. This is an important component of curriculum design as the level of clinical maturity of students can affect their perception of the importance and uptake of EBM principles in practice.Methods/DesignA randomised controlled trial will be conducted to identify the effectiveness of delivering a formal workshop in EBM literature searching skills to third year medical students entering their clinical years of study. The primary outcome of EBM competency in literature searching skills will be evaluated using the Fresno tool.DiscussionThis trial will provide novel information on the effectiveness of delivering a formal education workshop in evidence based medicine literature searching skills during the clinical years of study. The result of this study will also identify the impact of teaching EBM literature searching skills to medical students during the clinical years of study.

Self-perceived competence correlates poorly with objectively measured competence in Evidence Based Medicine among medical students

BackgroundPrevious studies report various degrees of agreement between self-perceived competence and objectively measured competence in medical students. There is still a paucity of evidence on how the two correlate in the field of Evidence Based Medicine (EBM). We undertook a cross-sectional study to evaluate the self-perceived competence in EBM of senior medical students in Malaysia, and assessed its correlation to their objectively measured competence in EBM.MethodsWe recruited a group of medical students in their final six months of training between March and August 2006. The students were receiving a clinically-integrated EBM training program within their curriculum. We evaluated the students' self-perceived competence in two EBM domains ("searching for evidence" and "appraising the evidence") by piloting a questionnaire containing 16 relevant items, and objectively assessed their competence in EBM using an adapted version of the Fresno test, a validated tool. We correlated the matching components between our questionnaire and the Fresno test using Pearson's product-moment correlation.ResultsForty-five out of 72 students in the cohort (62.5%) participated by completing the questionnaire and the adapted Fresno test concurrently. In general, our students perceived themselves as moderately competent in most items of the questionnaire. They rated themselves on average 6.34 out of 10 (63.4%) in "searching" and 44.41 out of 57 (77.9%) in "appraising". They scored on average 26.15 out of 60 (43.6%) in the "searching" domain and 57.02 out of 116 (49.2%) in the "appraising" domain in the Fresno test. The correlations between the students' self-rating and their performance in the Fresno test were poor in both the "searching" domain (r = 0.13, p = 0.4) and the "appraising" domain (r = 0.24, p = 0.1).ConclusionsThis study provides supporting evidence that at the undergraduate level, self-perceived competence in EBM, as measured using our questionnaire, does not correlate well with objectively assessed EBM competence measured using the adapted Fresno test.Study registrationInternational Medical University, Malaysia, research ID: IMU 110/06

Evidence‐based medicine training in a resource‐poor country, the importance of leveraging personal and institutional relationships

Efforts to implement evidence-based medicine (EBM) training in developing countries are limited. We describe the results of an international effort to improve research capacity in a developing country; we conducted a course aimed at improving basic EBM attitudes and identified challenges. Between 2005 and 2009, we conducted an annual 3-day course in Perú consisting of interactive lectures and case-based workshops. We assessed self-reported competence and importance in EBM using a Likert scale (1 = low, 5 = high). Totally 220 clinicians participated. For phase I (2005-2007), self-reported EBM competence increased from a median of 2 to 3 (P < 0.001) and the perceived importance of EBM did not change (median = 5). For phase II (2008-2009), before the course, 8-72% graded their competence very low (score of 1-2). After the course, 67-92% of subjects graded their increase in knowledge very high (score of 4-5). The challenges included limited availability of studies relevant to the local reality written in Spanish, participants' limited time and lack of long-term follow-up on practice change. Informal discussion and written evaluation from participants were universally in agreement that more training in EBM is needed. In an EBM course in a resource-poor country, the baseline self-reported competence and experience on EBM were low, and the course had measurable improvements of self-reported competence, perceived utility and readiness to incorporate EBM into their practices. Similar to developed countries, translational research and building the research capacity in developing countries is critical for translating best available evidence into practice.

Undergraduate medical student perceptions and use of Evidence Based Medicine: A qualitative study

BackgroundMany medical schools teach the principles of Evidence Based Medicine (EBM) as a subject within their medical curriculum. Few studies have explored the barriers and enablers that students experience when studying medicine and attempting to integrate EBM in their clinical experience. The aim of this study was to identify undergraduate medical student perceptions of EBM, including their current use of its principles as students and perceived future use as clinicians.MethodsThird year medical students were recruited via email to participate in focus group discussions. Four focus groups were conducted separately across four hospital sites. All focus groups were conducted by the same facilitator. All discussions were transcribed verbatim, and analysed independently by the two authors according to the principles of thematic analysis.ResultsFocus group discussions were conducted with 23 third-year medical students, representing three metropolitan and one rural hospital sites. Five key themes emerged from the analysis of the transcripts: (1) Rationale and observed use of EBM in practice, (2) Current use of EBM as students, (3) Perceived use of EBM as future clinicians, (4) Barriers to practicing EBM, and (5) Enablers to facilitate the integration of EBM into clinical practice. Key facilitators for promoting EBM to students include competency in EBM, mentorship and application to clinical disciplines. Barriers to EBM implementation include lack of visible application by senior clinicians and constraints by poor resourcing.ConclusionsThe principles and application of EBM is perceived by medical students to be important in both their current clinical training and perceived future work as clinicians. Future research is needed to identify how medical students incorporate EBM concepts into their clinical practice as they gain greater clinical exposure and competence.

1. Validation of an Evidence-Based Medicine (EBM) Critically Appraised Topic

ACGME requirements for residency and fellowship training mandate the teaching and evaluation of competence in evidence-based medicine (EBM). Many residency programs now require an EBM project, such as the creation and presentation of a Critically Appraised Topic (CAT) to demonstrate these skills. However, there are few validated tools available to assess EBM skills among residents, and there is no known valid and reliable tool to assess residents' ability to develop and present an EBM CAT.

Assessment of the Methodological Quality of Systematic Reviews Published in the Urological Literature From 1998 to 2008

Well done systematic reviews provide the highest quality evidence for clinical questions of therapeutic effectiveness. We assessed the methodological quality of systematic reviews in the urological literature. We systematically investigated all systematic reviews published in 4 major urological journals from 1998 to 2008. Studies were identified using a predefined search strategy in PubMed and confirmed by a hand search of journal tables of contents. A validated 11-point instrument to assess the methodological quality of systematic reviews was applied by 2 independent reviewers after a pilot testing phase. Disagreements were discussed and resolved by consensus. The systematic literature search identified 217 individual systematic reviews, of which 57 ultimately met study eligibility criteria. Ten (17.5%), 20 (35.1%) and 27 (47.4%) systematic reviews were published in 1998 to 2001, 2002 to 2005 and 2006 to 2008, respectively. Using the measurement tool to assess systematic reviews the mean +/- SD score was 4.8 +/- 2.0 points. Fewer than half of all systematic reviews performed a systematic literature search that included at least 2 databases (49.1%) or unpublished studies (31.6%), or provided a list of included and excluded studies (45.6%). Of the systematic reviews 63.2% assessed and documented the methodological quality of included studies. Systematic reviews with The Cochrane Collaboration authorship affiliation had a higher mean score than those with no such reported affiliation (6.5 +/- 1.2 vs 4.4 +/- 1.9 points, p <0.001). Results suggest that an increasing number of systematic reviews are published in the urological literature. However, many systematic reviews fail to meet established methodological standards, raising concerns about validity. Increased efforts are indicated to promote quality standards for performing systematic reviews among the authors and readership of the urological literature.

Rationale for Using OSCEs to Assess Student Competency in Evidence-based Medicine

Rationale for Using OSCEs to Assess Student Competency in Evidence-based Medicine

Development and validation of a questionnaire to evaluate medical students' evidence-based medicine competencies.

The purpose of the study was to develop and validate a questionnaire to evaluate medical students' knowledge of, attitude towards and practice of evidence-based medicine (EBM). The participants of the study were 418 medical students enrolled in the Kyung Hee University School of Medicine in Seoul, Korea. To examine construct validity of the questionnaire, an exploratory factor analysis (EFA) was performed with 118 participants; a confirmatory factor analysis (CFA) was conducted with the remaining 281 participants. We developed 41 items with a 4-point Likert scale. An EFA was performed to verify the emergence of four dimensions of EBM competencies. The principal axis factoring method and the direct oblimin rotation method were used. To confirm construct validity, a CFA was conducted with the remaining 281 participants. To evaluate model fitness, root mean square error of approximation (RMSEA) and comparative fit index (CFI) were used as fit indices. We conducted ANOVA with Scheffe as discriminant validation, and calculated Cronbach's alpha of 4 subscales as reliability checkup. After refinement procedure, factor analysis of the 32 items in therevised questionnaire yielded 4 factors. The Scree plot supported a 4 factor solution explaining 53.5% of the variance. The 4 components derived were: factor 1_knowledge on EBM (11 items; Cronbach's alpha=0.92); factor 2_ pursuit towards EBM (10; 0.88); factor 3_reluctance on EBM (7; 0.78); factor 4_practice of EBM (4; 0.75). The questionnaire could discriminate competence differences among 1-3 yr students. Satisfactory Cronbach's alpha scores were noted for each factor as well. The EBM competency questionnaire was validated.

Perceptions and Competence in Evidence-Based Medicine: A Survey of the American Urological Association Membership

We investigated the attitudes and opinions of urologists toward evidence-based medicine to help guide future efforts of the American Urological Association and other organizations vested in the education and training of urologists. From August to November 2006 we performed a mail survey of a random sample of 2,000 members of the American Urological Association. Questions in the survey addressed the role of evidence-based medicine in urology, participants' self-assessed understanding of evidence-based medicine related terminology, their familiarity with and use of web based evidence-based medicine resources, as well as their evidence-based medicine competence based on their understanding of core concepts such as randomization and blinding. A total of 889 respondents completed the survey resulting in a response rate of 45%. There was widespread agreement that practicing evidence-based medicine improves patient care (median score 8; IQR 7, 10) and that every urologist should be familiar with critical appraisal techniques (median score 9; IQR 8, 10). The percentage of respondents who indicated that they "understand and could explain to others" the terms number needed to treat, power and level of evidence was 42%, 29% and 18%, respectively. The American Urological Association Guidelines were used regularly by 35% and on occasion by 51% of respondents. Of the participants 44% were unaware of the PubMed(R) search engine and only 14% used it regularly, while 76% were unaware of the Cochrane Database of Systematic Reviews and only 8% had ever used it. The mean evidence-based medicine competence score for all respondents was 67.2% +/- 17.0%. The findings of this survey confirm that urologists have a favorable attitude toward evidence-based medicine. However, understanding of evidence-based medicine terminology, concepts and use of related resources among American Urological Association members leaves room for improvement. Increased efforts to promote an understanding of evidence-based medicine through workshops, publications and web based resources specifically for a urological audience appear indicated.

Questions Remain about Whether EBM Competencies Learned in Medical School are Retained in Residency

Objective – To assess medical graduates’ use of evidence based medicine (EBM) in residency, self-perception of EBM skills, attitudes toward EBM, and the impact of a formal EBM curriculum in their third undergraduate year.&#x0D; &#x0D; Design – A longitudinal follow-up study by self-administered questionnaire.&#x0D; &#x0D; Setting – Internal medicine residency programs in US hospitals.&#x0D; &#x0D; Subjects – A convenience sample of 2001 and 2002 graduates of the University of Illinois College of Medicine at Peoria (UICOM-P) (n=78), and their respective residency program directors (n=72).&#x0D; &#x0D; Methods – A student graduate questionnaire (SGQ) was sent to all members of UICOM-P’s 2001 and 2002 graduating classes who had completed the EBM course during their M-3 Internal Medicine clerkship. A program director questionnaire (PDQ), similar to the SGQ, was sent to the graduates’ residency program directors. The research instrument was tested with a pilot group prior to use, but not validated. The questionnaires consisted of 4 main sections. The first section examined formal and informal EBM programs in the graduates’ residency curriculum. The second section consisted of a self-assessment of EBM skills by the residents and an assessment of those skills by their program directors. The third section asked graduates to compare their EBM skills to those of their fellow residents who had not been students at UICOM-P. Similarly, in the third section of the PDQ, program directors were asked to compare the EBM skills of UICOM-P graduates and non-UICOM-P graduates participating in the residency program. The last section concerned professional and demographic characteristics. Copies of the surveys were mailed out to non-responders after 6 weeks. Results were collated but statistical analysis was not applied.&#x0D; &#x0D; Main results – The response rate was 32% for residents and 35% for program directors. The number of incomplete surveys was not reported. Forty-four percent of all respondents reported having a formal EBM curriculum for residents, and 76% reported an informal curriculum. For both formal and informal programs, the most common teaching formats were journal clubs, followed by lectures, teaching rounds, morning reports, bedside consultations, ambulatory clinics and seminars. In section two of the questionnaires, both residents and program directors rated the residents’ EBM skills similarly. However, the residents rated their skills in searching the literature and application of findings to clinical practice higher than the program directors. Program directors also rated the residents’ skills in understanding statistics and tests higher than the residents themselves. Twenty-four percent of both residents and program directors rated the UICOM-P graduates as “very competent” or “extremely competent” in EBM skills (50). Only 35% of program directors and 27% of residents rated the UICOM-P graduates’ EBM skills as “usually better” or “always better” than their peers who were not UICOM-P graduates (50).&#x0D; &#x0D; Conclusion - The authors of this study conclude that, for UICOM-P graduates, “it might be implied from these results that the EBM skills gained during medical school were retained through their medical school graduation and into their residency training” (51). However, this study has methodological weaknesses which make it difficult to draw any definite conclusions from the results.