Methodological Quality Of Clinical Guidelines Research Articles

A Critical Appraisal of the Congress of Neurological Surgeons Evidence-Based Guidelines on the Evaluation and Treatment of Patients With Thoracolumbar Spine Trauma.

Background and objective Thoracolumbar spine trauma (TST) is frequently associated with spinal cord injury and other soft tissue and bony injuries.The management of such injuries requires an evidence-based approach. This study used the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument to assess the methodological quality of clinical guidelines for the management of TST published by the Congress of Neurological Surgeons (CNS). Methods All clinical guidelines on TST published by CNS until 2020 were assessed. Five appraisers from three international centers evaluated the quality of eligible clinical guidelines by using AGREE II. Mean AGREE II scores for each domain were determined. In higher-quality domains, the scores for individual items were analyzed. Results A total of 12 guidelines published by CNSon TST were assessed. Mean scores for all six domains were as follows: Scope and Purpose (75.2%), Stakeholder Involvement (45.4%), Rigor of Development (57.0%), Clarity of Presentation (58.7%), Applicability (16.9%), and Editorial Independence (64.1%). The mean score for the overall quality of all CNS guidelines was 52.9% [95% confidence interval (CI): 52.2-53.5%]. The overall agreement among appraisers was excellent [intra-class correlation coefficients (ICCs) for each guideline ranged from 0.903 to 0.963]. Conclusions CNS guidelines for the management of TST demonstrated acceptable quality across most domains; however, the domains of Applicability and Stakeholder Involvement could befurther improved in future guideline updates. The assessors concluded that all guidelines could still be recommended for clinical practice with or without modifications.

Clinical guidelines for herpes labialis: recommendations and quality evaluation according to AGREE II.

To evalúate the methodological quality of Clinical Guidelines (CG), clinical guides and manuals for care of the population affected by herpes labialis, to verify their compliance with evidence-based health standards. A search was conducted for CG on labial herpes in the MedicalLiteratureAnalysis andRetrieval System Online (Medline) database, Google Scholar, Brazilian Virtual Health Library (BVS), and sites of institutions/professional categories, using the descriptors "herpes labialis" or "oral herpes". Document quality was assessed using the Appraisal of Guidelines for Research & Evaluation Instrument (AGREE II). The Kappa test was used to avoid randomness or poor agreement between results. Analysis of the 12 selected publications on the management of labial herpes revealed flaws in quality, as the publications did not follow a quality standard. The main quality flaws identified were in "rigor in development" and "applicability. ". Priorities need to be redefined in the development of CG for clinical practice related to fever blisters to reduce the variability of the quality standard, and generate reliable, applicable recommendations.

Quality Assessment of Clinical Guidelines for Preventing Falls in Hospitalized Elderly People in Iran Using the Appraisal of Guidelines, Research, and Evaluation (AGREE) Checklist

Objectives Hospitalization is a vulnerable period for the elderly. During this period, they are at risk of falling. There are various clinical guidelines for fall prevention, whose usefulness depends on their quality and clinical acceptance. This study was to evaluate the methodological quality of selected clinical guidelines for fall prevention in hospitalized elderly people in Iran using the Appraisal of Guidelines, Research, and Evaluation (AGREE) checklist. Methods & Materials A systematic search was conducted for clinical guidelines published from 2009 to 2020 using the keywords clinical guideline, falling, prevention, aged, and hospitalization. Of 351 clinical guidelines identified, 4 guidelines were selected based on the inclusion and exclusion criteria and by a purposive sampling method. The quality of the selected guidelines was evaluated by 5 experts independently using the AGREE II checklist. Based on the quality scores, the guidelines were categorized as “highly recommended” or “recommended with modifications”. Results The "Falls Assessment and Prevention of Falls in Older People", "Preventing Falls and Harm From Falls in Older People", and "Preventing Falls and Reducing Injury from Falls" were categorized as highly recommended, while the "Post Fall Multidisciplinary Management Guidelines for Western Australian Health Care Settings" was categorized as “recommended with modifications”. Therefore, they can be localized and used to reduce the risk of falls in hospitalized elderly people in Iran. The mean overall scores of 6 domains for the guidelines were as follows: 91. 1% for “clarity of presentation”, 86. 6% for “scope and purpose”, 83. 6% for “stakeholder involvement” 72. 08% for “editorial independence”, 71. 14% for “rigor of development”, and 66. 66% for “applicability”. Conclusion Evaluation of the methodological quality of clinical guidelines using the AGREE tool should be done to be able to be used in clinical practice. It is recommended to use these tools in updating the current or future clinical guidelines to ensure their methodological quality.

Critical Appraisal of Paralyzed Veterans of America Guidelines in Spinal Cord Injury: An International Collaborative Study Using the Appraisal of Guidelines for Research and Evaluation II Instrument (AGREE II).

Spinal cord injuries (SCI) in military personnel, veterans, and others require an evidence-based, multidisciplinary approach to their care. This appraisal used the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument to evaluate the methodological quality of clinical guidelines for the management of SCI published by the Paralyzed Veterans of America (PVA) organization. We searched clinical guidelines on SCI published by PVA until December 2019. Four appraisers across three international centers independently evaluated the quality of eligible clinical guidelines using AGREE II. Mean AGREE II scores for each domain were calculated. In higher quality domains, scores for individual items were analyzed. A total of 12 guidelines published by PVA on SCI were assessed. Mean scores for all six domains were as follows: Scope and Purpose (78.8%), Stakeholder Involvement (63.7%), Rigor of Development (68.4%), Clarity of Presentation (80.1%), Applicability (53.0%), and Editorial Independence (28.5%). The mean score for the overall quality of all PVA guidelines was 71.9% (95% CI: 69.7-74.1). No guideline was assessed as "not recommended" by any appraiser. Overall quality was significantly associated with year of publication (rs = 0.754, P = 0.0046). Overall agreement among appraisers was excellent (intraclass correlation coefficients for each guideline ranged from 0.96 to 0.99). PVA guidelines for the management of SCI demonstrated acceptable or good quality across most domains. We recommend the use of PVA guidelines for the assessment and treatment of SCI and related disorders. The quality of PVA guidelines for the management of SCI have improved over time.

Methodological quality of clinical guidelines for universal newborn hearing screening.

To review existing guidelines for universal newborn hearing screening (UNHS), identify those that provide comprehensive and clear recommendations on the subject, and provide a brief overview. A scoping literature review was performed in PubMed, the Guidelines International Network library, and national guideline databases to identify guidelines on newborn hearing screening developed or updated between 2004 and 2019. The quality of the guidelines was checked with the Checklist for the Quality Assessment of Guidelines (AGREE II). Six guidelines met all the inclusion criteria. All six were based on the 1-3-6 benchmark (screening completed by 1mo, audiological diagnosis by 3mo, enrolment in early intervention by 6mo). However, the guidelines varied in terms of their recommendations for the application of screening methods, role of health professionals in the screening process, and quality. Based on the AGREE II score, flexibility, adaptability, and foundation role for all other guidelines, the 2019 guidelines of the Joint Committee on Infant Hearing position statement were identified as the most appropriate to be recommended for adaptation by countries or programmes. The diversity in the existing guidance can be confusing for countries and institutions that are planning to develop universal hearing screening programmes. As more countries and organizations develop their newborn hearing screening programmes, they will need examples to emulate. This review provides an evaluation of the quality, comprehensiveness, and applicability of existing clinical guidelines that can serve as a facilitator for countries, institutions, or organizations in their planning and implementation of a UNHS programme.

Quality and Specific Concerns of Clinical Guidelines for Integrated Chinese and Western Medicine: A Critical Appraisal.

Objective This study aimed to investigate the methodological quality of clinical guidelines (CGs) for integrated Chinese and Western medicine (ICWM) to inform clinical practice and guideline development. Methods We searched PubMed, EMBASE, Chinese Biomedical Literature Database, China National Knowledge Infrastructure, Wanfang Data, VIP, five guideline databases, and four online book malls to identify ICWM CGs published up to January 11, 2019. Four independent appraisers assessed the quality of CGs using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument and evaluated six specific concerns for ICWM. The standardized scores were calculated for the individual AGREE II domains. Results Sixty-two ICWM CGs were included. The median standardized scores in the six domains of AGREE II were 65% in scope and purpose, 46% in clarity of presentation, 26% in applicability, 24% in stakeholder involvement, 15% in rigor of development, and 0% in editorial independence. The quality of ICWM CGs was significantly associated with the publication year (higher quality for CGs published after 2014) and the development method (higher quality for evidence-based CGs). Only one ICWM CG obtained a direct recommendation for use, and 14 could be recommended for use after modifications. The intra-appraiser consistency of the AGREE II appraisal was good (mean intraclass correlation coefficient range, 0.813–0.998). ICWM CGs also lacked a systematic search of ancient traditional Chinese medicine (TCM) classics (40.3%), conversion of TCM recommendations from ancient Chinese to the vernacular (14.5%), a discussion of interactions between TCM and Western medicine (27.4%), and rankings of different ICWM choices (0%). Conclusions Although an improvement after 2014 occurred, the current 64 ICWM CGs are generally of poor methodological quality. Only 15 ICWM CGs can be recommended for use directly or with modifications. As the key distinctions from Western/Chinese medicine CGs, the ICWM-specific recommendations are also insufficient for the ICWM CGs, especially for interactions between TCM and Western medicine and rankings of different ICWM choices. Study Registration. This study has been registered at PROSPERO (no. CRD42018095767).

Appraisal of exercise recommendations for osteoporosis treatment of current guidelines: a systematic review

International guidelines include resistance exercise as part of osteoporosis treatment, although there is no clear agreement on exercise prescription. The aim of this study was to assess methodological quality of clinical guidelines that included exercise as a therapeutic intervention for osteoporosis, in order to establish the recommendations with the best level of evidence. A systematized review on clinical guidelines for osteoporosis published between 2010 and 2014 was performed. Each guide was assessed by 4 blinded reviewer experts on osteoporosis rehabilitation. Guidelines scored 4.5 or more were selected for data extraction. Intra-class concordance coefficient was obtained for overall guideline assessment. Three guidelines fulfilled our inclusion criteria. After Appraisal of Guidelines for Research & Evaluation II (AGREE-II) assessment, 2 obtained 4.5 or more AGREE-II score. Only exercise recommendations were included. Future clinical guidelines development and updates must enhance adequate methodological quality, considering age, comorbidities and functional assessment in exercise prescription for osteoporosis treatment.

Clinical guidelines in pediatric headache: evaluation of quality using the AGREE II instrument.

BackgroundThe Appraisal of Guidelines for Research and Evaluation (AGREE II) tool is a validated questionnaire used to assess the methodological quality of clinical guidelines (CGs). We used the AGREE II tool to assess the development process, the methodological quality, and the quality of reporting of available pediatric CGs for the management of headache in children. We also studied the variability in responses related to the characteristics of eleven Italian neuropediatric centers, showing similarities and differences in the main recommendations reported in CGs.MethodsA systematic literature search was conducted from January 2002 to June 2013 on Mediline, the Cochrane database, the National Guideline Clearinghouse website and the NHS evidence search tool, using the following terms: headache, cephalalgia, guidelines and children (MESH or text words). Six CGs providing information on the diagnosis and management of headache and specific recommendations for children were selected. Eleven neuropediatric centers assessed the overall quality and the appropriateness of all available CGs using of the AGREE II instrument.ResultsSix CGs meeting the inclusion and exclusion criteria were identified and assessed by 11 reviewers. Our study showed that the NICE CGs was “strongly recommended” while the French and Danish CGs were mainly “not recommended”. The comparison between the overall quality score of the French CGs and the NICE CGs was statistically significant (6.54 ± 0.69 vs 4.18 ± 1.08; p =0.001). The correlation analysis between quality domain score and guideline publication date showed a statistically significant association only for the “editorial independence” domain (r = 0.842 p = 0.035). The intra-class coefficients showed that the 11 reviewers had the highest agreement for the Lewis CGs (r = 0.857), and the lowest one for the NICE CGs (r = 0.656). Statistical analyses showed that professionals from outpatient services dedicated pediatric headache assigned a higher overall quality score to the NICE CGs as compared to professionals from non-outpatient services (6.86 ± 0.38 vs 6.0 ± 0.82; p = 0.038).ConclusionsCGs resulted definitely of low-moderate quality and non “homogeneous”. Further major efforts are needed to update the existing CGs according to the principles of evidence based medicine.

Methodological quality of guidelines in gastroenterology.

Clinical guidelines are a common feature in modern endoscopy practice and they are being produced faster than ever. However, their methodological quality is rarely assessed. This study evaluated the methodological quality of current clinical guidelines in the field of gastroenterology, with an emphasis on endoscopy. Practice guidelines published by the American College of Gastroenterology (ACG), American Gastroenterological Association (AGA), American Society for Gastrointestinal Endoscopy (ASGE), European Society of Gastrointestinal Endoscopy (ESGE), British Society of Gastroenterology (BSG), National Institute for Health and Care Excellence (NICE), and the Scottish Intercollegiate Guidelines Network (SIGN) were searched between September and October 2012 and evaluated using the AGREE II (Appraisal of Guidelines for Research and Evaluation) instrument (23 items, scores 1 - 7 for each item; higher scores mean better quality). A total of 100 guidelines were assessed. The mean number of items scoring 6 or 7 per guideline was 9.2 (out of 23 items). Overall, 99 % of guidelines failed to include the target population in the development process, and 96 % did not report facilitators and barriers to guideline application. In addition, 86 % did not include advice or tools, and 94 % did not present monitoring or auditing criteria. The global methodological quality of clinical guidelines in the field of gastroenterology is poor, particularly regarding involvement of the target population in the development of guidelines and in the provision of clear suggestions to practitioners.

Methodology of Clinical Nutrition Guidelines for Adult Cancer Patients

Malnutrition delays recovery from cancer treatment and can lead to additional serious complications. Clinical guidelines for the management of malnutrition in cancer patients are essential tools for optimizing nutritional care; therefore, their methodological quality is of great importance. This review assesses the methodological quality of international clinical guidelines for the management of malnutrition in adult cancer patients. Guidelines were identified through searches in multiple electronic databases; afterward, they were systematically reviewed with the AGREE instrument, which is one method of evaluating the methodological quality of guidelines. The methodological quality of the guidelines reviewed varied greatly. The highest scores were observed in the domains "scope and purpose" and "clarity and presentation," while the lowest scores were awarded in the domains "editorial independence," "stakeholder involvement," and "applicability." Furthermore, there was consensus on the indication for parenteral nutrition and nutrition screening. However, there was a lack of consensus on how nutritional therapy should be provided. No improvement was observed in methodological quality of the more recent guidelines compared to the older ones. The methodological quality of clinical guidelines on malnutrition for cancer patients and the way they are reported need to be improved. To achieve this, developers should utilize available guideline assessment tools, such as the AGREE instrument, when writing or updating guidelines on this topic.

Quality of Low Back Pain Guidelines Improved

Systematic review of clinical guidelines. To assess the methodological quality of clinical guidelines for the management of acute and chronic low back pain (LBP) in primary care and compare their recommendations. A guideline evaluation performed in 2004 concluded that the quality and transparency of the development process and consistency in the reporting of primary care guidelines for LBP need to be improved. At present, several guidelines have been revised and new guidelines are published. We evaluated if the quality of guidelines has improved. Guidelines published since 2004 were selected by electronically searching in MEDLINE, Cochrane Back Review Group database, Guideline Clearing House, Google, and contacting experts. The methodological quality of the guidelines was assessed by 2 authors independently, using the Appraisal of Guidelines, Research, and Evaluation in Europe instrument. Also, the diagnostic and therapeutic recommendations were compared. Fourteen guidelines were included. In general, the quality was satisfactory. The guidelines had best scores on clarity and presentation. The domain scores of scope and purpose were often moderate due to the absence of description of the clinical questions. The domain of stakeholder involvement scored moderate, mostly because guidelines were not tested among target users. Domains that had generally low scores were applicability and editorial independence. Four guidelines scored low on the rigor of development, but the other guidelines scored high on this domain.The diagnostic and therapeutic recommendations in the guidelines for acute LBP were mainly comparable while the recommendations for the management of chronic LBP varied widely. Compared to the quality assessment performed in 2004, the average quality of guidelines has improved. However, guideline developers should still improve the quality transparency of the development process. Especially the applicability of guidelines and the editorial independence need to be ensured in future guidelines.

The methodological quality of clinical guidelines of the European Society of Human Reproduction and Embryology (ESHRE)

Clinical practice guidelines bridge the gap between the evidence from literature and clinical practice, and they may provide guidance in ethical, legal and societal dilemmas. To explore the potentials for future international guideline development within the field of human reproduction and embryology, we assessed the quality of existing guidelines produced by the European Society of Human Reproduction and Embryology (ESHRE). We systematically searched for the ESHRE guidelines produced after 1996 in electronic databases and on the Internet. Subsequently, we assessed the methodological quality of these guidelines using the validated Appraisal of Guidelines for Research and Evaluation (AGREE) Instrument. The overall methodological quality of most of the 11 selected ESHRE guidelines was poor. Most of the guidelines scored <30% in the domains of 'stakeholder involvement', 'rigour of development', 'applicability' and 'editorial independence'. Only one guideline was rated 'strongly recommended'. The methodological quality of the guidelines produced under the auspices of ESHRE can be improved. We suggest a systematic, up-to-date methodology, investment in guideline development specialists, systematic quality control and the incorporation of indicator development. Furthermore, attention should be paid to the document nomenclature, and an ESHRE guidelines' summary on a special part of the ESHRE website would be a good initiative.