The NICE OECD countries' geographic search filters: Part 2-validation of the MEDLINE and Embase (Ovid) filters.

Lynda Ayiku,Ceri Williams,Thomas Hudson,Paul Levay,Catherine Jacob

doi:10.5195/jmla.2021.1224

Abstract

Objective:We previously developed draft MEDLINE and Embase (Ovid) geographic search filters for Organisation for Economic Co-operation and Development (OECD) countries to assess their feasibility for finding evidence about the countries. Here, we describe the validation of these search filters.Methods:We identified OECD country references from thirty National Institute for Health and Care Excellence (NICE) guidelines to generate gold standard sets for MEDLINE (n=2,065) and Embase (n=2,023). We validated the filters by calculating their recall against these sets. We then applied the filters to existing search strategies for three OECD-focused NICE guideline reviews (NG103 on flu vaccination, NG140 on abortion care, and NG146 on workplace health) to calculate the filters' impact on the number needed to read (NNR) of the searches.Results:The filters both achieved 99.95% recall against the gold standard sets. Both filters achieved 100% recall for the three NICE guideline reviews. The MEDLINE filter reduced NNR from 256 to 232 for the NG103 review, from 38 to 27 for the NG140 review, and from 631 to 591 for the NG146 review. The Embase filter reduced NNR from 373 to 341 for the NG103 review, from 101 to 76 for the NG140 review, and from 989 to 925 for the NG146 review.Conclusion:The NICE OECD countries' search filters are the first validated filters for the countries. They can save time for research topics about OECD countries by finding the majority of evidence about OECD countries while reducing search result volumes in comparison to no filter use.

Highlights

A search filter is a set of premade, reusable search terms with known performance characteristics [1, 2]
We identified the OECD country-related references for the MEDLINE and Embase gold standard (GS) sets from the evidence reviews of thirty National Institute for Health and Care Excellence (NICE) guidelines that were published between December 2018 and December 2019
This ensured there were no duplicate records in our gold standard set

Summary

Introduction

A search filter is a set of premade, reusable search terms with known performance characteristics [1, 2]. They are applied to literature search strategies to retrieve evidence for specific topics [1, 2]. Geographic search filters are applied to literature searches with the aim of retrieving evidence about geographic locations such as continents or countries [3]. Validated search filters differ from search strategies because their recall ( known as “sensitivity”) has been established using a gold standard (GS) set ( known as a “reference set”) [1, 2]. Recall is the proportion of known, relevant results retrieved by a filter [1, 2]

Methods

Results

Discussion

Conclusion