Performance Measure Development, Use, and Measurement of Effectiveness Using the Guideline on Mechanical Ventilation in Acute Respiratory Distress Syndrome. An Official American Thoracic Society Workshop Report.

Abstract

Guideline implementation tools are designed to improve uptake of guideline recommendations in clinical settings but do not uniformly accompany the clinical practice guideline documents. Performance measures are a type of guideline implementation tool with the potential to catalyze behavior change and greater adherence to clinical practice guidelines. However, many performance measures suffer from serious flaws in their design and application, prompting the American Thoracic Society (ATS) to define its own performance measure development standards in a previous workshop in 2012. This report summarizes the proceedings of a follow-up workshop convened to advance the ATS’s work in performance measure development and guideline implementation. To illustrate the application of the ATS’s performance measure development framework, we used the example of a low–tidal volume ventilation performance measure created de novo from the 2017 ATS/European Society of Intensive Care Medicine/Society of Critical Care Medicine mechanical ventilation in acute respiratory distress syndrome clinical practice guideline. We include a detailed explanation of the rationale for the specifications chosen, identification of areas in need of further validity testing, and a preliminary strategy for pilot testing of the performance measure. Pending additional resources and broader performance measure expertise, issuing “preliminary performance measures” and their specifications alongside an ATS clinical practice guideline offers a first step to further the ATS’s guideline implementation agenda. We recommend selectively proceeding with full performance measure development for those measures with positive early user feedback and the greatest potential impact in accordance with ATS leadership guidance.