Minimally important difference in cost savings: Is it possible to identify an MID for cost savings?

Abstract

As healthcare costs continue to increase, studies assessing costs are becoming increasingly common, but researchers planning for studies that measure costs differences (savings) encounter a lack of literature or consensus among researchers on what constitutes “small” or “large” cost savings for common measures of resource use. Other fields of research have developed approaches to solve this type of problem. Researchers measuring improvement in quality of life or clinical assessments have defined minimally important differences (MID) which are then used to define magnitudes when planning studies. Also, studies that measure cost effectiveness use benchmarks, such as cost/QALY, but do not provide benchmarks for cost differences. In a review of the literature, we found no publications identifying indicators of magnitude for costs. However, the literature describes three approaches used to identify minimally important outcome differences: (1) anchor-based, (2) distribution-based, and (3) a consensus-based Delphi methods. In this exploratory study, we used these three approaches to derive MID for two types of resource measures common in costing studies for: (1) hospital admissions (high cost); and (2) clinic visits (low cost). We used data from two (unpublished) studies to implement the MID estimation. Because the distributional characteristics of cost measures may require substantial samples, we performed power analyses on all our estimates to illustrate the effect that the definitions of “small” and “large” costs may be expected to have on power and sample size requirements for studies. The anchor-based method, while logical and simple to implement, may be of limited value in cases where it is difficult to identify appropriate anchors. We observed some commonalities and differences for the distribution and consensus-based approaches, which require further examination. We recommend that in cases where acceptable anchors are not available, both the Delphi and the distribution-method of MID for costs be explored for convergence.