Nothing to Cheer About: Endorsing Imaginary Economic Evaluations and Value Claims with CHEERS 22

Abstract

One of the more unfortunate features of health technology assessment is the tenacity with which leaders in the field and organizations such as the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the Institute for Clinical and Economic Review (ICER) cling to an evaluation framework that fails to meet the standards of normal science. Believers subscribe to a meme that is clearly non-science (metaphysics and pseudoscience) and one that should have been discarded over 30 years ago. Certainly, subscribing to an impossible belief is not unusual; indeed it may make the belief that much stronger. Yet the meme is non-sustainable; it is also pointless as the economic evaluation claims are non-evaluable. There is no acknowledgement of the standards of normal science or the limitations imposed by the axioms of fundamental measurement. The purpose of this commentary is to make the case that the recent release of the Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 22) checklist is misleading; CHEERS 22 fails to address the manifest deficiencies in the approach to economic evaluations endorsed by ISPOR and ICER. Instead, it continues to promote economic evaluations in healthcare that invent evidence and non-empirically evaluable value claims. Given the widespread publicity that has accompanied the release of CHEERS 22, the purpose of this commentary is to detail the deficiencies in CHEERS 22 and propose an alternative framework for economic evaluation in health care to meet the information needs of formulary committees. This means abandoning the standards for economic evaluations that have dominated health technology assessment for 30 years, notably the key role assigned to the mathematically impossible quality adjusted life year (QALY). The proposed new start recommends single attribute evaluable value claims that meet ratio or interval measurement standards and are supported by evaluation protocols.