A summary of the Advisory Committee for Immunization Practices (ACIP) use of a benefit-risk assessment framework during the first year of COVID-19 vaccine administration in the United States

Abstract

To inform Advisory Committee for Immunization Practices (ACIP) COVID-19 vaccine policy decisions, we developed a benefit-risk assessment framework that directly compared the estimated benefits of COVID-19 vaccination to individuals (e.g., prevention of COVID-19-associated hospitalization) with risks associated with COVID-19 vaccines. This assessment framework originated following the identification of thrombosis with thrombocytopenia syndrome (TTS) after Janssen COVID-19 vaccination in April 2021. We adapted the benefit-risk assessment framework for use in subsequent policy decisions, including the adverse events of myocarditis and Guillain-Barre syndrome (GBS) following mRNA and Janssen COVID-19 vaccination respectively, expansion of COVID-19 vaccine approvals or authorizations to new age groups, and use of booster doses. Over the first year of COVID-19 vaccine administration in the United States (December 2020–December 2021), we used the benefit-risk assessment framework to inform seven different ACIP policy decisions. This framework allowed for rapid and direct comparison of the benefits and potential harms of vaccination, which may be helpful in informing other vaccine policy decisions. The assessments were a useful tool for decision-making but required reliable and granular data to stratify analyses and appropriately focus on populations most at risk for a specific adverse event. Additionally, careful decision-making was needed on parameters for data inputs. Sensitivity analyses were used where data were limited or uncertain; adjustments in the methodology were made over time to ensure the assessments remained relevant and applicable to the policy questions under consideration.