An audit test evaluation of state practices for supporting access to and promoting Covid-19 vaccinations

Abstract

A field experiment, using a paired audit testing design with testers of different racial and language profiles, was conducted to document and evaluate individual encounters in inquiring about COVID-19 vaccinations in the U.S. states. Testers communicated with state health department and major vaccination site staff about obtaining the COVID-19 vaccine and assessed the extent to which evidence-informed communication tactics for encouraging take-up were employed. The audit testers included individuals representing Latinx identities, given research showing they face greater hardships in navigating vaccine infrastructure and place less trust in public immunization efforts. Data were collected in phone and electronic communications between mid-June and mid-August of 2021. Empirical analyses confirmed that states vary considerably in how clearly officials communicate vaccination requirements and procedures, and in what they ask of individuals before providing the opportunity to receive the COVID-19 vaccine. The Spanish-speaking tester was more likely to encounter negative or racialized language—primarily implicit in nature—such as calls abruptly ended (vs. attempting to secure language support) and requests for additional identification or personal information before continuing with vaccination registration. Examples of overtly negative or racist encounters included condescending comments about Latinx testers' identification (or perceived undocumented status) and the Spanish-speaking tester's communication in Spanish. Analysis of an index of good practices constructed from the audit data revealed that very few strategies for promoting vaccinations were regularly implemented. In regression analyses, an additional point on the good practices index predicted a 0.133 percentage point increase in the percent of the population receiving the first vaccine dose, suggesting the lack of implementation of these good practices may represent a missed opportunity to increase COVID-19 vaccination rates. We identified exemplars in the communications that the federal government could disseminate to rapidly improve state practices and the accessibility of accurate information on COVID-19 vaccination opportunities.