Vaccine Efficacy Trials Research Articles

Vaccine Development during a Pandemic: General Lessons for Clinical Trial Design

The COVID-19 pandemic triggered an unprecedented research effort to develop vaccines and therapeutics. Urgency dictated that development and regulatory assessment were accelerated, while maintaining all standards for quality, safety and efficacy. To speed up evaluation the European Medicines Agency (EMA) implemented “rolling reviews” allowing developers to submit data for assessment as they became available. We discuss the clinical trial designs and the applied statistical approaches in vaccine efficacy trials, focusing on aspects such as multiple testing, interim and updated analyses, and reporting of results for the first four vaccines recommended for approval by the EMA. The fast accrual of COVID-19 cases in the clinical vaccine efficacy trials led to multiple data updates within a short time frame, which had consequences for the evaluation and interpretation of results. Key trial results are discussed in the light of these aspects. Notably, the aspects discussed did not affect the benefit/risk relationship in a meaningful way, which was clearly positive for all four vaccines. Assessment of the development and evaluation of the four vaccine trials during the pandemic has led to a proposal for standardized terminology for trials with multiple analyses and a recommendation to appropriately preplan the timing of primary and updated analyses. For the reporting of updated estimates of vaccine efficacy, we discuss how to best describe the uncertainty around estimates of vaccine efficacy (e.g., via confidence intervals). Finally, we briefly highlight the benefit of a comprehensive discussion on estimands for vaccine efficacy trials.

A mark-specific quantile regression model.

Quantile regression has become a widely used tool for analysing competing risk data. However, quantile regression for competing risk data with a continuous mark is still scarce. The mark variable is an extension of cause of failure in a classical competing risk model where cause of failure is replaced by a continuous mark only observed at uncensored failure times. An example of the continuous mark variable is the genetic distance that measures dissimilarity between the infecting virus and the virus contained in the vaccine construct. In this article, we propose a novel mark-specific quantile regression model. The proposed estimation method borrows strength from data in a neighbourhood of a mark and is based on an induced smoothed estimation equation, which is very different from the existing methods for competing risk data with discrete causes. The asymptotic properties of the resulting estimators are established across mark and quantile continuums. In addition, a mark-specific quantile-type vaccine efficacy is proposed and its statistical inference procedures are developed. Simulation studies are conducted to evaluate the finite sample performances of the proposed estimation and hypothesis testing procedures. An application to the first HIV vaccine efficacy trial is provided.

Assessing the robustness of COVID-19 vaccine efficacy trials: systematic review and meta-analysis, January 2023.

BackgroundVaccines play a crucial role in the response to COVID-19 and their efficacy is thus of great importance.AimTo assess the robustness of COVID-19 vaccine efficacy (VE) trial results using the fragility index (FI) and fragility quotient (FQ) methodology.MethodsWe conducted a Cochrane and PRISMA-compliant systematic review and meta-analysis of COVID-19 VE trials published worldwide until 22 January 2023. We calculated the FI and FQ for all included studies and assessed their associations with selected trial characteristics using Wilcoxon rank sum tests and Kruskal-Wallis H tests. Spearman correlation coefficients and scatter plots were used to quantify the strength of correlation of FIs and FQs with trial characteristics.ResultsOf 6,032 screened records, we included 40 trials with 54 primary outcomes, comprising 909,404 participants with a median sample size per outcome of 13,993 (interquartile range (IQR): 8,534-25,519). The median FI and FQ was 62 (IQR: 22-123) and 0.50% (IQR: 0.24-0.92), respectively. FIs were positively associated with sample size (p < 0.001), and FQs were positively associated with type of blinding (p = 0.023). The Spearman correlation coefficient for FI with sample size was moderately strong (0.607), and weakly positive for FI and FQ with VE (0.138 and 0.161, respectively).ConclusionsThis was the largest study on trial robustness to date. Robustness of COVID-19 VE trials increased with sample size and varied considerably across several other important trial characteristics. The FI and FQ are valuable complementary parameters for the interpretation of trial results and should be reported alongside established trial outcome measures.

HTA91 Health Impact of a Potential HIV Vaccine Among Men Who Have Sex with Men in the United States

70% of new HIV infections in the United States (U.S.) occur among men who have sex with men (MSM). Ongoing prophylactic HIV vaccine efficacy trials for MSM may provide efficacy evidence, but the long-term impact of future HIV vaccines is not clear. This study aims to evaluate the long-term health outcomes of a potential HIV vaccine in the U.S. MSM population under different scenarios of efficacy, durability, and coverage.

Automated monitoring and detection of disease using a generic facial feature scoring system - A case study on FMD infected cows.

Digital images are becoming more readily available and possibilities for image processing are developing rapidly. This opens the possibility to use digital images to monitor and detect diseases in animals. In this paper we present 1) a generic facial feature scoring system based on seven facial features, 2) manual scores of images of Holstein Frisian heifers during foot-and-mouth disease vaccine efficacy trials and 3) automatic disease scores of the same animals. The automatic scoring system was based on the manual version and trained on annotated images from the manual scoring system. For both systems we found an increase in disease scores three days post infection, followed by a recovery. This temporal pattern matched with observations made by animal caretakers. Importantly, the automatic system was able to discern animals that were protected by the vaccine, and did not develop blisters at the feet, and animals that were not protected. Finally, automatic scores could be used to detect healthy and sick animals with a sensitivity and specificity of 0.94 on the second and third days following infection in an experimental setting. This generic facial feature disease scoring system could be further developed and extended to lactating Holstein Frisian dairy cows, other breeds and other infectious diseases. The system could be applied during animal experiments or, after further development, in a farm setting.

Nonparametric estimation of marked survival data in the presence of dependent censoring.

We consider nonparametrically estimating the joint distribution of a survival time and mark variable, where the survival time is subject to right censoring and the mark variable is only observed when the survival time is not censored. The possibility of dependent censoring is allowed for using inverse probability of censoring weights. The proposed estimator is shown to be consistent and asymptotically normal. Finite sample behavior of the proposed methods are investigated via simulation study. Finally, we illustrate the nonparametric estimator from a recent HIV vaccine efficacy trial.

Risk Factors Associated with HIV Acquisition in Males Participating in HIV Vaccine Efficacy Trials in South Africa

In South Africa, HIV acquisition risk has been studied less in people assigned male at birth. We studied the associations between risk behaviors, clinical features and HIV incidence amongst males in two South African HIV preventive vaccine efficacy trials. We used Cox proportional hazards models to test for associations between demographics, sexual behaviors, clinical variables and HIV acquisition among males followed in the HVTN 503 (n = 219) and HVTN 702 (n = 1611) trials. Most males reported no male sexual partners (99.09% in HVTN 503) or identified as heterosexual (88.08% in HVTN 702). Annual HIV incidence was 1.39% in HVTN 503 (95% CI 0.76–2.32%) and 1.33% in HVTN 702 (95% CI 0.80–2.07%). Increased HIV acquisition was significantly associated with anal sex (HR 6.32, 95% CI 3.44–11.62), transactional sex (HR 3.42, 95% CI 1.80–6.50), and non-heterosexual identity (HR 16.23, 95%CI 8.13–32.41) in univariate analyses and non-heterosexual identity (HR 14.99, 95% CI 4.99–45.04; p < 0.01) in multivariate analysis. It is appropriate that prevention efforts in South Africa, although focused on the severe epidemic in young women, also encompass key male populations, including men who have sex with men, but also men who engage in anal or transactional sex.

Kinetics of the Antibody Response to Symptomatic SARS-CoV-2 Infection in Vaccinated and Unvaccinated Individuals in the Blinded Phase of the mRNA-1273 COVID-19 Vaccine Efficacy Trial.

Hybrid immunity is associated with more durable protection against coronavirus disease 2019 (COVID-19). We describe the antibody responses following severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection in vaccinated and unvaccinated individuals. The 55 vaccine arm COVID-19 cases diagnosed during the blinded phase of the Coronavirus Efficacy trial were matched with 55 placebo arm COVID-19 cases. Pseudovirus neutralizing antibody (nAb) activity to the ancestral strain and binding antibody (bAb) responses to nucleocapsid and spike antigens (ancestral and variants of concern [VOCs]) were assessed on disease day 1 (DD1) and 28 days later (DD29). The primary analysis set was 46 vaccine cases and 49 placebo cases with COVID-19 at least 57 days post-first dose. For vaccine group cases, there was a 1.88-fold rise in ancestral antispike bAbs 1 month post-disease onset, although 47% had no increase. The vaccine-to-placebo geometric mean ratios for DD29 antispike and antinucleocapsid bAbs were 6.9 and 0.04, respectively. DD29 mean bAb levels were higher for vaccine vs placebo cases for all VOCs. DD1 nasal viral load positively correlated with bAb levels in the vaccine group. Following COVID-19, vaccinated participants had higher levels and greater breadth of antispike bAbs and higher nAb titers than unvaccinated participants. These were largely attributable to the primary immunization series.

Vaccine clinical trials with dynamic borrowing of historical controls: Two retrospective studies.

Traditional vaccine efficacy trials usually use fixed designs with fairly large sample sizes. Recruiting a large number of subjects requires longer time and higher costs. Furthermore, vaccine developers are more than ever facing the need to accelerate vaccine development to fulfill the public's medical needs. A possible approach to accelerate development is to use the method of dynamic borrowing of historical controls in clinical trials. In this paper, we evaluate the feasibility and the performance of this approach in vaccine development by retrospectively analyzing two real vaccine studies: a relatively small immunological trial (typical early phase study) and a large vaccine efficacy trial (typical Phase 3 study) assessing prophylactic human papillomavirus vaccine. Results are promising, particularly for early development immunological studies, where the adaptive design is feasible, and control of type I error is less relevant.

Antibody Correlates of Protection From Severe Respiratory Syncytial Virus Disease in a Vaccine Efficacy Trial.

Respiratory syncytial virus (RSV) can cause serious lung infections in young children and there is currently no available vaccine. We used complementary statistical frameworks to analyze 4 RSV serology measurements in mothers and their infants in South Africa who participated in a phase 3 maternal immunization trial of an RSV F protein nanoparticle vaccine as correlates of risk and of protection against different RSV disease endpoints. We found evidence to support each antibody measurement-encompassing RSV-neutralizing antibodies and F surface glycoprotein-binding antibodies-as an inverse correlate of risk of RSV-associated acute lower respiratory tract infection with severe hypoxia in at least 1 framework, with vaccine-induced fold-rise from the maternal enrollment to day 14 samples of anti-F immunoglobulin G (IgG) binding antibodies having the most consistent evidence. This evidence includes a significant association of fold-rise anti-F IgG with vaccine efficacy (VE); achieving a baseline covariate-adjusted VE of 75% requires a vaccine-induced maternal anti-F IgG fold-rise of around 16. Neither multivariable logistic regression nor superlearning analyses showed benefit to including multiple time points or assays in the same model, suggesting a parsimonious correlate. Post hoc exploratory analyses supported adherence of vaccine-induced maternal anti-F IgG fold-rise to the Prentice criteria for a valid surrogate endpoint. Our results suggest that the vaccine induced protective anti-F antibody responses. If this finding is confirmed, VE could potentially be augmented by increasing these responses.

Foundations for improved vaccine correlate of risk analysis using positive-unlabeled learning

ABSTRACT Insights into mechanisms of protection afforded by vaccine efficacy field trials can be complicated by both low rates of exposure and protection. However, these barriers do not preclude the discovery of correlates of reduced risk (CoR) of infection, which are a critical first step in defining correlates of protection (CoP). Given the significant investment in large-scale human vaccine efficacy trials and immunogenicity data collected to support CoR discovery, novel approaches for analyzing efficacy trials to optimally support discovery of CoP are critically needed. By simulating immunological data and evaluating several machine learning approaches, this study lays the groundwork for deploying Positive/Unlabeled (P/U) learning methods, which are designed to differentiate between two groups in cases where only one group has a definitive label and the other remains ambiguous. This description applies to case–control analysis designs for field trials of vaccine efficacy: infected subjects, or cases, are by definition unprotected, whereas uninfected subjects, or controls, may have been either protected or unprotected but simply never exposed. Here, we investigate the value of applying P/U learning to classify study subjects using model immunogenicity data based on predicted protection status in order to support new insights into mechanisms of vaccine-mediated protection from infection. We demonstrate that P/U learning methods can reliably infer protection status, supporting the discovery of simulated CoP that are not observed in conventional comparisons of infection status cases and controls, and we propose next steps necessary for the practical deployment of this novel approach to correlate discovery.

Expected endpoints from future chikungunya vaccine trial sites informed by serological data and modeling.

In recent decades, there has been an increased interest in developing a vaccine for chikungunya. However, due to its unpredictable transmission, planning for a chikungunya vaccine trial is challenging. To inform decision making on the selection of sites for a vaccine efficacy trial, we developed a new framework for projecting the expected number of endpoint events at a given site. In this framework, we first accounted for population immunity using serological data collated from a systematic review and used it to estimate parameters related to the timing and size of past outbreaks, as predicted by an SIR transmission model. Then, we used that model to project the infection attack rate of a hypothetical future outbreak, in the event that one were to occur at the time of a future trial. This informed projections of how many endpoint events could be expected if a trial were to take place at that site. Our results suggest that some sites may have sufficient transmission potential and susceptibility to support future vaccine trials, in the event that an outbreak were to occur at those sites. In general, we conclude that sites that have experienced outbreaks within the past 10years may be poorer targets for chikungunya vaccine efficacy trials in the near future. Our framework also generates projections of the numbers of endpoint events by age, which could inform study participant recruitment efforts.

Screening and detection of multivalent human papillomavirus antibodies using a high-throughput liquid chip fluoroimmunoassay system.

Immunoassays are commonly used in disease diagnosis and vaccine evaluation but can be costly and time-consuming when confronted with multivalent targets, such as antisera containing antibodies to human papillomavirus (HPV), because of their limited ability to discriminate between multiple analytes in a single reaction well. This study describes the development of a high-throughput liquid chip system that combines immunoassay techniques and magnetic beads to allow the simultaneous screening and quantitative detection of antibodies to four types of HPV using the Luminex fluoroimmunoassay system. Groups of beads embedded with fluorescent dyes at various ratios were coated with optimized HPV capture antigens and demonstrated excellent dose-dependent response to four monoclonal antibodies used as reference standards. This assay is sensitive, accurate, repeatable, and simple to perform, enabling multiplex antibody detection with a high degree of orthogonality. The performance of the Luminex system was compared with conventional immunoassays for quantitative detection of quadrivalent HPV antibodies in antisera of mice immunized with five lots of HPV vaccines, verifying the accuracy and detection efficiency of the assay. This strategy is a promising approach to characterizing antibodies present in polyclonal antisera and has promising applications in research, clinical, and industrial settings, for example, streamlining vaccine efficacy trials and vaccine lot inspection and release procedures.

Establishing a single-sex controlled human Schistosoma mansoni infection model for Uganda: protocol for safety and dose-finding trial.

Control of schistosomiasis depends on a single drug, praziquantel, with variable cure rates, high reinfection rates, and risk of drug resistance. A vaccine could transform schistosomiasis control. Preclinical data show that vaccine development is possible, but conventional vaccine efficacy trials require high incidence, long-term follow-up, and large sample size. Controlled human infection studies (CHI) can provide early efficacy data, allowing the selection of optimal candidates for further trials. A Schistosoma CHI has been established in the Netherlands but responses to infection and vaccines differ in target populations in endemic countries. We aim to develop a CHI for Schistosoma mansoni in Uganda to test candidate vaccines in an endemic setting. This is an open-label, dose-escalation trial in two populations: minimal, or intense, prior Schistosoma exposure. In each population, participants will be enrolled in sequential dose-escalating groups. Initially, three volunteers will be exposed to 10 cercariae. If all show infection, seven more will be exposed to the same dose. If not, three volunteers in subsequent groups will be exposed to higher doses (20 or 30 cercariae) following the same algorithm, until all 10 volunteers receiving a particular dose become infected, at which point the study will be stopped for that population. Volunteers will be followed weekly after infection until CAA positivity or to 12 weeks. Once positive, they will be treated with praziquantel and followed for one year. The trial registry number is ISRCTN14033813 and all approvals have been obtained. The trial will be subjected to monitoring, inspection, and/or audits.

Feasibility of conducting HIV prevention trials among key populations in Nairobi, Kenya

ObjectiveTo assess the feasibility of conducting HIV prevention trials among key populations in Nairobi, Kenya.BackgroundHIV prevention trials require the inclusion of those at high risk of HIV infection and their informed decision to take part and remain in the clinical trial to the end is crucial. In Kenya key populations including men who have sex with men (MSM) and female sex workers (FSW) are, disproportionately, at high risk of HIV infection when compared to the general population. Few trials testing biomedical prevention products against HIV have enrolled Kenyan FSW and MSM.MethodsWe performed simulated vaccine efficacy trial (SiVET) using licensed hepatitis B vaccines as substitutes for a HIV vaccine candidate and included randomization for those immune to hep B. The SiVET was an observational study designed to mimic the rigors of a clinical trial; we assessed HIV risk, provided risk counselling and prevention tools and performed HIV testing at baseline and periodically until the end of the trial. MSM and FSW were enrolled at a ratio of 4:1. Volunteers were assigned to either hepatitis B vaccine or placebo.ResultsRecruitment took approximately 24 months between Sep 2015 and Sep 2017. Of the 368 volunteers screened, 250 (200 MSM and 50 FSW) were enrolled. Reasons for exclusion at screening included: being positive for HIV (n = 7), hepatitis (n = 14), other pre-existing medical conditions (n = 41), eligible but chose not to enrol (n = 47). Most of the volunteers adhered to study procedures and attended their study visits within the study window. These include volunteers who received the second vaccination 244 (98%), the third vaccination 228 (91%) and, the final study visit 217 (87%). The reasons volunteers discontinued from the study early included: relocation and loss to follow up (n = 14). A total of 8 cases of HIV infection were observed in 174.5 Person Years at Risk (PYAR), all among MSM, including 5 seroconversions identified at the last study visit, for a HIV incidence of 4.58 cases/ 100 PYAR, among MSM enrolled in the study.ConclusionOur findings suggest that it is possible to conduct HIV prevention trials among key populations in Nairobi with a good adherence to a vaccine efficacy trial schedule. Despite HIV prevention efforts, we also noted a high incidence of HIV infection. This demonstrates the need for effective HIV prevention products in these populations.

2297. COVID-19 Vaccine Effectiveness Among Pregnant People

Abstract Background COVID-19 presents a serious health risk to pregnant people and pregnancy outcomes. However, pregnant people were not included in pivotal phase III COVID-19 vaccine efficacy trials. Methods We used Cox regression models in a cohort study to determine hazard ratios (HR) of a PCR positive test (“infection”) comparing vaccinated with unvaccinated pregnant persons in Kaiser Permanente Northern California. HRs were adjusted for age, race/ethnicity, type of insurance coverage, geographical area, BMI, preexisting diabetes, hypertension, parity, time since pregnancy onset and smoking status. Vaccine effectiveness (VE), calculated as 1 minus adjusted HR, was estimated for fully vaccinated &amp;lt; 150 and ≥ 150 days prior to infection. VE was estimated for before and during Delta, and Omicron. We also calculated incidence rates of COVID-pneumonia associated hospitalization by vaccination status. Results Among 68836 pregnancies between 12/15/2020 and 3/31/2022, 21834 (31.7%) were fully vaccinated and 5980 (8.7%) were boosted by the end of pregnancy. Compared with unvaccinated persons, the HRs of infection for fully vaccinated &amp;lt; 150 days prior were 0.13 (95% CI: 0.07 – 0.23; VE=87% [77% - 93%]) before Delta; 0.25 (CI: 0.20 – 0.30; VE=75% [70% - 80%]) during Delta and 0.76 (CI: 0.61 – 0.94; VE= 24% [16% - 39%]) during Omicron. The HRs for ≥ 150 days prior were 0.38 (CI: 0.31 – 0.46; VE=62 % [54% - 69%]) during Delta and 1.04 (CI: 0.89 – 1.22; VE= -0.04% [-0.22% – 0.11%]) during Omicron. The HRs for boosted persons were 0.10 (CI: 0.04 – 0.25; VE= 90% [75% - 96%]) during Delta and 0.42 (CI: 0.34 – 0.52; VE=58% [48% - 66%]) during Omicron periods. Incidence rates (IR) per 1000 person-years for hospitalization before delta were 0.75 among unvaccinated and zero among vaccinated. During Delta, the IR was 6.64 for unvaccinated and zero for fully vaccinated and boosted. During Omicron, the IR was 10.27 for unvaccinated, zero for fully vaccinated &amp;lt; 150 days prior, 2.48 for fully vaccinated ≥ 150 days prior and zero for those boosted. Conclusion COVID-19 vaccines protect against infection and hospitalization among pregnant people. However, vaccine effectiveness against infection wanes over time and was lower during Omicron. Booster doses are necessary for continuous protection. Disclosures All Authors: No reported disclosures.

Pediatric solid organ transplant recipients demonstrate robust cell-mediated and humoral responses to three doses of mRNA SARS-CoV-2 vaccine

Pediatric solid organ transplant recipients (pSOTR) often demonstrate suboptimal vaccine responses and are not included in severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) vaccine efficacy trials. This population has shown variable humoral immunity following SARS‐CoV‐2 vaccination, and no studies have assessed cell‐mediated responses after SARS‐CoV‐2 vaccination in pSOTR. SARS‐CoV‐2‐specific interferon‐gamma release assay (IGRA), immunoglobulin G (IgG), and receptor‐binding domain (RBD)‐angiotensin‐converting enzyme 2 (ACE2) blocking antibody (Ab) were measured in pSOTR aged 5–17 years after 2–3 doses of SARS‐CoV‐2 mRNA vaccine. In all, 33 subjects were included, with 25 tested after the second dose of mRNA vaccine (V2) and 21 tested after the third dose of mRNA vaccine (V3). Of the 19 subjects who had IgG testing after V3, 100.0% (19/19) had a positive IgG response. Of the 17 subjects who had IGRA testing after V3, 94.1% (16/17) had a positive IGRA response. RBD‐ACE2 blocking antibody increased significantly from V2 to V3 (p = .007). Subjects <1 year from transplant demonstrated a significantly larger increase in RBD‐ACE2 blocking Ab from V2 to V3 than did those >1 year from transplant (p = .05). SARS‐CoV‐2 vaccination induces humoral and cell‐mediated responses in the majority of pSOTR, with improved quantitative humoral response after three doses.

Forty years of investment in HIV research: progress towards ending the HIV pandemic and preparation for future pandemics.

Forty years of investment in HIV research: progress towards ending the HIV pandemic and preparation for future pandemics.

COVID-19 Vaccination During Pregnancy: Coverage and Safety

(Am J Obstet Gynecol. 2022;226:236.e1–14) While the pregnant population was not included in initial randomized controlled safety and efficacy trials of the COVID-19 vaccines, some limited data on the vaccine during pregnancy came from the CDC V-safe health checker, some inadvertent pregnancies in vaccine trials, and a formal pregnancy registry. While the COVID-19 vaccines do not contain a live virus and are theoretically considered safe in pregnancy, not all health care professionals have recommended routine vaccination since the start of vaccine rollout. This study examines the safety of COVID-19 in pregnant women, the rate of uptake, and outcomes of vaccinated pregnant individuals compared with the unvaccinated pregnant population.

COVID-19 site readiness initiative: Building clinical trial capacity for vaccine efficacy trials in Latin America in response to the pandemic

According to the World Health Organization, the American region has the highest coronavirus disease-2019 (COVID-19) cases and deaths since the start of the pandemic. This humanitarian tragedy presented the possibility of generating efficacy data from COVID-19 vaccine trials. The race to develop successful vaccines imposed a high demand for trained healthcare personnel and clinical sites where large scale randomized clinical trials could be conducted. This site readiness initiative, funded by the Bill and Melinda GatesFoundation (BMGF), was carried out to rapidly build site capacity for running COVID-19 vaccine trials in Latin America.Twenty-two sites across 7 countries were selected and received funding. Site selection was based on defined feasibility criteria which deemed these sites as suitable for running vaccine efficacy trials. Criteria for selection included investigator and core permanent staff experience, public health measures in place for COVID-19, import/export requirements for study drug and biological specimens, a clear and accelerated ethical and regulatory approval process for COVID-19 trials. Training was tailored and delivered according to the experience level of the investigator and site staff, and included GCP training, standard operating procedures (SOP) fundamentals, conducting vaccine trials, COVID-19 pathophysiology, and vaccine trials lessons learned. Most of the grant funds were utilized for space expansion and renovation (46 %) followed by purchase of equipment (36 %); the remaining 18 % was spent on human resources. By the end of this site readiness initiative project, which took approximately 4 months, 21 of 22 (95 %) sites had agreements in place or were in discussions with sponsors to conduct large scale COVID-19 vaccine trials.