Estimation Of Final Size Research Articles

The RAPIDD ebola forecasting challenge: Synthesis and lessons learnt

Infectious disease forecasting is gaining traction in the public health community; however, limited systematic comparisons of model performance exist. Here we present the results of a synthetic forecasting challenge inspired by the West African Ebola crisis in 2014–2015 and involving 16 international academic teams and US government agencies, and compare the predictive performance of 8 independent modeling approaches. Challenge participants were invited to predict 140 epidemiological targets across 5 different time points of 4 synthetic Ebola outbreaks, each involving different levels of interventions and “fog of war” in outbreak data made available for predictions. Prediction targets included 1–4 week-ahead case incidences, outbreak size, peak timing, and several natural history parameters. With respect to weekly case incidence targets, ensemble predictions based on a Bayesian average of the 8 participating models outperformed any individual model and did substantially better than a null auto-regressive model. There was no relationship between model complexity and prediction accuracy; however, the top performing models for short-term weekly incidence were reactive models with few parameters, fitted to a short and recent part of the outbreak. Individual model outputs and ensemble predictions improved with data accuracy and availability; by the second time point, just before the peak of the epidemic, estimates of final size were within 20% of the target. The 4th challenge scenario − mirroring an uncontrolled Ebola outbreak with substantial data reporting noise − was poorly predicted by all modeling teams. Overall, this synthetic forecasting challenge provided a deep understanding of model performance under controlled data and epidemiological conditions. We recommend such “peace time” forecasting challenges as key elements to improve coordination and inspire collaboration between modeling groups ahead of the next pandemic threat, and to assess model forecasting accuracy for a variety of known and hypothetical pathogens.

Epidemiological inference for partially observed epidemics: The example of the 2001 foot and mouth epidemic in Great Britain

This paper develops a statistical framework for a retrospective analysis for well-observed livestock epidemics during which intervention policies may conceal cases, thus potentially biasing naively derived parameter and final size estimates. We apply the methods to the 2001 foot and mouth epidemic (FMD) in Great Britain, during which a large number of farms (about 7500) were pre-emptively culled as part of the control effort without ever being diagnosed as being infected. We infer farm-level infectivity and susceptibility parameters, a distribution for the delay from infection to report, together with a time varying farm infectivity profile for farms. Hidden infections among proactively culled farms were accounted for using a data augmentation approach utilising reversible jump MCMC methods. Simulated epidemics derived using the parameter estimates obtained reproduced the 2001 epidemic well. Our analysis demonstrates that time-varying infectivity profiles fit the 2001 data better than naive assumptions of constant infectiousness. We estimate that around 210 (or 2.8%) of the farms proactively culled in the 2001 epidemic were infected. However, for the parameter estimated obtained, preliminary simulation results indicate that had contiguous culling not been applied in 2001, the epidemic might have been substantially larger.