Comparison of statistical methods for the early detection of disease outbreaks in small population settings

Abstract

ObjectivesThis study examines the performance of 6 aberration detection algorithms for the early detection of disease outbreaks in small population settings using syndrome-based early warning surveillance data collected by the Pacific Syndromic Surveillance System (PSSS). Although previous studies have proposed statistical methods for detecting aberrations in larger datasets, there is limited knowledge about how these perform in the presence of small numbers of background cases. MethodsTo address this gap a simulation model was developed to test and compare the performance of the 6 algorithms in detecting outbreaks of different magnitudes, durations, and case distributions. ResultsThe study found that while the Early Aberration Reporting System–C1 algorithm developed by Hutwagner et al. outperformed others, no single approach provided reliable monitoring across all outbreak types. Furthermore, aberration detection approaches could only detect very large and acute outbreaks with any reliability. ConclusionThe findings of this study suggest that algorithm-based approaches to outbreak signal detection perform poorly when applied to settings with small numbers of background cases and should not be relied upon in these contexts. This highlights the need for alternative approaches for accurate and timely outbreak detection in small population settings, particularly those that are resource-constrained.