A data science pipeline applied to Australia's 2022 COVID-19 Omicron waves

Abstract

The field of software engineering is advancing at astonishing speed, with packages now available to support many stages of data science pipelines. These packages can support infectious disease modelling to be more robust, efficient and transparent, which has been particularly important during the COVID-19 pandemic. We developed a package for the construction of infectious disease models, integrated it with several open-source libraries and applied this composite pipeline to multiple data sources that provided insights into Australia's 2022 COVID-19 epidemic. We aimed to identify the key processes relevant to COVID-19 transmission dynamics and thereby develop a model that could quantify relevant epidemiological parameters.The pipeline's advantages include markedly increased speed, an expressive application programming interface, the transparency of open-source development, easy access to a broad range of calibration and optimisation tools and consideration of the full workflow from input manipulation through to algorithmic generation of the publication materials. Extending the base model to include mobility effects slightly improved model fit to data, with this approach selected as the model configuration for further epidemiological inference. Under our assumption of widespread immunity against severe outcomes from recent vaccination, incorporating an additional effect of the main vaccination programs rolled out during 2022 on transmission did not further improve model fit. Our simulations suggested that one in every two to six COVID-19 episodes were detected, subsequently emerging Omicron subvariants escaped 30–60% of recently acquired natural immunity and that natural immunity lasted only one to eight months on average. We documented our analyses algorithmically and present our methods in conjunction with interactive online code notebooks and plots.We demonstrate the feasibility of integrating a flexible domain-specific syntax library with state-of-the-art packages in high performance computing, calibration, optimisation and visualisation to create an end-to-end pipeline for infectious disease modelling. We used the resulting platform to demonstrate key epidemiological characteristics of the transition from the emergency to the endemic phase of the COVID-19 pandemic.