3.C. Skills building seminar: Guidance on using natural experiments to evaluate population health interventions

Abstract

Abstract There has been a substantial increase in the conduct of natural experimental evaluations since original guidance was published. There have been advances in relevant methodologies, greater availability of big datasets, and a rise in demand for ‘what works’ evidence amenable to natural experimental evaluation. Therefore, it is important that researchers, public health practitioners, funders, and users of intervention research are aware of recent developments and of the strengths, weaknesses, and applicability of natural experimental evaluations. Updated and extended guidance has been developed for using natural experiments to evaluate population health interventions. Guidance was developed from three international workshops and an online consultation with researchers, journal editors and end users of natural experimental evaluations. The project was funded by The UK Medical Research Council and the National Institute for Health and Care Research, and the project team comprised researchers with expertise in natural experimental evaluations. The project had a funder-assigned oversight group and an advisory group of independent experts, including researchers and practitioners with experience of commissioning natural experimental evaluations. This updated and extended guidance provides an integrated guide to the use of natural experimental methods to evaluate population health interventions, offering a range of tools to support its use and detailed, evidence-based information for researchers, funders, publishers, and users of evidence. The objective of this skills building seminar is to upskill public health researchers and practitioners on the design and use of natural experimental methods. The seminar will present key aspects of the guidance and provide the opportunity to discuss and explore each aspect. The first presentation will highlight important considerations when designing and planning a natural experimental evaluation and introduce recommendations for planning, commissioning, conducting, and using evidence from natural experimental evaluations. The second presentation will outline the value and roles of qualitative methods, explaining how qualitative evidence strengthens evaluations. There will then be a discussion and collaborative learning session, providing an opportunity for researchers and public health practitioners to share experiences and engage with the guidance. The discussions will be prompted by examples of natural experimental evaluations relevant to the presentations. Key messages • Natural experimental evaluations are valuable for assessing the impacts of population health interventions. • This workshop provides an opportunity to engage with and discuss new guidance, highlighting good practice in the design, planning, conduct and use of evidence from natural experimental evaluations.