Setting the game plan: an international Delphi study on evaluating a population-wide youth sports financial incentive

Abstract

BackgroundChildren and adolescents’ physical inactivity is a global problem. Financial incentives are increasingly utilised to support children’s participation in sport, with programs introduced in multiple jurisdictions globally, however few programs have comprehensive evaluations. This study used a Delphi methodology to develop evaluation recommendations for an existing population-wide financial incentive program based in South Australia.MethodsA three-round Delphi study was conducted from October 2022 to April 2023. A diverse range of stakeholders including end-users, government representatives, academics/researchers, and Non-Government Organisation representatives participated in the Delphi panel. Round 1 focussed on the perceived importance of various evaluation components, including reach, process, and effectiveness. Round 2 focussed on identifying evaluation approaches and tools, while Round 3 determined methodological priorities and timeframes. A consensus level of ≥ 70% was set a priori (rating 6 or 7 on 7-point scale). Round 3 results were used to formulate evaluation recommendations.ResultsSixty-seven stakeholders agreed to participate, with an average response rate of 76% (87%; 73% and 67% for each round, respectively). All evaluation components gained consensus in Round 1. In Round 2, consensus was gained on 14 evaluation measures, including measuring the cost of sport, awareness of the program amongst eligible families, and reasons for non-participation, with evaluation methods generated for each measure. Round 3 results determined participants’ preferred methods of evaluation and informed the development of evaluation recommendations. Recommended evaluation methods included mixed method approaches for provider and user process evaluations and measuring program awareness using an epidemiological survey.ConclusionThis Delphi study sought the views and opinions from diverse stakeholders to create evaluation recommendations for a population-wide sports voucher program. Results suggested that a comprehensive evaluation strategy is needed to understand the reach, effectiveness, and impact of the program. Additionally, there was a consensus on reallocating program funds for this evaluation.