DEVASYS - Development of an Online Tool to Support Systematic Evaluation of Intervention Projects in Prevention and Health Promotion

Abstract

To date, knowledge about the effects and implementation quality of disease prevention and health promotion projects in Germany is limited. Only a few structured evaluation systems exist that can be easily used and which include features for evaluating research and practice projects. The aim of the current project was to develop and carry out a pilot study of an online evaluation tool that enables structured self-evaluation of projects in disease prevention and health promotion practice and contributes to an improved documentation and cyclical development of projects. The mixed-methods approach taken in this project included 2 steps: a) search of literature and database to develop a theoretical framework for the tool and b) adaptation process to test the fit of the tool for practice, including a focus group discussion and a usability test with different disease prevention and health promotion stakeholders (N=12). The resulting documentation and evaluation system (DEVASYS) is comprised of the components "planning", "documentation", and "evaluation" which can be used independently of one another. The conceptual basis of the tool is the RE-AIM framework. To determine the quality of an individual project, dimensions of both the output (reach, acceptance, implementation) and the outcome levels (effectiveness, maintenance) can be documented with the tool. DEVASYS is a practice-oriented tool contributing to an improved evaluation of existing practice-related intervention projects and the overall quality of future projects in the area of disease prevention and health promotion. Systematic dissemination and implementation of the tool are the next steps to be taken.