Abstract
Background: The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and identify opportunities for improving use outside of research contexts.Methods: We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants (n = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data.Results: Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach (n = 9), adoption (n = 11), and implementation (n = 12) while effectiveness (n = 7) and maintenance (n = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall M = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall M = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design (M = 4.7 ± 0.6) relative to the other dimensions (3.0–3.9). All dimensions were considered similarly important for decision-making (average M = 4.1 ± 1.4), with the exception of maintenance (M = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert.Discussion: RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.
Highlights
With the proliferation of evidence-based programs for improving population health, there is a greater concern with promoting the dissemination and implementation (D&I) of health programs [1]
Familiar, and easy to understand D&I framework, it is a good choice for a planning or evaluation framework in real-world settings
RE-AIM is generally not seen as an alternative to more traditional program evaluation methods, focusing on effectiveness, but as a way to broaden and contextualize results, with a focus on population impact [15]
Summary
With the proliferation of evidence-based programs for improving population health, there is a greater concern with promoting the dissemination and implementation (D&I) of health programs [1]. Most assessments of the use of frameworks have been in research settings [6]. This is true of the RE-AIM framework, use of which in research grants and publications has been welldocumented [7,8,9]. There has been far less evaluation of use of RE-AIM in non-research settings. Such use is especially appropriate for RE-AIM, which is designed to be a pragmatic model [10]. The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the “real-world” and identify opportunities for improving use outside of research contexts
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have