Reach, Effectiveness, Adoption, Implementation, Maintenance Framework Research Articles

Evaluating the Implementation and Clinical Effectiveness of an Innovative Digital First Care Model for Behavioral Health Using the RE-AIM Framework: Quantitative Evaluation.

In the United States, innovation is needed to address the increasing need for mental health care services and widen the patient-to-provider ratio. Despite the benefits of digital mental health interventions (DMHIs), they have not been effective in addressing patients' behavioral health challenges as stand-alone treatments. This study evaluates the implementation and effectiveness of precision behavioral health (PBH), a digital-first behavioral health care model embedded within routine primary care that refers patients to an ecosystem of evidence-based DMHIs with strategically placed human support. Patient demographic information, triage visit outcomes, multidimensional patient-reported outcome measure, enrollment, and engagement with the DMHIs were analyzed using data from the electronic health record and vendor-reported data files. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used to evaluate the implementation and clinical effectiveness outcomes of PBH. PBH had a 47.58% reach rate, defined as patients accepting the PBH referral from their behavioral health integrated clinician. PBH patients had high DMHI registration rates (79.62%), high activation rates (76.54%), and high retention rates at 15 days (57.69%) and 30 days (44.58%) compared to literature benchmarks. In total, 74.01% (n=168) of patients showed clinical improvement, 22.47% (n=51) showed no clinical change, and 3.52% (n=8) showed clinical deterioration in symptoms. PBH had high adoption rates, with behavioral health integrated clinicians referring on average 4.35 (SD 0.46) patients to PBH per month and 90%-100% of clinicians (n=12) consistently referring at least 1 patient to PBH each month. A third (32%, n=1114) of patients were offered PBH as a treatment option during their triage visit. PBH as a care model with evidence-based DMHIs, human support for patients, and integration within routine settings offers a credible service to support patients with mild to moderate mental health challenges. This type of model has the potential to address real-life access to care problems faced by health care settings.

Evaluation of Caru Programme: A National Programme Supporting Palliative, End of Life and Bereavement Care in Nursing Homes in Ireland

Abstract Background The aim of the interim evaluation report is to provide the Caru Programme team with information on the impact of the Programme to date and to highlight the outcomes and challenges, whilst reiterating the key aims and objectives of the Programme and the overall evaluation. Methods The evaluation utilities’ a combination of quantitative and qualitative methodologies. A pre-post design of baseline, mid-line and end-line primary data collection is used to measure the overall impact of the programme. Secondary data analysis of participant feedback, workshop evaluations and attendance was completed under the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Results The education sessions provided were highly valued, with the majority of participants indicating an increase in baseline knowledge after attending a session. There were very high levels of positive experience with 80-99% of participants strongly endorsing the activities and recommending the programme. Participants who attended the Project ECHO and the QI workshops, indicated an intention to change practice; however, at this stage of the evaluation, there is a lack of specific details on what practice or change would be introduced, or indeed, its timeline. This will be measured in the next phase of the evaluation. Conclusion Caru is an innovative continuous learning programme supporting nursing home staff in the delivery of palliative, end-of-life, and bereavement care to residents. The learning components are delivered using a range of approaches, Webinars, Project ECHO online learning, Regional Networks, Quality Improvement Workshops. The interim evaluation report outlines the outcomes from Phase I and the first year of the programme’s delivery. It provides insights into its impact, outcomes, and challenges as well as providing a basis for the next phase of the evaluation. This interim evaluation lays the groundwork for a comprehensive understanding of the Caru Programme model and impact and provides valuable insights into its effectiveness.

An evaluation of the best practices and barriers for the Nagasaki acute myocardial infarction secondary prevention clinical pathway

Aims The Nagasaki Acute Myocardial Infarction Secondary Prevention Clinical Pathway (NASP), a guideline-based regional clinical pathway, was developed to manage low-density lipoprotein cholesterol levels for patients with acute myocardial infarction (AMI) in the Nagasaki prefecture in Japan. This study aimed to summarize the perceived best practices and barriers for the dissemination and operation of the NASP. Methods This exploratory sequential mixed methods study was developed around the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. Focus group interviews were conducted with 24 physicians with experience treating AMI in alignment with the NASP at foundation hospitals. The identified themes and insights were integrated into the development of the questionnaire. The web-based, self-administered questionnaire with a cross-sectional study design was given to 62 physicians in the Nagasaki prefecture. Mixed-method data integration of the results from both study phases was conducted through meta-inferences made from the qualitative and quantitative data. Results The best practices included the development of multi-disciplinary operation teams at medical facilities in preparation for the implementation of the NASP, the simplification of the document preparation process, and the establishment of an additional medical fees policy for the utilization of the NASP instead of patient referral documents. Practices tailored to the type of medical institute such as instructing patients on the NASP regimen during index hospitalization for acute-care hospitals, and the development of NASP instructions and manuals for primary care hospitals/outpatient clinics were also recommended. In addition, barriers to the implementation of the NASP such as missed eligible AMI patients for the NASP and the inconsistent implementation to eligible AMI patients were identified. Conclusions This study identified the perceived best practices and barriers for the NASP. This knowledge should be considered when expanding the NASP to other institutions across Japan.

Using the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) Framework to Evaluate a Tailored Education Program to Reduce Obesity-Related Cancers in El Paso, Texas.

Background: Pasos Para Prevenir Cancer is a tailored lifestyle program that focuses on behavioral modification through knowledge and behavioral strategy education, which was delivered in El Paso, Texas, on the U.S.-Mexico border. Methods: Using the RE-AIM framework, we assessed Pasos Para Prevenir Cancer for efficacy and potential for sustainability. Survey, administrative, and observational data were collected between 2018 and 2022. The program was evaluated to determine reach, effectiveness, adoption, implementation, and maintenance. Results: Tailoring and adapting to the U.S.-Mexico border context is feasible and necessary to deliver evidence-based healthy eating and active living education content. Pasos Para Prevenir Cancer was well received and delivered in diverse settings with varying linguistic needs. Components of the program were adopted by other organizations and integrated into existing programming. Conclusions: Adapting and tailoring evidence-based programs to improve healthy eating and active living is required to meet the needs of Latino subgroup populations, like those on the U.S.-Mexico border.

Using RE-AIM Framework to Evaluate Recovery Opioid Overdose Team Plus: A Peer-Led Post-overdose Quick Response Team.

Peer recovery coaches utilize their lived experiences to support overdose survivors, a role gaining prominence across communities. A convergent mixed methods design, informed by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, was used to evaluate the Recovery Opioid Overdose Team Plus (ROOT +), through an iterative evaluation using web-based surveys and qualitative interviews. Reach: Over 27months, ROOT + responded to 83% of suspected overdose referrals (n = 607) and engaged with 41% of survivors (n = 217) and 7% of survivors' family/friends (n = 38). Effectiveness: Among those initially engaged with ROOT +, 36% of survivors remained engaged, entered treatment, or were in recovery at 90days post-overdose (n = 77). Adoption: First responders completed 77% of ROOT + referrals (n = 468). Implementation: Barriers included lack of awareness of ROOT + , working phones, and access to treatment from community partner interviews (n = 15). Maintenance: Adaptations to ROOT + were made to facilitate implementation. Peer-led teams are promising models to engage with overdose survivors.

Understanding benefits of a college student-homebound adult partnership program to support aging in place: An exploratory study

The need for effective approaches to support aging and homebound adults is recognized internationally and domestically. This exploratory study sought to understand the proximal benefits of an intergenerational program in Delaware, USA that connected homebound individuals with college students. The primary goal was to describe program impacts on home-bound community residents to inform future research, program planning, and implementation. Outcomes of interest included quality of life, well-being, and independence. Semi-structured interviews were conducted with 19 participants recruited from a nonprofit partner. Findings yielded seven unique themes: emotional fulfillment, special feelings of support from a rare “unconditional” relationship, assistance with tasks, close connection with someone not ordinarily met, intergenerational understanding, someone to talk to, and appreciation. Additionally, the research team applied the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, to contextualize the approach and findings. Results inform future evaluation efforts of homebound visiting programs, which may seek to incorporate outcome indicators aligned with these themes and serve as a foundation for future quantitative measures of impact.

Experiences with implementing advance care planning (ACP-GP) in Belgian general practice in the context of a cluster RCT: a process evaluation using the RE-AIM framework

BackgroundGeneral practice is often recommended as an ideal setting to initiate advance care planning (ACP), but uptake of ACP in this setting is low. ACP-GP is a complex intervention to facilitate ACP for patients with chronic, life-limiting illness in Belgian general practice. It aims to increase patient ACP engagement and general practitioner (GP) ACP self-efficacy. In a cluster-randomized controlled trial, the intervention was not superior to control in increasing these outcomes. A parallel process evaluation aimed to enhance understanding of how the intervention was implemented, and which factors might have influenced trial results.MethodsWe conducted a mixed-methods process evaluation following the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Data sources include recruitment and implementation monitoring, questionnaires for patients and GPs, and semi-structured (focus group) interviews with patients and GPs. Questionnaire data were analyzed descriptively. Qualitative data were first analyzed inductively; themes were then assigned deductively to RE-AIM dimensions.ResultsThirty-five GPs and 95 patients were recruited to the trial; GP reach was low. Sixteen GPs and 46 patients provided questionnaire data at 3 months post-baseline; qualitative data were transcribed for 14 GPs and 11 patients. Adoption of intervention components was moderate to good, with the exception of the documentation template for GPs. Interviews revealed varying patient attitudes towards ACP, but patients nonetheless emphasized that conversations made them feel reassured. GPs especially valued a positive framing of ACP. When adopted, the intervention was well-implemented and participant satisfaction was high. However, intention for maintenance was moderate, with GPs raising questions of how to sustainably implement ACP conversations in the future.ConclusionsImplementing the complex ACP-GP intervention in general practice is feasible, and can be successful. However, the implementation process is challenging and the sustainability is suboptimal. Our findings will guide future research and recommendations for facilitating and implementing ACP in general practice.Trial registrationISRCTN12995230; prospectively registered on 19/06/2020.

Osteoporosis screening in Australian community pharmacies: A mixed methods study.

Osteoporosis and poor bone health impact a large proportion of the Australian population, but is drastically underdiagnosed and undertreated. Community pharmacies are a strategic location for osteoporosis screening services due to their accessibility and the demographic profile of customers. The aim of this study was to develop, implement and evaluate a community pharmacy health promotion service centred on encouraging consumers to complete an anonymous osteoporosis screening survey called Know Your Bones. The implementation process was documented using the REAIM (reach, effectiveness, adoption, implementation, maintenance) framework. Uptake of the Know Your Bones screening tool was monitored anonymously with website traffic. Surveys and interviews were designed to capture consumer outcomes after screening. Semi-structured interviews were conducted with Australian community pharmacy stakeholders during design and implementation phases to explore their perspectives of the barriers and facilitators. The service was implemented in 27 community pharmacies. There were 448 visits to the screening website. Interviews were conducted with 41 stakeholders. There were a range of factors that appeared to influence implementation of the service. Perceived acceptability was critical, which depended on staff training, pharmacists' altruism, and remuneration. Staff relied heavily on their existing close relationships with consumers. No consumers completed non-anonymous surveys or agreed to participate in interviews post-screening. Using an implementation science approach, a community pharmacy osteoporosis screening service for the Australian context was designed and found to be acceptable to pharmacy staff and effective in reaching the target population. SO WHAT?: This low-cost and non-invasive health promotion has potential to sustainably increase national screening rates for osteoporosis.

PREHABILITATION BEFORE GASTROINTESTINAL CANCER SURGERY (PREHAB-GI): AN IMPLEMENTATION STUDY

BACKGROUND Surgery continues to be the primary treatment option for early-stage colorectal and upper gastrointestinal (UGI) cancers. However, up to 30-40% will experience a major complication. Prehabilitation aims to improve preoperative functional reserves through physical, nutritional, and/or psychological interventions. We aimed to evaluate the implementation of a multimodal prehabilitation program in gastrointestinal cancer surgery patients. METHODS A single-arm implementation study using a pre-post design. Colorectal or UGI cancer patients scheduled for curative intent surgery at Concord Hospital with ≥14 days pre-surgery were recruited. The intervention was face-to-face or by telehealth (COVID adaptations): a 2-4-week program consisting of i) supervised exercise, ii) dietary education and protein supplements, iii) nursing support. The primary outcome was implementation using the RE-AIM (Reach/Effectiveness/Adoption/Implementation/Maintenance) framework. Secondary outcomes included functional, nutritional, and surgical outcomes. RESULTS Over 16 months, 181 were screened; 95 (52%) were eligible. Reach: 77/95 recruited (64 colorectal, 13 UGI). The median age was 70 years; 46 (60%) were males. Median intervention duration was 16 days. Effectiveness: Functional capacity using the 6-minute walk test and 2-minute step test improved from baseline to pre-surgery; 9.3m (p=0.038) and 6.5 steps (p=<0.001), respectively. Self-reported moderate, vigorous and resistance training statistically increased from baseline to pre-surgery. Hospital length of stay decreased by 1.9 days (p=0.010). There was no difference in total complications and readmissions. Adoption: 91% of referrals were directly from surgeons. Implementation: 72 completed the intervention; 5 withdrew after baseline assessment. 34% of assessments and intervention were delivered by telehealth. Adherence to the intervention was high; 94% exercise, 97% nutrition, 98% nursing. Overall, participant and clinician satisfaction was high. Maintenance: The program has been adopted as standard care with modifications post-study completion. CONCLUSIONS Our study shows that multimodal prehabilitation can be successfully implemented in a real-world setting, with a trend to improve functional and surgical outcomes.

Implementation of a Clinical Vessel Wall MR Imaging Program at an Academic Medical Center.

The slow adoption of new advanced imaging techniques into clinical practice has been a long-standing challenge. Principles of implementation science and the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework were used to build a clinical vessel wall imaging program at an academic medical center. Six phases for implementing a clinical vessel wall MR imaging program were contextualized to the RE-AIM framework. Surveys were designed and distributed to MR imaging technologists and clinicians. Effectiveness was measured by surveying the perceived diagnostic value of vessel wall imaging among MR imaging technologists and clinicians, trends in case volumes in the clinical vessel wall imaging examination, and the number of coauthored vessel wall imaging-focused publications and abstracts. Adoption and implementation were measured by surveying stakeholders about workflow. Maintenance was measured by surveying MR imaging technologists on the value of teaching materials and online tip sheets. The Integration dimension was measured by the number of submitted research grants incorporating vessel wall imaging protocols. Feedback during the implementation phases and solicited through the survey is qualitatively summarized. Quantitative results are reported using descriptive statistics. Six phases of the RE-AIM framework focused on the following: 1) determining patient and disease representation, 2) matching resource availability and patient access, 3) establishing vessel MR wall imaging (VWI) expertise, 4) forming interdisciplinary teams, 5) iteratively refining workflow, and 6) integrating for maintenance and scale. Survey response rates were 48.3% (MR imaging technologists) and 71.4% (clinicians). Survey results showed that 90% of the MR imaging technologists agreed that they understood how vessel wall MR imaging adds diagnostic value to patient care. Most clinicians (91.3%) reported that vessel wall MR imaging results changed their diagnostic confidence or patient management. Case volumes of clinical vessel wall MR imaging performed from 2019 to 2022 rose from 22 to 205 examinations. Workflow challenges reported by MR imaging technologists included protocoling examinations and scan length. Feedback from ordering clinicians included the need for education about VWI indications, limitations, and availability. During the 3-year implementation period of the program, the interdisciplinary teams coauthored 27 publications and abstracts and submitted 13 research grants. Implementation of a clinical imaging program can be successful using the principles of the RE-AIM framework. Through iterative processes and the support of interdisciplinary teams, a vessel wall MR imaging program can be integrated through a dedicated clinical pipeline, add diagnostic value, support educational and research missions at an academic medical center, and become a center for excellence.

A feasibility, randomised controlled trial of Club Connect: a group-based healthy brain ageing cognitive training program for older adults with major depression within an older people’s mental health service

BackgroundUsing the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework, we outline steps taken to implement an evidence-based cognitive training program, Club Connect, in older adults with major depressive disorder in an Older People’s Mental Health Service in Sydney, Australia. The primary aim was to explore feasibility (or ‘reach’), tolerability (or ‘implementation’), and acceptability (or ‘adoption’). The secondary aim was to explore the most sensitive clinical outcomes and measurement tools (i.e. ‘effectiveness’) to inform a formal randomised controlled trial, and to explore the healthcare resources used (i.e. costs) to assist decision-making by health care managers and policy-makers in relation to future resource allocation.MethodsUsing a single blinded feasibility design, 40 participants (mean age: 76.13 years, SD: 7.45, range: 65–95 years) were randomised to either (a) Club Connect, a 10-week group-based multifaceted program, comprising psychoeducation and computer-based cognitive training, or (b) a waitlist control group.ResultsImplementing group-based cognitive training within a clinical setting was feasible, well tolerated and accepted by participants. Further, cognitive training, in comparison to the waiting list control, was associated with moderate to very large effect size improvements in depression, stress and inhibition (ηp2 = 0.115–0.209). We also found moderate effect size improvements on measures of daily functioning, wellbeing and cognitive flexibility. Small effect size improvements for other cognitive and psychosocial outcomes were also observed. The average cost per person participating in in the intervention was AU$607.50.ConclusionsOur findings support the feasibility of implementing group-based cognitive training into a specialised clinical (public health) setting. This trial was registered on the Australian and New Zealand Clinical Trial Registry (ACTRN12619000195156, 12/02/2019).

The Shaping Healthy Choices Program: Improving the impact through community partnerships

The high prevalence of childhood overweight and obesity demonstrates the need for effective intervention strategies. The Shaping Healthy Choices Program (SHCP) is a school-based intervention that promotes nutrition and physical education, develops family and community partnerships, and incorporates foods available on the school campus, with the goal of achieving sustainable student health outcomes. Partnerships developed through implementation of the SHCP were analyzed using the RE-AIM: Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework to assess the potential for adoption, scaling and sustainability of the program. The RE-AIM framework is a comprehensive approach to evaluating public health interventions through reach, effectiveness, adoption, implementation and maintenance. Partners of the SHCP include site staff (teachers, administration and health professionals), parents, peer teachers, and state and federal agencies, such as the Supplemental Nutrition Assistance Program Education (SNAP-Ed), which funds CalFresh Healthy Living, University of California (CFHL, UC), and UC Cooperative Extension. This analysis highlights how partnerships developed and sustained with the SHCP may serve as a model for other programs to expand, while also enabling programs to remain responsive to the diverse challenges and needs of local community partners.

Community-based Advocacy Communication Social Mobilization (ACSM) intervention by empowering key community leaders: Evaluation using the RE-AIM framework.

Based on the theme of World Tuberculosis (TB) Day 2018-"Wanted Leaders for TB free world," various studies and country-level project have witnessed how training leaders on TB has helped enhance TB awareness in the community. This study was conducted to evaluate the effectiveness of Advocacy Communication and Social Mobilization (ACSM) intervention strategy through key community leaders, using Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. This study was undertaken by the Department of Community Medicine, Sri Manakula Vinayagar Medical College and Hospital (SMVMCH), Puducherry, in the field practice area of Primary Health Centre (PHC), Thirubuvanai. The STOP TB, ENGAGE-TB, and National TB Elimination Program (NTEP) guidelines were used for interventions. Key community leaders (KCL) list (N = 117) was obtained from Mannadipet commune panchayat and PHC. The study was conducted in four phases: phase 1 (baseline): quantitative data: proportion of presumptive TB cases from notification register; phase 2 (intervention): training program for staff nurses, auxiliary nurse midwife (ANM), Accredited Social Health Activist (ASHA), and Anganwadi workers (group activity), participatory rural appraisal (PRA) activity for self-help group (SHG) leaders, and health education session for religious leaders and ex-panchayat leaders; phase 3: strengthening of ongoing activity: health education session and active case finding for TB; and phase 4: end line: outcome of the intervention, evaluated using the RE-AIM framework. As an outcome of the intervention, there was a marginal increase (21 cases) in the proportion of presumptive TB cases when comparing before (2018) and after (2019) intervention. The proportion of presumptive TB cases identified and referred by KCL was 312. A total of 77 presumptive TB cases were identified through community-based active case finding (ACF). Two sputum samples (on the spot early morning) were collected and sent for Cartridge-based nucleic acid amplification testing (CBNAAT), of which three cases were positive. This study was community led and involved leaders from diverse backgrounds, optimizing the chance of success. For sustainability, we have initiated TB support group.

Implementation of remote home care: assessment guided by the RE-AIM framework

BackgroundWelfare technology interventions have become increasingly important in home-based palliative care for facilitating safe, time-efficient, and cost-effective methods to support patients living independently. However, studies evaluating the implementation of welfare technology innovations are scarce, and the empirical evidence for sustainable models using technology in home-based palliative care remains low. This study aimed to report on the use of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to assess the implementation of remote home care (RHC) a technology-mediated service for home-living patients in the palliative phase of cancer. Furthermore, it aimed to explore areas of particular importance determining the sustainability of technologies for remote palliative home-based care.MethodsA secondary analysis of data collected by semi-structured interviews with patients with cancer in the palliative phase, focus groups, and semi-structured interviews with healthcare professionals (HCPs) experienced with RHC was performed. A deductive reflexive thematic analysis using RE-AIM dimensions was conducted.ResultsFive themes illustrating the five RE-AIM dimensions were identified: (1) Reach: protective actions in recruitment - gatekeeping, (2) Effectiveness: potential to offer person-centered care, (3) Adoption: balancing high touch with high tech, (4) Implementation: moving towards a common understanding, and (5) Maintenance: adjusting to what really matters. The RE-AIM framework highlighted that RHC implementation for patients in the palliative phase of cancer was influenced by HCP gatekeeping behavior, concerns regarding abandoning palliative care as a high-touch specialty, and a lack of competence in palliative care. Although RHC facilitated improved routines in patients’ daily lives, it was perceived as a static service unable to keep pace with disease progression.ConclusionsA person-centered approach that prioritizes individual needs and preferences is necessary for providing optimal care. Although technologies such as RHC are not a panacea, they can be integrated as support for increasingly strained health services.

Implementation evaluation of tiered tele-triage pathways for burn center consultations and transfers.

Early transfer to specialized centers improves trauma and burn outcomes; however, overtriage can result in unnecessary burdens to patients, providers, and health systems. Our institution developed novel burn triage pathways in 2016 to improve resource allocation. We evaluated the implementation of these pathways, analyzing trends in adoption, resource optimization, and pathway reliability after implementation. Triage pathways consist of transfer nurses (RNs) triaging calls based on review of burn images and clinical history: green pathway for direct outpatient referral, blue pathway for discussion with the on-call provider, red pathway for confirmation of transfer as requested by referring provider, and black pathway for the rapid transfer of severe burns. We used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework to evaluate implementation. These pathways affected all acute burn referrals to our center from January 2017 to December 2019 (reach). Outcomes of interest were pathway assignment over time (adoption), changes to burn provider call volume (effectiveness), and the concordance of pathway assignment with final disposition (implementation reliability). Transfer RNs triaged 5,272 burn referrals between 2017 and 2019. By January 2018, >98% of referrals were assigned a pathway. In 2018-2019, green pathway calls triaged by RNs reduced calls to burn providers by a mean of 40 (SD, 11) per month. Patients in green/blue pathways were less likely to be transferred, with >85% receiving only outpatient follow-up ( p < 0.001). Use of the lower acuity pathways increased over time, with a concordant decrease in use of the higher acuity pathways. Younger adults, patients referred from Level III to Level V trauma centers and nontrauma hospitals, and patients referred by APPs were less likely to be triaged to higher acuity pathways. Implementation of highly adopted, reliable triage pathways can optimize existing clinical resources by task-shifting triage of lower acuity burns to nursing teams. Prognostic and Epidemiological; Level III.

The influence of organizational models on the implementation of internet-based cognitive behavior therapy in primary care: A mixed methods study using the RE-AIM framework

BackgroundInternet-Based Cognitive Behavioral Therapy (iCBT) holds great potential in addressing mental health issues, yet its real-world implementation poses significant challenges. While prior research has predominantly focused on centralized care models, this study explores the implementation of iCBT in the context of decentralized organizational structures within the Swedish primary care setting, where all interventions traditionally are delivered at local Primary Care Centers (PCCs). AimThis study aims to enhance our understanding of iCBT implementation in primary care and assess the impact of organizational models on the implementation's outcome using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. MethodA mixed-methods research design was employed to identify the factors influencing iCBT implementation across different levels, involving patients, therapists and managers. Data spanning two years was collected and analyzed through thematic analysis and statistical tests. The study encompassed 104 primary care centers, with patient data (n = 1979) sourced from the Swedish National Quality Register for Internet-Based Psychological Treatment (SibeR). Additionally, 53 iCBT therapists and 50 PCC managers completed the Normalization Measure Development Questionnaire, and 15 leaders participated in interviews. ResultsOur investigation identified two implementation approaches, one concentrated and one decentralized. Implementation effectiveness was evident through adherence rates suggesting that iCBT is a promising approach for treating mental ill-health in primary care, although challenges were observed concerning patient assessment and therapist drift towards unstructured treatment. Mandatory implementation, along with managerial and organizational support, positively impacted adoption. Results vary in terms of adherence to established protocols, with therapists working in concentrated model showing a significantly higher percentage of registration in the quality register SibeR (X2 (1, N = 2973) = 430.5774, p = 0.001). They also showed significantly higher means in cognitive participation (Z = −2.179, p = 0.029) and in reflective monitoring (Z = −2.548, p = 0.011). DiscussionOverall, the study results demonstrate that iCBT, as a complex and qualitatively different intervention from traditional psychological treatment, can be widely implemented in primary care settings. The study's key finding highlights the substantial advantages of the concentrated organizational model. This model has strengths in sustainability, encourages reflective monitoring among therapists, the use of quality registers, and enforces established protocols. ConclusionIn conclusion, this study significantly contributes to the understanding of the practical aspects associated with the implementation of complex internet interventions, particularly in the context of internet-based cognitive-behavioral therapy (iCBT). The study highlights that effective iCBT integration into primary care requires a multifaceted approach, taking into account organizational models, robust support structures, and a commitment to maintaining quality standards. By emphasizing these factors, our research aims to provide actionable insights that can enhance the practicability and real-world applicability of implementing iCBT in primary care settings.

Optimising the implementation of digital-supported interventions for the secondary prevention of heart disease: a systematic review using the RE-AIM planning and evaluation framework

BackgroundmHealth technologies are now widely utilised to support the delivery of secondary prevention programs in heart disease. Interventions with mHealth included have shown a similar efficacy and safety to conventional programs with improvements in access and adherence. However, questions remain regarding the successful wider implementation of digital-supported programs. By applying the Reach-Effectiveness-Adoption-Implementation-Maintenance (RE-AIM) framework to a systematic review and meta-analysis, this review aims to evaluate the extent to which these programs report on RE-AIM dimensions and associated indicators.MethodsThis review extends our previous systematic review and meta-analysis that investigated the effectiveness of digital-supported programs for patients with coronary artery disease. Citation searches were performed on the 27 studies of the systematic review to identify linked publications that reported data for RE-AIM dimensions. All included studies and, where relevant, any additional publications, were coded using an adapted RE-AIM extraction tool. Discrepant codes were discussed amongst reviewers to gain consensus. Data were analysed to assess reporting on indicators related to each of the RE-AIM dimensions, and average overall reporting rates for each dimension were calculated.ResultsSearches found an additional nine publications. Across 36 publications that were linked to the 27 studies, 24 (89%) of the studies were interventions solely delivered at home. The average reporting rates for RE-AIM dimensions were highest for effectiveness (75%) and reach (67%), followed by adoption (54%), implementation (36%) and maintenance (11%). Eleven (46%) studies did not describe relevant characteristics of their participants or of staff involved in the intervention; most studies did not describe unanticipated consequences of the intervention; the ongoing cost of intervention implementation and maintenance; information on intervention fidelity; long-term follow-up outcomes, or program adaptation in other settings.ConclusionsThrough the application of the RE-AIM framework to a systematic review we found most studies failed to report on key indicators. Failing to report these indicators inhibits the ability to address the enablers and barriers required to achieve optimal intervention implementation in wider settings and populations. Future studies should consider alternative hybrid trial designs to enable reporting of implementation indicators to improve the translation of research evidence into routine practice, with special consideration given to the long-term sustainability of program effects as well as corresponding ongoing costs.RegistrationPROSPERO—CRD42022343030.

Abstract C116: Provider input following implementation trial to address overdue colorectal cancer screening

Abstract Implementing Fit Kit Colorectal Cancer (CRC) Screening in At-Risk Populations Study was a trial of 4 evidence-based strategies to increase colorectal cancer (CRC) screening in the primary care setting. The focus of this report is the factors that impacted implementation of these interventions in a safety net setting. Using the RE-AIM (Reach Effectiveness Adoption Implementation Maintenance) framework, we evaluated providers’ assessments of the impact of the intervention on the 2 main outcomes: 1) CRC screening ordered; 2) CRC screening completed in a diverse population with more than 3,000 individuals overdue for screening. Methods: We conducted a Qualtrics evaluation survey among 51 staff members identified as individuals involved in cancer screening in a safety net primary care setting that serves over 38,000 individuals in New Haven, CT. The staff surveys are part of the evaluation of the program at one-year post-intervention. Invited staff were provided links through group emails from the provider partners requesting participation in a 2–5-minute Qualtrics survey. Questions on job title, role in CRC screening, and whether and how the interventions (referred to as “the study”) impacted CRC screening in this facility, understanding of the procedures in place to facilitate scheduling and completion of CRC screening, and the barriers and facilitators that impact CRC screening completion were queried. Descriptive results will be mapped to relevant aspects of the RE-AIM framework. Results: Twenty (39%) staff members completed the survey including 9 (45.0%) registered nurses/advanced practice registered nurses, 6 (30.0%) physicians, 2 (10.0%) physician assistants, and 3 (15.0%) individuals in other roles, e.g., schedulers. 87.5% (n=14) were authorized to order colorectal cancer (CRC) screening tests, either colonoscopy or stool-based testing, for their patients. By self-report, effectiveness of the intervention on provider behavior was limited with only 22.2% reporting that the study impacted decisions to order CRC screening. Yet 41% of providers in the study placed a “blanket order” for all individuals who were due for CRC screening even if they were not seen for an appointment during the study period. Barriers to completion of CRC screening were “patient factors” (37%) and insufficient consultation time during appointments (27.3%). Most health care providers cited COVID-19 as a significant factor in delivering an effective CRC screening program. Provider suggestions to improve CRC screening uptake included posted information in exam rooms, use of clinical decision-making tools in the electronic medical record to determine if colonoscopy or FIT (stool-based) testing is the best option, nurse visits to teach use of stool-based testing and making in-home test kits available over the counter in pharmacies. Discussion: Although the results from this small sample of providers has limited generalizability, the findings will be useful in designing scalable interventions in similar high volume primary care settings. Citation Format: Beth A. Jones, Denise L. Stevens, Sakinah Suttiratana, Sarah A. DeGiovanni, Laney Zhang, Margarita Vargas-Torres, Michael Couturie, Levita Robinson. Provider input following implementation trial to address overdue colorectal cancer screening [abstract]. In: Proceedings of the 16th AACR Conference on the Science of Cancer Health Disparities in Racial/Ethnic Minorities and the Medically Underserved; 2023 Sep 29-Oct 2;Orlando, FL. Philadelphia (PA): AACR; Cancer Epidemiol Biomarkers Prev 2023;32(12 Suppl):Abstract nr C116.

Evaluating Blinatumomab Treatment Adoption in Varied Resource Settings Using the RE-AIM Framework

Background Blinatumomab is a targeted immunotherapy for B-ALL. Widespread adoption of this evidence-based intervention in varied resource settings has been limited due to cost, commercial access, and barriers including institutional capacity and medication complexity. We used implementation science frameworks to facilitate and study the translation of blinatumomab into hospitals in lower-resource settings in partnership with a drug-donation program. After 2 years of collaboration, we applied the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework to assess implementation processes and effectiveness outcomes in 2 pilot centers. Methods As a component of a larger hybrid effectiveness-implementation type 2 study, we applied RE-AIM methodology retrospectively to examine data for one hospital in India and one in Pakistan. Quantitative and qualitative data were abstracted from meeting notes, readiness assessments, a 54-question implementation survey based on validated measures, and clinical team observations. Local physicians overseeing the patient treatment with blinatumomab collected de-identified clinical data from routine care from 20 patients. Infusion and 6-month follow-up data were available for 18 and 16 patients, respectively. Patient characteristics were summarized using descriptive statistics. Clinical data were analyzed in aggregate to report real-world effectiveness, and other data were integrated to report on the five RE-AIM domains. Results Overall reach was determined by comparing proportion of annual patient requests, predicted number of eligible patients, and characteristics of patients who received blinatumomab. Reach varied by site from 48%-110%. Participants were representative with a median age of 8 years (IQR 6.23) and 55% were female. MRD-positive disease was the primary indication for receiving blinatumomab (60%, n=12). Regarding effectiveness, 73.3% of patients achieved remission after cycle 1, and 9 patients (60%) proceeded to hematopoietic stem cell transplant after receiving blinatumomab. At six months, 81.3% of patients were alive, 1 had died, and 2 were lost to follow-up. Adoption at the staff level was measured based on engagement of provider roles in training and feedback as measured by completion of a multidisciplinary implementation survey. While nursing was engaged in training at both sites, there was a notable lack of nursing-specific input to the implementation survey, identifying a key opportunity to improve engagement strategies. Early-indicator implementation outcomes were assessed by local multidisciplinary teams demonstrated high feasibility (aggregate mean 4.64/5, SD 0.35), acceptability (aggregate mean 4.71/5, SD 0.39), and appropriateness (aggregate mean 4.86/5, SD 0.24) of blinatumomab at their institution. Site-specific modifications to improve implementation included: modifications to the bag change schedule due to the lack of availability of medical supplies (bag sizes, pump cassette), and nursing ratios were temporarily reduced to provide closer monitoring for patients receiving blinatumomab. Thematic analysis revealed that maintenance is supported by the perceived relative advantage of blinatumomab vs. traditional chemotherapy, with physicians appreciating the opportunity for improved quality of life for patients and noting that also “the treating teams and the parents are happy,” highlighting a potentially positive impact on the physician and family wellbeing. One challenge for program maintenance is the cost of associated medical supplies such as medication infusion tubing and filters and the need for prolonged hospitalization due to barriers related to transportation and the availability of outpatient and emergency services. This will inform future strategies, such as implementation mapping, to determine how to address these site and resource-specific barriers. Conclusion Successful implementation and collaboration with local multidisciplinary teams is a critical predecessor to establishing effectiveness and improving future global access to complex, novel therapies such as blinatumomab. Systematic application of established implementation measures, such as RE-AIM, can improve reporting of rich implementation data and inform strategies to improve the long-term adoption and maintenance of these effective therapies in the real world.

Applying the RE-AIM framework to evaluate an educational model to “close the gap” and improve health equity in uncontrolled hypertension

ObjectivesTo use the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework to evaluate an educational model addressing self-management of uncontrolled hypertension. MethodsWe used a pre-post single cohort design to identify minoritized patients with uncontrolled hypertension (systolic > 160 mmHg and/or diastolic > 100 mmHg). Trained Ambassadors provided telephone outreach, skill-based blood pressure (BP) monitoring, and goal-setting for 4 months. Follow-up occurred at 7 months. We evaluated the initiative using the RE-AIM framework and quantitative analysis for process and outcome measures post-intervention. ResultsAmong Black patients (n = 345), the average age was 55.4 years (8.7), half identified as male (n = 173, 50.1 %); many were uninsured (n = 159, 46.1 %). Engagement in calls occurred for 67.8 % (n = 234) of the cohort; monitor distribution was 22.9 % (n = 79); and goal setting occurred for 64 patients. BP improved for 40 % of the cohort (mean pre: 168/98 mmHg, mean post: 150/89 mmHg; p < 0.0001) and 40 % of patients’ last known BP was < 140/90. ConclusionsRE-AIM evaluation of the Closing the Gap initiative suggests that the model is associated with BP reduction in high-risk Black patients. Practice ImplicationsAn educational model for patient-centered hypertension management in low-income populations is feasible and addresses self-monitoring barriers.