Process Evaluation Of Interventions Research Articles

Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme: a single-arm pilot study

BackgroundThe growing obesity epidemic in Malaysia presents a public health challenge that requires innovative intervention strategies. In an effort to address this problem, an Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme, which is a web-based initiative designed for preschool child–parent dyads offers a novel approach. Nevertheless, the success of such a web-based intervention depends on several interrelated factors. This research aims to examine the feasibility of i-MaCHeL in the Malaysian context, its usability for preschool child–parent dyads, and the acceptability of the programme among these user groups.MethodsThis was a single-arm pilot study involving 46 child–parent dyads recruited from six government preschools in Terengganu, Malaysia. The preschools were selected using a cluster random sampling technique at the preschool level. The intervention feasibility was determined based on the retention rate of participants in the pilot study. The System Usability Scale (SUS) and intervention process evaluation were used to assess the usability and acceptability of the web-based i-MaCHeL programme.ResultsThe retention data demonstrated that 42 out of 46 participants completed the 13-week intervention programme, which showed that the overall retention rate was 91.3%. A mean (SD) SUS score of 84.70 (13.82) was obtained from parents, indicating that the web-based i-MaCHeL had an acceptable usability level. The mean scores of the process evaluation items ranged from 4.52 (0.63) to 4.83 (0.38), demonstrating that the web-based i-MaCHeL was highly accepted by the parents. The acceptability data also indicated that at least 92.9% (39/42) of the parents agreed/strongly agreed that the web content, programme duration, intervention dose, WhatsApp group, and delivery mode were appropriate.ConclusionsAccording to these findings, the i-MaCHeL intervention using a web-based approach was feasible, usable, and acceptable as part of a weight-related behaviour change intervention for preschool child–parent dyads. This pilot study demonstrated that the web-based i-MaCHeL was feasible and promising for delivering weight-related behavioural intervention to child–parent dyads.Trial registrationClinicalTrials.gov, NCT04711525. Registered on January 15, 2021.

Process Evaluations of Interventions for the Prevention of Type 2 Diabetes in Women with Gestational Diabetes Mellitus: A Systematic Review (Preprint)

Process Evaluations of Interventions for the Prevention of Type 2 Diabetes in Women with Gestational Diabetes Mellitus: A Systematic Review (Preprint)

Systematic review of process evaluations of interventions in trials investigating sedentary behaviour in adults

ObjectivesTo systematically review and synthesise findings from process evaluations of interventions in trials which measured sedentary behaviour as an outcome in adults to explore: (1) how intervention content, implementation, mechanisms...

It's Not Just What You Do but the Way You Do It: A Systematic Review of Process Evaluation of Interventions to Improve Gross Motor Competence.

Motor competence is an important predictor of health behaviours. However, levels of motor competence are low in children and adolescents. Many interventions have improved motor competence, yet intervention effects were highly variable. Potential causes of such variations are not fully understood. Process evaluation can assist with the understanding of why an intervention worked or not, but its application and reporting in motor competence interventions has received little attention. The primary aim of this review was to investigate whether process evaluations have been reported in interventions to improve motor competence and, if reported, which process evaluation measures have been used. A secondary aim was to explore the association of intervention characteristics and process evaluation findings (outcomes of process evaluation measures) with intervention outcomes, in a search for what process evaluation measures may impact on intervention functioning and outcomes. The process of conducting and reporting this review adhered to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The review protocol was registered with PROSPERO (CRD42019124412). A systematic search of seven electronic databases (i.e. MEDLINE [via EBSCOhost], Cochrane Central Register of Controlled Trials [CENTRAL], CINAHL, Academic Search Complete, Education Database, SPORTDiscus and Scopus) was conducted with no date restrictions. Eligibility criteria included the following: (1) a study sample of typically developing children and adolescents aged 5-18years, (2) an intervention aimed to improve motor competence, (3) an intervention included a control group, (4) a report of motor competence outcome at both pre- and post-intervention. Only original articles published in English in peer-reviewed journals were considered. Process evaluation measures and findings were extracted using the UK Medical Research Council's process evaluation framework in order to provide overarching descriptions on the implementation, mechanism of change and context of interventions. Univariable meta-regressions were performed to ascertain whether selected study-level covariates moderated the improvement in motor competence outcomes in interventions. The search identified 60 intervention studies. Only 30 studies (50%) reported process evaluation measures. No studies reported (or employed) theoretical frameworks to guide process evaluation. Process evaluation measures relating to implementation were most commonly reported, with the most prevalent aspect being fidelity. This was followed by reporting on measures relating to mechanism of change and context of the intervention. Meta-analysis results suggested intervention duration, dose, inclusion of process evaluation aim, provision of lesson plans, sample size and sex as potential moderators. Reporting of process evaluation measures may help build our understanding of the optimal characteristics of motor competence interventions. However, process evaluation is under-used and/or under-reported. This review serves as a call for more process evaluations and better reporting in motor competence interventions.

A Protocol of Process Evaluations of Interventions for the Prevention of Type 2 Diabetes in Women With Gestational Diabetes Mellitus: A Systematic Review

Background Process evaluations of randomised controlled trials (RCTs) can provide insight and inform us on the intervention implementation, the causal mechanisms and the contextual factors. This will inform about interventions’ success or failure due to their implementation or the interventions themselves. We aim to consolidate the methodology from previous process evaluations of complex interventions upon their findings on facilitators and barriers to address the prevention of type 2 diabetes mellitus among women with gestational diabetes mellitus (GDM). Methods Comprehensive search will be conducted on electronic databases and reference lists of recent reviews for RCTs of complex interventions which address process evaluations of diabetes prevention intervention (DPI) for women with GDM in healthcare settings. There is no restriction on the language of the papers and year of publication until December 2020. Data from each study will be extracted by two reviewers independently using standardised forms. Data extracted include descriptive items on the study design and the outcomes of process evaluations from the three dimensions: (1) implementation; (2) mechanism of impact and (3) context. The quality of the studies will be assessed using mixed methods appraisal tool which is designed for the appraisal of mixed studies in systematic reviews. A narrative and framework analysis of the findings will be presented to inform the contents of a new DPI for women with GDM. Discussion The findings from this process evaluation findings are valuable in determining whether a complex intervention should be scaled up or modified for other contexts in future plan. It will give deeper understanding of potential challenges and solutions to aid in the implementation of effective DPIs for GDM in Malaysia.

Effectiveness, quality and process evaluation of interventions to prevent childhood obesity. – ADDENDUM

An abstract is not available for this content so a preview has been provided. As you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Effectiveness, quality and process evaluation of interventions to prevent childhood obesity.

AbstractChildhood obesity is one of the most serious global public health challenges of the 21stcentury. Health and scientific organizations demand early interventions, although their complexity generates difficulties in their implementation. In systematic reviews, quality assessments are intended to limit mislead reporting and it is important they are conducted in a manner that minimizes bias. Process evaluation (PE) is used to monitor and document program implementation and can aid in understanding the relationship between specific program elements and program outcomes. Failure to deliver an intervention as intended can lead to unclear conclusions about the effectiveness of the intervention. The aim of the present study is to evaluate the effectiveness of the studies based on the process evaluation and the quality on its interventions. We performed a systematic review of randomized control trials aiming to prevent childhood obesity. The Cochrane Handbook for Systematic Reviews of Interventions tool was used to assess and report methodological risk of bias. Each item was judged as being at high (HR), low (LR) or unclear (UN) risk of bias as per criteria. Key domains random sequence generation and allocation concealment were also assessed. Effectiveness was estimated when the study showed changes in body composition as the main outcome (BMI z-score or waist circumference). Process evaluation was evaluated if at least one process evaluation indicator was identified as being adequately implemented. From the 41 studies, 26 showed any degree of effectiveness and 15 were not effective. Almost half of studies scored high risk of bias: 20/41 (Effective 13/26; non effective 7/15). Moreover, 16/41 studies reported to have unclear risk of bias (effective 10/26; and non-effective 6/15). Only 5/41 articles reported to have low risk (effective 3/26; non effective 2/15). Regarding random sequence generation, there was no difference according to the quality of the studies (effective: LR 25/26, UN 1/26 AND HR 0/26; non effective: LR 15/15, UN 0/15 AND HR 0/15). Concerning the allocation concealment domain, there were no differences found either (effective: LR 11/26, UN 10/26 AND HR 5/26; non effective: LR 7/15, UN 5/15 AND HR 3/15). PE was used in 7 papers (effective 3/7 and non-effective 4/7). Quality seems to have slightly more influence in the non-effective studies (LR 13.3%) than in the effective studies (LR 11.5%). The non-effective studies showed the highest proportion of performing PE. There seems to be a relationship between the quality and PE performance.

A protocol for a systematic review of process evaluations of interventions investigating sedentary behaviour in adults

IntroductionSedentary behaviour is defined as any waking behaviour characterised by low energy expenditure ≤1.5 metabolic equivalents while in a sitting, lying or reclining posture. The expanding evidence base suggests that...

A realist review of which advocacy interventions work for which abused women under what circumstances.

A realist review of which advocacy interventions work for which abused women under what circumstances.

Using the critical incident technique for qualitative process evaluation of interventions: The example of the “Let's Move It” trial

RationaleTrials evaluating interventions to promote health behavior change rarely embed investigations that assess participant perceptions of crucial triggers of change. ObjectiveThe "Let's Move It” (LMI) randomized trial evaluated a theorybased whole school system intervention aiming to increase physical activity (PA) of adolescents attending vocational schools. This article serves two main purposes: to describe how to use the critical incident technique (CIT) to conduct in qualitative process evaluation to identify events, including intervention elements, which LMI trial participants perceived to enable or support behavior change. MethodSemi-structured interviews (n = 34) conducted immediately post intervention from intervention and control arms were analyzed using the CIT. ResultsThe analysis identified altogether 39 critical incidents. Most of the critical incidents were related to the LMI in the intervention arm and the findings are partly aligned with the LMI intervention theory. Analysis revealed several critical incidents also in the control arm, including gaining insights regarding PA and mere measurement effects, illustrating challenges facing real-world trials. ConclusionThe CIT seems a promising approach for directing analysis towards potentially crucial intervention elements as described by the participants themselves, helping in focusing and limiting the text corpus to accounts relevant to change. Qualitative evaluations in trials may add valuable understanding to complement quantitative assessments.

Group members’ questions shape participation in health counselling and health education

ObjectiveThis study examines how group members’ questions shape member participation in health counselling and health education groups. MethodsThe study applies conversation analytic principles as a method. The data consist of video-recorded health education lessons in secondary school and health counselling sessions for adults with a high risk of Type 2 diabetes. ResultsGroup members’ questions accomplish a temporary change in participatory roles. They are used to 1) request counselling, 2) do counselling or 3) challenge previous talk. They are usually treated as relevant and legitimate actions by the participants, but are occasionally interpreted as transitions outside the current action or topic. ConclusionGroup members’ questions result in a shift from leader-driven to member-driven discussion. Thus they constitute a pivot point for detecting changes in participation in group interventions. Practice implicationsObserving the occurrence of group members’ questions helps group leaders to adjust their own actions accordingly and thus facilitate or guide group participation. Comparison of the type and frequency of members’ questions is a way to detect different trajectories for delivering group interventions and can thus be used to develop methods for process evaluation of interventions.

Testing an Integrated Model of Program Implementation: the Food, Health & Choices School-Based Childhood Obesity Prevention Intervention Process Evaluation.

Childhood obesity is a complex, worldwide problem. Significant resources are invested in its prevention, and high-quality evaluations of these efforts are important. Conducting trials in school settings is complicated, making process evaluations useful for explaining results. Intervention fidelity has been demonstrated to influence outcomes, but others have suggested that other aspects of implementation, including participant responsiveness, should be examined more systematically. During Food, Health & Choices (FHC), a school-based childhood obesity prevention trial designed to test a curriculum and wellness policy taught by trained FHC instructors to fifth grade students in 20 schools during 2012-2013, we assessed relationships among facilitator behaviors (i.e., fidelity and teacher interest); participant behaviors (i.e., student satisfaction and recall); and program outcomes (i.e., energy balance-related behaviors) using hierarchical linear models, controlling for student, class, and school characteristics. We found positive relationships between student satisfaction and recall and program outcomes, but not fidelity and program outcomes. We also found relationships between teacher interest and fidelity when teachers participated in implementation. Finally, we found a significant interaction between fidelity and satisfaction on behavioral outcomes. These findings suggest that individual students in the same class responded differently to the same intervention. They also suggest the importance of teacher buy-in for successful intervention implementation. Future studies should examine how facilitator and participant behaviors together are related to both outcomes and implementation. Assessing multiple aspects of implementation using models that account for contextual influences on behavioral outcomes is an important step forward for prevention intervention process evaluations.

Are We All in the Same Boat? The Role of Perceptual Distance in Organizational Health Interventions.

The study investigates how agreement between leaders' and their team's perceptions influence intervention outcomes in a leadership-training intervention aimed at improving organizational learning. Agreement, i.e. perceptual distance was calculated for the organizational learning dimensions at baseline. Changes in the dimensions from pre-intervention to post-intervention were evaluated using polynomial regression analysis with response surface analysis. The general pattern of the results indicated that the organizational learning improved when leaders and their teams agreed on the level of organizational learning prior to the intervention. The improvement was greatest when the leader's and the team's perceptions at baseline were aligned and high rather than aligned and low. The least beneficial scenario was when the leader's perceptions were higher than the team's perceptions. These results give insights into the importance of comparing leaders' and their team's perceptions in intervention research. Polynomial regression analyses with response surface methodology allow three-dimensional examination of relationship between two predictor variables and an outcome. This contributes with knowledge on how combination of predictor variables may affect outcome and allows studies of potential non-linearity relating to the outcome. Future studies could use these methods in process evaluation of interventions. Copyright © 2016 John Wiley & Sons, Ltd.

A systematic review of the role of community pharmacies in improving the transition from secondary to primary care.

We set out to determine the potential contribution of community pharmacists to improve the transfer of care of patients from secondary to primary care settings. We systematically reviewed the literature on interventions that involved community pharmacy post-discharge. We considered all relevant studies, including both randomized and non-randomized controlled trials, irrespective of patient population. Our primary outcome was any impact on patient and medication outcomes, while the secondary outcome was to identify intervention characteristics that influenced all reported outcomes. We retrieved 14 studies that met our inclusion criteria. There were four studies reporting outcomes relating to the identification and rectification of medication errors that were significantly improved with community pharmacy involvement. Other patient outcomes such as medication adherence and clinical control were not unanimously positively or negatively influenced via the inclusion of community pharmacy in a transfer of care post-discharge intervention. Some inconsistencies in implementation and process evaluation of interventions were found across the reviewed studies. This limited the accuracy with which true impact could be considered. There is evidence that interventions including a community pharmacist can improve drug related problems after discharge. However, impact on other outcomes is not consistent. Further studies are required which include process evaluations to describe fully the context of the intervention so as to determine better any influencing factors. Also applying more stringent controls and closer adherence to protocols in both intervention and control groups would allow clearer correlations to be made between the intervention and the outcomes.

Do Italian Companies Manage Work-Related Stress Effectively? A Process Evaluation in Implementing the INAIL Methodology.

Studies on Intervention Process Evaluation are attracting growing attention in the literature on interventions linked to stress and the wellbeing of workers. There is evidence that some elements relating to the process and content of an intervention may have a decisive role in implementing it by facilitating or hindering the effectiveness of the results. This study aimed to provide a process evaluation on interventions to assess and manage risks related to work-related stress using a methodological path offered by INAIL. The final sample is composed of 124 companies participating to an interview on aspects relating to each phase of the INAIL methodological path put in place to implement the intervention. INAIL methodology has been defined as useful in the process of assessing and managing the risks related to work-related stress. Some factors related to the process (e.g., implementation of a preliminary phase, workers' involvement, and use of external consultants) showed a role in significant differences that emerged in the levels of risk, particularly in relation to findings from the preliminary assessment. Main findings provide information on the key aspects of process and content that are useful in implementing an intervention for assessing and managing risks related to work-related stress.

Protocol for the process evaluation of interventions combining performance-based financing with health equity in Burkina Faso.

BackgroundThe low quality of healthcare and the presence of user fees in Burkina Faso contribute to low utilization of healthcare and elevated levels of mortality. To improve access to high-quality healthcare and equity, national authorities are testing different intervention arms that combine performance-based financing with community-based health insurance and pro-poor targeting. There is a need to evaluate the implementation of these unique approaches. We developed a research protocol to analyze the conditions that led to the emergence of these intervention arms, the fidelity between the activities initially planned and those conducted, the implementation and adaptation processes, the sustainability of the interventions, the possibilities for scaling them up, and their ethical implications.Methods/DesignThe study adopts a longitudinal multiple case study design with several embedded levels of analyses. To represent the diversity of contexts where the intervention arms are carried out, we will select three districts. Within districts, we will select both primary healthcare centers (n =18) representing different intervention arms and the district or regional hospital (n =3). We will select contrasted cases in relation to their initial performance (good, fair, poor). Over a period of 18 months, we will use quantitative and qualitative data collection and analytical tools to study these cases including in-depth interviews, participatory observation, research diaries, and questionnaires. We will give more weight to qualitative methods compared to quantitative methods.DiscussionPerformance-based financing is expanding rapidly across low- and middle-income countries. The results of this study will enable researchers and decision makers to gain a better understanding of the factors that can influence the implementation and the sustainability of complex interventions aiming to increase healthcare quality as well as equity.

Implementation and Evaluation of Interventions for Home Care Aides on Blood and Body Fluid Exposure in Large-Group Settings

Participatory research conducted with academic, union and management cooperation resulted in the development, implementation, and process evaluation of interventions designed to reduce occupational blood and body fluid exposure among home care aides. Home care aides working for a large urban home care agency took part in the design and implementation of an interactive participatory training program conducted in large-group settings, and the development and evaluation of two training tools: an information card for home care aides and a sharps safety magnet for their clients. A process evaluation conducted immediately following the interactive training program found that 72 percent of the home care aides preferred it to lecture-style trainings typically offered, while only 9 percent preferred typical trainings. Home care aides were able to effectively articulate information learned during the interactive training program, with less than 2 percent providing inaccurate information about what was taught during the training. Home care aides overall responded positively to the information card and the magnet, with aides caring for clients who used sharps rating the tools as more useful. Participatory training programs can be effectively implemented in a large-group setting.

Collaborating With Low‐Income Families and Their Overweight Children to Improve Weight‐Related Behaviors: An Intervention Process Evaluation

This paper aims to examine the collaborative negotiation process, an interventional approach being tested at a primary-care school-based clinic to help low-income families improve lifestyle and weight-related health indicators in their overweight children. Process evaluation of the intervention employed in an ongoing longitudinal pilot study. Descriptive analysis is from structured field notes and audiotapes of parent-child-provider interactions during intervention visits (n=111). Activity levels and eating patterns were families' main concerns in managing their children's weight. Challenges and facilitators of implementing health plans were explored. The collaborative negotiation intervention provides a family-centered approach to engage families in management of children's weight.

A systematic review of psychological interventions for sexual offenders II: Quasi-experimental and qualitative data

This paper reports the method and results of a systematic review of the international literature on psychological interventions with adult sexual offenders and those showing abusive sexual behaviours. It provides the results of quasi-experimental and qualitative research in this area and is linked to our previous paper in this volume (a meta-analysis of randomised control trials). The research shows that 21 studies which used quasi-experimental methodologies met the criteria for inclusion. Of these, seven studies found significant effects and 10 revealed no significant effects. As with the review of the experimental literature, there is little consensus on the capabilities of interventions from varying theoretical backgrounds in altering offenders' behaviour or attitudes. In the review of the qualitative literature, the research team identified four studies which met the Cochrane guidelines for inclusion. Valuable findings from the studies include crucial contextual information on the barriers to and facilitation of effective treatment. Three process evaluations were found; in two of these data were analysed using grounded theory, and one exploratory study was found which used thematic content analysis. However, no large process evaluations of interventions were found of sophistication or complexity, suggesting a paucity of sound qualitative research in the area. The paper concludes by suggesting the implications of this for policy-makers and practitioners working with this group of offenders.