Abstract
BackgroundCluster randomised trials (CRTs) are a key instrument to evaluate public health interventions. Fidelity assessment examines study processes to gauge whether an intervention was delivered as initially planned. Evaluation of implementation fidelity (IF) is required to establish whether the measured effects of a trial are due to the intervention itself and may be particularly important for CRTs of complex interventions conducted in low- and middle-income countries (LMICs). However, current CRT reporting guidelines offer no guidance on IF assessment. The objective of this review was to study current practices concerning the assessment of IF in CRTs of public health interventions in LMICs.MethodsCRTs of public health interventions in LMICs that planned or reported IF assessment in either the trial protocol or the main trial report were included. The MEDLINE/PubMed, CINAHL and EMBASE databases were queried from January 2012 to May 2016. To ensure availability of a study protocol, CRTs reporting a registration number in the abstract were included. Relevant data were extracted from each study protocol and trial report by two researchers using a predefined screening sheet. Risk of bias for individual studies was assessed.ResultsWe identified 90 CRTs of public health interventions in LMICs with a study protocol in a publicly available trial registry published from January 2012 to May 2016. Among these 90 studies, 25 (28%) did not plan or report assessing IF; the remaining 65 studies (72%) addressed at least one IF dimension. IF assessment was planned in 40% (36/90) of trial protocols and reported in 71.1% (64/90) of trial reports. The proportion of overall agreement between the trial protocol and trial report concerning occurrence of IF assessment was 66.7% (60/90). Most studies had low to moderate risk of bias.ConclusionsIF assessment is not currently a systematic practice in CRTs of public health interventions carried out in LMICs. In the absence of IF assessment, it may be difficult to determine if CRT results are due to the intervention design, to its implementation, or to unknown or external factors that may influence results. CRT reporting guidelines should promote IF assessment.Trial RegistrationProtocol published and available at: https://doi.org/10.1186/s13643-016-0351-0
Highlights
Cluster randomised trials (CRTs) are a key instrument to evaluate public health interventions
Stage 1 of the full text review was used to define the study denominator, as follows: of the 226 articles screened, 90 were CRTs of public health interventions in low- and middle-income countries (LMICs) with a study protocol in a publicly available trial registry published from January 2012 to May 2016
Outcome We identified 90 CRTs of public health interventions in LMICs with a study protocol in a publicly available trial registry published from January 2012 to May 2016
Summary
Cluster randomised trials (CRTs) are a key instrument to evaluate public health interventions. Evaluation of implementation fidelity (IF) is required to establish whether the measured effects of a trial are due to the intervention itself and may be important for CRTs of complex interventions conducted in low- and middle-income countries (LMICs). The objective of this review was to study current practices concerning the assessment of IF in CRTs of public health interventions in LMICs. Cluster randomised trials (CRTs) have become a key instrument to evaluate public health interventions [1,2,3,4,5,6,7], in low- and middle-income countries (LMICs) [3, 8]. Intervention fidelity in CRTs of public health interventions Recent methodologically oriented systematic reviews have found evidence of improvements in the design and analysis of CRTs, while noting deficiencies in trial implementation [18, 19]. Previous systematic reviews have emphasised the potential importance of process evaluation to mitigate these methodological problems, which can affect the internal and external validity of trial results [3, 18, 20,21,22]
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have