Abstract
Background: Interventions, whether simple or complex, are increasing in health care in response to the growing complexity and acuity of patient’s conditions. Monitoring the fidelity of implementing interventions is challenging. A common method to assess and monitor fidelity of intervention implementation is through a structured, reliable and valid instrument. Purpose: The purpose of this paper is to examine existing instruments measuring fidelity of intervention implementation in order to determine aspects of fidelity that have been assessed and reported on the reliability and validity of these instruments. Design: A descriptive review was conducted. Studies were included if they described and reported on the fidelity of intervention implementation instruments, their psychometric properties were published between 1980 and 2015. Methods: Data were extracted on the study characteristics, levels and aspects of fidelity and the psychometric properties, specifically the reliability and validity of the fidelity of intervention implementation instruments. Results: In total, 21 studies were included in the review. Overall results showed that some aspects and levels of fidelity of intervention implementation are included in the instruments. At the theoretical level, fidelity of intervention implementation is not accounted for majority of the studies and few explicitly reports on the use of instruments to evaluate intervention differentiation. At the operational level, interventionists’ adherence and competence are included in the instruments; however, participants’ engagement, exposure and enactment are not. The instruments demonstrate acceptable level of validity and reliability. Conclusion: Sustained focus on developing psychometrically sound instruments that account for all levels (i.e. theoretical and operational) and aspects of fidelity of intervention implementation is imperative to strengthen the methodological literature for interventions research; and for researchers to correctly interpret research findings and to arrive at valid conclusions on the effectiveness of interventions, whether simple or complex.
Highlights
Intervention fidelity received little attention in intervention research because of the assumption that interventions were delivered in a standardized and consistent manner by interventionists who strictly followed the treatment protocol and manual [1]
The target population included: persons living with addictions (n = 4, 19%), pre-mature infants (n = 1, 4.8%), children (n = 4, 19%), older adults (n = 1, 4.8%), persons living with mental health challenges (n = 5, 24%), persons living with physical health challenges (n = 2, 10%), homeless persons (n = 1, 4.8%); couples (n = 1, 4.8%), parents of lower socioeconomic status (n = 1, 4.8%), and teachers providing social-emotional competence and behavioral support (n = 1, 4.8%)
The type of interventions comprised of two or more components, such as educational and behavioral and included: psychotherapy (n = 3, 14.3%); psycho-education (n = 1, 4.8%); cognitive behavioral therapy (CBT) (n = 2, 9.5%); emotion-focused therapy (n = 1, 4.8%); educational (n = 1, 4.8%) behavioral therapy (n = 6, 28.9%); Figure 1
Summary
Intervention fidelity received little attention in intervention research because of the assumption that interventions were delivered in a standardized and consistent manner by interventionists who strictly followed the treatment protocol and manual [1]. In the 1970s, a shift in intervention research emerged with an emphasis on collecting data on the implementation of treatment This was done as a means of ensuring the interventionists adhered to the treatment protocol and determining whether contamination took place, that is, the extent to which the experimental treatment was disseminated to the control arm of the study. Methods: Data were extracted on the study characteristics, levels and aspects of fidelity and the psychometric properties, the reliability and validity of the fidelity of intervention implementation instruments. Conclusion: Sustained focus on developing psychometrically sound instruments that account for all levels (i.e. theoretical and operational) and aspects of fidelity of intervention implementation is imperative to strengthen the methodological literature for interventions research; and for researchers to correctly interpret research findings and to arrive at valid conclusions on the effectiveness of interventions, whether simple or complex
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.