Continuous Quality Improvement Intervention Research Articles

The impact of systematically repairing multiple choice questions with low discrimination on assessment reliability: an interrupted time series analysis

At our centre, we introduced a continuous quality improvement (CQI) initiative during academic year 2018-19 targeting for repair multiple choice question (MCQ) items with discrimination index (D) < 0.1. The purpose of this study was to assess the impact of this initiative on reliability/internal consistency of our assessments. Our participants were medical students during academic years 2015-16 to 2020-21 and our data were summative MCQ assessments during this time. Since the goal was to systematically review and improve summative assessments in our undergraduate program on an ongoing basis, we used interrupted time series analysis to assess the impact on reliability. Between 2015-16 and 2017-18 there was a significant negative trend in the mean alpha coefficient for MCQ exams (regression coefficient -0.027 [-0.008, -0.047], p = 0.024). In the academic year following the introduction of our initiative (2018-19) there was a significant increase in the mean alpha coefficient (regression coefficient 0.113 [0.063, 0.163], p = 0.010) which was then followed by a significant positive post-intervention trend (regression coefficient 0.056 [0.037, 0.075], p = 0.006). In conclusion, our CQI intervention resulted in an immediate and progressive improvement reliability of our MCQ assessments.

Impact of externally facilitated continuous quality improvement cohorts on Advanced Access to support primary healthcare teams: protocol for a quasi-randomized cluster trial

BackgroundImproving access to primary health care is among top priorities for many countries. Advanced Access (AA) is one of the most recommended models to improve timely access to care. Over the past 15 years, the AA model has been implemented in Canada, but the implementation of AA varies substantially among providers and clinics. Continuous quality improvement (CQI) approaches can be used to promote organizational change like AA implementation. While CQI fosters the adoption of evidence-based practices, knowledge gaps remain, about the mechanisms by which QI happens and the sustainability of the results. The general aim of the study is to analyse the implementation and effects of CQI cohorts on AA for primary care clinics. Specific objectives are: 1) Analyse the process of implementing CQI cohorts to support PHC clinics in their improvement of AA. 2) Document and compare structural organisational changes and processes of care with respect to AA within study groups (intervention and control). 3) Assess the effectiveness of CQI cohorts on AA outcomes. 4) Appreciate the sustainability of the intervention for AA processes, organisational changes and outcomes.MethodsCluster-controlled trial allowing for a comprehensive and rigorous evaluation of the proposed intervention 48 multidisciplinary primary care clinics will be recruited to participate. 24 Clinics from the intervention regions will receive the CQI intervention for 18 months including three activities carried out iteratively until the clinic’s improvement objectives are achieved: 1) reflective sessions and problem priorisation; 2) plan-do-study-act cycles; and 3) group mentoring. Clinics located in the control regions will receive an audit-feedback report on access. Complementary qualitative and quantitative data reflecting the quintuple aim will be collected over a period of 36 months.ResultsThis research will contribute to filling the gap in the generalizability of CQI interventions and accelerate the spread of effective AA improvement strategies while strengthening local QI culture within clinics. This research will have a direct impact on patients’ experiences of care.ConclusionThis mixed-method approach offers a unique opportunity to contribute to the scientific literature on large-scale CQI cohorts to improve AA in primary care teams and to better understand the processes of CQI.Trial registrationClinical Trials: NCT05715151.

Continuous quality improvement strategy for increasing immediate postpartum long-acting reversible contraceptive use at Jimma University Medical Center, Jimma, Ethiopia

BackgroundEven though the immediate postpartum period is a golden time and a great opportunity to provide long-acting reversible contraceptives to prevent unintended pregnancy, its utilisation is very low in Ethiopia....

Improved Outcomes Following a Care Guideline Implementation: Part 1 of an Analysis of 12 355 Patients After Total Knee Arthroplasty.

OBJECTIVE: To describe the application and examine the influence of a continuous quality improvement intervention, which had a goal of standardizing care to reduce the proportion of patients who do not have a meaningful improvement in patient-reported outcomes following total knee arthroplasty (TKA). DESIGN: Continuous quality improvement. METHODS: A physical therapy (PT) care guideline was initiated in 2013 for patients following TKA. The Knee Outcome Survey - Activities of Daily Living (KOS-ADL) was measured at every visit, and scores were extracted from a clinical outcomes database to calculate the proportion of patients who did not achieve a minimal clinically important difference. Based on logistic regression analysis, we compared the proportion of patients who did not progress on the KOS-ADL in a non-care guideline group (2008-2012) to a care guideline (CG) group (2014-2019). RESULTS: This study included 12 355 patients (aged 18-92 years) following TKA incurring at least 3 PT visits from 2008 to 2019. The percentage of patients who did not progress in the non-care guideline group was 25.8% and in the care guideline group 14.3% (P<0.001). The relationship between care guideline adherence and lack of progression on the KOS-ADL was statistically significant, X2 (df = 1) = 148.7, P<.001. CONCLUSION: The percentage of patients who did not achieve meaningful progress on the KOS-ADL declined significantly in the 6 years after implementing a TKA care guideline without an increase in the number of clinical visits. The standardized care guideline was associated with meaningful improvements for patients following TKA when applied in conjunction with PT access to outcome data, feedback through audits, performance goals, and financial incentives. J Orthop Sports Phys Ther 2023;53(3):143-150. Epub: 12 December 2022. doi:10.2519/jospt.2022.11369.

Transforming an Orthopaedic Unit Into an "Age-Friendly" Unit Through Implementation of the American Geriatrics Society's CoCare: Ortho Program.

To transform an inpatient orthopaedic unit into an age-friendly unit for geriatric fracture center (GFC) patients. Pragmatic dissemination study of a continuous quality improvement intervention with episodic data review. Large quaternary care university hospital with no on-site geriatrics program and no dedicated geriatric inpatient unit. Individuals 60 years of age and older with fragility fracture of the native proximal femur hospitalized from July 2017 to June 2020. A hospital medicine-orthopaedics comanagement model for a GFC was developed using processes, tools, and education provided by the American Geriatrics Society's AGS CoCare: Ortho program to support the age-friendly 4Ms principles: mentation, mobility, medications, and what matters. Delirium reduction strategies included minimizing sleep interruption through changes in blood draw times, order sets for pain management, and nursing education. Mobility specialists were incorporated to improve early mobilization on the orthopaedic unit. Frequency of weight-bearing on postoperative day 1 and frequency of delirium among GFC patients on the orthopaedic unit were compared with those among concurrent GFC patients on other units. Frequency of delirium was 26% among patients on the orthopaedic unit versus 35% among those on other units (P = 0.055). Frequency of weight-bearing on post-operative day 1 was 84% among patients on the orthopaedic unit versus 72% among those on other units (P = 0.003). AGS CoCare: Ortho is an effective dissemination program for establishing a hospital medicine-orthopaedics comanagement program and making an orthopaedic unit age-friendly in a hospital without onsite geriatricians or a dedicated geriatrics unit. Therapeutic Level III. See Instructions for Authors for a complete description of levels of evidence.

Hepatitis C prevalence and quality of health services among HIV-positive mothers in the Democratic Republic of the Congo

Hepatitis C virus (HCV) contributes to liver-related morbidity and mortality throughout Africa despite effective antivirals. HCV is endemic in the Democratic Republic of the Congo (DRC) but data on HCV/HIV co-infection in pregnancy is limited. We estimated the prevalence of and risk factors for HCV/HIV co-infection among pregnant women in the Kinshasa province of the DRC. This cross-sectional study was conducted as a sub-study of an ongoing randomized trial to assess continuous quality improvement interventions (CQI) for prevention of mother-to-child transmission (PMTCT) of HIV (CQI-PMTCT study, NCT03048669). HIV-infected women in the CQI-PMTCT cohort were tested for HCV, and risk factors were evaluated using logistic regression. The prevalence of HCV/HIV co-infection among Congolese women was 0.83% (95% CI 0.43-1.23). Women who tested positive for HCV were younger, more likely to live in urban areas, and more likely to test positive during pregnancy versus postpartum. HCV-positive women had significantly higher odds of infection with hepatitis B virus (HBV) (aOR 13.87 [3.29,58.6]). An inverse relationship was noted between HCV infection and the overall capacity of the health facility as measured by the service readiness index (SRI) (aOR:0.92 [0.86,0.98] per unit increase). Women who presented to rural, for-profit and PEPFAR-funded health facilities were more likely to test positive for HCV. In summary, this study identified that the prevalence of HCV/HIV co-infection was < 1% among Congolese women. We also identified HBV infection as a major risk factor for HCV/HIV co-infection. Individuals with triple infection should be linked to care and the facility-related differences in HCV prevalence should be addressed in future studies.

UTERINE ARTERY EMBOLISATION: CONTINUOUS QUALITY IMPROVEMENT REDUCES RADIATION DOSE WHILE MAINTAINING IMAGE QUALITY.

The purpose of this study was to introduce a continuous quality improvement (CQI) program for radiation dose optimisation during uterine artery embolisation (UAE) and assess its impact on dose reduction and image quality. The CQI program investigated the effects of optimising radiation dose parameters on the kerma-area product (KAP) and image quality when comparing a 'CQI intervention' group (n=50) and 'Control' group (n=50). Visual grading characteristics (VGC) analysis was used to assess image quality, using the 'Control' group as a reference. A significant reduction in KAP by 17% (P=0.041, d=0.2) and reference air kerma (Ka, r) by 20% (P=0.027, d=0.2) was shown between the two groups. The VGC analysis resulted in an area under the VGC curve (AUCVGC) of 0.54, indicating no significant difference in image quality between the two groups (P=0.670). The implementation of the CQI program and optimisation of radiation dose parameters improved the UAE radiation dose practices at our centre. The dose reduction demonstrated no detrimental effects on image quality.

Respect Is Central: A Critical Review of Implementation Frameworks for Continuous Quality Improvement in Aboriginal and Torres Strait Islander Primary Health Care Services.

Background: Primary health care (PHC) services are complex systems, shaped by an interplay of factors at individual, organisational and broader system levels. For Aboriginal and Torres Strait Islander PHC services, closer relationships with the people they serve, local knowledge of community, and cultural awareness are critical. Continuous quality improvement (CQI) has proven to be an effective process for identification of priority issues in health care delivery and for instigating the design, implementation and evaluation of improvement interventions in these settings. However, wide-scale variation in care quality persists partly due to the mismatch between CQI interventions and context.Methods: This critical review of implementation frameworks for CQI in Aboriginal and Torres Strait Islander primary health care was conducted in two phases: (1) a review of primary published implementation frameworks used in PHC contexts, and (2) a comparison of key features of these frameworks with quality concepts identified by high-improving Aboriginal and Torres Strait Islander PHC services in remote Australia.Results: We found nine primary implementation frameworks previously used in PHC contexts guiding interventions within and between macro (broader contextual) level; meso (health service) level; and micro (community and inter-personal) level systems. There was commonality between these frameworks and key quality concepts in Aboriginal and Torres Strait Islander PHC. However, none of the frameworks covered all concepts with rare consideration of communities driving health improvement, two-way learning (integrating cultural knowledge into healthcare provision), and caring staff—engendering trusting relationships with community enacted through respect.Conclusion: Respect, as a secret essence, privileges the importance of culture, and is an essential element of CQI implementation frameworks for positive change in Aboriginal and Torres Strait Islander PHC services. It is essential to work with communities to design workforce models that grow a caring stable workforce to ensure improvements in quality of care that are effective for their context.

Continuous quality improvement in HIV and TB services at selected healthcare facilities in South Africa.

BackgroundContinuous quality improvement (CQI) is essential for HIV and tuberculosis (TB) services. Similarly, a thorough understanding of the requirements and impact of CQI is critical to its successful institutionalisation. However, this is currently lacking.ObjectivesThe objective of this study is to describe the CQI implementation process and examine its effect on HIV and TB service delivery at selected primary healthcare facilities in two South African districts.MethodWe used a separate sample, pre- and post-test, quasi-experimental study design based on data collected from the clinical audit of patient cohorts seen in 2014 and 2015 respectively. Quality was measured based on the extent to which prescribed services were provided. Tailored CQI interventions were implemented based on service delivery gaps identified by the 2014 CQI audit. Data were summarised and analysed using a combination of univariate and multivariate analysis.ResultsThe services identified as low quality were related to opportunistic infections management and laboratory practices. Compliance to prescribed service items in antiretroviral treatment initiation and monitoring, pharmacy and laboratory management, exceeded 70% across study sites. Over 80% of low quality service delivery items were optimised in less than six months with targeted quality improvement support.ConclusionThe observed improvements signal the effectiveness of the CQI approach, its capacity to rapidly improve under-performance, its high replicability and the need to provide quality maintenance support to sustain or improve healthcare facilities performing well. The study strongly underscores the need to improve the management of opportunistic infections and complications, particularly TB.

Implementing Continuous Quality Improvement in an Integrated Community Urology Practice: Lessons Learned

To determine the effectiveness of 2 different continuous quality improvement interventions in an integrated community urology practice. We specifically assessed the impact of audited physician feedback on improving physicians' adoption of active surveillance for low-risk prostate cancer (CaP) and adherence to a prostate biopsy time-out intervention. The electronic medical records of Genesis Healthcare Partners were analyzed between August 24, 2011 and September 30, 2020 to evaluate the performance of 2 quality interventions: audited physician feedback to improve active surveillance adoption in low-risk CaP patients, and audited physician feedback to promote adherence to an electronic medical records embedded prostate biopsy time-out template. Physician and Genesis Healthcare Partners group adherence to each quality initiative was compared before and after each intervention type using ANOVA testing. For active surveillance, we consistently saw an increase in active surveillance adoption for low risk CaP patients in association with continuous audited feedback (P < .001). Adherence to the prostate biopsy time-out template improved when audited feedback was provided (P < .001). The implementation of clinical guidelines into routine clinical practice remains challenging and poses an obstacle to the improvement of United States healthcare quality. Continuous quality improvement should be a dynamic process, and in our experience, audited feedback coupled with education is most effective.

A Continuous Quality Improvement Intervention to Improve Antenatal HIV Care Testing in Rural South Africa: Evaluation of Implementation in a Real-World Setting.

Background: We evaluated continuous quality improvement (CQI) targeting antenatal HIV care quality in rural South Africa using a stepped-wedge cluster-randomised controlled trial (Management and Optimisation of Nutrition, Antenatal, Reproductive, Child health, MONARCH) and an embedded process evaluation. Here, we present results of the process evaluation examining determinants of CQI practice and ‘normalisation.’ Methods: A team of CQI mentors supported public-sector health workers in seven primary care clinics to (1) identify root causes of poor HIV viral load (VL) monitoring among pregnant women living with HIV and repeat HIV testing among pregnant women not living with HIV, and (2) design and iteratively test their own solutions. We used a mixed methods evaluation with field notes from CQI mentors (‘dose’ and ‘reach’ of CQI, causes of poor HIV care testing rates, implemented change ideas); patient medical records (HIV care testing by clinic and time step); and semi-structured interviews with available health workers. We analysed field notes and semi-structured interviews for determinants of CQI implementation and ‘normalisation’ using Normalisation Process Theory (NPT) and Tailored Implementation of Chronic Diseases (TICD) frameworks. Results: All interviewed health workers found the CQI mentors and methodology helpful for quality improvement. Total administered ‘dose’ was higher than planned but ‘reach’ was limited by resource constraints, particularly staffing shortages. Simple workable improvements to identified root causes were implemented, such as a patient tracking notebook and results filing system. VL monitoring improved over time, but not repeat HIV testing. Besides resource constraints, gaps in knowledge of guidelines, lack of leadership, poor clinical documentation, and data quality gaps reduced CQI implementation fidelity and normalisation. Conclusion: While CQI holds promise, we identified several health system challenges. Priorities for policy makers include improving staffing and strategies to improve clinical documentation. Additional support with implementing clinical guidelines and improving routine data quality are needed. Normalising CQI may be challenging without concurrent health system improvements.

The impact of continuous quality improvement on coverage of antenatal HIV care tests in rural South Africa: Results of a stepped-wedge cluster-randomised controlled implementation trial.

Evidence for the effectiveness of continuous quality improvement (CQI) in resource-poor settings is very limited. We aimed to establish the effects of CQI on quality of antenatal HIV care in primary care clinics in rural South Africa. We conducted a stepped-wedge cluster-randomised controlled trial (RCT) comparing CQI to usual standard of antenatal care (ANC) in 7 nurse-led, public-sector primary care clinics-combined into 6 clusters-over 8 steps and 19 months. Clusters randomly switched from comparator to intervention on pre-specified dates until all had rolled over to the CQI intervention. Investigators and clusters were blinded to randomisation until 2 weeks prior to each step. The intervention was delivered by trained CQI mentors and included standard CQI tools (process maps, fishbone diagrams, run charts, Plan-Do-Study-Act [PDSA] cycles, and action learning sessions). CQI mentors worked with health workers, including nurses and HIV lay counsellors. The mentors used the standard CQI tools flexibly, tailored to local clinic needs. Health workers were the direct recipients of the intervention, whereas the ultimate beneficiaries were pregnant women attending ANC. Our 2 registered primary endpoints were viral load (VL) monitoring (which is critical for elimination of mother-to-child transmission of HIV [eMTCT] and the health of pregnant women living with HIV) and repeat HIV testing (which is necessary to identify and treat women who seroconvert during pregnancy). All pregnant women who attended their first antenatal visit at one of the 7 study clinics and were ≥18 years old at delivery were eligible for endpoint assessment. We performed intention-to-treat (ITT) analyses using modified Poisson generalised linear mixed effects models. We estimated effect sizes with time-step fixed effects and clinic random effects (Model 1). In separate models, we added a nested random clinic-time step interaction term (Model 2) or individual random effects (Model 3). Between 15 July 2015 and 30 January 2017, 2,160 participants with 13,212 ANC visits (intervention n = 6,877, control n = 6,335) were eligible for ITT analysis. No adverse events were reported. Median age at first booking was 25 years (interquartile range [IQR] 21 to 30), and median parity was 1 (IQR 0 to 2). HIV prevalence was 47% (95% CI 42% to 53%). In Model 1, CQI significantly increased VL monitoring (relative risk [RR] 1.38, 95% CI 1.21 to 1.57, p < 0.001) but did not improve repeat HIV testing (RR 1.00, 95% CI 0.88 to 1.13, p = 0.958). These results remained essentially the same in both Model 2 and Model 3. Limitations of our study include that we did not establish impact beyond the duration of the relatively short study period of 19 months, and that transition steps may have been too short to achieve the full potential impact of the CQI intervention. We found that CQI can be effective at increasing quality of primary care in rural Africa. Policy makers should consider CQI as a routine intervention to boost quality of primary care in rural African communities. Implementation research should accompany future CQI use to elucidate mechanisms of action and to identify factors supporting long-term success. This trial is registered at ClinicalTrials.gov under registration number NCT02626351.

Intent-to-treat analysis of cluster randomized trials when clusters report unidentifiable outcome proportions.

Cluster randomized trials are designed to evaluate interventions at the cluster or group level. When clusters are randomized but some clusters report no or non-analyzable data, intent-to-treat analysis, the gold standard for the analysis of randomized controlled trials, can be compromised. This article presents a very flexible statistical methodology for cluster randomized trials whose outcome is a cluster-level proportion (e.g. proportion from a cluster reporting an event) in the setting where clusters report non-analyzable data (which in general could be due to nonadherence, dropout, missingness, etc.). The approach is motivated by a previously published stratified randomized controlled trial called, "The Randomized Recruitment Intervention Trial (RECRUIT)," designed to examine the effectiveness of a trust-based continuous quality improvement intervention on increasing minority recruitment into clinical trials (ClinicalTrials.gov Identifier: NCT01911208). The novel approach exploits the use of generalized estimating equations for cluster-level reports, such that all clusters randomized at baseline are able to be analyzed, and intervention effects are presented as risk ratios. Simulation studies under different outcome missingness scenarios and a variety of intra-cluster correlations are conducted. A comparative analysis of the method with imputation and per protocol approaches for RECRUIT is presented. Simulation results show the novel approach produces unbiased and efficient estimates of the intervention effect that maintain the nominal type I error rate. Application to RECRUIT shows similar effect sizes when compared to the imputation and per protocol approach. The article demonstrates that an innovative bivariate generalized estimating equations framework allows one to implement an intent-to-treat analysis to obtain risk ratios or odds ratios, for a variety of cluster randomized designs.

Mobility Action Group: Using Quality Improvement Methods to Create a Culture of Hospital Mobility.

To describe the Mobility Action Group (MACT), an innovative process to enhance implementation of hospital mobility programs and create a culture of mobility in acute care. Continuous quality improvement intervention with episodic data review. Inpatient units including medical, surgical, and intensive care settings. A total of 42 hospitals of varying sizes across the United States. The MACT and Change Package were developed to provide a conceptual framework, road map, and step-by-step guide to enable mobility teams to implement mobility programs successfully and meet their mobilization goals. Participants were encouraged to select two to three change tactics to pursue during the first action cycle and select and implement additional tactics in subsequent cycles. Nine learning sessions were held via webinar from April 27, 2017, to October 5, 2017, during which faculty provided brief presentations, facilitation, and group discussion. Implementation of programs, walks per day, use of bed and chair alarms, and participant satisfaction. Successful implementation of mobility programs was achieved at most (76%) sites. The proportion of patients who received at least three walks per day increased from 9% to 19%. The proportion of patients who were placed on a bed or chair alarm decreased from 36% to 20%. On average, 69% of participants reported they were "strongly satisfied" with the learning sessions. Most participants found the Change Package (58%) and Toolkit (63%) "very helpful." Since the conclusion of the active initiative, the Change Package has been downloaded 1,200 times. Of those who downloaded it, 48% utilized it to establish a mobility program, and 58% used it at their organization at least once a month. The MACT and Change Package provides an innovative approach emphasizing systemwide change that can help catalyze a culture of mobility in hospitals across the nation, improving the quality of care for hospitalized older adults. J Am Geriatr Soc 68:2373-2381, 2020.

The cost of the training and supervision of community health workers to improve exclusive breastfeeding amongst mothers in a cluster randomised controlled trial in South Africa

BackgroundInterventions targeting community health workers (CHWs) aim to optimise the delivery of health services to underserved rural areas. Whilst interventions are evaluated against their objectives, there remains limited evidence on the economic costs of these interventions, and the practicality and value of scale up. The aim of this paper is to undertake a cost analysis on a CHW training and supervision intervention using exclusive breastfeeding rates amongst mothers as an outcome measure.MethodsThis is a retrospective cost analysis, from an implementer’s perspective, of a cluster randomised controlled trial investigating the effectiveness of a continuous quality improvement (CQI) intervention aimed at CHWs providing care and support to pregnant women and women with babies aged < 1 year in South Africa.ResultsOne of the outcomes of the RCT revealed that the prevalence of exclusive breastfeeding (EBF) significantly improved, with the cost per mother EBF in the control and intervention arm calculated at US$760,13 and US$1705,28 respectively. The cost per additional mother practicing EBF was calculated to be US$7647, 88, with the supervision component of the intervention constituting 64% of the trial costs. In addition, women served by the intervention CHWs were more likely to have received a CHW visit and had significantly better knowledge of childcare practices.ConclusionWhilst the cost of this intervention is high, adapted interventions could potentially offer an economical alternative for achieving selected maternal and child health (MCH) outcomes. The results of this study should inform future programmes aimed at providing adapted training and supervision to CHWs with the objective of improving community-level health outcomes.

Using Continuous Quality Improvement Tools to Promote Tobacco Cessation Among Primary Caregivers in a Home Visiting Program in Alabama.

Alabama's Maternal, Infant, and Early Childhood Home Visiting-funded program was one of 10 state teams accepted to participate in the first wave of the Federal Home Visiting Program State and Territory Continuous Quality Improvement Practicum. This article reports methods and results of Alabama's continuous quality improvement (CQI) project and lessons learned in developing CQI capabilities among state and local public health practitioners. The Alabama team tracked CQI data weekly for the duration of the practicum using an annotated run chart. Participants included 20 identified tobacco users in 2 participating LIAs. This article highlights specific CQI tools to achieve the project aim. On the basis of CQI interventions, Alabama reached its goal; 12 of 20 primary caregivers in 2 home visiting programs made quit attempts. Alabama utilized multiple CQI tools to reach an ambitious, behavior-based aim; these same concepts could be broadly applied to quality improvement initiatives in any federal or state public health program to guide process- and outcomes-based improvement efforts.

Improving immunization capacity in Ethiopia through continuous quality improvement interventions: a prospective quasi-experimental study

BackgroundStrong scientific evidence is needed to support low-income countries in building effective and sustainable immunization programs and proactively engaging in global vaccine development and implementation initiatives. This study aimed to implement and evaluate the effectiveness of system-wide continuous quality improvement (CQI) interventions to improve national immunization programme performance in Ethiopia.MethodsThe study used a prospective, quasi-experimental design with an interrupted time-series analysis to collect data from 781 government health sectors (556 healthcare facilities, 196 district health offices, and 29 zonal health departments) selected from developing and emerging regions in Ethiopia. Procedures included baseline quality assessment of immunization programme and services using structured checklists; immunization systems strengthening using onsite technical support, training, and supportive supervision interventions in a Plan-Do-Check-Act cycle over 12 months; and collection and analysis of data at baseline and at the 6th and 12th month of interventions using statistical process control and the t-test. Outcome measures were the coverage of the vaccines pentavalent 3, measles, Bacillus Calmette–Guérin vaccine (BCG), Pneumococcal Conjugate Vaccine (PCV), as well as full vaccination status; while process measures were changes in human resources, planning, service delivery, logistics and supply, documentation, coordination and collaboration, and monitoring and evaluation. Analysis and interpretation of data adhered to SQUIRE 2.0 guidelines.ResultsPrior to the interventions, vaccination coverage was low and all seven process indicators had an aggregate score of below 50%, with significant differences in performance at healthcare facility level between developing and emerging regions (P = 0.0001). Following the interventions, vaccination coverage improved significantly from 63.6% at baseline to 79.3% for pentavalent (P = 0.0001), 62.5 to 72.8% for measles (P = 0.009), 62.4 to 73.5% for BCG (P = 0.0001), 65.3 to 81.0% for PCV (P = 0.02), and insignificantly from 56.2 to 74.2% for full vaccination. All seven process indicators scored above 75% in all regions, with no significant differences found in performance between developing and emerging regions.ConclusionsThe CQI interventions improved immunization capacity and vaccination coverage in Ethiopia, where the unstable transmission patterns and intensity of infectious diseases necessitate for a state of readiness of the health system at all times. The approach was found to empower zone, district, and facility-level health sectors to exercise accountability and share ownership of immunization outcomes. While universal approaches can improve routine immunization, local innovative interventions that target local problems and dynamics are also necessary to achieve optimal coverage.

The MONARCH intervention to enhance the quality of antenatal and postnatal primary health services in rural South Africa: protocol for a stepped-wedge cluster-randomised controlled trial

BackgroundGaps in maternal and child health services can slow progress towards achieving the Sustainable Development Goals. The Management and Optimization of Nutrition, Antenatal, Reproductive, Child Health & HIV Care (MONARCH) study will evaluate a Continuous Quality Improvement (CQI) intervention targeted at improving antenatal and postnatal health service outcomes in rural South Africa where HIV prevalence among pregnant women is extremely high. Specifically, it will establish the effectiveness of CQI on viral load (VL) testing in pregnant women who are HIV-positive and repeat HIV testing in pregnant women who are HIV-negative.MethodsThis is a stepped-wedge cluster-randomised controlled trial (RCT) of 7 nurse-led primary healthcare clinics to establish the effect of CQI on selected routine antenatal and postnatal services. Each clinic was a cluster, with the exception of the two smallest clinics, which jointly formed one cluster. The intervention was applied at the cluster level, where staff received training on CQI methodology and additional mentoring as required. In the control exposure state, the clusters received the South African Department of Health standard of care. After a baseline data collection period of 2 months, the first cluster crossed over from control to intervention exposure state; subsequently, one additional cluster crossed over every 2 months. The six clusters were divided into 3 groups by patient volume (low, medium and high). We randomised the six clusters to the sequences of crossing over, such that both the first three and the last three sequences included one cluster with low, one with medium, and one with high patient volume.The primary outcome measures were (i) viral load testing among pregnant women who were HIV-positive, and (ii) repeat HIV testing among pregnant women who were HIV-negative. Consenting women ≥18 years attending antenatal and postnatal care during the data collection period completed outcome measures at delivery, and postpartum at three to 6 days, and 6 weeks. Data collection started on 15 July 2015. The total study duration, including pre- and post-exposure phases, was 19 months. Data will be analyzed by intention-to-treat based on first booked clinic of study participants.DiscussionThe results of the MONARCH trial will establish the effectiveness of CQI in improving antenatal and postnatal clinic processes in primary care in sub-Saharan Africa. More generally, the results will contribute to our knowledge on quality improvement interventions in resource-poor settings.Trial registrationThis trial was registered on 10 December 2015: www.clinicaltrials.gov, identifier NCT02626351.

Building capacity for continuous quality improvement (CQI): A pilot study

Background and objectiveLittle is known about the feasibility, effectiveness, and sustainability of CQI approaches in substance use disorder treatment settings. MethodsIn the initial phase of this study, eight programs were randomly assigned to receive a CQI intervention or to a waitlist control condition to obtain preliminary information about potential effectiveness. In the second phase, the initially assigned control programs received the CQI intervention to gain additional information about intervention feasibility while sustainability was explored among the initially assigned intervention programs. Results and conclusionsAlthough CQI was feasible and sustainable, demonstrating its effectiveness using administrative data was challenging suggesting the need to better align performance measurement systems with CQI efforts. Further, although the majority of staff were enthusiastic about utilizing this approach and reported provider and patient benefits, many noted that dedicated time was needed in order to implement and sustain it.

Continuous quality improvement intervention for adolescent and young adult HIV testing services in Kenya improves HIV knowledge.

Objectives:To determine whether continuous quality improvement (CQI) improves quality of HIV testing services for adolescents and young adults (AYA).Design:CQI was introduced at two HIV testing settings: Youth Centre and Voluntary Counseling and Testing (VCT) Center, at a national referral hospital in Nairobi, Kenya.Methods:Primary outcomes were AYA satisfaction with HIV testing services, intent to return, and accurate HIV prevention and transmission knowledge. Healthcare worker (HCW) satisfaction assessed staff morale. T tests and interrupted time series analysis using Prais–Winsten regression and generalized estimating equations accounting for temporal trends and autocorrelation were conducted.Results:There were 172 AYA (Youth Centre = 109, VCT = 63) during 6 baseline weeks and 702 (Youth Centre = 454, VCT = 248) during 24 intervention weeks. CQI was associated with an immediate increase in the proportion of AYA with accurate knowledge of HIV transmission at Youth Centre: 18 vs. 63% [adjusted risk difference (aRD) 0.42,95% confidence interval (CI) 0.21 to 0.63], and a trend at VCT: 38 vs. 72% (aRD 0.30, 95% CI −0.04 to 0.63). CQI was associated with an increase in the proportion of AYA with accurate HIV prevention knowledge in VCT: 46 vs. 61% (aRD 0.39, 95% CI 0.02–0.76), but not Youth Centre (P = 0.759). In VCT, CQI showed a trend towards increased intent to retest (4.0 vs. 4.3; aRD 0.78, 95% CI −0.11 to 1.67), but not at Youth Centre (P = 0.19). CQI was not associated with changes in AYA satisfaction, which was high during baseline and intervention at both clinics (P = 0.384, P = 0.755). HCW satisfaction remained high during intervention and baseline (P = 0.746).Conclusion:CQI improved AYA knowledge and did not negatively impact HCW satisfaction. Quality improvement interventions may be useful to improve adolescent-friendly service delivery.