Outcome evaluation of capacity building and mentorship partnership (CBMP) program on data quality in the public health facilities of Amhara National Regional State, Ethiopia: a quasi-experimental evaluation

Moges Asressie,Binyam Tilahun,Asmamaw Atnafu,Tsegaye Gebremedhin,Berhanu Fikadie Endehabtu,Melaku Birhanu Alemu

doi:10.1186/s12913-021-07063-2

Moges Asressie, Binyam Tilahun + Show 4 more

Open Access

https://doi.org/10.1186/s12913-021-07063-2

Copy DOI

Abstract

Background Capacity Building and Mentorship Partnership (CBMP) is a flagship program designed by the Ethiopian Ministry of Health in collaboration with six local universities to strengthen the national health information system and facilitate evidence-informed decision making through various initiatives. The program was initiated in 2018. This evaluation was aimed to assess the outcome of CBMP on health data quality in the public health facilities of Amhara National Regional State, Ethiopia.MethodsA matched comparison group evaluation design with a sequential explanatory mixed-method was used to evaluate the outcome of CBMP on data quality. A total of 23 health facilities from the intervention group and 17 comparison health facilities from a randomly selected district were used for this evaluation. The Organization for Economic Cooperation and Development (OECD) evaluation framework with relevance, effectiveness, and impact dimensions was used to measure the program’s outcome using the judgment parameter. The program’s average treatment effect on data quality was estimated using propensity score matching (PSM).ResultsThe overall outcome of CBMP was found to be 90.75 %. The mean data quality in the intervention health facility was 89.06 % [95 %CI: 84.23, 93.88], which has a significant mean difference with the comparison health facilities (66.5 % [95 % CI: 57.9–75]). In addition, the CBMP increases the data quality of pilot facilities by 27.75 % points [95 %CI: 17.94, 37.58] on the nearest neighboring matching. The qualitative data also noted that there was a data quality problem in the health facility and CBMP improved the data quality gap among the intervention health facilities.ConclusionsThe outcome of the CBMP was highly satisfactory. The program effectively increased the data quality in the health facilities. Therefore, the finding of this evaluation can be used by policymakers, program implementers, and funding organizations to scale the program at large to improve the overall health data quality for health outcome improvement.

Highlights

Capacity Building and Mentorship Partnership (CBMP) is a flagship program designed by the Ethiopian Ministry of Health in collaboration with six local universities to strengthen the national health information system and facilitate evidence-informed decision making through various initiatives
The program effectively increased the data quality in the health facilities. The finding of this evaluation can be used by policymakers, program implementers, and funding organizations to scale the program at large to improve the overall health data quality for health outcome improvement
Evaluation area and period The evaluation was conducted in East Gojjam, South Wollo, and Central Gondar zones of the Amhara National Regional State, Ethiopia (Fig. 2) [14], from April 28 to June 12, 2020

Summary

Introduction

Capacity Building and Mentorship Partnership (CBMP) is a flagship program designed by the Ethiopian Ministry of Health in collaboration with six local universities to strengthen the national health information system and facilitate evidence-informed decision making through various initiatives. This evaluation was aimed to assess the outcome of CBMP on health data quality in the public health facilities of Amhara National Regional State, Ethiopia. Effective health service delivery needs quality data and evidence-based decision making. Accurate and complete data are vital for appropriate evidencebased decision-making on health expenditure, for responding to countries’ specific health needs and measuring the impact of health programs [2]. The health sector data are used to describe the health status, morbidity, trends and cause and effect analysis on health problems. It helps to assess the effectiveness of health interventions. Low data quality results in poor and inefficient utilization and can result in serious errors in decision-making practice [6]

Methods

Results

Discussion

Conclusion