Abstract

BackgroundThrough the Balanced Scorecard program there have been independent, annual and nationwide assessments of the Afghan health system from 2004 to 2013. During this period, Afghanistan remained in a dynamic state of conflict, requiring innovative approaches to health service evaluation in insecure areas. The primary objective of this pilot study was to evaluate the reliability of health facility assessments conducted by a novel, locally-based data collection method compared to a standard survey team.MethodsIn this cross-sectional study, one standard survey team of clinicians and multiple rapidly trained locally-based survey teams of teachers conducted health facility assessments in Badghis province, Afghanistan from March – August, 2010. Outpatient facilities covered under the country’s Basic Package of Health Services were eligible for inclusion. Both approaches attempted to survey as many health facilities as safely possible, up to 25 total facilities per method. Each facility assessed was scored on 23 health services indicators used to evaluate performance in the annual Balanced Scorecard national assessment. For facilities assessed by both survey methods, the indicator scores produced by each method were compared using Spearman’s correlation coefficients and linear regression analysis with generalized estimating equations.ResultsThe standard survey team was able to assess 11 facilities; the locally-based approach was able to assess these 11 facilities, as well as 13 additional facilities in areas of greater insecurity. Among the 11 facilities assessed by both approaches, 19 of 23 indicators were statistically similar by survey method (p < .05). Spearman’s coefficients varied widely from (−0.39) to (0.71). The differences were greatest for items requiring specialized data collector knowledge on reviewing patient records, patient examination and counseling, and health worker reported satisfaction.ConclusionsThis pilot study of a novel method of data collection in health facility assessments showed that an approach using locally-based survey teams provided markedly increased access to areas of insecurity. Though analysis was limited by small sample size, indicator scores used for facility evaluation were relatively comparable overall, but less reliable for items requiring clinical knowledge or when asking health worker opinions, suggesting that alternative approaches may be needed to assess these parameters in insecure environments.

Highlights

  • The Balanced Scorecard (BSC) has been an essential component of health services monitoring and evaluation in Afghanistan since 2004, when it was created to assess the implementation of the country’s Basic Package of Health Services (BPHS)

  • This study addresses questions relevant to improve health facility assessments in Afghanistan, but to health systems evaluation in any area of conflict or insecurity

  • Study design and site selection This research was conducted on a method to implement the larger Balanced Scorecard national assessment, which was approved by the Johns Hopkins University and Afghan Ministry of Public Health institutional review boards

Read more

Summary

Introduction

The Balanced Scorecard (BSC) has been an essential component of health services monitoring and evaluation in Afghanistan since 2004, when it was created to assess the implementation of the country’s Basic Package of Health Services (BPHS). Due to worsening insecurity in significant parts of Afghanistan, innovative methods for data collection are required that optimize both team safety and data accuracy and ensure that the BSC remained a reliable and representative measure of health system performance. Such methods are essential to estimate the impact of insecurity on health service delivery and to assess bias introduced by restricting sampling to secure facilities. Through the Balanced Scorecard program there have been independent, annual and nationwide assessments of the Afghan health system from 2004 to 2013 During this period, Afghanistan remained in a dynamic state of conflict, requiring innovative approaches to health service evaluation in insecure areas. The primary objective of this pilot study was to evaluate the reliability of health facility assessments conducted by a novel, locally-based data collection method compared to a standard survey team

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call