Contribution analysis as an evaluation strategy in the context of a sector-wide approach: Performance-based health financing in Rwanda

Abstract

Sector-wide approaches (SWAps) emerged as a response to donor fragmentation and non-adjusted and parallel programming. In the health sector, SWAps have received considerable support by the international donor community due to their potential to reduce inefficiencies through alignment to common procedures and hence to increase development effectiveness. Evaluating development cooperation in the context of a SWAp, however, translates into methodological challenges for evaluators who have to disentangle the cumulative effects in strongly donor-aligned, complex sector environments. In this article the authors discussed the application of a methodological strategy for evaluating development interventions in complex settings – for example in the context of a SWAp –and reflected the suitability of the approach. The authors conducted a contribution analysis, a theory-based approach to evaluation, and exemplified the approach for an intervention of performance-based financing for Rwandan health workers supported by the Rwanda-German cooperation. The findings suggested that the Rwandan system of performance based financing increased service orientation and outputs of health professionals, but also indicated that negative motivational side effects and resource constraints are real. With regard to the methodological approach, the authors conclude that contribution analysis has a high potential to evaluate development cooperation in the context of a SWAp dueto its high flexibility to use different data collection tools and its capability to assess risks and rival explanations. Challenges can be identified with regard to the efficiency of the evaluation strategy and a remaining trade-off between scope and causal strength ofevidence.