Abstract
Conducting rigorous evaluations of whether the process of creating new institutions affects their performance of mandated duties presents several challenges. Not only is assignment to process often not random, but when the process of creating new institutions starts, outcomes and other performance-influencing covariates are not measurable because the yet-to-be created institutions are not functioning at baseline. This paper compares the performance of 74 ‘treated’ water user associations (WUAs) in Tajikistan that were created using a longer training process with 67 ‘control’ WUAs that were created using shorter training, to assess the impact of training on WUA performance of mandated duties. First, propensity scores were constructed to estimate the probabilities of being ‘treated’ by treatment status. These results guided the application of the difference-in-difference technique with right-hand side covariates in a context where field measures of outcomes and other performance-influencing covariates were made after the new institutions were created and functioning. The first measures were taken within 12–18 months of the new institutions being functional and the second measures were taken 24 months after the first. This choice of methods introduces a bias due to measurement error causing an underestimate of the treatment effects, while controlling for biases due to time-invariant and time-varying unobservables. An alternative method that only compared the differences in outcomes at a single point in time after the new institutions were created would have provided an inaccurate estimate of the effects of the intervention. This is a context in which methods such as synthetic controls are impossible to employ due to the nature of the intervention, other macroeconomic structural changes, and severe data restrictions. The methodology employed here generates evidence that, while biased toward generating an underestimate of effect, can still be useful and informative for policy and management purposes, and for evaluating the impact of process on the functioning of new institutions in transition settings.
Highlights
Institutions for water management are rapidly transforming in Central Asia, as larger political and economic changes take place
The recent literature on institutional reform, which has focussed on process, rather than design (Denyer Willis and Mota Prado 2014) suggests that Water user associations (WUAs) that have been created through a longer process may be more successful in performing their legally mandated functions than those created with a shorter process (Yap-Salinas 1994; Mukhtarov et al 2015)
Quantitative evidence on whether longer training affects performance is important for shaping government programs that are creating new and strengthening existing WUAs
Summary
Institutions for water management are rapidly transforming in Central Asia, as larger political and economic changes take place. Water user associations (WUAs) are the legally mandated form of organization that provides irrigation services to agricultural land in Tajikistan (Republic of Tajikistan 2006). Some of these WUAs were created using a longer and more gradual process than others. Quantitative evidence on whether longer training affects performance is important for shaping government programs that are creating new and strengthening existing WUAs (e.g., the ongoing Tajikistan Second Public Employment for Sustainable Agriculture and Water Resource Management Project).. Observable characteristics of the geographies where WUAs were created and unobservable characteristics of the same geographies that either are constant or are varying over time may have determined selection into longer and shorter training, confounding the effects of training
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
