Evaluating health services research capacity building programs: Implications for health services and human resource development

Abstract

Evaluation of research capacity building programs presents challenges, including defining “research capacity building” and measuring it. The present study evaluates infrastructure capacity-building strategies and barriers and facilitators of two federally funded health-related research capacity building programs within the United States. We developed a conceptual framework and abstracted 223 data elements from existing project files. We administered questionnaires to 17 principal investigators and conducted 2-h interviews of 15 principal investigators. Finally, we conducted one-and-a-half-day site visits with five projects. We aggregated data and analysis results across the two programs. Impacts and strategies were also analyzed as to whether host institutions had little or no existing research infrastructure (“seed projects”) or had well-developed research infrastructure (“fertilizer projects”). Projects were associated with increases in publication and presentation rates by Principal Investigators and staff, increases in research funding, changes in organizational research culture, and positive impacts on the community. Project characteristics and activities associated with each of these outcomes were identified. It was also noted that the correlations between these outcomes were small and non-significant.