Building Program Evaluation Capacity Through an Online Training for Graduate Students at Schools and Programs of Public Health.

Abstract

Program evaluation is an essential function for public health professionals that is necessary to acquire funding for public health programs and support evidenced-based practice, but coverage of program evaluation principles and methodology within the master of public health (MPH) curriculum is inconsistent and may not adequately prepare students to conduct program evaluation activities postgraduation, especially on culturally responsive program evaluation. We examined the effectiveness of an online training course on program evaluation topics. In July 2021, we recruited current and recently graduated MPH students from accredited US universities to measure the effectiveness of a 1-hour online training course in program evaluation. We distributed pre- and postsurveys to eligible participants. We assessed program evaluation skills on a 4-point Likert scale to determine improvements in knowledge (from 4 = extremely knowledgeable to 1 = not knowledgeable), attitudes (from 4 = strongly agree to 1 = strongly disagree), and self-efficacy (from 4 = strongly agree to 1 = strongly disagree). Among 80 MPH students who completed the survey, respondents indicated mean (SD) increases from presurvey to postsurvey in knowledge (from 2.13 [0.66] to 3.24 [0.54]) and attitudes (from 3.61 [0.51] to 3.84 [0.30]) toward program evaluation and in self-efficacy in conducting program evaluation (from 2.92 [0.71] to 3.44 [0.52]). The course may be an effective approach for training public health professionals about program evaluation. Our results provide a basis for revising the way program evaluation is taught and practical recommendations for integrating program evaluation competencies within public health curricula, such as by incorporating a self-paced training course for continuing education.