Enhancing effectiveness of Extension program evaluations by validating the trustworthiness of self-reported measures of Extension program outcomes

Abstract

Assessment of program outcomes in extension often relies on subjective measures, such as perceived or self-reported knowledge, which are criticized for potential bias and inaccuracy. Conversely, objective knowledge, i.e., how much an individual actually knows, is considered more accurate. Studies show varying associations between subjective and objective knowledge, ranging from no correlation to high correlation, and their influence on behavior change also varies. In this study, we aim to quantify the relationship between subjective knowledge, objective knowledge, and behavior change. Data were collected from Master Gardener Volunteer training attendees. We used Pearson correlation and hierarchical linear regressions to explore the relationship between subjective and objective knowledge and their influence on behavior, i.e., engagement in gardening practices. Our findings show that subjective and objective knowledge post-training were moderately correlated, indicating that participants' self-assessments were not entirely accurate before training. Interestingly, only subjective knowledge before training predicted engagement in gardening practices after training, highlighting the significant role of perceived understanding in behavior change. Based on the findings, we suggest that extension programs should focus on addressing participants' existing beliefs to foster enduring behavior change. By designing programs that consider these pre-existing perceptions, extension can more effectively translate knowledge into practical, lasting behaviors.