Factorial Validity of a Subjective Outcome Evaluation Tool for Implementers of a Positive Youth Development Program

Abstract

Study ObjectivesThis study examined the dimensionality of the subjective outcome evaluation tool assessing the views of program implementers in the context of the Project P.A.T.H.S. in Hong Kong. For illustration purpose, both exploratory and confirmatory factor analyses were performed to examine the factor structure of the instrument. DesignSubjective outcome evaluation findings were collected from 1,170 program implementers who implemented the Grade 7 level program. A validated subjective outcome evaluation scale was used to assess the views of the program implementers. Conceptually, the scale was designed to assess program implementers’ perceptions about program content, implementer qualities, and program effectiveness after completion of the program. ResultsExploratory factor analyses showed that 3 factors were abstracted from the scale and they were stable across 2 random subsamples. Confirmatory factor analyses showed that there was support for a higher-order factor model containing 3 primary factors and 1 second-order factor, and that evidence supporting factorial invariance was found. The 3 subscales were also shown to be reliable with acceptable internal consistency. ConclusionBoth exploratory and confirmatory factor analyses provided support for the factorial validity of the subjective outcome evaluation tool designed for program implementers in the Project P.A.T.H.S. in Hong Kong.