Multisource evaluation of policing competence: the development of self- and supervisor-rating scales for police recruits

Abstract

ABSTRACT Some police departments are responding to changing community needs by promoting a departmental cultural shift, which may involve their training programs. Reliable evaluation tools are needed to capture policing preparedness of graduating probationary officers (P1s) in line with evolving policing theory. The current study examines a multisource evaluation tool that includes P1 self-report and the observed ratings from their field training officers (FTOs) for 679 dyads. Results indicated that both raters grouped items into analogous factor structures, allowing for direct comparisons. P1’s and FTO’s ratings neither agreed nor covaried, and P1s tended to over-rate their preparedness. The psychometric properties of the developed scales were discussed as well as implications for program evaluations. Specifically, P1s and FTOs functioned as unique sources of information who could provide non-redundant perspectives on police preparedness and competency resulting from training. Review of both raters in concert may provide an additional level of potentially useful interpretation.