Are risk assessment tools more accurate than unstructured judgments in predicting violent, any, and sexual offending? A meta-analysis of direct comparison studies.

Abstract

We conducted a pre-registered meta-analysis of studies that directly compared the predictive validity of risk assessment tools to unstructured judgments of risk for violent, any, or sexual offending. A total of 31 studies, containing 169 effect sizes from 45,673 risk judgments, met inclusion criteria. Based on the results of three-level mixed-effects meta-regression models, the predictive validity of total scores on risk assessment tools was significantly higher than that of unstructured judgments for predictions of violent, any, and sexual offending. Tools continued to outperform unstructured judgments after accounting for risk of bias. This finding was also robust to variations in population, assessment context, and outcome measurement. Although this meta-analysis provides support for the use of risk assessment tools, it also highlights limitations and gaps that future research should address.