Development and Validation of a Crash Culpability Scoring Tool

Abstract

Objective: Several traffic safety research techniques require researchers to separate crash-involved drivers into culpable and nonculpable. Nonculpable drivers are assumed to be randomly involved in crashes by external factors and to approximate a noncollision control population. If this is true, factors that increase crash risk should be found more often in culpable than in nonculpable drivers. Though a culpability scoring tool has been developed for research purposes, that tool does not adequately address winter driving conditions (Robertson and Drummer 1994). Moreover, traditional culpability scoring requires assessors to read and score individual collision reports. The purpose of this study is to develop and validate an automated, rule-based Canadian culpability scoring tool that is capable of rapidly scoring police crash reports from large administrative datasets. Methods: We used an iterative approach to develop and validate our tool. First, the Robertson-Drummer culpability scoring tool was modified to include the extensive police report data collected in the British Columbia Traffic Accident System (TAS) and to account for winter driving conditions. This was done in consultation with traffic safety experts. The scoring tool was automated, employing a rule-based decision model that avoids interpretation of free-text reports. The scoring tool was applied to 73 collisions (134 drivers). Two experts also reviewed these collisions and determined the culpability of each driver. Discrepant cases were discussed to understand why the scoring tool differed from the expert assessment and the scoring tool was modified accordingly. The final tool was compared with expert assessment on another sample of 96 crashes. The tool was also applied to a sample of 2086 crash-involved drivers with known blood alcohol concentrations (BACs) and the adjusted odds of culpability were calculated for several BAC ranges. Results: The final scoring tool included 7 factors and had content validity for traffic safety experts. It had excellent agreement with expert scoring on the first set of collisions (kappa = 0.83, 95% confidence interval [CI]: 0.75–0.91) and on the second set (kappa = 0.84, 95% CI: 0.77–0.92). When applied to crash-involved drivers with known BAC levels, the scoring tool exhibited predictive validity: the odds of culpability increased with higher BACs, consistent with the known dose effect of BAC on crash risk. Conclusions: We have developed an automated culpability scoring tool contextualized to Canadian driving conditions. This tool will allow road safety researchers to assess collision responsibility in large administrative data sets derived from police reports.