Evaluation of Autonomous Driving Safety by Operational Design Domains (ODD) in Mixed Traffic

Abstract

This study derived effective driving behavior indicators to assess the driving safety of autonomous vehicles (AV). A variety of operation design domains (ODD) in urban road networks, which include intersections, illegal parking, bus stop, bicycle lanes, and pedestrian crossings, were taken into consideration in traffic simulation analyses. Both longitudinal and interaction driving indicators were investigated to identify the driving performance of AVs in terms of traffic safety in mixed traffic stream based on simulation experiments. As a result of identifying the appropriate evaluation indicator, time-varying stochastic volatility (VF) headway time was selected as a representative evaluation indicator for left turn and straight through signalized intersections among ODDs related to intersection types. VF headway time is suitable for evaluating driving ability by measuring the variation in driving safety in terms of interaction with the leading vehicle. In addition to ODDs associated with intersection type, U-turns, additional lane segments, illegal parking, bus stops, and merging lane have common characteristics that increase the likelihood of interactions with neighboring vehicles. The VF headway time for these ODDs was derived as driving safety in terms of interaction between vehicles. The results of this study would be valuable in establishing a guideline for driving performance evaluation of AVs. The study found that unsignalized left turns, signalized right turns, and roundabouts had the highest risk scores of 0.554, 0.525, and 0.501, respectively, indicating these as the most vulnerable ODDs for AVs. Additionally, intersection and mid-block crosswalks, as well as bicycle lanes, showed high risk scores due to frequent interactions with pedestrians and cyclists. These areas are particularly risky because they involve unpredictable movements from non-vehicular road users, which require AVs to make rapid adjustments in speed and trajectory. These findings provide a foundation for improving AV algorithms to enhance safety and establishing objective criteria for AV policy-making.