Testing ADAS/ADS – from critical scenarios to automated testing oracles

Abstract

Automated and autonomous driving systems are increasingly integrated into modern vehicles to support the vision of safe, efficient, and comfortable transportation. Given the complexity of these systems, thorough testing and close monitoring of their behavior is inevitable to prevent hazardous situations and unexpected behaviors. This paper presents different approaches for testing ADAS/ADS, focusing on generating critical scenarios for virtual validation and monitoring approaches applied during operation. Specifically, we provide a comprehensive overview of our previous work on combinatorial and search-based testing methodologies, highlighting their application in generating robust test suites. Additionally, we summarize our work on intelligent monitoring approaches to detect operational issues. Our findings emphasize the necessity of advanced testing solutions and continuous monitoring to identify and mitigate potential failures, demonstrating their applicability in enhancing the safety and trustworthiness of ADAS/AD.