Testing Of Autonomous Vehicles Research Articles

Correction: Accelerated Testing and Evaluation of Autonomous Vehicles Based on Dual Surrogates

Correction: Accelerated Testing and Evaluation of Autonomous Vehicles Based on Dual Surrogates

Risk and Complexity Assessment of Autonomous Vehicle Testing Scenarios

Autonomous vehicles (AVs) must fulfill adequate safety requirements before formal application, and performing an effective functional evaluation to verify vehicle safety requires extensive testing in different scenarios. However, it is crucial to rationalize the application of different scenarios to support different testing needs; thus, one of the current challenges limiting the development of AVs is the critical evaluation of scenarios, i.e., the lack of quantitative criteria for scenario design. This study introduces a method using the Spherical Fuzzy-Analytical Network Process (SF-ANP) to evaluate these scenarios, addressing their inherent risks and complexities. The method involves constructing a five-layer model to decompose scenario elements and using SF-ANP to calculate weights based on element interactions. The study evaluates 700 scenarios from the China In-depth Traffic Safety Study–Traffic Accident (CIMSS-TA) database, incorporating fuzzy factors and element weights. Virtual simulation of vehicles in the scenarios was performed using Baidu Apollo, and the performance of the scenarios was assessed by collecting the vehicle test results. The correlation between the obtained alternative safety indicators and the quantitative values confirms the validity and scientific validity of this approach. This will provide valuable guidance for categorizing audiovisual test scenarios and selecting corresponding scenarios to challenge different levels of vehicle functionality. At the same time, it can be used as a design basis to generate a large number of effective scenarios to accelerate the construction of scenario libraries and promote commercialization of AVs.

Pedestrian safety behavior modeling method in human-vehicle-intelligence shared road space

In the context of the development of autonomous vehicles sharing road resources with traditional traffic participants in the future, modeling the safe behavior of pedestrians in the shared road space between people, vehicles and intelligence is crucial for the simulation development and reliability and safety testing of autonomous vehicles. To meet this demand, the safe movement behavior of pedestrians is first analyzed, and on this basis, the traditional pedestrian social force model is improved to construct a momentum model for the interactive movement of pedestrians with other pedestrians, traditional vehicles and autonomous vehicles in the shared road space; then, the safety parameters of the model are calibrated using a data set of human-vehicle interactive movement and a genetic algorithm, and a typical shared road space scenario is built to verify the effectiveness of the model. The simulation results show that the model can simulate the real safe movement behavior of pedestrians, and has better simulation effects when used in tasks such as human-vehicle-intelligence shared road space simulation.

Instance Space Analysis of Testing of Autonomous Vehicles in Critical Scenarios

Before being deployed on roads, Autonomous Vehicles (AVs) must undergo comprehensive testing. Safety-critical situations, however, are infrequent in usual driving conditions, so simulated scenarios are used to create them. A test scenario comprises static and dynamic features related to the AV and the test environment; the representation of these features is complex and makes testing a heavy process. A test scenario is effective if it identifies incorrect behaviors of the AV. In this article, we present a technique for identifying key features of test scenarios associated with their effectiveness using Instance Space Analysis (ISA). ISA generates a ( \(2D\) ) representation of test scenarios and their features. This visualization helps to identify combinations of features that make a test scenario effective. We present a graphical representation of each feature that helps identify how well each testing technique explores the search space. While identifying key features is a primary goal, this study specifically seeks to determine the critical features that differentiate the performance of algorithms. Finally, we present metrics to assess the robustness of testing algorithms and the scenarios generated. Collecting essential features in combination with their values associated with effectiveness can be used for selection and prioritization of effective test cases.

EpiTESTER: Testing Autonomous Vehicles With Epigenetic Algorithm and Attention Mechanism

EpiTESTER: Testing Autonomous Vehicles With Epigenetic Algorithm and Attention Mechanism

Future-Proofing Your Organization: Key Principles for Leading Through the AI Transition

As artificial intelligence (AI) advances rapidly, organizations must develop meaningful long-term strategies to realize opportunities and mitigate risks, as academic research shows AI will significantly impact over 50% of jobs by 2030, requiring workforce planning, while industries like travel agencies have faced disruption from failing to adapt to digital technologies like AI. Effective AI strategies include establishing integrated 3-5 year technology roadmaps that articulate adoption timelines, skill development, and business transformations, identifying core capabilities to augment with AI, such as diagnostics for healthcare, while data and technology foundations are also critical for deploying AI projects at scale and continuous skills training is needed to fill emerging roles and offset potential job losses. The article discusses strategic considerations for industries like healthcare, where strategies focus on augmenting clinicians, standardizing data, and establishing governance, transportation organizations must plan for autonomous vehicle testing and adoption, and reskill mechanics, and financial institutions can develop robo-advisors and lending platforms while modernizing legacy systems. Therefore, organizational leaders need such integrated roadmaps and ongoing governance to leverage AI's productivity benefits while guiding responsible adoption and workforce evolution amid ongoing disruption through proactive strategic planning that will help direct, rather than undergo, technological transformation.

High-risk powered two-wheelers scenarios generation for autonomous vehicle testing using WGAN

Objective Autonomous vehicles (AVs) have the potential to revolutionize the future of mobility by significantly improving traffic safety. This study presents a novel method for validating the safety performance of AVs in high-risk scenarios involving powered 2-wheelers (PTWs). By generating high-risk scenarios using in-depth crash data, this study is devoted to addressing the challenge of public road scenarios in testing, which often lack the necessary complexity and risk to effectively evaluate the capabilities of AVs in high-risk situations. Method Our approach employs a Wasserstein generative adversarial network (WGAN) to generate high-risk scenes, particularly focusing on PTW scenarios. By extracting 314 car-to-PTW crashes from the China In-depth Mobility Safety Study–Traffic Accident database, we simulate outcomes using PC-Crash software. The data are divided into scenes at 0.1-s intervals, with WGAN generating numerous high-risk scenes. By using a cumulative distribution function (CDF), we sampled and analyzed the vehicle’s dynamic information to generate complete scenarios applicable to the test. The validation process involves using the SVL Simulator and the Baidu Apollo joint simulation platform to evaluate the AV’s driving behavior and interactions with PTWs. Results This study evaluates model generation results by comparing distributions using Wasserstein distance as an indicator. The generator converges after approximately 200 epochs, with the iterator converging quickly. Subsequently, 10,000 new scenes are then generated. The distribution of several key parameters in the generated scenes can be found to approximate that of the original scenes. After sampling, the usability of generated scenarios is 64.76%. Virtual simulations confirm the effectiveness of the scenario generation method, with a generated scenario crash rate of 16.50% closely reflecting the original rate of 15.0%, showcasing the method’s capacity to produce realistic and hazardous scenarios. Conclusions The experimental results suggest that these scenarios exhibit a level of risk similar to the original crashes and are effective for testing AVs. Consequently, the generated scenarios enhance the diversity of the scenario library and accelerate the overall testing process of AVs.

Virtual Tools for Testing Autonomous Driving: A Survey and Benchmark of Simulators, Datasets, and Competitions

Traditional road testing of autonomous vehicles faces significant limitations, including long testing cycles, high costs, and substantial risks. Consequently, autonomous driving simulators and dataset-based testing methods have gained attention for their efficiency, low cost, and reduced risk. Simulators can efficiently test extreme scenarios and provide quick feedback, while datasets offer valuable real-world driving data for algorithm training and optimization. However, existing research often provides brief and limited overviews of simulators and datasets. Additionally, while the role of virtual autonomous driving competitions in advancing autonomous driving technology is recognized, comprehensive surveys on these competitions are scarce. This survey paper addresses these gaps by presenting an in-depth analysis of 22 mainstream autonomous driving simulators, focusing on their accessibility, physics engines, and rendering engines. It also compiles 35 open-source datasets, detailing key features in scenes and data-collecting sensors. Furthermore, the paper surveys 10 notable virtual competitions, highlighting essential information on the involved simulators, datasets, and tested scenarios involved. Additionally, this review analyzes the challenges in developing autonomous driving simulators, datasets, and virtual competitions. The aim is to provide researchers with a comprehensive perspective, aiding in the selection of suitable tools and resources to advance autonomous driving technology and its commercial implementation.

Generalization of cut-in pre-crash scenarios for autonomous vehicles based on accident data

The utilization of high-risk test cases constitutes an effective approach to enhance the safety testing of autonomous vehicles (AVs) and enhance their efficiency. This research paper presents a derivation of 2052 high-hazard pre-crash scenarios for testing autonomous driving, which were based on 23 high-hazard cut-in accident scenarios from the National Automobile Accident In-Depth Investigation System (NAIS) through combining importance sampling and combined testing methods. Compared to the direct combination of the original distribution after sampling, the proposed method has a 2.92 times higher crash rate of 69.32% for the test case set in this paper. It also has a 5.8 times higher rate of triggering Automatic Emergency Braking (AEB), improving hazardous scenario coverage. Using the proposed method, the generated parameters of the cut-in accident scenario test set were compared with those of the cut-in test scenarios included in existing Chinese autonomous driving test protocols and standards. The velocity of the ego-vehicle obtained using the proposed method matched those in the existing protocols, whereas the velocity, time gap, and time to collision of the target vehicle were significantly lower than those existing protocols indicating scenarios obtained from accident data can enrich the selection of testing scenarios for autonomous driving.

Accelerated Testing and Evaluation of Autonomous Vehicles Based on Dual Surrogates

Accelerated Testing and Evaluation of Autonomous Vehicles Based on Dual Surrogates

Research capabilities of the Competence Centre for Autonomous and Connected Vehicles in the area of testing autonomous vehicles in Poland

The paper focuses on the most frequently used systems for storing energy recovered during vehicle braking are presented in this paper. Various solutions relying mainly on electrochemical batteries were analysed. The attention is also concentrated on systems that enable storing large amounts of energy using supercapacitors, and kinetic energy accumulators as the alternative approach.

A modeling method for two-dimensional two-wheeler driving behavior during severe conflict interaction at intersections

The safety of two-wheelers is a serious public safety issue nowadays. Two-wheelers usually have severe conflict interaction with vehicles at intersections, such as running red lights, which is very likely to cause traffic accidents. Therefore, a model of two-wheeler driving behavior in conflicting interactions can provide guidance for traffic safety management on one hand, and can be used for the development and testing of autonomous vehicles on the other. However, the existing models perform poorly when interacting with vehicles. To address the problems, this paper proposes a modeling method (an improved social force model, ISFM) for two-dimensional two-wheeler driving simulation for conflict interaction at intersections. Based on analysis of naturalistic driving study data, when two-wheelers encounter with vehicles, their driving intentions and trajectories can be categorized into two groups, which are yielding and overtaking. Therefore, the vehicle-related social forces are designed to be a set of two forces rather than a repulsion force in original SFM, which is a yielding force based on the relative distance between the two-wheeler and the vehicle, and an overtaking force based on the velocity of the two-wheeler itself. This opens up the possibilities for modeling the multi-modal driving intention of two-wheelers encountering with cross traffic. Based on ISFM, a bicycle model, a powered two-wheeler (PTW) model and a model of a group of PTWs, are then constructed. Compared to the original SFM, ISFM increases the precision of driving intention prediction by 19.7 % (yielding situation) and 25.0 % (overtaking situation), and reduces the root mean square error between simulated and actual trajectories by 7.8 % and 14.8 % on the bicycle model and the PTW model, respectively. Meanwhile, the model of a group of PTWs also performs well. Finally, the results of ablation experiments also validate the effectiveness of the social force designed based on velocity.

Comprehensive Survey of Autonomous Driving Systems and Advanced Technologies: Literature Review, Gap Analysis and Future Directions

Abstract: This article presents a literature review of numerous research papers focusing around the topic ‘Development of Autonomous Driving Vehicle System’, and related works. The advent of autonomous driving technology has revolutionized the automotive industry, promising enhanced safety, efficiency, and convenience on the road. A critical aspect of autonomous vehicle development is the assessment of their performance ina controlled and risk-free environment. Virtual environments, enabled by cutting-edge technologies, offer a dynamic plat- form for rigorous testing and training of autonomous vehicles. This paper aims to study and analyze different approaches and methodologies that are implemented for the development of Autonomous Driving Systems(ADS). Some of the primary aspects that are found common in most papers are Virtual Environment, pedestrians’ safety, privacy, security, real-time datapresentation, precise torque control, Reinforcement Learning, Deep Learning, Hardware-in-the-loop (HIL)- simulation, Model- in-the-loop (MIL)-simulation, etc. The sole idea of extracting valuable information from a virtual environment ensures a sense of safety as there are no humans involuntarily involved to take part in the development. However, the data extracted from the virtual environment must be highly accurate and reliable, as it will be trained and tested in real environments post deployment. Collision scenarios need to be carefully studied, for which relative positioning of vehicle and pedestrians should be taken into account, so as to examine their velocities, time to collision, and appropriately taking actions. Above all, it should be noted that the safety of human lives holds the highest priority, if a method suggests a high risk factor for a human life, then it should be either discarded, or improved

Pre-crash scenarios for safety testing of autonomous vehicles: A clustering method for in-depth crash data

Autonomous vehicles (AVs) provide an opportunity to enhance traffic safety. However, AVs market penetration is still restricted due to their safety concerns and dependability. For widespread adoption, it is crucial to thoroughly assess the safety response of AVs in various high-risk scenarios. To achieve this objective, a clustering method was used to construct typical testing scenarios based on the China In-depth Mobility Safety Study-Traffic Accident (CIMSS-TA) database. Initially, 222 car-to-powered two-wheelers (PTWs) crashes and 180 car-to-car crashes were reconstructed from CIMSS-TA database. Second, six variables were extracted and analyzed, including the motion of the two vehicles involved, relative movement, lighting condition, road condition, and visual obstruction. Third, these variables were clustered using the k-medoids algorithm, identifying five typical pre-crash scenarios for car-to-PTWs and seven for car-to-car. Additionally, we extracted the velocities and surrounding environmental information of the crash-involved parties to enrich the scenario description. The approach used in this study used in-depth case review and thus provided more insightful information for identifying and quantifying representative high-risk scenarios than prior studies that analyzed overall descriptive variables from Chinese crash databases. Furthermore, it is crucial to separately test car-to-car scenarios and car-to-PTWs scenarios due to their distinct motion characteristics, which significantly affect the resulting typical scenarios.

An entropy‐based model for quantifying multi‐dimensional traffic scenario complexity

AbstractQuantifying the complexity of traffic scenarios not only provides an essential foundation for constructing the scenarios used in autonomous vehicle training and testing, but also enhances the robustness of the resulting driving decisions and planning operations. However, currently available quantification methods suffer from inaccuracies and coarse‐granularity in complexity measurements due to issues such as insufficient specificity or indirect quantification. The present work addresses these challenges by proposing a comprehensive entropy‐based model for quantifying traffic scenario complexity across multiple dimensions based on a consideration of the essential components of the traffic environment, including traffic participants, static elements, and dynamic elements. In addition, the limitations of the classical information entropy models applied for assessing traffic scenarios are addressed by calculating magnitude entropy. The proposed entropy‐based model is analyzed in detail according to its application to simulated traffic scenarios. Moreover, the model is applied to real world data within a naturalistic driving dataset. Finally, the effectiveness of the proposed quantification model is illustrated by comparing the complexity results obtained for three typical traffic scenarios with those obtained using an existing multi‐factor complexity quantification method.

Developing Zero-Cost Solutions for Testing Autonomous Vehicle Software

As the development of autonomous vehicles accelerates, the need for robust and cost-effective testing solutions becomes paramount. This paper explores the concept of zero-cost solutions for testing autonomous vehicle software, aiming to reduce development expenses while maintaining high testing efficacy. We examine various methodologies, tools, and strategies that leverage existing resources to create effective testing frameworks without significant financial investment. Case studies and practical implementations illustrate the feasibility and benefits of these approaches in real-world scenarios.

PEM: Perception Error Model for Virtual Testing of Autonomous Vehicles

PEM: Perception Error Model for Virtual Testing of Autonomous Vehicles

Design and Development of a Digital Twin Platform for Scenario-Based Testing of Road Vehicles

There currently exists a need for a platform that provides users with the ability to perform extensive, repeatable and meaningful simulation and testing for the hardware and software which compose vehicle/autonomous vehicle systems whilst being broadly accessible, widely supported and provides robust features and development tools. The contemporary implementations of similar systems are either financially exorbitant or highly contained. The system reflected in this paper aims to fill a gap in the industry of vehicle/autonomous vehicle development by extending on currently existing open-source software to provide a highly streamlined platform to support the production of general road vehicle and autonomous vehicle driving systems. The software tools and hardware components chosen for the system will be discussed, followed by the features constructed throughout the development process. The end result of the system is a platform that allows for quick, repeatable, accurate, and nearly endless testing of a digital twin of real life vehicles. This system will allow users to gain valuable simulation and testing data of hardware and software components in a manner which is not always feasible using the traditional methods of autonomous vehicle testing.

Beyond the Value for AI Adopters: Analyzing the Impacts of Autonomous Vehicle Testing on Traffic Conditions in California

Beyond the Value for AI Adopters: Analyzing the Impacts of Autonomous Vehicle Testing on Traffic Conditions in California

Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A Survey

Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A Survey