Advanced Driver Assistance Systems Research Articles

Special issue on “User-centered advanced driver assistance systems (UCADAS)”

Special issue on “User-centered advanced driver assistance systems (UCADAS)”

Machine Vision-Based Method for Reconstructing the Vehicle Coordinate System in End-of-Line ADAS Calibration

To ensure the accuracy and reliability of Advanced Driver Assistance Systems (ADAS), it is essential to perform offline calibration before the vehicles leave the factory. This paper proposes a method for reconstructing the vehicle coordinate system based on machine vision, which can be applied to the offline calibration of ADAS. Firstly, this study explains the preliminary preparations, such as the selection of feature points and the choice of camera model, combining actual application scenarios and testing requirements. Subsequently, the YOLO model is trained to identify and obtain feature regions, and feature point coordinates are extracted from these regions using template matching and ellipse fitting. Finally, a validation experiment is designed to evaluate the accuracy of this method using metrics such as the vehicle’s lateral and longitudinal offset distances and yaw angle. Experimental results show that, compared to traditional vehicle alignment platforms, this method improves reconstruction accuracy while reducing costs.

Scenario Identification and Classification to Support the Assessment of Advanced Driver Assistance Systems

In recent years, driver assistance systems in cars, buses, and trucks have become more common and powerful. In particular, the introduction of AI methods to sensors, signal fusion, and traffic recognition allows us to step forward from actual level-2 assistance to level-3 Advanced Driver Assistance Systems (ADAS), where driving becomes autonomous and responsibility shifts from the driver to the automobile manufacturers. This, however, requires a high-precision risk assessment of failure, which can only be achieved by extensive data acquisition and statistical analysis of real traffic scenarios (which is impossible to perform by humans). Therefore, critical driving situations have to be identified and classified automatically. This paper develops and compares two different strategies—a traditional rule-based approach derived from deterministic causal considerations, and an AI-based approach trained with idealized cut-in, cut-out, and cut-through maneuvers. Application to a 10-h measurement sequence on a German highway demonstrates that the latter has the higher performance, whereas the former misses some of the safety-relevant events to be identified.

Analysis of BGA Lead-Free solder joints failure behavior based on thermal shock testing

The interconnected solder joints within automotive electronic components are the most vulnerable parts of the structure, and their reliability is crucial for the development of new energy vehicles. This study focuses on automotive ADAS (Advanced Driver Assistance System) devices, analyzing the failure behavior of internal BGA (Ball Grid Array) lead-free solder joints under thermal shock conditions.Through thermal shock testing from −40℃ to 95℃, it was observed that microcracks first appeared in the upper intermetallic compound (IMC) layer of corner solder joints after 1600 cycles. As the number of thermal shock cycles increased, the net-like β-Sn phase in the solder joints gradually transformed into block and dot-like structures. Due to the relatively weak strength between the IMC layer and the Ag-Sn compound region, cracks typically propagated along the boundaries of these areas. Recrystallization occurred in the interface between the solder joint and the upper pad, with the proportion of high-angle grain boundaries increasing from 10.74% to 72.43%. The crack propagation mode changed from initial intergranular to transgranular fracture. Throughout the thermal shock test, the upper IMC layer remained thicker than the lower one, with the lower IMC layer thickness showing a minimum point at 750 cycles.The average thrust force between the solder joints and the substrate decreased more rapidly with thermal shock cycles, indicating that non-solder mask defined pads are more effective in improving structural strength.

Radar Powered Perception: Multiple Approaches for Vehicle Classification

The proliferation of Advanced Driver-Assistance Systems (ADAS) and autonomous vehicles demands robust and reliable techniques for vehicle detection and classification. This paper investigates the potential of automotive radar systems for this critical task, focusing on classifying vehicles into three distinct categories (bus/truck, car/sedan/SUV, bike/bicycle). We explore multiple approaches that leverages rich set of features extracted from radar measurements. These features include target size, point density, and other signature characteristics derived from the radar return signal. By analyzing these features, we explain multiple approach aims to achieve vehicle classification. The effectiveness of the proposed method is evaluated using real-world data, with a particular focus on demonstrating its suitability for real-time applications in ADAS. The paper delves into the critical trade-offs that exist between classification accuracy, computational complexity, and inherent limitations of automotive radar sensors. We discuss the impact of sparse data, such as low point cloud data on classification accuracy. Additionally, we discuss on potential mitigation strategies to ensure reliability in challenging scenarios. Finally, the paper concludes by outlining potential future directions for enhancing vehicle classification using automotive radar systems. These advancements will pave the way for the development of more robust and reliable ADAS and autonomous vehicles, ultimately contributing to improved safety on our roads.

Advanced Driver Assist System for Automobiles

Advanced Driver Assist System for Automobiles

Energy efficiency assessment in advanced driver assistance systems with real-time image processing on custom Xilinx DPUs

Energy efficiency assessment in advanced driver assistance systems with real-time image processing on custom Xilinx DPUs

Electric vehicle eco-driving strategy at signalized intersections based on optimal energy consumption

Electric vehicles (EVs), which are a great substitute for gasoline-powered vehicles, have the potential to achieve the goal of reducing energy consumption and emissions. However, the energy consumption of an EV is highly dependent on road contexts and driving behavior, especially at urban intersections. This paper proposes a novel ecological (eco) driving strategy (EDS) for EVs based on optimal energy consumption at an urban signalized intersection under moderate and dense traffic conditions. Firstly, we develop an energy consumption model for EVs considering several crucial factors such as road grade, curvature, rolling resistance, friction in bearing, aerodynamics resistance, motor ohmic loss, and regenerative braking. For better energy recovery at varying traffic speeds, we employ a sigmoid function to calculate the regenerative braking efficiency rather than a simple constant or linear function considered by many other studies. Secondly, we formulate an eco-driving optimal control problem subject to state constraints that minimize the energy consumption of EVs by finding a closed-form solution for acceleration/deceleration of vehicles over a time and distance horizon using Pontryagin’s minimum principle (PMP). Finally, we evaluate the efficacy of the proposed EDS using microscopic traffic simulations considering real traffic flow behavior at an urban signalized intersection and compare its performance to the (human-based) traditional driving strategy (TDS). The results demonstrate significant performance improvement in energy efficiency and waiting time for various traffic demands while ensuring driving safety and riding comfort. Our proposed strategy has a low computing cost and can be used as an advanced driver-assistance system (ADAS) in real-time.

Machine-learning-based ensemble regression for vehicle-to-vehicle distance estimation using a toe-in style stereo camera

Adjusting the following distance from the front vehicle in highway traffic is important to reduce the risk of collision. Distance estimation is an important research area for advanced driver assistance systems. Therefore, this paper presents a methodology that combines the strengths of several machine learning algorithms using joint decision mechanisms and searches for optimal results for vehicle-to-vehicle distance estimation. The hyperparameter optimization of machine learning models is performed by an iterative algorithm that compares combinations of hyperparameter values. In addition, machine learning algorithms are combined and tested with ensemble learning methods to improve the results obtained. According to the experiments, the ensemble voting regression created by combining extreme gradient boosting, categorical boosting and two multi-layer perceptron models achieves the best result with a mean absolute percentage error value of 1.5444. Considering the comparisons made with other methods, the accuracy of the results obtained with the proposed method is quite high.Code is at: https://github.com/ozgurduran/V2V-VR.

Optimizing Camera Exposure Time for Automotive Applications.

Camera-based object detection is integral to advanced driver assistance systems (ADAS) and autonomous vehicle research, and RGB cameras remain indispensable for their spatial resolution and color information. This study investigates exposure time optimization for such cameras, considering image quality in dynamic ADAS scenarios. Exposure time, the period during which the camera sensor is exposed to light, directly influences the amount of information captured. In dynamic scenarios, such as those encountered in typical driving scenarios, optimizing exposure time becomes challenging due to the inherent trade-off between Signal-to-Noise Ratio (SNR) and motion blur, i.e., extending exposure time to maximize information capture increases SNR, but also increases the risk of motion blur and overexposure, particularly in low-light conditions where objects may not be fully illuminated. The study introduces a comprehensive methodology for exposure time optimization under various lighting conditions, examining its impact on image quality and computer vision performance. Traditional image quality metrics show a poor correlation with computer vision performance, highlighting the need for newer metrics that demonstrate improved correlation. The research presented in this paper offers guidance into the enhancement of single-exposure camera-based systems for automotive applications. By addressing the balance between exposure time, image quality, and computer vision performance, the findings provide a road map for optimizing camera settings for ADAS and autonomous driving technologies, contributing to safety and performance advancements in the automotive landscape.

A note on Tesla's revised safety report crash rates

Between June 2018 and December 2023, Tesla released quarterly safety reports citing average miles between crashes for Tesla vehicles. Prior to March 2021, crash rates were categorized as (1) with their SAE Level 2 automated driving system Autopilot engaged, (2) without Autopilot but with active safety features such as automatic emergency braking, and (3) without Autopilot and without active safety features. In January 2023, Tesla revised past reports to reflect their new categories of with and without Autopilot engaged, in addition to making small adjustments based on recently discovered double counting of reports and excluding previously recorded crashes that did not meet their thresholds of airbag or active safety restraint activation. The revisions are heavily biased towards no-active-safety-features—a surprising result given prior research showing that drivers predominantly keep most active safety features enabled. As Tesla's safety reports represent the only national source of Level 2 advanced driver assistance system crash rates, clarification of their methods is essential for researchers and regulators. This note describes the changes and considers possible explanations for the discrepancies.

Evaluating the User Experience of V2X Communication Alerts for Emergencies in Level 3 Autonomous Driving

Communicating effectively with autonomous vehicles requires contextualized visual and auditory cues to ensure clear message delivery. Evaluating the user experience involves assessing which types of information can be safely reacted to without additional monitoring and how it is presented. Validating the visual and auditory cues supports the driver’s course of action. This study investigates message types and preferred modalities of driver-to-driver communication via vehicle-to-everything (V2X) in advanced driver assistance systems technologies for autonomous and manual driving and proposes efficient ways to respond to event situations. Four modalities, including baseline and three message types with different information were proposed to investigate the information required by drivers. Results indicate that providing notifications during autonomous driving is more helpful and less workload-intensive than during manual driving. Most notifications were highly visible and easy to recognize. Although behavioral messages in both autonomous and manual driving enhance usability, providing advice and behavioral messages is safer for autonomous driving. Designing V2X notification information based on future events is vital because of its highly pragmatic nature.

Enhancing advanced driver assistance systems through explainable artificial intelligence for driver anomaly detection

The recent advancements in Advanced Driver Assistance Systems (ADAS) have significantly contributed to road safety and driving comfort. An integral aspect of these systems is the detection of driver anomalies such as drowsiness, distraction, and impairment, which are crucial for preventing accidents. Building upon previous studies that utilized ensemble model learning (XGBoost) with deep learning models (ResNet50, DenseNet201, and InceptionV3) for anomaly detection, this study introduces a comprehensive feature importance analysis using the SHAP (SHapley Additive exPlanations) technique. The technique is implemented through explainable artificial intelligence (XAI). The primary objective is to unravel the complex decision-making process of the ensemble model, which has previously demonstrated near-perfect performance metrics in classifying driver behaviors using in-vehicle cameras. By applying SHAP, the study aims to identify and quantify the contribution of each feature – such as facial expressions, head position, yawning, and sleeping – in predicting driver states. This analysis offers insights into the model’s inner workings and guides the enhancement of feature engineering for more precise and reliable anomaly detection. The findings of this study are expected to impact the development of future ADAS technologies significantly. By pinpointing the most influential features and understanding their dynamics, a model can be optimized for various driving scenarios, ensuring that ADAS systems are robust, accurate, and tailored to real-world conditions. Ultimately, this study contributes to the overarching goal of enhancing road safety through technologically advanced, data-driven approaches.

Personalizing driver safety interfaces via driver cognitive factors inference

Recent advances in AI and intelligent vehicle technology hold the promise of revolutionizing mobility and transportation through advanced driver assistance systems (ADAS). Certain cognitive factors, such as impulsivity and inhibitory control have been shown to relate to risky driving behavior and on-road risk-taking. However, existing systems fail to leverage such factors in assistive driving technologies adequately. Varying the levels of these cognitive factors could influence the effectiveness and acceptance of ADAS interfaces. We demonstrate an approach for personalizing driver interaction via driver safety interfaces that are are triggered based on the inference of the driver’s latent cognitive states from their driving behavior. To accomplish this, we adopt a data-driven approach and train a recurrent neural network to infer impulsivity and inhibitory control from recent driving behavior. The network is trained on a population of human drivers to infer impulsivity and inhibitory control from recent driving behavior. Using data collected from a high-fidelity vehicle motion simulator experiment, we demonstrate the ability to deduce these factors from driver behavior. We then use these inferred factors to determine instantly whether or not to engage a driver safety interface. This approach was evaluated using leave-one-out cross validation using actual human data. Our evaluations reveal that our personalized driver safety interface that captures the cognitive profile of the driver is more effective in influencing driver behavior in yellow light zones by reducing their inclination to run through them.

Truck drivers’ views on the road safety benefits of advanced driver assistance systems and Intelligent Transport Systems in Tanzania

Truck drivers’ views on the road safety benefits of advanced driver assistance systems and Intelligent Transport Systems in Tanzania

ADAS and automation-arelevant contribution to maintaining mobility of older drivers?

Driving is the most important and safest form of mobility for the majority of senior citizens. However, physical and mental performance gradually decline with age, which can lead to more problems, critical situations or even accidents. Vehicle technology innovations such as advanced driver assistance systems (ADAS) have the potential to increase the road safety of older people and maintain their individual mobility for as long as possible.This overview article aims to identify ADAS that have the greatest potential to reduce the number of accidents involving older drivers. For this purpose, the accident and damage occurrence as well as the driving behaviour and compensation strategies of older people are examined in more detail. Suitable ADAS should compensate for typical driver errors, reduce information deficiencies and have ahigh level of acceptance. For older drivers, emergency braking, parking assistance, navigation, intersection assistance and distance speed control systems as well as systems for detecting blind spots and obstacles appear to be particularly suitable.Some of the disadvantages of ADAS are the lack of market penetration, acceptance problems and interface designs that have not yet been optimally adapted to the needs of older users. For older drivers in particular, it appears to be apriority to develop coherent and integrated solutions in the sense of cooperative assistance instead of pushing ahead with high and full automation with many system limits and exceptions, which can place high demands on attention, for example if the vehicle has to be taken over in acritical situation.

CycleInSight: An enhanced YOLO approach for vulnerable cyclist detection in urban environments

As urbanization continues to reshape transportation, the safety of cyclists in complex traffic environments has become a pressing concern. In response to this challenge, our research introduces a CycleInSight framework, which harnesses advanced deep learning and computer vision techniques to enable precise and efficient cyclist detection in diverse urban settings. Utilizing you only look once version 8 (YOLOv8) object detection algorithm, the proposed model aims to detect and localize vulnerable cyclists near vehicles equipped with onboard cameras. Our research presents comprehensive experimental results demonstrating its effectiveness in identifying vulnerable cyclists amidst dynamic and challenging traffic conditions. With an impressive average precision of 90.91%, our approach outperforms existing models while maintaining efficient inference speeds. By effectively identifying and tracking cyclists, this framework holds significant potential to enhance urban traffic safety, inform data-driven infrastructure planning, and support the development of advanced driver assistance systems and autonomous vehicles.

Lived experience of driving in individuals with functional neurological disorder.

Functional neurological disorder (FND) is a common neurological diagnosis that encapsulates a range of incapacitating clinical presentations. These include functional seizures, movement disorders, and sensory disturbances. Safe driving requires both cognitive skills and physical abilities, which may be impacted by FND symptoms. The primary objective of this study was to gain deeper insights into the challenges faced by people with FND when driving. A qualitative study and interpretative phenomenological analysis were conducted. Individuals experiencing functional seizures and/or movement disorders completed both questionnaires and semi-structured interviews about FND symptoms, driving behavior, and crashes. A total of 26 patients with FND participated in this study. Based on the interviews, four key themes were identified: (1) driving difficulties experienced by individuals with FND; (2) strategies utilized by people with FND to overcome difficulties experienced while driving; (3) barriers preventing driving challenges being addressed in this population; and (4) crashes and perceived dangerous driving events experienced by individuals with FND. All participants reported that driving a car provoked FND symptoms and this affected their driving ability. FND sufferers reported using a number of strategies such as limiting how far they drive and relying on advanced driver assistance system features to help manage their associated symptoms, such as fatigue and/or pain. Several participants reported crashes and perceived dangerous driving events since developing FND. Individuals experiencing FND often employ self-regulation techniques, yet the extent to which these methods enhance driving safety remains uncertain. The variable nature of the disorder makes judging an individual's driving risk particularly difficult. The themes emerging from the interviews highlighted the need for further empirical research to inform guidelines and best practice when determining the impact of FND on an individual's driving safety .

Formal analysis of an AUTOSAR-based basic software module

The widespread use of advanced driver assistance systems in modern vehicles, together with their integration with the Internet and other road nodes, has made vehicle more vulnerable to cyber-attacks. To address these risks, the automotive industry is increasingly focusing on the development of security solutions: formal methods and software verification techniques, which have been successfully applied to a number of safety-critical systems, could be a promising approach in the automotive area. In this work, we concentrate on in-vehicle communications, provided by many Electronic Control Units (ECUs) that work together thanks to serial protocols such as Controller Area Network (CAN). However, increasing connectivity exposes the internal network to a variety of cyber-risks. Our aim is to formally verify the AUTOSAR-based Basic Software module called CINNAMON, designed to ensure confidentiality, integrity, and authentication at the same time for traffic exchanged over CAN protocol. More precisely, it adds confidentiality guarantees to the Secure Onboard Communication (SecOC) module. We formally analyze CINNAMON with the verification tool Tamarin. Our analysis shows that CINNAMON could be an effective security solution, as it can ensure the desired properties, in particular, confidentiality in a send-receive scenario between two ECUs. Finally, we describe a potential application scenario.

Real Time Traffic Sign Recognition Using Integrated Camera Sensors and YOLOV8 Algorithm

Traffic signs are an important element in maintaining smoothness and safety on the road. However, there are still many drivers who violate them, causing various negative impacts. Traffic Sign Recognition (TSR) is a technology that has the ability to detect and identify various types of traffic signs by utilizing artificial intelligence in the computer vision domain. TSR has been applied in various vehicle applications, such as Advance Driver Assistance System (ADAS) and Autonomous Driving System (ADS). This system is made by integrating camera sensors with the YOLOv8 algorithm which has high accuracy and fast data processing. The data used were 2093 images and annotated through Roboflow. Then the data is trained through Google Collaboratory with a mAP evaluation result of 95.5% which shows that the system can detect objects accurately. The level of precision and success of the model in detecting objects is 93.5% and the success is 93.3%. The results of system testing can use images, videos, and through cameras in real time.