The system of headlights operation recognition using the digital twin method

Abstract

Virtual digital representation of a physical object or system, created with precision through computer simulations, data analysis, and various digital technologies can be used as training set for real life situations. The principal aim behind creating a virtual representation is to furnish a dynamic, data-fueled, and digital doppelgänger of the physical asset. This digital counterpart serves multifaceted purposes, including the optimization of performance, the continuous monitoring of its well-being, and the augmentation of informed decision-making processes. Main advantage of employing a digital twin is its capacity to facilitate experimentation and assessment of diverse scenarios and conditions, all without impinging upon the actual physical entity. This capability translates into substantial cost savings and superior outcomes, as it allows for the early identification and mitigation of issues before they escalate into significant problems in the tangible world. Within our research endeavors, we've meticulously constructed a digital twin utilizing the Unity3D software. This digital replica faithfully mimics vehicles, complete with functioning headlamp toggles. Our lighting system employs polygons and normal vectors, strategically harnessed to generate an array of dispersed and reflected light effects. To ensure realism, we've meticulously prepared the scene to emulate authentic road conditions. For validation and testing, we integrated our model with the YOLO (You Only Look Once) neural network. A specifically trained compact YOLO model demonstrated impressive capabilities by accurately discerning the status of real vehicle headlamps. On average, it achieved an impressive recognition probability of 80%, affirming the robustness of our digital twin.