Development of Artificial Intelligent-Based Methodology to Prepare Input for Estimating Vehicle Emissions

Abstract

Machine learning has significantly advanced traffic surveillance and management, with YOLO (You Only Look Once) being a prominent Convolutional Neural Network (CNN) algorithm for vehicle detection. This study utilizes YOLO version 7 (YOLOv7) combined with the Kalman-based SORT (Simple Online and Real-time Tracking) algorithm as one of the models used in our experiments for real-time vehicle identification. We developed the “ISTraffic” dataset. We have also included an overview of existing datasets in the domain of vehicle detection, highlighting their shortcomings: existing vehicle detection datasets often have incomplete annotations and limited diversity, but our “ISTraffic” dataset addresses these issues with detailed and extensive annotations for higher accuracy and robustness. The ISTraffic dataset is meticulously annotated, ensuring high-quality labels for every visible object, including those that are truncated, obscured, or extremely small. With 36,841 annotated examples and an average of 32.7 annotations per image, it offers extensive coverage and dense annotations, making it highly valuable for various object detection and tracking applications. The detailed annotations enhance detection capabilities, enabling the development of more accurate and reliable models for complex environments. This comprehensive dataset is versatile, suitable for applications ranging from autonomous driving to surveillance, and has significantly improved object detection performance, resulting in higher accuracy and robustness in challenging scenarios. Using this dataset, our study achieved significant results with the YOLOv7 model. The model demonstrated high accuracy in detecting various vehicle types, even under challenging conditions. The results highlight the effectiveness of the dataset in training robust vehicle detection models and underscore its potential for future research and development in this field. Our comparative analysis evaluated YOLOv7 against its variants, YOLOv7x and YOLOv7-tiny, using both the “ISTraffic” dataset and the COCO (Common Objects in Context) benchmark. YOLOv7x outperformed others with a mAP@0.5 of 0.87, precision of 0.89, and recall of 0.84, showing a 35% performance improvement over COCO. Performance varied under different conditions, with daytime yielding higher accuracy compared to night-time and rainy weather, where vehicle headlights affected object contours. Despite effective vehicle detection and counting, tracking high-speed vehicles remains a challenge. Additionally, the algorithm’s deep learning estimates of emissions (CO, NO, NO2, NOx, PM2.5, and PM10) were 7.7% to 10.1% lower than ground-truth.