Vehicle detection in diverse traffic using an ensemble convolutional neural backbone via feature concatenation

Abstract

ABSTRACT Nowadays, deploying an intelligent vehicle detection system (IVDS) in diverse traffic is a work priority. It provides real-time traffic information with vehicle counts and types of vehicles. IVDS deployment in diverse traffic is challenging because different vehicle classes occlude each other on the road. In recent years, convolutional neural network (CNN) based deep learning (DL) methods have attained incredible progress in implementing IVDS. However, most CNN-based DL methods do not include diverse traffic conditions in Asian countries. Also, due to existing feature extraction backbones, they cannot accurately detect multi-scale vehicles. This work proposes an advanced visual computing deep learning (AVCDL) method with a vast labeled vehicle dataset to detect vehicles in diverse traffic. It includes an ensemble backbone and an improved multi-stage vehicle detection head (MSVDH). An ensemble CNN backbone extracts the vehicle features and combines them on a single channel via a feature concatenation. The final detection is carried out by an improved MSVDH that classifies the target vehicles. The proposed method is examined, tested, and evaluated using traffic statistics. It is contrasted with current cutting-edge vehicle detection techniques. It achieves 86.32% mean average precision (mAP) on self-collected diverse traffic labeled dataset (DTLD) and 86.17% mAP on KITTI. Moreover, the real-time performance is validated with NVIDIA Jetson Tx2 and Nano boards. It achieves 15 frames per second (FPS) on Jetson Tx2 and 7 FPS on Jetson Nano.