Automatic Outer Contour Detection and Quantification of Vehicles Using Monocular Vision

Abstract

Oversized vehicles have the potential to collide with walls or ceilings when passing through tunnels and bridges, posing a serious threat to the health of transportation infrastructure and public safety. Hence, it is crucial to accurately and immediately detect vehicle dimensions, including length, width, and height, to avoid such accidents. Using computer vision and view geometry, this study presents a framework for automatically detecting and quantifying the outer contours of vehicles through monocular vision. First, traffic scene images are captured which are then used to create a transformation matrix of the ground surface. Second, a modified Mask region-based convolutional neural network (Mask R-CNN) is constructed to detect and segment the vehicle instances from the video frames. Finally, a view geometry-based algorithm was developed to detect the outer contours of passing vehicles and quantify their dimensions. In the field test, the accuracy of the vehicle segmentation and the identified vehicle dimensions was validated. In addition, the proposed method’s superiority was confirmed by comparing it with two other existing approaches. The comparison results show that the proposed method has better accuracy and is more convenient to use since it does not require a premeasured reference. In addition, the developed method can accurately identify not only the dimensions of vehicles parallel to the road but also vehicles that are changing lanes or making a U-turn.