The number of motorcycle accidents has increased rapidly due to different causes. Helmet is a one of the major safety equipment that helps to reduce the fatal accidents even though many of the motorcyclists are not used that. Currently many researchers have focused on traffic violator detection but they are yet to identify the violated person details as it requires high resolution cameras and expensive sensors for number plate extraction. This research article is focused on comprehensive study on the development of an automated helmet violation detection with number plate extraction in real time. This study divides the dataset into rider with helmet, rider without helmet, passenger with helmet and passenger without helmet classes, and four training model was created to detect helmet in rider and passengers. The proposed model was constructed in three stages to attain high accuracy with a vast amount of training dataset. In the first stage, the helmet was detected in the input image using the deep learning object-detection model .In the second stage, if the helmet identification confirmed in the input image then the entire motorcyclist image is segmented based on object segmentation model. In the third stage, number plate training model is deployed into the same object detection and object segmentation model to identify and segment the license plates in the motorcyclist image. This study primarily incorporates the Mask Region based Convolution Neural Networks (Mask R-CNN) for object detection and segmentation Further, it incorporates the three different deep neural networks like Dense block Network (DenseNet-121), Residual Network (ResNet-101) and Inception Residual Network architecture V2layers (Inception Res Net V2) to create accurate helmet violator detections with more extensive information. The experimental results indicates that this comprehensive helmet violator detection study improves the helmet detection accuracy by 6.2 %.In addition, the above three comprehensive proposed models are evaluated under Wilcoxon rank test for better sensitive information. Further, the less object detection loss (2 %) and significant computational time variation (69 %) indicates the performance of the comprehensive helmet violator detection system was good compared to existing study.
Read full abstract