Abstract

Poor road-surface conditions pose a significant safety risk to vehicle operation, especially in the case of autonomous vehicles. Hence, maintenance of road surfaces will become even more important in the future. With the development of deep learning-based computer image processing technology, artificial intelligence models that evaluate road conditions are being actively researched. However, as the lighting conditions of the road surface vary depending on the weather, the model performance may degrade for an image whose brightness falls outside the range of the learned image, even for the same road. In this study, a semantic segmentation model with an autoencoder structure was developed for detecting road surface along with a CNN-based image preprocessing model. This setup ensures better road-surface crack detection by adjusting the image brightness before it is input into the road-crack detection model. When the preprocessing model was applied, the road-crack segmentation model exhibited consistent performance even under varying brightness values.

Highlights

  • Electronics 2021, 10, 1402. https://To ensure driver safety and smooth vehicle operation, the road surface must always be maintained in a good condition

  • Computer vision problems based on deep learning can be classified into image classification [1,2,3,4], object detection [5,6,7], semantic segmentation [8,9], instance segmentation [10,11,12], and panoptic segmentation [13,14]

  • In this study, we developed a fully convolutional network (FCN) model that semantically divides the damaged road pixels on a road-surface image and a convolutional neural network (CNN) model that automatically provides an image-brightness-control variable to enable the developed FCN model to achieve the best detection performance

Read more

Summary

Introduction

To ensure driver safety and smooth vehicle operation, the road surface must always be maintained in a good condition. Tane et al [26] developed a crack detector based on Mask R-CNN by training 352 original and annotated crack images It appears that there are an inadequate number of image datasets suitable for training instance segmentation models for the crack detection problem. Even for the same surface damage at the same location, if the external environmental changes and leads to a change in brightness levels with respect to the training images, the damage may not be detected To address this issue, in this study, we developed a fully convolutional network (FCN) model that semantically divides the damaged road pixels on a road-surface image and a CNN model that automatically provides an image-brightness-control variable to enable the developed FCN model to achieve the best detection performance.

Development of a Road-Surface Crack Detection Model
Schematic
Model Training and Dataset Configuration for Testing
Learning Results by the Model
F1-score
Structure
Structure of Preprocessing
Training Dataset for the Image Preprocessing Model
Performance
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call