Multi-level feature fusion in densely connected deep-learning architecture and depth-first search for crack segmentation on images collected with smartphones

Abstract

Cracks are important signs of degradation in existing infrastructure systems. Automatic crack detection and segmentation plays a key role in developing smart infrastructure systems. However, this field has been challenging over the last decades due to irregular shape of the cracks and complex illumination conditions. This article proposes a novel deep-learning architecture for crack segmentation at pixel-level. In this architecture, one convolutional layer is densely connected to multiple other layers in a feed-forward fashion. Max pooling layers are used to reduce the dimensions of the features, and transposed convolution layers are used for multi-level feature fusion. A depth-first search–based algorithm is applied as post-processing tool to remove isolated pixels and improve the accuracy. The method is tested on two previously published data sets. It can reach 92.02%, 91.13%, and 91.58% for the first data set, and 92.17%, 91.61%, and 91.89% for the second data set for precision, recall, and F1 score, respectively. The performance of the proposed method outperforms other state-of-the-art methods. At the end of the article, the influence of feature fusion methods and transfer learning are also discussed.