Fast and accurate semantic segmentation of road crack video in a complex dynamic environment

Abstract

ABSTRACT This paper proposes a fast and accurate semantic segmentation of road crack video in a complex dynamic environment. First, a fast key frame selection algorithm is designed by combining the interframe dissimilarity constrained video frame difference method (FDM) and shot interval sampling method (SISM). Second, the complex and dynamic characteristics of application scenarios are studied, and a high-precision crack semantic segmentation DBPNet containing a densely diverse branch module (DDBM) and diverse branch pyramid module (DBPM) is proposed, which can not only focus on the local aggregation of the same scale feature but also fuse and reconstruct long-distance related semantic features. Finally, a dynamic video data set of cracks in complex environments, including multiple types of interference, different weather and lighting is established, and experimental analysis is carried out. The results show that the proposed method can improve the efficiency of video crack detection by 5–7 times compared to the method without using key frames, and the detection accuracy can reach 72.85%, which can adapt to dynamic video changes in a variety of complex scenes. The proposed network, DBPNet, outperforms the current state-of-the-art methods in road crack semantic segmentation on challenging data sets in terms of both Dice and MIOU.