Abstract

Daily inspection of ground crack over mine goaf is a necessary task for environmental protection and mining safety. However, the traditional manual inspection method is time-consuming, misjudgement-prone and with potential dangers because the goaf normally locates in remote regions and inevitably induces complicated and gullies-cross landform. Therefore, Unmanned Aerial Vehicle(UAV) is adopted to capture aerial images of the ground crack, which provides a convenient way for goaf inspection. Though aerial images display a full view for the region containing cracks, the rugged terrain results in rich noises that have the similar characteristics with cracks in an image, such as shadow, cliff, terrace and so on, which may lead to misclassification of cracks. To overcome the obstacles, an improved semantic segmentation framework called MSI-FCN is proposed in the paper. Firstly, a statistic pre-processing method is employed to remove useless patches before training, with the purpose of decreasing the training complexity. Following that, a multi-scale input method is applied to integrate the patches with the output tensor of each stage based on FCN, which precisely recognizes pixel-level crack. Furthermore, a multi-scale connection module is constructed to select the most important contextual information from the features under multiple scales and help for recovering high-dimension features. In particular, a statistic weighted softmax cross-entropy loss function is presented so as to classify crack pixels more rationally. The experimental results for three groups of images under various environmental conditions indicate that MSI-FCN is superior to the FCN-8, FCD-56 and DeepCrack-GF. In addition, the proposed method also shows high performance on CFD and deepcrack dataset. Thus, multi-scale information embedded in the proposed method can provide more local details of low-level features to high-level stages and improve the recognition performances.

Highlights

  • Ground cracks are gradually formed on the surface of the earth after the underground coal are mined out

  • In experiment I, the proposed algorithm is compared with the other methods, including fully convolutional DenseNet with 56 layers (FCD-56) [41], modified FCN-8 based on VGG-16 [32], and DeepCrack with guided filter (DeepCrack-GF) [33]

  • UAV is employed to capture aerial images about ground crack, which provides a convenient way for its detection

Read more

Summary

INTRODUCTION

Ground cracks are gradually formed on the surface of the earth after the underground coal are mined out. To deal with the problems, we present a Fully Convolutional Network with Multi-Scale Input (MSI-FCN), with the purpose of fully utilizing low-level features in images to enrich the high-level information of the network We construct this framework for detecting ground cracks, it’s appropriate for the other crack recognition. To tackle the weakness of traditional overlap sliding window methods, we propose the statistic-based pre-processing method to remove the useless patches that contain less information about cracks, with the purpose of increasing the proportion of cracks pixels and decreasing the computation complexity of the training process. The colored images embody more effective information for training the network, and many noises, such as plant and tree shadow, have the distinct color characteristics This feature will be lost during the transformation process from the RGB-based color images to the gray ones, which is unfavorable to the recognition performance

TOP-DOWN FEATURE EXTRACTION PATH WITH MULTI-SCALE INPUT
STATISTIC-BASED WEIGHTED LOSS FUNCTION
EXPERIMENTS
THE INDICATORS OF EVALUATING A METHOD
CONCLUSION
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call