Augmented reality-computer vision combination for automatic fatigue crack detection and localization

Abstract

Fatigue cracks in bridges are inspected visually by specialized bridge inspection professionals. Bridge inspectors conduct inspections in a limited amount of time, and at times small cracks may go unnoticed. Researchers have recently developed computer-based techniques to help overcome these issues. This study uses a computer vision algorithm combined with Augmented Reality (AR) to localize fatigue cracks during the visual inspection that otherwise may go unnoticed because of their size. The AR software utilizes a video processing algorithm for fatigue crack detection. Subsequently, the AR software generates a hologram using the algorithm’s detection result and anchors it over the crack’s location at the structure being inspected. The result of this new methodology is an automatic fatigue crack detection and localization AR software that provides holograms overlaid during the on-site visual inspection. This technique also provides the fatigue crack detection result in near-real-time. The method is verified using 2D and 3D benchmarks and a half-scale steel bridge girder specimen. The research team collected the feedback from bridge industry inspectors contextualized in real operations and their recommendations for integrating AR for inspections with the involvement of human resources and workforce development. This study is the first effort of holographic addressing the fatigue crack on the actual structure using AR headset.