3D pipe reconstruction employing video information from mobile robots

Abstract

The development of a virtual scenario is desirable in many hostile environments such as in mining or sewer pipelines to inspect its current condition and to identify possible failures. Obtaining a virtual image through the reconstruction of the mineshaft or the inner pipe is a valuable tool for assessment and fault detection. The approach presented in this paper uses a fuzzy controlled robot so that the video information can reliably be taken. The robot fuzzy control guarantees its motion in a straight line while taking the images from the pipe. The control algorithm therefore prevents the robot from overturning while moving inside the pipe. Results from our 3D reconstruction approach using the autonomous mobile robot is presented. The proposed method overcomes the limitations of different detectors by using a novel combination of DoG and Harris Laplace. Once the frame selection is made, then the regions with affine transformations are used to find image features as correspondences using image descriptors such as SIFT (Scale-Invariant Feature Transform). The correspondences are required to obtain the orientation and position of the camera and to obtain the scene structure leading to the creation of the 3D virtual environment. The 3D reconstruction method outperformed similar commercial software which highlights its potential.