On 3-D Motion Estimation From Feature Tracks in 2-D FS Sonar Video

Abstract

Visual odometry involves the computation of 3-D motion and (or) trajectory by tracking features in the video or image sequences recorded by the camera(s) on some autonomous terrestrial, aerial, and marine robotics platform. For exploration, mapping, inspection, and surveillance operations within turbid waters, high-frequency 2-D forward-scan sonar systems offer a significant advantage over cameras by providing both imagery with target details and attractive tradeoff in range, resolution, and data rate. Operating these at grazing incidence gives larger scene coverage and improved image quality due to the dominance of diffuse backscattered reflectance but induces cast shadows that are typically more distinct than brightness patterns due to the direct reflectance of casting objects. For the computation of 3-D motion by automatic video processing, the estimation accuracy and robustness can be enhanced by integrating the visual cues from shadow dynamics with the image flow of stationary 3-D objects, both induced by sonar motion. In this paper, we present the mathematical models of image flow for 3-D objects and their cast shadows, utilize them in devising various 3-D sonar motion estimation solutions, and study their robustness. We present results of experiments with both synthetic and real data in order to assess the accuracy and performance of these methods.