A robust method for recovering geometric proxy from multiple panoramic images

Abstract

The use of multiple panoramic images for walkthrough applications is attracting more attention in recent years. The geometric proxy, which can be recovered from wide-baseline images can be used to reduce the sampling rate. However correspondence matching across widely separated panoramic images requires searching a large disparity range, which can significantly increase the number of false matches. In addition, 3D point estimation along the antipodal direction of panoramic images is unreliable due to small vergence angle. Moreover, existing methods only recover 3D points, which do not provide information about object continuity in the scene. In this paper, we propose a robust method for recovering geometric proxy of a scene from multiple wide-baseline panoramic images. Correspondences are matched under the epipolar constraint. A robust algorithm is developed to remove false matches and estimate a set of reliable sparse 3D points. We further recover information about object continuity with topology and pattern similarity checking.