Shape from Photometric Ratio and Stereo

Abstract

Based on the traditional problem formulation, it is difficult to integrate the two important vision cues, i.e., shading and stereo, for shape reconstruction due to conflicting albedo and image projection assumptions. In this research, we propose a novel scheme to integrate shading and stereo. First, by using the photometric ratio, we derive a new SFS (shape from shading) formulation where no albedo is needed for shape reconstruction. Then, we establish a unified framework for the integration of photometric ratio and stereo by employing perspective projection on a parametric surface via minimizing a cost functional which consists of a weighted sum of shading and stereo errors. Simulation results are given to show the performance of our new robust algorithm.