3D reconstruction of specular surfaces using a calibrated projector–camera setup

Abstract

Structured light is widely used for shape measurement of beamless surfaces using the triangulation principle. In the case of specular surfaces deflectometry is an appropriate method. Hereby the reflection of a light pattern is observed by a camera. The distortion of the reflected pattern is evaluated to obtain information about the reflecting surface. An important requirement for a 3d reconstruction of a specular surface by deflectometry is a calibrated measurement setup. We propose a method for the overall calibration of a setup consisting of a structured light source, a projection screen and a camera. We consider all extrinsic and intrinsic parameters for the optical mapping including a distortion model for the projector and for the camera, respectively. Given the deflectometric data obtained by the calibrated setup two methods are described which allow the 3d reconstruction of points on a specular surface. This is not trivial as a reconstruction using solely deflectometric data shows ambiguity. In the first method screen displacement between two deflectometric measurements is used to overcome this ambiguity. In the second method curvature-like features on the surface are determined to serve as starting points for a region growing approach. Results of the reconstruction of a specular surface are shown and the performance of the described reconstruction methods are compared to each other.