Fast panoramic 3D shape measurement using the multi-view system with plane mirrors

Abstract

In this paper, we propose a fast panoramic 3D shape measurement technique based on the multi-view system with plane mirrors. Fringe projection profilometry (FPP), as an active 3D measurement technique based on structured light and triangulation, has been one of the most promising methods for measuring dynamic scenes, due to its inherent property of non-contact, full-field, high-precision, and high efficiency. However, for acquiring the 360-degree 3D information of the tested object with complex surfaces, multiple measurements from different perspectives and the complicated registration algorithms need to be implemented, which are time-consuming and low efficiency that limits the potential application of FPP. To solve this problem, by introducing plane mirrors into the traditional FPP system, we develop a mirror-assisted panoramic measurement system, which can capture deformed fringe images of the measured object from three different perspectives simultaneously including a real camera and two virtual cameras realized by plane mirrors. In addition, a robust calibration method is proposed to easily calibrate the mirror, which can be used to convert 3D data obtained from real and virtual perspectives into a common world coordinate system. Then, for low-modulation fringe regions, they are further corrected based on the proposed phase compensation technique. Finally, these proposed techniques constitute a complete computational framework that allows achieving a fast, high-accuracy, and panoramic 3D reconstruction results with high completeness.