Deep learning-based 3D shape reconstruction with multi-frequency projection fringes

Abstract

Three dimensional (3D) shape reconstruction based on structured light technique is one of the most crucial and attractive techniques in the field of optical metrology and measurements due to the nature of non-contact and high-precision. Acquiring high-quality 3D shape data of objects with complex surface is an issue that is difficult to solve by single-frequency method. However, 3D shape data of objects with complex surface can be obtained only at a limited accuracy by classical multi-frequency approach. In this paper, we propose a new robust deep learning shape reconstruction (DLSR) method based on the structured light technique, where we accurately extract shape information of objects with complex surface from three fringe patterns with different frequencies. In the proposed DLSR method, the input of the network is three deformed fringe patterns, and the output is the corresponding 3D shape data. Compared with traditional approach, the DLSR method is pretty simple without using any geometric information and complicated triangulation computation. The experimental results demonstrate that the proposed DLSR method can effectively achieve robust, high-precision 3D shape reconstruction for objects with complex surface.