Three-dimensional reconstruction based on multi-view photometric stereo fusion technology in movies special-effect

Abstract

3D movies have become very popular in recent years. But there are vertical disparities between left and right views of 3D frames due to the lack of accuracy of the mechanical alignment during the shooting. In order to improve accuracy of reconstruction, a three-dimensional reconstruction technology based on multi-view photometric stereo fusion algorithm in movies special-effect production is present in this paper. The original normal is firstly replaced with the surface normal in the average normal, and the reconstructed normal is optimized so as to reduce the deviation of the original surface normal. And then, a reference-plane-based approach is applied to estimate the principle optical axis of each light source as well as its principle radiant energy. For each surface point on the target, the direction and intensity of its incident light ray can be precisely determined by the calibration parameters and the quasi-point light model. Finally, 3D reconstruction of the surface with a quasi-point light source is also implemented in two steps. By estimating the mean value of depth in the iterative process, the surface depth is projected into the physical coordinates. Qualitative and quantitative experimental results show that higher accuracy surface normal as well as better 3D reconstruction quality can be obtained by the proposed approach in comparison with conventional reconstruction methods.