Surface Reconstruction Techniques Using Neural Networks to Recover Noisy 3D Scenes

Abstract

This paper presents a novel neural network approach to recovering of 3D surfaces from single gray scale images. The proposed neural network uses photometric stereo to estimate local surfaces orientation for surfaces at each point of the surface that was observed from same viewpoint but with different illumination direction in surfaces that follow the Lambertian reflection model. The parameters for the neural network are a 3x3 brightness patch with pixel values of the image and the light source direction. The light source direction of the surface is calculated using two different approaches. The first approach uses a mathematical method and the second one a neural network method. The images used to test the neural network were both synthetic and real images. Only synthetic images were used to compare the approaches mainly because the surface was known and the error could be calculated. The results show that the proposed neural network is able to recover the surface with a highly accurately estimate.KeywordsNeural networks3D surfacesreconstructionnoisy sceneslight sources