3D human face reconstruction using depth sensor of Kinect 2

Abstract

3D Human Face Reconstruction or 3D Human Face Modeling is a construction of 3D geometry graphics of human face model which has been a very challenging research in both computer vision and computer graphics for over the last three decades. Researchers have proposed many methods for 3D human face reconstruction by using or not using 3D scanner. One of the affordable 3D scanner today is Microsoft Kinect which is well known as a motion sensor add-on for Xbox gaming console. By using the depth sensor of Kinect version 2, 3D human face reconstruction is possible to construct, yet the depth information from Kinect scanning alone may not produce a good quality of 3D model which could lose the details of the 3D face; therefore, the optimization and improvement are needed. This research is mainly aimed to reconstruct the 3D human face model by using a single shot of 3D depth information or point cloud from the depth sensor of Microsoft Kinect version 2, and then, reconstruct with the proposed method including Poisson Surface Reconstruction. The results come as expected and are measured by comparing to the result of the zoomed of original RGB point cloud which looks like a 3D model and to the result of Microsoft 3D applications.