Efficient 3D scan registration for hand modeling and reconstruction

Abstract

In this paper, we propose a new method for 3D hand scan registration. This method includes two stages: liner blending skinning(LBS) and non-rigid ICP. A template hand mesh model is used to register to the 3D hand scans, which have large pose and shape variations. To fit different types of 3D hand scans, the template model is driven by the skeletons follow the principle of LBS to eliminate pose variations, and then non-rigid ICP is used to deform the template so that shape variations can be eliminated. Finally, template and scan model completely overlap together, and the vertices of template and scan can be matched one by one. We believe that the ability to align a template to each scan is the basis for more in-depth research in future. For example, this work can be used as basis for training pose and shape parameters. With the help of these parameters a template can be used to model any 3D hand in real life just like SMPL[7] for human and SMAL[14] for animals.