3D Human Body Reconstruction from a Single Image

Abstract

In this paper, a generative adversarial network based on SMPL model is used to reconstruct three-dimensional (3D) human mesh from a single image. The generative adversarial network consists of two parts (generative network and adversarial network). The generative network is made up of a deep residual network and a multilayer perception network. The goal is to generate suitable SMPL model parameters and camera parameters which fit the 2D and 3D position annotation of human skeleton joints. The adversarial network judges whether the shape and pose parameters generated by the generative network match the real human body through a discriminator. The purpose is to guide the generative network output parameters that conform to the laws of human kinematics. A geometric prior of the 3D joint angle limitation of the human body is introduced into the network to further constrain the generated human pose. Experiments verify the effectiveness of the algorithm.