HUMAN POSTURE RECONSTRUCTION AND ANIMATION FROM MONOCULAR IMAGES BASED ON GENETIC ALGORITHMS

Abstract

The paper aims to propose a new approach towards human posture reconstruction and animation from monocular video sequences that contain any kind of human postures and movements. This is a way towards low cost motion capture and at the same time it avoids many limitations of those classical methods. A parameterized human skeleton model based on anatomy is adopted where the angular constraints are encoded in the joints. Criterion Function is defined to represent the residuals between feature points in the monocular image and the corresponding points resulted from projecting the human model to the projection plane. By transforming each segment of the human model to achieve the minimum value of the Criterion Function, the proper human posture that resembles the one represented by the monocular image can be generated. Different kinds of adjustments are utilized to adjust the body parts into the proper locations and orientations in 3D space without camera calibration. In order to find the optimal solution effectively in a high-dimensional parameter space by considering all the parameters simultaneously, the method of Genetic Algorithms is proposed. A procedure is developed to recover the whole body posture, and then a human animation system is developed to animate a series of human movements from monocular image sequences, during which information between consecutive frames is considered to improve the accuracy. Our technique makes it feasible to reconstruct any possible human postures, and experimental results from many monocular images and video sequences are encouraging.