Human Pose Estimation with Multi-Camera Localization Using Multi-Objective Optimization Based on Topological Structured Learning

Abstract

This paper presents a method of pose estimation with camera localization based on a genetic algorithm to derive the joint angle using an inverse kinematics model. In recent years, some open-source libraries for human skeleton tracking that can be implemented on smartphones have been released. Such software can detect joint positions of a skeleton from a 2D camera image; however, the 3D posture cannot be obtained. We therefore propose a method to estimate joint angles by using skeleton data. In the proposed approach, we use a multi-island genetic algorithm to maintain the diversity of the population and design a multi-objective function to improve the robustness. Moreover, structured learning based on topological mapping is implemented in the proposed method to enhance searching efficiency. In an experiment, the proposed method reduced the effect of outliers caused by misdetection. In addition, the structured learning was effective in decreasing the difference between skeleton data and the estimated poses.