Monocular three-dimensional human pose estimation using local-topology preserved sparse retrieval

Abstract

Estimating three-dimensional (3-D) pose from a single image is usually performed by retrieving pose candidates with two-dimensional (2-D) features. However, pose retrieval usually relies on the acquisition of sufficient labeled data and suffers from low retrieving accuracy. Acquiring a large amount of unconstrained 2-D images annotated with 3-D poses is difficult. To solve these issues, we propose a coupled-source framework that integrates two independent training sources. The first source contains only 3-D poses, and the second source contains images annotated with 2-D poses. For accurate retrieval, we present a local-topology preserved sparse coding (LTPSC) to generate pose candidates, where the estimated 2-D pose of a test image is regarded as features for pose retrieval and represented as a sparse combination of features in the exemplar database. Our LTPSC can ensure that the semantically similar poses are retrieved with larger probabilities. Extensive experiments validate the effectiveness of our method.