Deformation Weight Constraint and 3D Reconstruction of Nonrigid Objects

Abstract

The problem of 3D reconstruction of nonrigid objects from uncalibrated image sequences is addressed in the paper. Our method assumes that the nonrigid object is composed of rigid part and deformation part. We first recover the affine structure of the object and separate the rigid features from the deformation ones. Then stratify the structure from affine to Euclidean space by virtue of the rigid features. The novelty of the paper lies in two aspects. First, we propose a deformation weight constraint to the problem and prove that the recovered shape bases and shapes are transformation invariant under this constraint. Second, we propose a constrained power factorization (CPF) algorithm to recover the deformation structure in affine space. The algorithm overcomes the limitations of previous SVD-based methods and can work with missing data in the tracking matrix. Extensive experiments on synthetic data and real sequences validate the proposed method and show improvements over existing solutions.