Combining Local and Global Shape Models for Deformable Object Matching

Abstract

We describe a method for modelling and locating deformable objects using a combination of global and local shape models. An object is represented as a set of patches together with a geometric model of their relative positions. The geometry is modelled with a global pose and linear shape model, together with a Markov Random Field (MRF) model of local displacements from the global model. Matching to a new image involves an alternating scheme in which an MRF inference technique selects the best candidates for each point, which are then used to update the parameters of the global pose and shape model. A cascade of increasingly complex models is used to achieve robust matching to new images. We explore the effect of model parameters on system performance and show that the proposed method achieves better accuracy than other widely used methods on standard datasets.