Motion Segmentation from Feature Trajectories with Missing Data

Abstract

This paper presents a novel approach for motion segmentation from feature trajectories with missing data. It consists of two stages. In the first stage, missing data are filled in by applying a factorization technique to the matrix of trajectories. Since the number of objects in the scene is not given and the rank of this matrix can not be directly computed, a simple technique for matrix rank estimation, based on a frequency spectra representation, is proposed. In the second stage, motion segmentation is obtained by using a clustering approach based on the normalized cuts criterion. Finally, the shape Sand motion Mof each of the obtained clusters (i.e., single objects) are recovered by applying classical SFM techniques. Experiments with synthetic and real data are provided in order to demonstrate the viability of the proposed approach.