Multi-frame simultaneous motion estimation and segmentation

Abstract

This study proposes a new approach to jointly perform motion estimation and segmentation in the spatiotemporal domain. An energy functional that embeds the constraints of both the motion estimation and segmentation problems is minimized through the Euler-Lagrange equations yielding a set of descent equations executed via spatiotemporal level-sets representation. The resulting motion field is smooth yet boundary preserving and the motion segmentation map reflects the motion field enhancement.