Scene Flow Estimation Based on 3D Local Rigidity Assumption and Depth Map Driven Anisotropic Smoothness

Abstract

In this paper, we present a novel method to estimate the dense scene flow from the aligned depth map and color image using variational framework. For scene flow estimation, most scenes can be seen as scenes composed by independent 3-D rigid parts, so we apply 3-D local rigidity assumption to data term as a fidelity measure for each pixel. Meanwhile, in order to improve the accuracy of scene flow estimation at the boundaries of motion, we assume that depth map and color image are aligned and utilize the boundaries information of depth map to yield smoothness term which is weighted by a depth map driven anisotropic diffusion tensor. In addition, an efficient numerical algorithm named primal-dual algorithm is implemented for the variational formulation of scene flow estimation. Our method is tested on the Middlebury data sets, and the real-world scene data set captured by KINECT. Experimental results show that our method can receive dense and accurate scene flow and preserve motion boundaries well.