Depth map refinement using multiple patch-based depth image completion via local stereo warping

Abstract

We propose a fusion method for multiple patch-based depth image completion via local stereo warping, in order to refine the disparity map. The false disparities are often extracted from occluded areas and textureless areas in stereo matching due to their ambiguities. Our fusion method iteratively performs the following three steps in order to reconstruct the areas with false disparities. First, we generate a reliability map from the initial disparity map. Second, we extract multiple patch candidates by using the proposed depth image completion. Finally, we verify each patch candidate by using local stereo warping in order to update the reliability map. Experimental results show that the proposed method is very robust for large textureless areas and occluded areas as well because our method yields superior results in comparison to many state-of-the-art methods using stereo matching.