Local Edge Structure Guided Depth Up-Sampling

Abstract

AbstractThe current depth up-sampling cannot effectively using the pixel correlation and the edge structure between depth map and color map. In this paper, we proposes a new depth up-sampling method based on the local edge structure. Firstly, the non-robust pixel refinement in the low resolution (LR) depth image is obtained from the LR sobel-based edge map. Then, the structural consistency judgment within the depth map and the color map and the pixels classification is implemented with the guidance of the gradient matrix of the high resolution (HR) color image. Finally, according to the influence between pixels and spatial location constraints, the depth map is refined by the effective depth. Extensive experiments demonstrate that the proposed method outperforms conventional interpolation algorithms and some other edge-based depth up-sampling methods.KeywordsDepth imageUp-samplingEdge structureDepth refinement