Weight-Flooding Aggregation with Canny Edge Constraint for 3D Depth Estimation

Abstract

Considering the computation efficiency, local based 3D depth estimation has been considered of higher potential compared with global based methods. The most well recognized local based 3D depth estimation is the cross-based approach, which computes a local region for each pixel, called the support region, and the cost aggregation for the pixel is conducted within the support region. However, due to the optimization is conducted only within the support region, it also has less accuracy performance. Furthermore, obtaining the support region requires a significant computing power. In view of these problems, this paper proposes a novel local based method using weight-flooding aggregation for cost optimization in 3D depth estimation. The weightflooding aggregation performs in a global way, such that every pixel transfers its cost to its neighboring pixels through a weight map. Accompanied with the weight-flooding aggregation is an edge based restriction to reduce the cost influences from other objects during the propagation. Any propagation passing through the edge will be stopped. The propagation in the flooding is performed from a gradual collection. Thus part of the flooding propagation to a pixel can be reused by the neighboring pixels and an integral computing can be applied. By so designed, the pixel optimization is allowed to receive costs globally, achieving high accuracy. Also, the lift of the requirement of obtaining support region for each pixel and the feasibility of applying integral computing significantly reduces the time complexity. In this paper, the L-R check is adopted as a post processing to rectify the errors which may result from mismatch due to occlusion or noise. The experimental results show that compared to cross-based local method, the system requires only half to onethird computing cost while achieves comparable estimation accuracy.