High precision light field image depth estimation via multi‐region attention enhanced network

Abstract

AbstractLight field (LF) depth estimation is a key task with numerous practical applications. However, achieving high‐precision depth estimation in challenging scenarios, such as occlusions and detailed regions (e.g. fine structures and edges), remains a significant challenge. To address this problem, the authors propose a LF depth estimation network based on multi‐region selection and guided optimisation. Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, the guided optimisation leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Experiments demonstrate the effectiveness of network on the HCInew dataset, especially in handling occlusions and detailed regions.