Abstract
Light Field (LF) imaging enables many attractive applications since scene angular and spatial information can be captured simultaneously. However, the limited angular resolution hinders its development. To alleviate this problem, in this paper, we put forward a geometry-assisted multi-representation view reconstruction network for LF angular super-resolution. There are two stages in our method, namely multi-representation view reconstruction and geometry-assisted refinement. The former fully utilizes the LF lenslet image, sub-aperture image array, and pseudo video sequence representations to synthesize a high-angular-resolution dense LF image stack by adequately exploring the structural characteristics of such three representations. The latter aims to exploit the intra-LF spatial–angular information and inter-LF geometry information contained in the derived dense LF image stack to further promote the reconstruction performance. Specifically, a bidirectional view stack structure is constituted first, which is then fed into the proposed geometry-aware refinement network to allow adequate interactions between the intra-LF spatial–angular information and inter-LF geometry information. Comprehensive angular reconstruction experiments on both real-world and synthetic LF scenes validate the effectiveness of the proposed method. Furthermore, extensible applications on scene depth estimation also demonstrate that the proposed method can recover more texture details.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.