Abstract

Super resolution (SR) is essential for the camera-array based infrared light field (IRLF) images. However, the existing SR methods are mainly designed for visible LF images and are unsuitable for IRLF. This is because the sub-aperture images (SAIs) in IRLF hold blurred edges and pixel-level shifts. Artifacts and unbalanced SR performance may exist. In this paper, we propose a novel SR network, named IRLF-SRnet, to mitigate the above problems. It includes two designs: (1) local–global feature enhance-refine strategy, and (2) multi-branch cross-view correlation modeling block. The former uses global features from all SAIs to enhance the local feature from one SAI, which enhances the edges in each SAI implicitly. Then, it refines the global feature with the enhanced local feature, which further refines the edges. The latter first divides and sends the features of SAIs into multiple branches, and then models the cross-view correlation among features in each branch by bidirectional convolutional long-short term memory (BiConvLSTM), so that be aware of the pixel-level shifts. Qualitative and quantitative results show that our method outperforms state-of-the-art methods, with more balanced SR performance and fewer artifacts.

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.