Multi-Scale Interaction Network for Low-Light Stereo Image Enhancement

Abstract

Low-light stereo image enhancement (LLSIE) is a task that improves the visual quality of stereo images captured in low-light environment. The core idea of LLSIE is to exploit the cross-view cues for enhancing the stereo image pairs. However, LLSIE is still a challenging task due to the perspective difference and insufficient information interaction between left and right views. In this paper, we propose a novel Multi-Scale Interaction Network (MSINet) for LLSIE. To be specific, we present a new multi-scale stereo Interaction module (MIM), which can promote the multi-scale cross-view information flow. Firstly, MIM extracts multi-scale features from both the left and right views. Then, the features from two views are fused in different scales, so that the information from stereo image pairs can be fully exchanged. Compared to the existing parallax attention module (PAM), our MIM explores the cross-view interaction in multiple scales with less computational cost more sufficiently. Besides, we also develop a new Spatial Gating Block (SGB) for refining intra-view features. By incorporating the long residual and spatial gating mechanism, SGB is capable of completing dynamic spatial modeling and obtaining strong feature representations. Extensive experiments on the Flickr1024, KITTI 2015 and Middlebury datasets show that the proposed MSINet reaches SOTA performance and obtains better visual results than other compared methods.