Single image deraining via decorrelating the rain streaks and background scene in gradient domain

Abstract

Single image based rain removal is very challenging due to the lack of temporal and context information, and the existing techniques are usually unpractical in real-time applications as they are time-consuming, and make images blurred in varying degrees. To tackle this issue, this paper proposes a novel framework, based on a new observation that the background has a reasonably low correlation with rain streaks in gradient domain. The framework mainly contains three steps: 1) a rain-free direction with respect to a rain image or a block therein is proposed, describing the fact that there exists a direction along which the image is least-affected in gradient domain; 2) by combing total variation, low-rank constraint and a de-correlation term, a novel decomposition model is proposed to explicitly extract the rain and rain-free gradient components along the direction perpendicular to the just calculated rain-free direction; 3) the rain-free image is reconstructed using Poisson equation, which effectively resists the sparse noise contained in gradients. The favorable performance of the proposed framework has been confirmed by many experimental results, and especially the computational complexity is low.