Abstract

Removing rain streaks from a single image continues to draw attentions today in outdoor vision systems. In this paper, we present an efficient method to remove rain streaks. First, the location map of rain pixels needs to be known as precisely as possible, to which we implement a relatively accurate detection of rain streaks by utilizing two characteristics of rain streaks.The key component of our method is to represent the intensity of each detected rain pixel using a linear model: $p=\alpha s + \beta$, where $p$ is the observed intensity of a rain pixel and $s$ represents the intensity of the background (i.e., before rain-affected). To solve $\alpha$ and $\beta$ for each detected rain pixel, we concentrate on a window centered around it and form an $L_2$-norm cost function by considering all detected rain pixels within the window, where the corresponding rain-removed intensity of each detected rain pixel is estimated by some neighboring non-rain pixels. By minimizing this cost function, we determine $\alpha$ and $\beta$ so as to construct the final rain-removed pixel intensity. Compared with several state-of-the-art works, our proposed method can remove rain streaks from a single color image much more efficiently - it offers not only a better visual quality but also a speed-up of several times to one degree of magnitude.

Highlights

  • Because of rain’s high reflection to light, rain usually is imaged as bright streaks in an image and influences the visual quality of the image

  • In [27], we proposed a rough detection method of rain streaks based on the fact that the intensity of a rain pixel is usually larger than its neighboring non-rain pixels

  • In this paper, we derive a simple linear model p = αs + β to describe the physical principle of imaging rain pixels

Read more

Summary

INTRODUCTION

Because of rain’s high reflection to light, rain usually is imaged as bright streaks in an image and influences the visual quality of the image. Kim et al [18] detected rain streaks in a single image by combining an elliptical shape model of rain and a kernel regression method [38] They removed rain streaks by a non-local mean filter [39]. Fu et al extended ResNet to a deep detail network that reduces the input-to-output mapping range and makes the learning process easier [10], whereas the de-rained result is further improved by using some image-domain priori knowledge They built DerainNet to remove rain streaks [13] in which they use the high-frequency part of an image rather than the image itself during the training process. We follow this approach but optimize it by utilizing the color characteristics of rain to reduce the mis-detection of non-rain details.

A LINEAR MODEL AND ITS OPTIMIZATION
OPTIMIZATION
DETAILED EXPERIMENTAL RESULTS
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.