Recursive attention collaboration network for single image de‐raining

Abstract

AbstractSingle‐image rain removal is an important problem in the field of computer vision aimed at recovering clean images from rainy images. In recent years, data‐driven convolutional neural network (CNN)‐based rain removal methods have achieved significant results, but most of them cannot fully focus on the contextual information in rain‐containing images, which leads to the failure of recovering some of the background details of the images that have been corrupted due to the aggregation of rain streaks. With the success of Transformer‐based models in the field of computer vision, global features can be easily acquired to better help recover details in the background of an image. However, Transformer‐based models often require a large number of parameters during the training process, which makes the training process very difficult and makes it difficult to apply them to specific devices for execution in reality. The authors propose a Recursive Attention Collaboration Network, which consists of a recursive Swin‐transformer block (STB) and a CNN‐based feature fusion block. The authors designed the Recursively Integrate Transformer Block (RITB), which consists of several STBs recursively connected, that can effectively reduce the number of parameters of the model. The final part of the module can integrate the local information from the STBs. The authors also design the Feature Enhancement Block, which can better recover the details of the background information corrupted by rain streaks of different density shapes through the features passed from the RITB. Experiments show that the proposed network has an effective rain removal effect on both synthetic and real datasets and has fewer model parameters than other mainstream methods.