Feedback Network for Compact Thin Cloud Removal

Abstract

The thin cloud removal (CR) technique has great practical value for the application of remote sensing images. Existing deep-learning-based methods have attained remarkable achievements. However, most of them neglect the inherent feature correlations in deeper layers due to learning in a successive manner. In this letter, we propose a compact thin cloud removal network based on the feedback (FB) mechanism, called CRFB-Net, which leverages the high-level features as feedback information to modulate shallow representations. CRFB-Net employs the recurrent architecture to achieve such a feedback scheme. Specifically, the restoration process does not terminate after obtaining an output. In this case, the output of intermediate iterations will flow into the next iteration as feedback. For better utilization of feedback, a multiscale feature fusion block (MFFB) is designed to refine the low-level representations from three scales. Furthermore, we introduce a curriculum learning strategy to train the CRFB-Net by gradually increasing the complexity of restoration, through which a sharper result is produced step by step. Extensive experiments demonstrate the superiority of our CRFB-Net, outperforming state-of-the-art.