Effects of Label Noise on Performance of Remote Sensing and Deep Learning-Based Water Body Segmentation Models

Abstract

Large-scale management of surface water resources in urban areas can be difficult, especially if the region is subject to monsoonal waterlogging. Deep learning-based methods for computer vision tasks, such as image segmentation, can effectively be applied to remote sensing data for generating water body maps of large cities, aiding managerial entities, urban planners and policymakers. The robustness of these models to erroneous pixel level training class labels has not been studied in water body segmentation context. Label noise is commonly experienced in classification tasks and may hinder the performance. We collected and densely labeled Sentinel-2 images over Dhaka, one of the most densely populated and flood prone megacities in the world. We synthetically injected four types of label noise viz., i) Gaussian noise, ii) translation, ii) rotation, and iv) mirroring. Our primary objective is to observe and quantitatively analyze the effects of label noise on remote sensing data-driven deep learning models for water body segmentation. Our results show that salt and pepper noise (injected artificially using Gaussian noise) of only 50% can cause a massive 48.55% drop in Intersection-over-Union score. The consequences of learning from training data with different magnitudes and settings of label noise have been explored.