SemiRoadExNet: A semi-supervised network for road extraction from remote sensing imagery via adversarial learning

Abstract

Road extraction from remote sensing imagery is a popular and frontier research focus, since road information plays an essential role in application fields, such as urban management, map updating and traffic planning. Deep learning based methods have shown their dominance on road extraction from remote sensing imagery. However, the performance of the existing road extraction methods relies heavily on a large amount of high-quality annotated training data, which is usually hard to obtain in practice. Current semi-supervised road extraction models can effectively reduce the dependency on the labeled data, nevertheless they cannot fully utilize the latent information of low-confidence pixels in pseudo-labels effectively. These pixels are usually a border between road and non-road area and of importance for the prediction accuracy of road extraction models. In order to address these issues, we proposed a novel semi-supervised road extraction network, named SemiRoadExNet. SemiRoadExNet is based on a Generative Adversarial Network (GAN), containing one generator with two discriminators. Firstly, both labeled and unlabeled images are put into the generator network for road extraction, and the outputs of the generator not only include road segmentation results but also the corresponding entropy maps. The entropy maps represent the confidence of prediction (road or non-road) for each pixel. Then, the two discriminators enforce the feature distributions keeping the consistency of road prediction maps and entropy maps between the labeled and unlabeled data. During the adversarial training, the generator is continuously regularized by exploiting the potential information from unlabeled data, thus the generalization capacity of the proposed model can be improved effectively. Compared to several state-of-the-art semi-supervised semantic segmentation methods, the proposed SemiRoadExNet achieves 0.96–5.38% IoU improvements on DeepGlobe Road Extraction, Massachusetts Roads and CHN6-CUG datasets respectively. The source code of d SemiRoadExNet is freely available at https://github.com/hchen118/SemiRoadExNet.