Convolutional neural networks for urban green areas semantic segmentation on Sentinel-2 data

Abstract

Urban green areas are essential components of any urban environment, providing a wide range of uses. However, there is currently a noticeable absence of an automated tool for their land use classification. The use of urban green areas depends on their size, shape, and relationship with their surroundings, all of which are fundamental features in convolutional neural networks. Various convolutional neural network architectures (FCN, U-Net, SegNet, DeepLabv3+) were evaluated on open and widely accessible Sentinel-2 data for semantic segmentation of land cover and land use in different levels of urban green areas nomenclature and band combinations. Moreover, we compared the CNNs with random forests model as a baseline to underline the CNNs’ strengths. The evaluation found that convolutional neural networks are capable of the land cover and land use semantic segmentation not only on the full-band Sentinel-2 scenes but also on limited subdatasets consisting only of RGB bands. U-Net is identified as the best-performing architecture, achieving an overall accuracy of almost 95% for a simple binary vegetation detection, 90% for the land-use task, and almost 88% for the land-use task enhanced by a distinction between high and low vegetation, while random forests reached 93%, 84%, and 81%, respectively. CNNs’ misclassifications were primarily identified at the edges of two neighbouring competing classes where mixed pixels appear. Data augmentation improved the model’s performance in 94% of cases. However, dropout layers led to an overall accuracy decrease in more than half of the cases. Additionally, we compared the segmented urban green area with a pan-European dataset, the Coordination of Information on the Environment Land Cover - and found that the latter omits 74% of the total urban vegetation. This is mainly due to its minimal mapping unit specification. It is concluded that the most suitable approach for automated urban green areas land cover and land use semantic segmentation is the use of convolutional neural networks, from the tested architectures particularly U-Net.