SPANet: Successive Pooling Attention Network for Semantic Segmentation of Remote Sensing Images

Abstract

In the convolutional neural network, the precise segmentation of small-scale objects and object boundaries in remote sensing images is a great challenge. As the model gets deeper, low-level features with geometric information and high-level features with semantic information cannot be obtained simultaneously. To alleviate this problem, a successive pooling attention network (SPANet) was proposed. SPANet mainly consists of ResNet50 as the backbone, successive pooling attention module (SPAM) and feature fusion module (FFM). Specifically, SPANet uses two parallel branches to extract high-level features by ResNet50 and low-level features by the first 11 layers of ResNet50. Then, both high-level features and low-level features are fed to the SPAM module, which is mainly composed of a successive pooling operator and a self-attention sub-module, for further extracting deeper multi-scale and salient features. In addition, the low-level features and high-level features after SPAM are fused by FFM to achieve the complementarity of spatial information and geometric information. This fusion module alleviates the problem of accurate segmentation of object edges. Finally, the high-level features and enhanced low-level features of the two branches are fused to obtain the final prediction results. Experiments show that the proposed SPANet achieves a good segmentation effect compared with other models on two remotely sensed data sets.