Multiple Attention Network for Spartina alterniflora Segmentation Using Multitemporal Remote Sensing Images

Abstract

The semantic segmentation of multi-temporal remote sensing images to construct wetland land surface coverage is the basis for the perception and dynamic modeling of geographic scenes. However, the segmentation of Spartina alterniflora (S.alterniflora) in remote sensing images on wetlands faces the problems such as low level for cooperative interpretation in multi-temporal images and high fragmentation in the distribution of S.alterniflora. To solve the issues, a multiple attention network (MARNet) based on transfer learning is proposed. The method is designed with a plug-and-play attention module to enhance the learning of vegetation features and improve the network’s ability to focus on small areas of S.alterniflora. At the same time, MARNet designs the transfer learning architecture from both inter-domain alignment and intra-domain adaptation perspectives,aligning the statistical distribution by using the maximum mean difference (MMD) between the source and target domains, and entropy minimization within the domain of the target domain to enhance the high confidence prediction of this domain. In addition, since the samples have a serious imbalance problem, redundant cutting and splicing steps are employed for the prediction results to prevent the poor edge prediction of some image blocks. Experimental results on three cross-year RSIs datasets demonstrate that the proposed MARNet performs significantly better than other networks and is able to extract S.alterniflora in wetlands more accurately.