Reference-based super-resolution reconstruction of remote sensing images based on a coarse-to-fine feature matching transformer

Abstract

Remote sensing image super-resolution reconstruction technology mines the deep details of remote sensing image, which has been widely used in the fields of intelligent and precise agriculture, intelligent transportation, earth surface object recognition, and so on. To obtain more detailed information,we design a reference-based super-resolution reconstruction network. Firstly, the coarse-to-fine feature matching strategy is adopted for the features of the input image. Global coarse matching is performed on the center patch of each block, and then pixel-level local fine matching is performed on the edge patches of the block. This both reduces the amount of computation and improves the matching accuracy. A threshold is set to determine whether the feature matching results meet the criteria for feature transfer. Finally, different scale features are fused through several convolutional layers and sampling operations, obtaining the reconstruction features after a fourfold increase in resolution. The ultimate super-resolution image is generated through a decoder. We have performed training and testing on remote sensing datasets. Compared to the current state-of-the-art methods, our proposed method is visually more details and outperforms other methods in terms of objective evaluation metrics.