Remote Sensing Image Change Detection Research Articles

DEST: Difference enhanced-Swin Transformer for remote sensing change detection

ABSTRACT Remote sensing (RS) change detection (CD) has recently achieved remarkable success thanks to convolutional neural networks (CNNs). However, due to the limited receptive fields of CNN models, existing methods are prone to generating pseudo detections or missed detections. In this letter, we propose a difference enhanced-Swin Transformer network (DEST) for accurate and robust change detection in RS images. First, we design a difference enhancement module (DEM) in the feature extraction stage to boost the feature learning of differences for dual-temporal images at each level. Second, to enlarge the receptive fields of networks and capture more changed details, we apply a Swin Transformer module to the difference features to model the global contextual information. Third, to avoid the semantic loss and simultaneously solve the problem of uneven contributions of features at different levels, we design a feature weight fusion module (FWFM) to effectively aggregate multi-level feature difference maps. Extensive experimental results on two publicly available benchmarks demonstrate that the proposed method is superior to some state-of-the-art change detection models.

A GAN-based cyclic iterative unsupervised change detection network

ABSTRACT Remote sensing image change detection has significant applications across various fields. In recent years, the powerful feature extraction capability of deep learning technology has introduced innovative approaches to change detection methodologies. However, the accuracy of convolutional neural network algorithms hinges heavily on labelled data, necessitating substantial manpower and resources to generate labelled samples. Therefore, this paper proposes an unsupervised change detection model called CIUCD. This model operates on the fundamental premise of unsupervised change detection, employing a generator and a segmenter for iterative training. During each iteration, the generator and segmenter update and optimize their parameters, with the segmenter leveraging the generated change images as labels for training purposes. This iterative labelling process circumvents the need for manually labelled data, thereby mitigating the difficulty of obtaining change detection labels for actual remote sensing images. To validate the efficacy of the proposed model, we conducted experiments using actual remotely sensed images from the 2023 Turkey earthquake and the 2022 Afghanistan earthquake events. The results show that our method enhances the F1, Pr, Re and OA by 5.98%, 2.05%, 11.82% and 8.50% (Turkey earthquake), and by 9.54%, 5.87%, 4.52% and 11.34% (Afghanistan earthquake), respectively, when compared to the unsupervised change detection algorithm KPCA-Mnet. Experiments on real remote sensing images of 1000 × 1000 pixels showed that the CIUCD algorithm not only accurately detect larger change areas but is also capable of identifying changes in subtle objects such as solar panels. Additionally, the CIUCD algorithm is resilient to natural environmental factors like the angle of illumination, enabling precise predictions of changes in the actual remote sensing images and yielding clearer detection results. The performance of the CIUCD algorithm remains outstanding even when applied to larger images with a resolution of 3000 × 3000 pixels.

Bidirectional-enhanced transformer network with channel weighting feature fusion for remote sensing image change detection

Bidirectional-enhanced transformer network with channel weighting feature fusion for remote sensing image change detection

MATNet: Multilevel attention-based transformers for change detection in remote sensing images

Remote sensing image change detection is crucial for natural disaster monitoring and land use change. As the resolution increases, the scenes covered by remote sensing images become more complex, and traditional methods have difficulties in extracting detailed information. With the development of deep learning, the field of change detection has new opportunities. However, existing algorithms mainly focus on the difference analysis between bi-temporal images, while ignoring the semantic information between images, resulting in the global and local information not being able to interact effectively. In this paper, we introduce a new transformer-based multilevel attention network (MATNet), which is capable of extracting multilevel features of global and local information, enabling information interaction and fusion, and thus modeling the global context more effectively. Specifically, we extract multilevel semantic features through the Transformer encoder, and utilize the Feature Enhancement Module (FEM) to perform feature summing and differencing on the multilevel features in order to better extract the local detail information, and thus better detect the changes in small regions. In addition, we employ a multilevel attention decoder (MAD) to obtain information in spatial and spectral dimensions, which can effectively fuse global and local information. In experiments, our method performs excellently on CDD, DSIFN-CD, LEVIR-CD, and SYSU-CD datasets, with F1 scores and OA reaching 95.67%∕87.75%∕90.94%∕86.82% and 98.95%∕95.93%∕99.11%∕90.53% respectively.

Siamese InternImage for Change Detection

For some time, CNN was the de facto state-of-the-art method in remote sensing image change detection. Although transformer-based models have surpassed CNN-based models due to their larger receptive fields, CNNs still retain their value for their efficiency and ability to extract precise local features. To overcome the limitations of the restricted receptive fields in standard CNNs, deformable convolution allows for dynamic adjustment of sampling locations in convolutional kernels, improving the network’s ability to model global contexts. InternImage is an architecture built upon deformable convolution as its foundational operation. Motivated by InternImage, in this paper, a CNN-based change detection vision foundation model is proposed. By introducing deformable convolution into Siamese InternImage architecture, the proposed CNN-based change detection vision foundation model is capable of capturing long-range dependencies and global information. A refinement block is utilized to merge local detail, where channel attention is incorporated. The proposed approach achieved excellent performance on the LEVIR-CD and WHU-CD datasets.

Fine-Grained High-Resolution Remote Sensing Image Change Detection by SAM-UNet Change Detection Model

Remote sensing image change detection is crucial for urban planning, environmental monitoring, and disaster assessment, as it identifies temporal variations of specific targets, such as surface buildings, by analyzing differences between images from different time periods. Current research faces challenges, including the accurate extraction of change features and the handling of complex and varied image contexts. To address these issues, this study proposes an innovative model named the Segment Anything Model-UNet Change Detection Model (SCDM), which incorporates the proposed center expansion and reduction method (CERM), Segment Anything Model (SAM), UNet, and fine-grained loss function. The global feature map of the environment is extracted, the difference measurement features are extracted, and then the global feature map and the difference measurement features are fused. Finally, a global decoder is constructed to predict the changes of the same region in different periods. Detailed ablation experiments and comparative experiments are conducted on the WHU-CD and LEVIR-CD public datasets to evaluate the performance of the proposed method. At the same time, validation on more complex DTX datasets for scenarios is supplemented. The experimental results demonstrate that compared to traditional fixed-size partitioning methods, the CERM proposed in this study significantly improves the accuracy of SOTA models, including ChangeFormer, ChangerEx, Tiny-CD, BIT, DTCDSCN, and STANet. Additionally, compared with other methods, the SCDM demonstrates superior performance and generalization, showcasing its effectiveness in overcoming the limitations of existing methods.

Frequency-driven transformer network for remote sensing image change detection

Frequency-driven transformer network for remote sensing image change detection

Laddering vision foundation model for remote sensing image change detection

Laddering vision foundation model for remote sensing image change detection

Remote Sensing Image Change Detection Based on Deep Learning: Multi-Level Feature Cross-Fusion with 3D-Convolutional Neural Networks

Remote Sensing Image Change Detection Based on Deep Learning: Multi-Level Feature Cross-Fusion with 3D-Convolutional Neural Networks

DMF2Net: Dynamic multi-level feature fusion network for heterogeneous remote sensing image change detection

With the rapid development of remote sensing data fusion technology, heterogeneous remote sensing image (HRSI) change detection (CD) has become a frontier field. The powerful nonlinear information processing capability of deep neural network provides the possibility for image domain conversion of HRSIs. However, the majority of existing methods rely on stacking network layers to extract deep high-level semantic features to accomplish the mutual conversion of image domains. The effective extraction and utilization of shallow features have not been fully considered. At the same time, the dependence between deep and shallow features has not been deeply explored. Therefore, these algorithms severely restrict the performance of CD. A new HRSI-CD network (DMF2Net) based on multi-level feature fusion is proposed in this paper to address these issues. DMF2Net uses central difference convolution to extract fine-grained features from shallow layers of images. It is capable of capturing the intrinsic detail features of image by aggregating intensity and gradient information. The dynamic multi-level feature fusion method is used to learn the fusion weights from the features, which are then used to guide the organic fusion of shallow and deep semantic features. This can preserve more position and detail features of the image, which can prevent the loss of small data during image conversion and enhance the model’s ability to detect subtle changes. On this basis, a new DMF2Net-based method for detecting change in bi-temporal HRSIs is proposed. We conducted extensive experiments on four publicly available HRSI-CD datasets. The experimental results showed that the proposed CD framework achieves significant improvement over the most advanced methods. The project file of the proposed framework will be obtained from https://github.com/cwlnnu/DMF2Net.

Guided filter-based self-supervised remote sensing image change detection with global contrast

Guided filter-based self-supervised remote sensing image change detection with global contrast

Remote Sensing Image Change Detection Combined With Saliency

Remote Sensing Image Change Detection Combined With Saliency

Multi-Scale Fusion Siamese Network Based on Three-Branch Attention Mechanism for High-Resolution Remote Sensing Image Change Detection

Remote sensing image change detection (CD) is an important means in remote sensing data analysis tasks, which can help us understand the surface changes in high-resolution (HR) remote sensing images. Traditional pixel-based and object-based methods are only suitable for low- and medium-resolution images, and are still challenging for complex texture features and detailed image detail processing in HR images. At present, the method based on deep learning has problems such as inconsistent fusion and difficult model training in the combination of the difference feature information of the deep and shallow layers and the attention mechanism, which leads to errors in the distinction between the changing region and the invariant region, edge detection and small target detection. In order to solve the above problems of inconsistent fusions of feature information aggregation and attention mechanisms, and indistinguishable change areas, we propose a multi-scale feature fusion Siamese network based on attention mechanism (ABMFNet). To tackle the issues of inconsistent fusion and alignment difficulties when integrating multi-scale fusion and attention mechanisms, we introduce the attention-based multi-scale feature fusion module (AMFFM). This module not only addresses insufficient feature fusion and connection between different-scale feature layers, but also enables the model to automatically learn and prioritize important features or regions in the image. Additionally, we design the cross-scale fusion module (CFM) and the difference feature enhancement pyramid structure (DEFPN) to assist the AMFFM module in integrating differential information effectively. These modules bridge the spatial disparity between low-level and high-level features, ensuring efficient connection and fusion of spatial difference information. Furthermore, we enhance the representation and inference speed of the feature pyramid by incorporating a feature enhancement module (FEM) into DEFPN. Finally, the BICD dataset proposed by the laboratory and public datasets LEVIR-CD and BCDD are compared and tested. We use F1 score and MIoU values as evaluation metrics. For AMBMFNet, the F1 scores on the three datasets are 77.69%, 81.57%, and 77.91%, respectively, while the MIoU values are 84.65%, 85.84%, and 84.54%, respectively. The experimental results show that ABMFNet has better effectiveness and robustness.

T-UNet: triplet UNet for change detection in high-resolution remote sensing images

ABSTRACT Remote sensing image change detection aims to identify differences between images acquired at different times in the same area, crucial for land management, environmental monitoring, and disaster assessment. Current change detection methods mainly use Siamese or early fusion structures. Siamese networks focus on object features at different times but lack attention to change information, leading to false alarms and missed detections. Early fusion structures focus on fused features but neglect temporal object features, hindering accurate change detection. To address these issues, we propose a novel network, Triplet UNet (T-UNet), employing a triplet encoder to simultaneously extract object features and change features between the pre- and post-time-phase images. To effectively interact features extracted from the three branches of triplet encoder, we propose a multi-branch spatial-spectral cross-attention module. In the decoder, we employ channel attention and spatial attention mechanisms to fully mine and integrate detailed texture and semantic localization information. The proposed T-UNet surpasses seven other state-of-the-art methods on three publicly available datasets. Extensive experiments verify the effectiveness of the proposed structure and modules as well as the superiority of the proposed T-UNet. The source code for the proposed T-UNet is accessible at https://github.com/Pl-2000/T-UNet.

Multistage Interaction Network for Remote Sensing Change Detection

Change detection in remote sensing imagery is vital for Earth monitoring but faces challenges such as background complexity and pseudo-changes. Effective interaction between bitemporal images is crucial for accurate change information extraction. This paper presents a multistage interaction network designed for effective change detection, incorporating interaction at the image, feature, and decision levels. At the image level, change information is directly extracted from intensity changes, mitigating potential change information loss during feature extraction. Instead of separately extracting features from bitemporal images, the feature-level interaction jointly extracts features from bitemporal images. By enhancing relevance to spatial variant information and shared semantic channels, the network excels in overcoming background complexity and pseudo-changes. The decision-level interaction combines image-level and feature-level interactions, producing multiscale feature differences for precise change prediction. Extensive experiments demonstrate the superior performance of our method compared to existing approaches, establishing it as a robust solution for remote sensing image change detection.

A Siamese Swin-Unet for image change detection

The problem of change detection in remote sensing image processing is both difficult and important. It is extensively used in a variety of sectors, including land resource planning, monitoring and forecasting of agricultural plant health, and monitoring and assessment of natural disasters. Remote sensing images provide a large amount of long-term and fully covered data for earth environmental monitoring. A lot of progress has been made thanks to deep learning's quick development. But the majority of deep learning-based change detection techniques currently in use rely on the well-known Convolutional neural network (CNN). However, considering the locality of convolutional operation, CNN unable to master the interplay between global and distant semantic information. Some researches has employ Vision Transformer as a backbone in remote sensing field. Inspired by these researches, in this paper, we propose a network named Siam-Swin-Unet, which is a Siamesed pure Transformer with U-shape construction for remote sensing image change detection. Swin Transformer is a hierarchical vision transformer with shifted windows that can extract global feature. To learn local and global semantic feature information, the dual-time image are fed into Siam-Swin-Unet which is composed of Swin Transformer, Unet Siamesenet and two feature fusion module. Considered the Unet and Siamesenet are effective for change detection, We applied it to the model. The feature fusion module is designed for fusion of dual-time image features, and is efficient and low-compute confirmed by our experiments. Our network achieved 94.67 F1 on the CDD dataset (season varying).

High-Resolution Remote Sensing Image Change Detection Based on Cross-Mixing Attention Network

With the powerful discriminative capabilities of convolutional neural networks, change detection has achieved significant success. However, current methods either ignore the spatiotemporal dependencies between dual-temporal images or suffer from decreased accuracy due to registration errors. Addressing these challenges, this paper proposes a method for remote sensing image change detection based on the cross-mixing attention network. To minimize the impact of registration errors on change detection results, a feature alignment module (FAM) is specifically developed in this study. The FAM performs spatial transformations on dual-temporal feature maps, achieving the precise spatial alignment of feature pairs and reducing false positive rates in change detection. Additionally, to fully exploit the spatiotemporal relationships between dual-temporal images, a cross-mixing attention module (CMAM) is utilized to extract global channel information, enhancing feature selection capabilities. Furthermore, attentional maps are created to guide the up-sampling process, optimizing feature information. Comprehensive experiments conducted on the LEVIR-CD and SYSU-CD change detection datasets demonstrate that the proposed model achieves F1 scores of 91.06% and 81.88%, respectively, outperforming other comparative models. In conclusion, the proposed model maintains good performance on two datasets and, thus, has good applicability in various change detection tasks.

MSGFNet: Multi-Scale Gated Fusion Network for Remote Sensing Image Change Detection

Change detection (CD) stands out as a pivotal yet challenging task in the interpretation of remote sensing images. Significant developments have been witnessed, particularly with the rapid advancements in deep learning techniques. Nevertheless, challenges such as incomplete detection targets and unsmooth boundaries remain as most CD methods suffer from ineffective feature fusion. Therefore, this paper presents a multi-scale gated fusion network (MSGFNet) to improve the accuracy of CD results. To effectively extract bi-temporal features, the EfficientNetB4 model based on a Siamese network is employed. Subsequently, we propose a multi-scale gated fusion module (MSGFM) that comprises a multi-scale progressive fusion (MSPF) unit and a gated weight adaptive fusion (GWAF) unit, aimed at fusing bi-temporal multi-scale features to maintain boundary details and detect completely changed targets. Finally, we use the simple yet efficient UNet structure to recover the feature maps and predict results. To demonstrate the effectiveness of the MSGFNet, the LEVIR-CD, WHU-CD, and SYSU-CD datasets were utilized, and the MSGFNet achieved F1 scores of 90.86%, 92.46%, and 80.39% on the three datasets, respectively. Furthermore, the low computational costs and small model size have validated the superior performance of the MSGFNet.

BD-MSA: Body Decouple VHR Remote Sensing Image Change Detection Method Guided by Multiscale Feature Information Aggregation

BD-MSA: Body Decouple VHR Remote Sensing Image Change Detection Method Guided by Multiscale Feature Information Aggregation

WSMsFNet: Joint the Whole Supervision and Multiscale Fusion Network for Remote Sensing Image Change Detection

WSMsFNet: Joint the Whole Supervision and Multiscale Fusion Network for Remote Sensing Image Change Detection