Synthetic Aperture Radar Image Change Detection Research Articles

Two-stage fusion strategy and residual shrinkage capsule network for SAR image change detection

ABSTRACT Acquiring precise change map for synthetic aperture radar (SAR) images poses challenges due to the absence of labelled datasets and the presence of speckle noise interference. This paper presents a two-stage fusion strategy coupled with capsule network classification detection method. Initially, to enhance the structure of change areas within the difference image (DI), we propose an energy ratio (ER) algorithm based on the mean ratio (MR). Subsequently, employing a two-stage fusion strategy integrating multiplication and discrete wavelet transform (DWT), we fuse the DIs generated by the three algorithms to effectively complement change information across distinct DIs. In addition, a saliency detection algorithm is introduced to mitigate noise interference and balance the number of samples. Hierarchical fuzzy c-means clustering (HFCM) is then used to pre-classify the salient fusion difference image (SFDI) and derive pseudo-labels. Finally, we apply the residual shrinkage capsule network (RSCN) to reclassify pre-classification results and obtain the change detection outcome, capable of extracting the multi-scale refinement features and adaptively learning discriminant information from changed and unchanged regions. Experimental evaluations on various SAR image datasets demonstrate the exceptional detection performance of the proposed method.

Synthetic Aperture Radar Image Change Detection Based on Principal Component Analysis and Two-Level Clustering

Synthetic aperture radar (SAR) change detection provides a powerful tool for continuous, reliable, and objective observation of the Earth, supporting a wide range of applications that require regular monitoring and assessment of changes in the natural and built environment. In this paper, we introduce a novel SAR image change detection method based on principal component analysis and two-level clustering. First, two difference images of the log-ratio and mean-ratio operators are computed, then the principal component analysis fusion model is used to fuse the two difference images, and a new difference image is generated. To incorporate contextual information during the feature extraction phase, Gabor wavelets are used to obtain the representation of the difference image across multiple scales and orientations. The maximum magnitude across all orientations at each scale is then concatenated to form the Gabor feature vector. Following this, a cascading clustering algorithm is developed within this discriminative feature space by merging the first-level fuzzy c-means clustering with the second-level neighbor rule. Ultimately, the two-level combination of the changed and unchanged results produces the final change map. Five SAR datasets are used for the experiment, and the results show that our algorithm has significant advantages in SAR change detection.

A global patch similarity-based graph for unsupervised SAR image change detection

ABSTRACT This letter presents a novel method for synthetic aperture radar (SAR) image change detection using the global patch similarity-based graph (GPSG). First, the SAR image is divided into a number of square patches, which are then vectorized and stacked to form a global patch matrix (GPM). The GPSG is constructed by connecting the global similar patches that are selected through traversing the GPM. With the support of GPSG, the second-order random walk matrix is designed to widely aggregate the attributes of patches within the two-hop global neighbourhood. The difference image with good separability can be generated by comparing bitemporal patches and their aggregated attributes. Finally, the Otsu thresholding is adopted to obtain the change map showing changed and unchanged portions. Experiments conducted on three real SAR datasets demonstrate the superiority of the proposed GPSG method in terms of both robustness and accuracy for change detection.

A Multi-Scale Graph Based on Spatio-Temporal-Radiometric Interaction for SAR Image Change Detection

Change detection (CD) in remote sensing imagery has found broad applications in ecosystem service assessment, disaster evaluation, urban planning, land utilization, etc. In this paper, we propose a novel graph model-based method for synthetic aperture radar (SAR) image CD. To mitigate the influence of speckle noise on SAR image CD, we opt for comparing the structures of multi-temporal images instead of the conventional approach of directly comparing pixel values, which is more robust to the speckle noise. Specifically, we first segment the multi-temporal images into square patches at multiple scales and construct multi-scale K-nearest neighbor (KNN) graphs for each image, and then develop an effective graph fusion strategy, facilitating the exploitation of multi-scale information within SAR images, which offers an enhanced representation of the complex relationships among features in the images. Second, we accomplish the interaction of spatio-temporal-radiometric information between graph models through graph mapping, which can efficiently uncover the connections between multi-temporal images, leading to a more precise extraction of changes between the images. Finally, we use the Markov random field (MRF) based segmentation method to obtain the binary change map. Through extensive experimentation on real datasets, we demonstrate the remarkable superiority of our methodologies by comparing with some current state-of-the-art methods.

SAR Change Detection Algorithm Combined with FFDNet Spatial Denoising

Objectives: When detecting changes in synthetic aperture radar (SAR) images, the quality of the difference map has an important impact on the detection results, and the speckle noise in the image interferes with the extraction of change information. In order to improve the detection accuracy of SAR image change detection and improve the quality of the difference map, this paper proposes a method that combines the popular deep neural network with the clustering algorithm.Methods: Firstly, the SAR image with speckle noise was constructed, and the FFDNet architecture was used to retrain the SAR image, and the network parameters with better effect on speckle noise suppression were obtained. Then the log ratio operator is generated by using the reconstructed image output from the network. Finally, K-means and FCM clustering algorithms are used to analyze the difference images, and the binary map of change detection results is generated. Results: The experimental results have high detection accuracy on Bern and Sulzberger's real data, which proves the effectiveness of the method.

Change Detection in SAR Images through Clustering Fusion Algorithm and Deep Neural Networks

The detection of changes in synthetic aperture radar (SAR) images based on deep learning has been widely used in landslides detection, flood disaster monitoring, and other fields of change detection due to its high classification accuracy. However, the inherent speckle noise in SAR images restricts the performance of existing SAR image change detection algorithms by clustering analysis. Therefore, this paper proposes a novel method for SAR image change detection based on clustering fusion and deep neural networks. We first used hierarchical fuzzy c-means clustering (HFCM ) to process two different images to obtain HFCM classification results. Then a fusion strategy is designed to obtain the fused image from the two HFCM classified images as the pre-classification result. Furthermore, a lightweight deep neural network com posed of a decomposition convolution module and an auxiliary classification module was proposed; the former module could reduce network parameters by 28%, and the latter could reduce network parameters by 33.3%. To improve the recognition performance of the network, the classification layer was replaced by the regression layer at the outcome of the network. By comparing the experiments of different methods on five data sets, the performance of our proposed method is superior.

Clustering-segmentation network: a parallel dual-branch synthetic aperture radar image change detection framework

ABSTRACT Synthetic aperture radar (SAR) image change detection is a key technique for such essential applications as flood disaster assessment and forest fire detection. In SAR image change detection, clustering algorithm is the most applied methods, but clustering algorithm only considers the grey features, therefore it is more susceptible to speckle noise. Deep learning model is difficult to be trained by supervised learning because of lack of labels. To alleviate the above-mentioned challenges of SAR image change detection, a parallel dual-branch SAR image change detection network based on clustering and segmentation (Clustering-Segmentation Network) is proposed in this paper. In the clustering branch, the clustering-based change detection results were obtained by fuzzy c-means (FCM) clustering. In the segmentation branch, the Graph-Based Image Segmentation algorithm was used for pre-segmentation. These results were used as labels of the neural network for training for the segmentation-based change detection. After the fusion of these dual-branch, a double sparse dictionary (DSD) discrimination algorithm is proposed to extract the neighbourhood features for the final discrimination, and obtain the final results. By fusing the dual-branch results, the influence of speckle noise on change detection can be suppressed while maintaining a high accuracy. We show that the Clustering-Segmentation Network exhibited better results compared with existing algorithms on several datasets. The accuracy and kappa coefficients are improved by 0.83% and 3.45% respectively, thereby proving the effectiveness of our proposed method.

Unsupervised SAR Image Change Detection Based on Structural Consistency and CFAR Threshold Estimation

Despite the remarkable progress made in recent years, until today, the automatic detection of changes in synthetic aperture radar (SAR) images remains a difficult task due to speckle noise. This inherent multiplicative noise tends to increase false alarms and misdetections. As a solution, we developed an unsupervised method that detects SAR changes by analyzing structural differences. By this method, the spatial structure cues of a pixel are represented by a set of similarity weight vectors calculated from the non-local scale of the pixel. The difference image (DI) is then derived by measuring the structural consistency of the corresponding pixels. A new statistical distance that is insensitive to speckle noise was used to measure the similarity weights between patches in order to obtain an accurate structure. It was derived by applying the Nakagami–Rayleigh distribution to a statistical test and customizing the approximation based on change detection. The CFAR threshold estimator in conjunction with the Rayleigh hypothesis was then employed to attenuate the effect of the unimodal histogram of the DI. The results indicated that the proposed method reduces the false alarm rate and improves the kappa and F1-scores, while providing satisfactory visual results.

Unsupervised SAR Image Change Detection Based on Histogram Fitting Error Minimization and Convolutional Neural Network

Synthetic aperture radar (SAR) image change detection is one of the most important applications in remote sensing. Before performing change detection, the original SAR image is often cropped to extract the region of interest (ROI). However, the size of the ROI often affects the change detection results. Therefore, it is necessary to detect changes using local information. This paper proposes a novel unsupervised change detection framework based on deep learning. The specific method steps are described as follows: First, we use histogram fitting error minimization (HFEM) to perform thresholding for a difference image (DI). Then, the DI is fed into a convolutional neural network (CNN). Therefore, the proposed method is called HFEM-CNN. We test three different CNN architectures called Unet, PSPNet and the designed fully convolutional neural network (FCNN) for the framework. The overall loss function is a weighted average of pixel loss and neighborhood loss. The weight between pixel loss and neighborhood loss is determined by the manually set parameter λ. Compared to other recently proposed methods, HFEM-CNN does not need a fragment removal procedure as post-processing. This paper conducts experiments for water and building change detection on three datasets. The experiments are divided into two parts: whole data experiments and random cropped data experiments. The complete experiments prove that the performance of the method in this paper is close to other methods on complete datasets. The random cropped data experiment is to perform local change detection using patches cropped from the whole datasets. The proposed method is slightly better than traditional methods in the whole data experiments. In experiments with randomly cropped data, the average kappa coefficient of our method on 63 patches is over 3.16% compared to other methods. Experiments also show that the proposed method is suitable for local change detection and robust to randomness and choice of hyperparameters.

SSN: Stockwell Scattering Network for SAR Image Change Detection

Recently, synthetic aperture radar (SAR) image change detection has become an interesting yet challenging direction due to the presence of speckle noise. Although both traditional and modern learning-driven methods attempted to overcome this challenge, deep convolutional neural networks (DCNNs)-based methods are still hindered by the lack of interpretability and the requirement of large computation power. To overcome this drawback, wavelet scattering network (WSN) and Fourier scattering network (FSN) are proposed. Combining respective merits of WSN and FSN, we propose Stockwell scattering network (SSN) based on Stockwell transform (ST), which is widely applied against noisy signals and shows advantageous characteristics in speckle reduction. The proposed SSN provides noise-resilient feature representation and obtains state-of-the-art performance in SAR image change detection as well as high computational efficiency. Experimental results on three real SAR image datasets demonstrate the effectiveness of the proposed method.

SAR Image Change Detection in Spatial-Frequency Domain Based on Attention Mechanism and Gated Linear Unit

Change detection based on synthetic aperture radar (SAR) images is an important application in the remote sensing technology field. However, the lack of labeled data has been a difficult problem in SAR image detection, especially for pixel-level change detection. In this letter, we propose a novel unsupervised change detection algorithm, which improves the detection accuracy by exploring features from both spatial and frequency domains of SAR images. In particular, firstly clustering is used as pre-classification to obtain pseudo-labels, and then by incorporating classifiers and pseudo-labels in terms of feature learning, a novel unsupervised detection algorithm is proposed. In order to improve the sensitivity of the algorithm to changed details and enhance the anti-noise ability of the change detection network, the attention mechanism (AM) is integrated into the network to fully extract important spatial structure information. Moreover, a multi-domain fusion module is proposed to integrate spatial and frequency domain features into complementary feature representations. This module contains multi-region features weighted by the channel-spatial AM and deep features filtered out by the gated linear units (GLU) in the frequency domain. To verify the effectiveness of the proposed algorithm, it is compared against the other four SAR image change detection algorithms using three real datasets. The experimental results show that the proposed method outperforms the other four algorithms in terms of percent correct classification (PCC) and Kappa coefficient (KC).

Unsupervised SAR Image Change Detection Based on Feature Fusion of Information Transfer

Synthetic aperture radar (SAR) image change detection is a hot but challenging task due to SAR images’ complex contents and inherent speckle noises. The expected change detection methods should reduce the influence of speckle noises, obtain the discriminative feature representations, and generate accurate change maps simultaneously. To these ends, we propose a new SAR image change detection method named feature fusion of information transfer network (FFITN). First, we develop a hybrid convolution block to depress the speckle noise impacts and explore the valuable information from SAR images. Thus, the feature extraction module (FEM) is constructed to obtain the multi-level features. Then, an information transfer module (ITM) is proposed to capture the salient regions from various aspects. Also, the salient knowledge is transferred among features at different levels to enhance their discrimination. Next, a self-attention-based feature fusion module (SAFFM) is introduced to fuse various features. Finally, a change map generation module (CMGM) with the clustering algorithm and specific loss functions is designed to produce the pseudo labels and change maps. Experimental results on three public SAR data sets demonstrate the model’s effectiveness. Our source codes are available at https://github.com/TangXu-Group/FFITN.

SAR-TSCC: A Novel Approach for Long Time Series SAR Image Change Detection and Pattern Analysis

Change detection has played an increasingly important role in multi-temporal remote sensing applications recently. Long time series analysis is providing new information of land cover changes and improving the quality and accuracy of the change information being derived from remote sensing. The purpose of this study is to dig for more change temporal information and change pattern information from synthetic aperture radar (SAR) image time series (ITS), which is of great significance for monitoring urban area changes, conducting land-use surveys, and renovating illegal constructions. In the study, a novel unified framework for long Time Series SAR image Change detection and Change pattern mining (SAR-TSCC) was proposed for land cover change mapping. To obtain the most notable change time rapidly, a fast SAR ITS change point search method based on pruned exact linear time (SAR-PELT) algorithm was adopted. Meanwhile, the deep time series classification network, named SAR-TST, was implemented to recognize the change patterns, which is based on time series transformer (TST) architecture. Considering the lack of real training data, a novel synthetic data generation method is developed. The combination of the synthetic and real data enhanced the generalization of the classifiers. The proposed framework was used for monitoring a large urbanization area in the northwest of Hong Kong, China. The Cosmo Skymed (CSK) time series data acquired from 2013 to 2020 were exploited for land cover change analysis. Experiment results showed that our approach achieved state-of-the-art performance, as the time accuracy reached 86% and the classification accuracy on the four main change patterns (impulse, step, cycle, and complex) is over 99%. In particular, the proposed SAR-TST model showed remarkable advantages in the presence of insufficient real data.

TransUNet++SAR: Change Detection with Deep Learning about Architectural Ensemble in SAR Images

In the application of change detection satellite remote sensing images, synthetic aperture radar (SAR) images have become a more important data source. This paper proposes a new end-to-end SAR image change network architecture—TransUNet++SAR—that combines Transformer with UNet++. First, the convolutional neural network (CNN) was used to obtain the feature maps of the single time SAR images layer by layer. Tokenized image patches were encoded to extract rich global context information. Using improved Transformer for effective modeling of global semantic relations can generate rich contextual feature representations. Then, we used the decoder to upsample the encoded features, connected the encoded multi-scale features with the high-level features by sequential connection to learn the local-global semantic features, recovered the full spatial resolution of the feature map, and achieved accurate localization. In the UNet++ structure, the bitemporal SAR images are composed of two single networks, which have shared weights to learn the features of the single temporal image layer by layer to avoid the influence of SAR image noise and pseudo-change on the deep learning process. The experiment results show that the experimental effect of TransUNet++SAR on the Beijing, Guangzhou, and Qingdao datasets were significantly better than other deep learning SAR image change detection algorithms. At the same time, compared with other Transformer related change detection algorithms, the description of the changed area edge was more accurate. In the dataset experiments, the model had higher indices than the other models, especially the Beijing building change datasets, where the IOU was 9.79% higher and F1-score was 4.38% higher.

Unsupervised change detection in SAR images based on generalized likelihood ratio test and a two-stage morphological filter

ABSTRACT Generalized likelihood ratio test (GLRT) is an efficient method to generate difference image (DI) for change detection (CD) using synthetic aperture radar (SAR) images. GLRT is usually applied with a fixed-size moving window to the neighbourhood regions in multitemporal SAR images. The fixed window may be however not optimal for all the pixels under test. To solve disadvantages of the GLRT method, an adaptive circular window is proposed in this work. While the adaptive square window and the best fixed square window achieve an average Kappa coefficient of 83.55% and 82.12%, respectively, the adaptive circular window improves the average Kappa coefficient by 83.65% in six datasets. As another difficulty, speckle noise reduces quality of DI in SAR change detection. Three steps are considered to minimize effects of the speckle noise: (1) a two-stage morphological filter is suggested to reduce the speckle noise; (2) to generate DI, the adaptive circular window for generalized likelihood ratio test (ACWGLRT) is proposed that reduces influence of the speckle noise while preserves the edge details of multitemporal images; and (3) spatial fuzzy c-means (SFCM) is used to reduce effects of the residual speckle-noise during DI classification. The experimental results show superior performance of the proposed change detection method with respect to several competitors. The proposed method has the best Kappa coefficient and percentage correct classification (PCC) in four datasets of Ottawa, San Francisco, Farmland C, and Inland water.

Change Detection in SAR Images via Ratio-Based Gaussian Kernel and Nonlocal Theory

Compared with the synthetic aperture radar (SAR) image processing theory based on local neighborhood, the nonlocal theory is not limited to a local neighborhood of an image and has great potential in change detection of SAR images. In this study, an approach using ratio-based nonlocal information (RNLI) is proposed for change detection in multitemporal SAR images. First, the RNLI is extracted from a spatial–temporal nonlocal neighborhood where the similarity of two pixels in the nonlocal neighborhood is well characterized by the proposed ratio-based Gaussian kernel function. The parameters of RNLI: noise level and matching window size are adaptively determined to avoid the uncertainty of the change detection result caused by user experience. Second, the difference image is generated by using the RNLI and the ratio operator. Finally, the change map is obtained by segmenting the difference image with a threshold. Experiments conducted on two real datasets and two simulated datasets showed that the proposed method performed better than the other advanced change detection methods, which can better retain the edge information of the changed area while reducing the overall error of the change detection results.

SAR Image Change Detection Based on Heterogeneous Graph With Multiattributes and Multirelationships

The performance of change detection between synthetic aperture radar (SAR) images mainly depends on the selection and utilization of image attributes. Nevertheless, most existing change detection approaches merely take the intensity attribute into consideration, constraining their capacities of detecting changes in complex situations. To solve this problem, this study develops an unsupervised SAR image change detection approach based on heterogeneous graph with multi-attributes and multi-relationships. First, the structural attribute, obtained by removing the complex texture, can be used to reflect the overall features of a SAR image. A heterogeneous graph is then constructed to encode the structural and intensity attributes as vertices, and two types of edges are hence connected to capture the intra-relationships and inter-relationships from these different attributes. With the support of this graph, the hyper-adjacency characteristics are proposed to quantify the multi-relationships and describe the global heterogeneous information. Constructing heterogeneous graphs respectively on bi-temporal SAR images, the changes of both intensity and structural attributes can be measured via comparing the hyper-adjacency characteristics of the bi-temporal graphs, thereby generating a difference image with good separability. Finally, the change map is obtained by cutting off the weakly related edges of heterogeneous graph on the difference image. Experiments on four real SAR datasets prove the effectiveness of the proposed graph-driven approach in improving the accuracy and robustness of change detection.

A Hierarchical Heterogeneous Graph for Unsupervised SAR Image Change Detection

This letter presents a novel graph-driven synthetic aperture radar (SAR) image change detection approach. A hierarchical heterogeneous graph is proposed, combining two distinct graphs: a weighted graph based on adjacency of superpixels of an initial over-segmentation, and the dual-weighted heterogeneous graph. The superpixel-based regional affinities are coupled with pixel-based heterogeneous affinities, being embedded into the structure of hierarchical heterogeneous graph. The difference image generation relies on the matching of the bitemporal graphs, as well as the multiscale features of vertex domain. Finally, traditional graph cuts algorithm is applied to separate the difference image into changed and unchanged areas. Experiments on three real SAR datasets show that the proposed approach outperforms other experimental approaches and is a good candidate for SAR image change detection tasks.

Change Detection in SAR Images Based on Progressive Nonlocal Theory

For multi-temporal synthetic aperture radar (SAR) images, the change detection methods based on non-local theory can well suppress the adverse effects of coherent speckle noise over the change detection results. However, effectively retaining the edge information of the changed area is still a challenging task. To overcome this problem, this study proposes a change detection method based on progressive non-local theory. First, the progressive non-local theory is used to extract the spatial-temporal non-local information from multi-temporal SAR images. Compared with the traditional non-local theory, the progressive non-local theory proposed in this study has three distinctive characteristics: 1) the progressive non-local neighborhood from the matching window to the search window; 2) the progressive optimization of matching window weight from the isotropic Gaussian distribution to the irregular distribution; and 3) the progressive increase of noise level from the 2 sigma principle to the 4/3 sigma principle (the noise level corresponding to the 4/3 sigma principle is 1.5 times the noise level corresponding to the 2 sigma principle). The difference image is then obtained by using the spatial-temporal non-local information and the ratio operator. Finally, the change map is obtained by applying a threshold segmentation method to the difference image. Two data sets were used for the testing and it was shown that compared with other advanced methods, the method proposed in this study can better retain the edge information of the changed area and improve the Kappa coefficient and F1 score of the change map.

Dynamic Graph-Level Neural Network for SAR Image Change Detection

The graph neural network (GNN) has been widely applied to image analysis and recognition. Recently, a semisupervised graph convolutional network (ssGCN) method has been proposed to change detection and obtains promising performance on very-high-resolution remote sensing images. However, a synthetic aperture radar (SAR) image is subject to speckle noise, and there is no explicit structure. In this letter, an end-to-end dynamic graph-level neural network (DGLNN) is proposed to exploit the local structure of each pixel neighborhood block at a graph level and learn a more discriminative graph for change detection. Moreover, in the training of DGLNN, a <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$K$ </tex-math></inline-formula> -nearest neighborhood is employed to reconstruct edges between nodes instead of the fixed edges between two nodes so that each node exploits the features from different neighbor nodes. The proposed method is verified by cross-domain SAR image change detection on four sets of SAR images and compared with five state-of-the-art deep-learning-based SAR image change detection methods. The overall experimental results show that the proposed DGLNN obtains outstanding performance.