Change Detection Framework Research Articles

Signature-based IaaS Performance Change Detection

We propose a novel change detection framework to identify changes in the long-term performance behavior of an IaaS service. An IaaS service’s long-term performance behavior is represented by an IaaS performance signature. The proposed framework leverages time series similarity measures and a sliding window technique to detect changes in IaaS performance signatures. We introduce a new IaaS performance noise model that enables the proposed framework to distinguish between performance noise and actual changes in performance. The proposed framework utilizes a novel Signal-to-Noise Ratio (SNR) based approach to detect changes when prior knowledge about performance noise is available. A set of experiments is conducted using real-world datasets to demonstrate the effectiveness of the proposed change detection framework.

Monitoring Changes in Walkability Over Time: An Environmental Exposure Change Detection Framework with Implications for Equity and Social Justice

Evidence suggests that walkability and greenspace impact travel related activity patterns and vehicle emissions which affect sustainability, public health, and equity. Resulting levels of physical activity, active, or sedentary travel time impact obesity, diabetes, and heart disease which impact COVID-19 mortality. It is now possible to track changes in locally controlled land use characteristics known to impact sustainability and health. This information can provide decisionmakers with feedback required to spatially prioritize and better link state and nationally funded transportation investments with locally sanctioned land use actions. Linking the achievement of established benchmarks of health equity-based indicators with funding establishes a more performance-based approach connecting land use with transportation investment. This study longitudinally tracks neighborhood-level walkability features at the census tract level for 2013 and 2020 for the entire USA. Longitudinal volatility-based change detection models are developed to examine how changes in walkability over time correlate with racialization and social justice. Walkability tends to increase over time with significant variations across metro regions and the urban-rural continuum. Largest and smallest increases in walkability were observed in Western Pacific and Northwest states, respectively. Increased racial and social justice disparities were observed in access to more walkable infrastructure by marginalized populations (such as less-educated, older, unemployed, and black individuals). Significant heterogeneity in the spatial distribution of walkability was observed, over the variation captured by observed sociodemographic, regional, and urban/rural factors. The findings highlight the potential for an “environmental surveillance” system to support a “performance-based” approach to transportation funding that prioritizes resource allocation consistent with Justice40 and United Nation's Sustainable Development Goals.

Harmony in diversity: Content cleansing change detection framework for very-high-resolution remote-sensing images

Change detection, as a crucial task in the field of Earth observation, aims to identify changed pixels between multi-temporal remote-sensing images captured at the same geographical area. However, in practical applications, there are challenges of pseudo changes arising from diverse imaging conditions and different remote-sensing platforms. Existing methods either overlook the different imaging styles between bi-temporal images, or transfer the bi-temporal styles via domain adaptation that may lose ground details. To address these problems, we introduce the disentangled representation learning that mitigates differences of imaging styles while preserving content details to develop a change detection framework, named Content Cleansing Network (CCNet). Specifically, CCNet embeds each input image into two distinct subspaces: a shared content space and a private style space. The separation of style space aims to mitigate the discrepant style due to different imaging condition, while the extracted content space reflects semantic features that is essential for change detection. Then, a multi-resolution parallel structure constructs the content space encoder, facilitating robust feature extraction of semantic information and spatial details. The cleansed content features enable accurate detection of changes in the land surface. Additionally, a lightweight decoder for image restoration enhances the independence and interpretability of the disentangled spaces. To verify the proposed method, CCNet is applied to five public datasets and a multi-temporal dataset collected in this study. Comparative experiments against eleven advanced methods demonstrate the effectiveness and superiority of CCNet. The experimental results show that our method robustly addresses the issues related to both temporal and platform variations, making it a promising method for change detection in complex conditions and supporting downstream applications.

DeepQCD: An end-to-end deep learning approach to quickest change detection

This paper aims to generalize the quickest change detection (QCD) framework via a data-driven approach. To this end, a generic neural network architecture is proposed for the QCD task, composed of feature transformation, recurrent, and dense layers. The neural network is trained end-to-end to learn the change detection rule directly from data without needing the knowledge of probabilistic data models. Specifically, the feature transformation layers can perform a broad range of operations including feature extraction, scaling, and normalization. The recurrent layers keep an internal state summarizing the time-series data seen so far and update the state as new information comes in. Finally, the dense layers map the internal state into a decision statistic, defined as the posterior probability that a change has taken place. Comparisons with the existing model-based QCD algorithms demonstrate the power of the proposed data-driven approach, called DeepQCD, under several scenarios including transient changes and temporally correlated data streams. Experiments with real-world data illustrate superior performance of DeepQCD compared to state-of-the-art algorithms in real-time anomaly detection over surveillance videos and real-time attack detection over Internet of Things (IoT) networks.

On Unsupervised Multiclass Change Detection Using Dual-Polarimetric SAR Data

Change detection using SAR data has been an active topic in various applications. Because conventional change detection identifies signal changes in single-pol radar observations, they cannot separately detect different kinds of change associated with different ground parameters. In this study, we investigated the comprehensive use of dual-pol parameters and proposed a novel dual-pol-based change detection framework utilizing different dual-pol scatter-type indicators. To optimize the exploitation of dual-pol change information, we presented a two-step processing strategy that divides the multiclass change detection process into a binary detection step that identifies the presence of changes and the classification step that distinguishes the types of change. In the detection stage, each dual-pol parameter was considered as an independent information source. Assuming potential conflict between dual-pol parameters, a disjunctive combination of detection results from different dual-pol parameters was applied to obtain the final detection result. In the classification step, an unsupervised change classification strategy was proposed based on the change direction and magnitude of the dual-pol parameters within the change class. Experimental results exhibited significantly improved detectability across a wide change spectrum compared with previous dual-pol-based change detection approaches. They also demonstrated the possibility of distinguishing different semantic changes without in situ ground data.

Generative attention based framework for implicit language change detection

Spoken language change detection (LCD) refers to detecting language switching points in a multilingual speech signal. Most approaches in literature use the explicit framework that requires the modeling of intermediate phonemes and Senones to distinguish language. However, such techniques are limited when used with resource scare/ zero resource languages. Hence as an alternative, this study explores implicit frameworks to perform LCD. The focus of this work is to detect language change when a single speaker is speaking two languages. In this direction, a subjective study is performed to analyze the method humans adapt to discriminate languages. The outcome of the subjective study suggests humans require more neighborhood duration to detect language change. The initial observation suggests, that detecting language change is challenging using the baseline implicit unsupervised distance-based approach. Inspired by human cognition, prior language knowledge is integrated into the computational framework through the Gaussian mixture model and universal background model (GMM-UBM), temporal information via attention, and pattern storage using the Generative adversarial network (GAN) to enhance language discrimination. The experimental results on the Microsoft code-switched (MSCS) dataset show, compared to the unsupervised distance-based approach, the performance of the proposed LCD relatively improved by 19.3%, 47.3%, and 50.7% using the GMM-UBM, attention, and GAN-attention based framework, respectively.

Cross-modal change detection flood extraction based on self-supervised contrastive pre-training

Abstract. Flood extraction is a critical issue in remote sensing analysis. Accurate flood extraction faces challenges such as complex scenes, image differences across modalities, and a shortage of labeled samples. Traditional supervised deep learning algorithms demonstrate promising prospects in flood extraction. They mostly rely on abundant labeled data. However, in practical applications, there is a scarcity of available labeled samples for flood change regions, leading to an expensive acquisition of such data for flood extraction. In contrast, there is a wealth of unlabeled data in remote sensing images. Self-supervised contrastive learning (SSCL) provides a solution, allowing learning from unlabeled data without explicit labels. Inspired by SSCL, we utilized the open-source CAU-Flood dataset and developed a framework for cross-modal change detection in flood extraction (CMCDFE). We employed the Barlow Twin (BT) SSCL algorithm to learn effective visual feature representations of flood change regions from unlabeled cross-modal bi-temporal remote sensing data. Subsequently, these well-initialized weight parameters were transferred to the task of flood extraction, achieving optimal accuracy. We introduced the improved CS-DeepLabV3+ network for extracting flood change regions from cross-modal bi-temporal remote sensing data, incorporating the CBAM dual attention mechanism. By demonstrating on the CAU-Flood dataset, we proved that fine-tuning with only a pre-trained encoder can surpass widely used ImageNet pre-training methods without additional data. This approach effectively addresses downstream cross-modal change detection flood extraction tasks.

Deep Siamese Network for annual change detection in Beijing using Landsat satellite data

The detection of spatiotemporal changes in land use/land cover (LULC-SC) plays a paramount role in the analysis of smart cities, it can describe complex urban distribution, functions, and patterns. Chinas capital city has been developing rapidly in the past two decades, however, there are only few long-term studies on an annual scale of LULC-SC. To fill this research gap, we propose a remote sensing parallel framework for the detection of LULC-SC based on the combination of the Deep Siamese Network and long time series, which focuses on the spatial semantic information at the object level. A Landsat time series from 2002 to 2022 serves as input satellite data. First, we focus on building graph constructions at the object level and then use an autonomously constructed deeper-feature graph convolutional network (DF-GCN) to mine deeper features, spatial semantic, and relationships at the object level. Finally, the Siamese Network recognizes the changes in the spatial semantic tensors of long time series of Landsat images and quickly maps LULC-SC. The results prove that the proposed spatiotemporal change detection framework is effective in LULC-SC in Beijing. Compared with other networks, the optimal accuracy of semantic mining based on DF-GCN can reach about 90%. Over the past two decades, the LULC-SC of Beijing has changed in a complex way, with urbanization occurring primarily through the replacement of farmland. Consequently, the proposed framework can generate accurate LULC change maps at high temporal frequencies, which can contribute to a better comprehension of sustainable urban development and planning.

A building change detection framework with patch-pairing single-temporal supervised learning and metric guided attention mechanism

Building change detection (CD) aims to detect changes in buildings from bi-temporal pairwise images obtained at different times. Typically, a deep learning-based building CD algorithm requires bi-temporal samples with significant building changes for training. However, obtaining such bi-temporal samples is challenging because building changes have a low probability of occurrence. Fortunately, it is relatively simple to obtain single-temporal samples that include a substantial number of buildings. By using these single-temporal building samples, pseudo bi-temporal building change samples can be generated, which can effectively address the problem of limited available bi-temporal building change samples. In view of that, this study proposes a metric guided single-temporal supervised learning framework that uses single-temporal building samples for building CD. In the proposed framework, patch-pairing single-temporal supervised learning (PPSL) adopts a patch-pairing method to construct pseudo bi-temporal building change samples, while equipping the network to effectively suppresses the negative impact of geometric offset and radiation difference in real samples. To further suppress the impact of radiation difference and enhance the effectiveness of our framework, a metric-guided spatial attention module (MGSAM) is designed to minimize the intra-class feature differences between temporal samples and augment the spatial context modeling ability. The proposed method is verified by experiments on different datasets, and the results demonstrate that the proposed method can outperform the existing methods and achieve superior performance.

ENVINet5 deep learning change detection framework for the estimation of agriculture variations during 2012-2023 with Landsat series data.

Remote sensing is one of the most important methods for analysing the multitemporal changes over a certain period. As a cost-effective way, remote sensing allows the long-term analysis of agricultural land by collecting satellite imagery from different satellite missions. Landsat is one of the longest-running world missions which offers a moderate-resolution earth observation dataset. Land surface mapping and monitoring are generally performed by incorporating classification and change detection models. In this work, a deep learning-based change detection (DCD) algorithm has been proposed to detect long-term agricultural changes using the Landsat series datasets (i.e., Landsat-7, Landsat-8, and Landsat-9) during the period 2012 to 2023. The proposed algorithm extracts the features from satellite data according to their spectral and geographic characteristics and identifies seasonal variability. The DCD integrates the deep learning-based (Environment for visualizing images) ENVI Net-5 classification model and posterior probability-based post-classification comparison-based change detection model (PCD). The DCD is capable of providing seasonal variations accurately with distinct Landsat series dataset and promises to use higher resolution dataset with accurate results. The experimental result concludes that vegetation has decreased from 2012 to 2023, while build-up land has increased up to 88.22% (2012-2023) for Landsat-7 and Landsat-8 datasets. On the other side, degraded area includes water (3.20-0.05%) and fallow land (1-0.59%). This study allows the identification of crop growth, crop yield prediction, precision farming, and crop mapping.

Thompson Sampling-Based Partially Observable Online Change Detection for Exponential Families

This paper proposes a holistic sequential change detection framework for partially observable high-dimensional data streams with exponential-family distributions. The framework first proposes a general composite decomposition for exponential-family distributed data by projecting its natural parameter onto normal bases and abnormal bases, which enables efficient inference for sparse changes. Then, the inference results are used for detection scheme construction, and different types of test statistics can be compacted in our framework. Last, by further designing the test statistic as the reward function in the combinatorial multi-armed bandit problem, a Thompson sampling-based sensor allocation strategy is constructed to select the most anomalous variables. Theoretical properties of the detection framework are discussed. Finally, examples of Gaussian, Poisson, and binomial distributed data streams are given in numerical studies and case studies to evaluate the performance of our proposed method. History: Bianca Maria Colosimo served as the senior editor. Funding: C. Zhang is partially supported by the NSFC [Grants 71932006 and 72271138], the BNSF [Grant 9222014], and the ASFC [Grant 2020Z063058001]. H. Yan is partially supported by NIH [R21 AI157618] and NSF [CMMI 2316654]. Supplemental Material: The online appendix is available at https://doi.org/10.1287/ijds.2022.00011 . Data Ethics & Reproducibility Note: No data ethics considerations are foreseen related to this paper. The code capsule is available on Code Ocean at https://codeocean.com/capsule/8794940/tree/v1 and in the e-Companion to this article (available at https://doi.org/10.1287/ijds.2022.00011 ).

CausalCD: A Causal Graph Contrastive Learning Framework for Self-Supervised SAR Image Change Detection

CausalCD: A Causal Graph Contrastive Learning Framework for Self-Supervised SAR Image Change Detection

A Framework for Bayesian Quickest Change Detection in General Dependent Stochastic Processes

A Framework for Bayesian Quickest Change Detection in General Dependent Stochastic Processes

A multi-task framework for hyperspectral change detection and band reweighting with unbalanced contrastive learning

A multi-task framework for hyperspectral change detection and band reweighting with unbalanced contrastive learning

Interdomain Collaboration Between Hyperspectral and VHR Remote Sensing Images: A Cross-Scene Few-Shot Learning Framework for Change Detection

Interdomain Collaboration Between Hyperspectral and VHR Remote Sensing Images: A Cross-Scene Few-Shot Learning Framework for Change Detection

SSLChange: A Self-supervised Change Detection Framework Based on Domain Adaptation

SSLChange: A Self-supervised Change Detection Framework Based on Domain Adaptation

A Graph-Based Hyperspectral Change Detection Framework Using Difference Augmentation and Progressive Reconstruction With Limited Labels

A Graph-Based Hyperspectral Change Detection Framework Using Difference Augmentation and Progressive Reconstruction With Limited Labels

Multi-stage progressive change detection on high resolution remote sensing imagery

Change detection in remote sensing images, especially optical high and very high resolution images, is a pivotal technique that enables efficient identification of Earth observation alterations, with widespread applications including land use analysis, urban planning, environmental monitoring, and disaster mapping. Of these applications, change detection is predominantly employed in urbanization studies to monitor developmental changes in construction land. However, the pronounced class imbalance and variances between image domains present formidable challenges to change detection implementations. In response to these issues, we introduce the concept of reverse change discovery, redefining the primary goal of model learning for change detection in optical remote sensing images as stable invariant region detection. In line with this concept, we present a novel Multi-Stage Progressive Change Detection Network (MSP-CD) specifically designed for urbanization change detection, which integrates invariant detection, knowledge distillation, and a coarse-to-fine change detection structure. To validate the effectiveness and robustness of the proposed method, we conducted experiments using two widely recognized public datasets, namely the Lebedev-CD and Levir-CD datasets. The MSP-CD network demonstrated state-of-the-art performance across these datasets. Additionally, we curated an application-specific change detection dataset (JS-CD dataset) using remote sensing images from Jiangsu Province in China, which differs from public datasets in terms of annotations, to further validate the MSP-CD network’s performance. A case study on regional urbanization development in Yangzhou city, conducted using the proposed MSP-CD network, further attests to the applicability of our proposed change detection framework.

A Semi-Supervised Deep Learning Framework for Change Detection in Open-Pit Mines Using SAR Imagery

Detecting and monitoring changes in open-pit mines is crucial for efficient mining operations. Indeed, these changes comprise a broad spectrum of activities that can often lead to significant environmental impacts such as surface damage, air pollution, soil erosion, and ecosystem degradation. Conventional optical sensors face limitations due to cloud cover, hindering accurate observation of the mining area. To overcome this challenge, synthetic aperture radar (SAR) images have emerged as a powerful solution, due to their unique ability to penetrate clouds and provide a clear view of the ground. The open-pit mine change detection task presents significant challenges, justifying the need for a model trained for this specific task. First, different mining areas frequently include various features, resulting in a diverse range of land cover types within a single scene. This heterogeneity complicates the detection and distinction of changes within open-pit mines. Second, pseudo changes, e.g., equipment movements or humidity fluctuations, which show statistically reliable reflectivity changes, lead to false positives, as they do not directly correspond to the actual changes of interest, i.e., blasting, collapsing, or waste pile operations. In this paper, to the best of our knowledge, we present the first deep learning model in the literature that can accurately detect changes within open-pit mines using SAR images (TerraSAR-X). We showcase the fundamental role of data augmentations and a coherence layer as a critical component in enhancing the model’s performance, which initially relied solely on amplitude information. In addition, we demonstrate how, in the presence of a few labels, a pseudo-labeling pipeline can improve the model robustness, without degrading the performance by introducing misclassification points related to pseudo changes. The F1-Score results show that our deep learning approach is a reliable and effective method for SAR change detection in the open-pit mining sector.

Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange

Change detection is a critical task in studying the dynamics of ecosystems and human activities using multi-temporal remote sensing images. While deep learning has shown promising results in change detection tasks, it requires a large number of labeled and paired multi-temporal images to achieve high performance. Pairing and annotating large-scale multi-temporal remote sensing images is both expensive and time-consuming. To make deep learning-based change detection techniques more practical and cost-effective, we propose an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange (I3PE). The I3PE framework allows for training deep change detectors on unpaired and unlabeled single-temporal remote sensing images that are readily available in real-world applications. The I3PE framework comprises four steps: (1) intra-image patch exchange method is based on an object-based image analysis (OBIA) method and adaptive clustering algorithm, which generates pseudo-bi-temporal image pairs and corresponding change labels from single-temporal images by exchanging patches within the image; (2) inter-image patch exchange method can generate more types of land-cover changes by exchanging patches between images; (3) a simulation pipeline consisting of several image enhancement methods is proposed to simulate the radiometric difference between pre- and post-event images caused by different imaging conditions in real situations; (4) self-supervised learning based on pseudo-labels is applied to further improve the performance of the change detectors in both unsupervised and semi-supervised cases. Extensive experiments on two large-scale datasets covering Hong Kong, Shanghai, Hangzhou, and Chengdu, China, demonstrate that I3PE outperforms representative unsupervised approaches and achieves F1 value improvements of 10.65% and 6.99% to the state-of-the-art method. Moreover, I3PE can improve the performance of the change detector by 4.37% and 2.61% on F1 values in the case of semi-supervised settings. Additional experiments on a dataset covering a study area with 144 km2 in Wuhan, China, confirm the effectiveness of I3PE for practical land-cover change analysis tasks.