Abstract

Deep transfer-learning based change detection methods are dependent on the availability of sensor-specific pre-trained feature extractors. Such feature extractors are not always available due to lack of training data, especially for hyperspectral sensors and other hyperdimensional images. Moreover models trained on easily available multispectral (RGB/RGB-NIR) images cannot be reused on such hyperdimensional images due to their irregular number of bands. While hyperdimensional images show large number of spectral bands, they generally show much less spatial complexity, thus reducing the requirement of large receptive fields of convolution filters. Recent works in the computer vision have shown that even untrained deep models can yield remarkable result in some tasks like super-resolution and surface reconstruction. This motivates us to make a bold proposition that untrained lightweight deep model, initialized with some weight initialization strategy, can be used to extract useful semantic features from bi-temporal hyperdimensional images. Based on this proposition, we design a novel change detection framework for hyperdimensional images by extracting bi-temporal features using an untrained model and further comparing the extracted features using Deep Change Vector Analysis to distinguish changed pixels from the unchanged ones. We further use the deep change hypervectors to cluster the changed pixels into different semantic groups. We conduct experiments on four change detection datasets: three hyperspectral datasets and a hyperdimensional Polarimetric Synthetic Aperture Radar dataset. The results clearly demonstrate that the proposed method is suitable for change detection in hyperdimensional remote sensing data.

Highlights

  • Deep learning has attracted significant attention in Earth observation [1]

  • We use the same set of methods as for hyperspectral change detection (CD) for comparison except those designed for hyperspectral images (SAMZID and AICA) and DCVA3Channels-1/2 as there are no available R, G, B bands in this case

  • We presented an unsupervised change detection method for hyperdimensional images

Read more

Summary

Introduction

Deep learning has attracted significant attention in Earth observation [1]. Following this trend, deep learning based methods have been developed for change detection (CD) [2], an important topic in Earth observation. While the transfer learning based methods do not use any training or fine-tuning of the deep model, they depend on the availability of pre-trained feature extractor that can be used to capture the semantics of the input images In more details, such transfer learning based methods project the bi-temporal images in deep featurespace by using a pre-trained deep feature extractor and subsequently compares the images in the projected domain. They perform change detection by reusing a deep model that was previously trained for some unrelated task, e.g., image classification. Most deep transfer learning based CD methods are designed for Synthetic Aperture Radar (SAR) amplitude images and multispectral images with few bands

Objectives
Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call