Abstract

Deep-hashing methods have drawn significant attention during the past years in the field of remote sensing (RS) owing to their prominent capabilities for capturing the semantics from complex RS scenes and generating the associated hash codes in an end-to-end manner. Most existing deep-hashing methods exploit pairwise and triplet losses to learn the hash codes with the preservation of semantic-similarities which require the construction of image pairs and triplets based on supervised information (e.g., class labels). However, the learned Hamming spaces based on these losses may not be optimal due to an insufficient sampling of image pairs and triplets for scalable RS archives. To solve this limitation, we propose a new deep-hashing technique based on the class-discriminated neighborhood embedding, which can properly capture the locality structures among the RS scenes and distinguish images class-wisely in the Hamming space. An extensive experimentation has been conducted in order to validate the effectiveness of the proposed method by comparing it with several state-of-the-art conventional and deep-hashing methods. The related codes of this article will be made publicly available for reproducible research by the community.

Highlights

  • S PACEBORNE and airborne remotely sensed images offer an important tool to deal with current societal needs as well as future challenges [1]

  • Analyzing the other two deep hashing methods included in this experiment (i.e., deep hashing CNN (DHCNN) and Triplet), both CDNE(MU) and CDNE(MB) can better discover the locality structure of the images in the Hamming space based on their semantic information

  • We propose a new deep-hashing method for remote sensing (RS) content-based image retrieval (CBIR), termed CDNE

Read more

Summary

INTRODUCTION

S PACEBORNE and airborne remotely sensed images offer an important tool to deal with current societal needs as well as future challenges [1]. Current deep-hashing models are typically optimized by stochastically sampling image pairs or triplets within each mini-batch, which may eventually constrain the number of positive and negative land-cover sample concepts that can be considered in each training iteration This limited semantic scope may lead to an insufficient (or unaffordable) learning process, motivating the development of new deep-hashing models to effectively learn binary codes from unconstrained RS archives [12]. We define the class-discriminated neighborhood embedding (CDNE), which pursues to enhance the land-cover semantic information of the binary representations by sufficiently capturing the locality structures among RS scenes and class wisely distinguishing images in the Hamming space To achieve this goal, three main components take part in the presented design: first, the scalable neighborhood component analysis (SNCA), focused on discovering the neighborhood structure in the metric space; second, the cross entropy (CE) loss, aimed at preserving the land-cover class discrimination capability; and 3) the quantization loss, directed to generate the final binary codes.

Conventional Hashing
Deep Hashing
Current Limitations in RS Applications
Novelty of the Proposed Approach
CDNE FOR DEEP HASHING
Loss Function
Optimization Strategy
Datasets
Experimental Setup
Experimental Results
Findings
CONCLUSION AND FUTURE LINES
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call