Abstract

This article presents a novel global gradient sparse and nonlocal low-rank tensor decomposition model with a hyper-Laplacian prior for hyperspectral image (HSI) superresolution to produce a high-resolution HSI (HR-HSI) by fusing a low-resolution HSI (LR-HSI) with an HR multispectral image (HR-MSI). Inspired by the investigated hyper-Laplacian distribution of the gradients of the difference images between the upsampled LR-HSI and latent HR-HSI, we formulate the relationship between these two datasets as a $\ell _{p}$ $(0 -norm term to enforce spectral preservation. Then, the relationship between the HR-MSI and latent HR-HSI is built using a tensor-based fidelity term to recover the spatial details. To effectively capture the high spatio-spectral-nonlocal similarities of the latent HR-HSI, we design a novel nonlocal low-rank Tucker decomposition to model the 3-D regular tensors constructed from the grouped nonlocal similar HR-HSI cubes. The global spatial-spectral total variation regularization is then adopted to ensure the global spatial piecewise smoothness and spectral consistency of the reconstructed HR-HSI from nonlocal low-rank cubes. Finally, an alternating direction method of multipliers-based algorithm is designed to efficiently solve the optimization problem. Experiments on both the synthetic and real datasets collected by different sensors show the effectiveness of the proposed method, from visual and quantitative assessments.

Highlights

  • H YPERSPECTRAL imaging is an emerging modality that can provide the same scene over several hundreds of contiguous and narrow spectral bands

  • The existing panchromatic and multispectral imaging cameras can provide panchromatic images (PANs) and multispectral images (MSIs) with much higher spatial resolution, which can be fused with low spatial resolution hyperspectral image (HSI) (LRHSIs) to obtain HSIs with high spatial resolution (HR-HSIs)

  • To get rid of the empirical blur kernel, we explore the relationship between the target high-resolution HSI (HR-HSI) and observed low-resolution HSI (LR-HSI) by investigating the gradient distribution of the difference image between these two datasets

Read more

Summary

INTRODUCTION

H YPERSPECTRAL imaging is an emerging modality that can provide the same scene over several hundreds of contiguous and narrow spectral bands. In [26], a nonnegative dictionary learning algorithm using the block-coordinate descent optimization technique is proposed to learn the spectral basis, and a structured sparse coding approach is used to estimate the coefficient matrix In this way, the nonlocal spatial similarities of HR-HSIs are exploited to solve the superresolution problem and achieve promising performance. Many the matrix factorization-based methods have been proposed under different constraints and have yielded promising performances, all of them needed to unfold 3-D data structures into matrices, which makes it difficult to fully exploit the spatial-spectral correlations of HSIs [2], [3]. Dian et al [30] proposed a low tensor train rank-based HSI superresolution method, which learns the correlations among the spatial, spectral, and nonlocal modes of the nonlocal similar HR-HSI cubes via a tensor train rank prior. Global SSTV regularization is integrated into the fusion model to reconstruct the HR-HSI from these nonlocal low-rank cubes, to further capture the global spatial piecewise smoothness and spectral consistency of the HR-HSI

TENSOR NOTATIONS
PROPOSED MODEL
Spectral Preservation
Spatial Structural Preservation
Nonlocal Low-Rank and Global Total Variation Assumptions
Proposed HL-GSNLTD Model
Optimization Algorithm
EXPERIMENTAL STUDY
Synthetic Datasets
Implementation Details
Experimental Results on Synthetic Datasets
Experimental Results on Synthetic Dataset Corrupted by Gaussian Noise
Experimental Results on Real Dataset
DISCUSSION
Parameter Selection
Computational Complexity
CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call