Hyperspectral and Panchromatic Image Fusion via Adaptive Tensor and Multi-Scale Retinex Algorithm

Jiahui Qu,Yunsong Li,Haoming Xia,Qian Du

doi:10.1109/access.2020.2972939

Jiahui Qu, Yunsong Li + Show 2 more

Open Access

PDF Available

https://doi.org/10.1109/access.2020.2972939

Copy DOI

Export

Save

Cite

Abstract
Highlights/Summary
Full-Text PDF
Similar Papers

Abstract

Listen

Fusion of panchromatic image (PANI) and hyperspectral image (HSI) to obtain an output image with high spatial and spectral resolutions has received increasing interests recently. We propose a new image fusion method for HSI and PANI by combining adaptive tensor with a multi-scale Retinex algorithm in this paper. In the proposed method, an adaptive tensor based method is presented to effectively extract the structure information of HSI, and multi-scale Retinex algorithm is introduced to obtain the spatial and structure details of PANI. To integrate spatial structure information, a gradient-based weighted fusion strategy is proposed to combine spatial details of HSI and PANI. The integrated structure details are injected to generate the fused HSI. Experiments using both simulated and real remote sensing data sets demonstrated that the proposed fusion algorithm performs better than the state-of-the-art algorithms in visual inspection and objective assessment.

Highlights

Due to the technical constraints, information collected by a single sensor only reflects partial characteristics of an object, but cannot reflect complete characteristics
The Panchromatic (PAN) remote sensing sensors are capable of providing the PAN image (PANI) that possesses high spatial resolution (HSR)
Based on the idea of tensor matrix and Multi-scale Retinex algorithm, we present a new HS imagery (HSI) and PANI fusion method, where an adaptive tensor based algorithm is presented to extract the details of HSI

Summary

Introduction

Due to the technical constraints, information collected by a single sensor only reflects partial characteristics of an object, but cannot reflect complete characteristics. Multiple sensors can reflect more complete characteristics and information. The hyperspectral (HS) remote sensing sensors provide the HS imagery (HSI) which has abundant spectral information [1]. The Panchromatic (PAN) remote sensing sensors are capable of providing the PAN image (PANI) that possesses high spatial resolution (HSR). The HSI is a three-dimensional data, and has been used in various fields [2]–[5]. The HSI usually has low spatial resolution (LSR). The plentiful spatial information provided by the PAN images (PANIs) is helpful to locate the objects accurately [6].

Methods

Results

Conclusion