Multi-sensor data fusion using NIHS transform and decomposition algorithms

Abstract

Multi-spectral image fusion is to enhance the details present in multi-spectral bands with the spatial information available in the panchromatic image. Fused images have the effect of spectral distortions and lack of structural similarity. To overcome these limitations, three methods are proposed using intensity, hue, saturation (IHS) and nonlinear IHS (NIHS) transform along with the Dynamic Mode Decomposition (DMD) and 2D-Empirical Mode Decomposition (2D-EMD or IEMD). An intensity plane is calculated from the NIHS transform. The modes are constructed using DMD by considering the variations between the intensity plane computed using NIHS transforms of a low resolution multi-spectral image and a panchromatic image. Similarly, 2D-EMD is also used for image fusion. Modes are subjected to weighted fusion rule to get an intensity plane with spatial and edge information. Finally, the calculated intensity plane is concatenated along with the hue and saturation plane of low-resolution multi-spectral image and transformed into RGB color space. Thus, the fused images have high spatial and edge information on spectral bands. The experiments and its quality assessment assure that proposed methods perform better than the existing methods.