Remote Sensing Image Fusion Algorithm Research Articles

Quantum image scaling with applications to image steganography and fusion

A quantum hue, saturation, and lightness model is proposed in which a triple qubit sequence (QHTS) is encoded and used as a data model for the implementation of quantum image scaling. The preparation and retrieval of QHTS images is presented, in which only q+2 qubits (where q is the bit depth) are required to encode color information while retaining relevant HSL image features and operability. A conventional nearest neighbor interpolation was adopted to implement quantum image up-scaling and down-scaling operations, from which two other scaling applications were developed. One such technique is a form of quantum steganography based on end-to-end encryption, which provides high capacity while ensuring the security of carrier images and secret messages. The other is a spatial remote sensing image fusion algorithm, based on QHTS images, which pioneers quantum pseudocolor composites of multi-spectral and panchromatic images. Simulation experiments demonstrated the proposed methodology provides an embedding capacity more than double that of existing quantum image steganography algorithms. In addition, a complexity analysis demonstrated the efficiency of the two proposed quantum image scaling applications, which take full advantage of quantum parallelism.

Gram-Schmidt Remote Sensing Image Fusion Algorithm Based on Matrix Elementary Transformation

In the application of the Internet of vehicles, it is difficult for a single remote sensing image to have accurate spatial information and spectral information at the same time, so engineers must use image fusion to improve the utilization of remote sensing image information. Aiming at the shortcomings of low spectral resolution and relatively complex programming of traditional fusion algorithms, this paper proposes a Gram-Schmidt remote sensing image fusion algorithm based on matrix elementary transformation, which aims to improve the spatial resolution of multispectral images by using panchromatic images with high spatial resolution. The orthogonalization process of the algorithm in this paper uses the elementary matrix transformation, which is simple and easy to perform. The experimental results show that it can effectively improve the spatial resolution of the original image and has good spectral retention.

Remote Sensing Image Fusion Algorithm Based on Two-Stream Fusion Network and Residual Channel Attention Mechanism

A two-stream remote sensing image fusion network (RCAMTFNet) based on the residual channel attention mechanism is proposed by introducing the residual channel attention mechanism (RCAM) in this paper. In the RCAMTFNet, the spatial features of PAN and the spectral features of MS are extracted, respectively, by a two-channel feature extraction layer. Multiresidual connections allow the network to adapt to a deeper network structure without the degradation. The residual channel attention mechanism is introduced to learn the interdependence between channels, and then the correlation features among channels are adapted on the basis of the dependency. In this way, image spatial information and spectral information are extracted exclusively. What is more, pansharpening images are reconstructed across the board. Experiments are conducted on two satellite datasets, GaoFen-2 and WorldView-2. The experimental results show that the proposed algorithm is superior to the algorithms to some existing literature in the comparison of the values of reference evaluation indicators and nonreference evaluation indicators.

Saliency-Guided Nonsubsampled Shearlet Transform for Multisource Remote Sensing Image Fusion.

The rapid development of remote sensing and space technology provides multisource remote sensing image data for earth observation in the same area. Information provided by these images, however, is often complementary and cooperative, and multisource image fusion is still challenging. This paper proposes a novel multisource remote sensing image fusion algorithm. It integrates the contrast saliency map (CSM) and the sum-modified-Laplacian (SML) in the nonsubsampled shearlet transform (NSST) domain. The NSST is utilized to decompose the source images into low-frequency sub-bands and high-frequency sub-bands. Low-frequency sub-bands reflect the contrast and brightness of the source images, while high-frequency sub-bands reflect the texture and details of the source images. Using this information, the contrast saliency map and SML fusion rules are introduced into the corresponding sub-bands. Finally, the inverse NSST reconstructs the fusion image. Experimental results demonstrate that the proposed multisource remote image fusion technique performs well in terms of contrast enhancement and detail preservation.

Research on satellite remote sensing image fusion algorithm based on compression perception theory

With the development of space technology in recent years, various spacecraft with different sensors have been launched one after another, and there are more and more satellite remote sensing images in different situations. How to obtain better quality images has become the main research direction in the field of image fusion. Image fusion is an important branch and main research object of information fusion. Generally speaking, with the rapid development of the information society, people have higher and higher quality requirements for a variety of images, so There are serious challenges in storing, transmission and signal sampling. Nowadays, with the development of compressed sensing (CS) theory, a new sampling method has been extensively studied by many scholars. Compared with traditional Nyquist sampling theorem, Compression sensing can respond to the original signal with fewer sampling points. This paper is introduced the fusion algorithm of satellite remote sensing image based on compressed sensing. Firstly, the basic theory of compressed perceptual discretization signal is introduced. Secondly, a sparse CS remote sensing image fusion algorithm based on wavelet transform is proposed. Finally, through simulation verification, comparing the widely used IHS fusion and PCA fusion image methods, the method in this paper can get higher correlation coefficient and lower interaction entropy and spectral distortion after fusion. Compared with other methods in this paper, the fusion image can carry more space information and the original image is more similar.

Performance of Spatial Frequency Discrete Wavelet Transform Based Remote Sensing Image Fusion Algorithm

The high sensor cost for producing images with superior spectral and spatial qualities in remote sensing application have led to the development of image fusion algorithms. Image fusion technique combines a Panchromatic image and a Multispectral image with an aim to produce images with excellent spatial and spectral qualities. One of the major factors that affect the performance of any image fusion algorithm is the capability of the algorithm in extracting the spatial and spectral data from the respective images and how effective the so extracted information is blended together. One of the recently developed spectral domain algorithm to perform image fusion in remote sensing applications is Spatial Frequency Discrete Wavelet Transform abbreviated as SFDWT. The excellence of SFDWT image fusion algorithm is already proven better than the prevailing algorithms based on Discrete Wavelet Transform. This paper is coined with an eye to realize the performance of SFDWT based image fusion algorithm with respect to IHS-DWT, which being an enhanced form of a typical DWT based image fusion algorithm. The performance of SFDWT and IHS-DWT based image fusion algorithms will be evaluated by applying both techniques in the fusion of urban images received from Pléiades sensors with 1:4 resolution ratio using qualitative and quantitative image quality assessment methods. The consequence of varying the decomposition level on the quality of the images produced using SFDWT image fusion technique and three variants of IHS-DWT techniques based on substitution, averaging and maximum selection will be also evaluated. From the experimental analysis done using MATLAB simulation, it will be vivid that images obtained using image fusion algorithm based on SFDWT are much better than that obtained using IHS-DWT technique with excellent spatial and spectral qualities.

Remote sensing image fusion algorithm based on mutual-structure for joint filtering using saliency detection

Multimodality image fusion provides more comprehensive information and has an increasingly wide range of uses. For the remote sensing image fusion, traditional multiresolution analysis (MRA)-based methods always have insufficiencies in contrast with spatial details. At the same time, traditional sum of modified Laplace may do blocking artifacts. In order to overcome these deficiencies, we propose a remote sensing image fusion method based on the mutual-structure for joint filtering and saliency detection. Our method uses joint filtering to facilitate the correct extraction of the high and low frequency from source images. The saliency detection method also improves the effect of low-frequency fusion, and the high-frequency sub-bands calculate the extended sum of modified Laplace for better fusion. The method is compared with other five classical fusion methods. The experimental results show that the algorithm effectively preserves the structural information and textural information of the image and improves the sharpness of the fused image. It turns out to have many advantages in subjective and objective evaluation.

FusionCNN: a remote sensing image fusion algorithm based on deep convolutional neural networks

In remote sensing image fusion field, traditional algorithms based on the human-made fusion rules are severely sensitive to the source images. In this paper, we proposed an image fusion algorithm using convolutional neural networks (FusionCNN). The fusion model implicitly represents a fusion rule whose inputs are a pair of source images and the output is a fused image with end-to-end property. As no datasets can be used to train FusionCNN in remote sensing field, we constructed a new dataset from a natural image set to approximate MS and Pan images. In order to obtain higher fusion quality, low frequency information of MS is used to enhance the Pan image in the pre-processing step. The method proposed in this paper overcomes the shortcomings of the traditional fusion methods in which the fusion rules are artificially formulated, because it learns an adaptive strong robust fusion function through a large amount of training data. In this paper, Landsat and Quickbird satellite data are used to verify the effectiveness of the proposed method. Experimental results show that the proposed fusion algorithm is superior to the comparative algorithms in terms of both subjective and objective evaluation.

Remote sensing image fusion via RPCA and adaptive PCNN in NSST domain

In order to improve fused image quality of multi-spectral (MS) image and panchromatic (PAN) image, a new remote sensing image fusion algorithm based on robust principal component analysis (RPCA) and non-subsampled shearlet transform (NSST) is proposed. First, the first principle component PC1 of MS image is extracted via principal component analysis (PCA). Then, the component PC1 and PAN image are decomposed by NSST to get the low and high frequency subbands, respectively. For the low frequency subband, the sparse matrix of PAN image by RPCA decomposition is used to guide the fusion rule; for the high frequency subbands, the fusion rule employed is based on adaptive PCNN model. Finally, the fusion image is obtained by inverse NSST transform and inverse PCA transform. The experimental results illustrate that the proposed fusion algorithm outperforms other classical fusion algorithms (PCA, Curvelet, NSCT, NSST and NSCT-PCNN) in terms of visual quality and objective evaluation in whole, and achieve better fusion performance.

Remote Sensing Image Fusion Method Based on PCA and Curvelet Transform

In order to fuse two registered multi-spectral (MS) image and panchromatic (PAN) image in the same scene, a new remote sensing image fusion algorithm based on Principal Component Analysis (PCA) and Curvelet transform is proposed. The first principle component PC1 of MS image is extracted via PCA transform, at the same time, we perform the Morphology-Hat transform on the PAN image, and segment the transformed PAN image by the PCNN segmentation algorithm. Perform the Curvelet transform on the component PC1 of MS image and the PAN image after Morphology-Hat transform, and use different fusion rule to fuse different scale layers coefficients (coarse, detail and fine scale layer). For obtaining the fused image, we use the inverse Curvelet transform and inverse PCA transform to obtain the fused image. The experimental results illustrate that the proposed fusion algorithm outperforms Curvelet transform and other traditional fusion algorithms in whole such as intensity–hue–saturation, PCA, Brovey and Weighted Average both in visual effect and objective evaluation indexes (standard deviation, mean, information entropy, correlation coefficient, spectral distortions and deviation index).

An Improved Remote Sensing Image Fusion Algorithm Based on IHS Transformation

In remote sensing image processing, the traditional fusion algorithm is based on the Intensity-Hue-Saturation (IHS) transformation. This method does not take into account the texture or spectrum information, spatial resolution and statistical information of the photos adequately, which leads to spectrum distortion of the image. Although traditional solutions in such application combine manifold methods, the fusion procedure is rather complicated and not suitable for practical operation. In this paper, an improved IHS transformation fusion algorithm based on the local variance weighting scheme is proposed for remote sensing images. In our proposal, firstly, the local variance of the SPOT (which comes from French “Systeme Probatoire d`Observation dela Tarre” and means “earth observing system”) image is calculated by using different sliding windows. The optimal window size is then selected with the images being normalized with the optimal window local variance. Secondly, the power exponent is chosen as the mapping function, and the local variance is used to obtain the weight of the I component and match SPOT images. Then we obtain the I` component with the weight, the I component and the matched SPOT images. Finally, the final fusion image is obtained by the inverse Intensity-Hue-Saturation transformation of the I`, H and S components. The proposed algorithm has been tested and compared with some other image fusion methods well known in the literature. Simulation result indicates that the proposed algorithm could obtain a superior fused image based on quantitative fusion evaluation indices.

Research on Remote Sensing Image Fusion Algorithm Based on Compressed Sensing

Research on Remote Sensing Image Fusion Algorithm Based on Compressed Sensing

S-PCNN与二维静态小波相结合的遥感图像融合研究

S-PCNN与二维静态小波相结合的遥感图像融合研究

Remote Sensing Image Fusion Based On IHS and Dual Tree Compactly Supported Shearlet Transform

This paper presents a novel remote sensing image fusion algorithm, which implements the intensity-hue-saturation (IHS) transform on panchromatic sharpening of multispectral data and the dual-tree compactly supported shearlet transform (DT CSST) during fusion. Shearlet transforms can provide almost optimal representation of the anisotropic features of an image. The spatial domain discrete implementation, the compactly supported shearlet transform (CSST), which represents the directions by dilation operations, are selected in the proposed fusion method. Since most of the prominent features of images, such as edges and regions, have limited sizes in the spatial domain, CSST is very suitable for image fusion. However, the conventional CSST is shift-variant, which causes distortions in fused images. With the embedded dual-tree (DT) sturcture in the CSST, the shift-variant properties can be effectively reduced. Combining the IHS transform and the DT CSST, an effective panchromatic and multispectral image fusion method is proposed in this paper. The experiments’ results suggest that the proposed method extract more spatial information from panchromatic images with less lost in spectral consistency compared to other fusion methods which are based on discrete wavelet transform (DWT), a trous wavelet transform, a trous shearlet transform, the dual-tree complex wave transform ( DT CWT), or the Curvelet transform.

Multi-spectral and Panchromatic Remote Sensing Image Fusion Algorithm based on Directional Wavelet

Multi-spectral and Panchromatic Remote Sensing Image Fusion Algorithm based on Directional Wavelet

A Novel Algorithm for Satellite Images Fusion Based on Compressed Sensing and PCA

This paper studies the image fusion of high-resolution panchromatic image and low-resolution multispectral image. Based on the classic fusion algorithms on remote sensing image fusion, the PCA (principal component analysis) transform, and discrete wavelet transform, we carry out in-depth research. The compressed sensing (CS) abandons the full sample and shifts the sampling of the signal to sampling information that greatly reduces the potential consumption of traditional signal acquisition and processing. We combine compressed sensing with satellite remote sensing image fusion algorithm and propose an innovative fusion algorithm (CS-FWT-PCA), in which the symmetric fractional B-spline wavelet acts as the sparse base. In the algorithm we use Hama Da matrix as the measurement matrix and SAMP as the reconstruction algorithm and adopt an improved fusion rule based on the local variance. The simulation results show that the CS-FWT-PCA fusion algorithm achieves better fusion effect than the traditional fusion method.

Multi-Source Remote Sensing Image Fusion Algorithm Based on Combined Wavelet Transform and HIS Transform

Multi-Source Remote Sensing Image Fusion Algorithm Based on Combined Wavelet Transform and HIS Transform

Fusion of IKONOS Satellite Imagery Using IHS Transform and Local Variation

The intensity-hue-saturation (IHS) technique is a well-known merging approach for its computational efficiency and spatial definition holding. However, it results in color distortion particularly for the remote sensing images of IKONOS and QuickBird as some other fusion methods, such as principal component analysis, and Brovey transform. Although wavelet-based image fusion approaches can provide a better tradeoff between spatial and spectral quality, the fused images with these methods often have a spatial resolution that is less than that of the IHS-based algorithm. A remote sensing image fusion algorithm based on IHS transform and local variation and its modified approach with low computational complexity are proposed. Visual effect and quantity evaluation results show that the proposed simple algorithm outperforms the conventional image fusion methods in the spectral domain with the spatial quality similar to that of the undecimated wavelet transform-based scheme. The proposed modified method can obtain the similar spatial resolution of the merged image with the IHS-based fusion algorithm and the better spectral quality in the green vegetation areas.