A New Infrared and Visible Image Fusion Algorithm in NSCT Domain

Abstract

Infrared and visible image fusion can produce a composite image which has high contrast and rich background details of the scene. In view of the defects of some existing infrared and visible fusion method, such as low contrast and unclear background details, we propose a novel multi-scale fusion method based on the combination of non-sampled contourlet transform (NSCT), sparse representation and pulse coupled neural network. In our method, the source images are firstly decomposed into one low frequency sub-band and high frequency sub-bands at different scales and directions using NSCT. Fusion rules based on the sparse representation and modified PCNN are developed, and then used for fusion of the low sub-band and high frequency sub-bands, respectively. In the modified PCNN developed in this paper, we use Sum-Modified-Laplacian and Log-Gabor energy as values of the linking strength instead of setting it a constant. Each of the linking strength corresponds to an ignition map, the average of the two results is taken as the final PCNN output. The fused image are finally obtained by performing the inverse NSCT. Comparison experiment results show that the fused image produced by the proposed method has high contrast and rich details, as well as the greatly improved objective evaluation indexes values.