Infrared and visible image fusion of generative adversarial network based on multi-channel encoding and decoding

Abstract

Image fusion can overcome the shortcomings of unclear, inaccurate and incomplete target description of single sensor image, achieve more accurate expression of target, and lay a foundation for subsequent image analysis and processing. Aiming at the existing algorithms based on generative adversarial networks only relying on the adversarial training of discriminators to achieve image fusion, and the balance of the respective features of infrared and visible images is not comprehensive or even fine enough, an infrared and visible image fusion algorithm based on multi-channel encoding and decoding generative adversarial network was proposed in this paper. Compared with the existing image decomposition methods, a triple codec structure is designed for feature extraction, which can use the generator itself to get a fusion image with extraordinary effect, and then use the discriminator to improve the quality of the fusion result. Secondly, a contrast enhancement module is designed after the infrared path structure of the encoder in the generator to enhance the contrast information of the target area. In addition, a dual discriminator model is designed, and in order to improve the feature learning ability of the generator, an incentive module is designed at the end of the discriminator. Finally, gradient loss and contrast loss are designed, and the training speed is improved by combining specific functions. Experimental results show that compared with the eleven classical algorithms, almost all of the proposed algorithms have better visual effects, and their quantitative indicators are also better.