DIVFusion: Darkness-free infrared and visible image fusion

Abstract

As a vital image enhancement technology, infrared and visible image fusion aims to generate high-quality fused images with salient targets and abundant texture in extreme environments. However, current image fusion methods are all designed for infrared and visible images with normal illumination. In the night scene, existing methods suffer from weak texture details and poor visual perception due to the severe degradation in visible images, which affects subsequent visual applications. To this end, this paper advances a darkness-free infrared and visible image fusion method (DIVFusion), which reasonably lights up the darkness and facilitates complementary information aggregation. Specifically, to improve the fusion quality of nighttime images, which suffer from low illumination, texture concealment, and color distortion, we first design a scene-illumination disentangled network (SIDNet) to strip the illumination degradation in nighttime visible images while preserving informative features of source images. Then, a texture–contrast enhancement fusion network (TCEFNet) is devised to integrate complementary information and enhance the contrast and texture details of fused features. Moreover, a color consistency loss is designed to mitigate color distortion from enhancement and fusion. Finally, we fully consider the intrinsic relationship between low-light image enhancement and image fusion, achieving effective coupling and reciprocity. In this way, the proposed method is able to generate fused images with real color and significant contrast in an end-to-end manner. Extensive experiments demonstrate that DIVFusion is superior to state-of-the-art algorithms in terms of visual quality and quantitative evaluations. Particularly, low-light enhancement and dual-modal fusion provide more effective information to the fused image and boost high-level vision tasks. Our code is publicly available at https://github.com/Xinyu-Xiang/DIVFusion.