AMFNet: An attention-guided generative adversarial network for multi-model image fusion

Abstract

Most of the existing image fusion methods fail to retain sufficient salient information, lack focuses on the most discriminative regions of the image, and often neglect the subjective perception of the human visual system. To address these problems, we propose an attention-guided generative adversarial network (AMFNet) for multi-model image fusion. The generator network of AMFNet consists of three parts: an attention network for capturing long-range dependencies in the internal representations of images, an information refinement network for obtaining image feature maps, and a fusion network for merging the attention network and the information refinement network. In addition, the convolutional block attention module is introduced to force the discriminator to focus on the most discriminative regions of the multi-modal source images. The results of qualitative and quantitative experiments conducted on numerous public datasets demonstrate that the proposed method outperforms other methods on visual effects and retains more detail information about the images.