Abstract

Infrared and visible image fusion technologies make full use of different image features obtained by different sensors, retain complementary information of the source images during the fusion process, and use redundant information to improve the credibility of the fusion image. In recent years, many researchers have used deep learning methods (DL) to explore the field of image fusion and found that applying DL has improved the time-consuming efficiency of the model and the fusion effect. However, DL includes many branches, and there is currently no detailed investigation of deep learning methods in image fusion. In this work, this survey reports on the development of image fusion algorithms based on deep learning in recent years. Specifically, this paper first conducts a detailed investigation on the fusion method of infrared and visible images based on deep learning, compares the existing fusion algorithms qualitatively and quantitatively with the existing fusion quality indicators, and discusses various fusions. The main contribution, advantages, and disadvantages of the algorithm. Finally, the research status of infrared and visible image fusion is summarized, and future work has prospected. This research can help us realize many image fusion methods in recent years and lay the foundation for future research work.

Highlights

  • Under normal conditions, objects will radiate electromagnetic waves of different frequencies, which is called thermal radiation

  • Fusion Methods of Infrared and Visible Images Based on Deep Learning this section, wecomprehensively comprehensivelyreview review the the infrared infrared and based In we andvisible visibleimage imagefusion fusionmethods methods based section, we comprehensively review the infrared and visible image fusion methods based on deep

  • The application of deep learning methods (DL)-based techniques to visible and infrared image fusion has been progressing at a fast rate in recent years

Read more

Summary

Introduction

Objects will radiate electromagnetic waves of different frequencies, which is called thermal radiation. Each type of fusion method involves three key challenges, i.e., image transform, activity-level measurement, and fusion rule designing [33]. In the field of image fusion, a variety of different infrared and visible image fusion methods have been proposed in recent years. This research aims to conduct a detailed review of the existing deep learning-based infrared and visible image fusion algorithms and discuss their future development trends and challenges. This article introduces the theoretical knowledge of infrared and visible image fusion and the corresponding fusion evaluation index This survey makes a qualitative and quantitative comparison of some related articles’ experiments to provide a reliable basis for this research. Infrared and visible image fusion techniques based on deepimage learning:

Fusion
CNN-Based Fusion Methods
Limitation
Siamese Networks-Based Fusion Methods
GAN-Based Fusion Methods
Methods
Assessment
Subjective Evaluation Methods
Objective Evaluation Metrics
XM XN h
3.2.13. Other Metrics
Experiments
Medical Diagnosis Applications
Experiment for Typical Methods
Qualitative
Future Trends
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.