Internet street view image fusion method using convolutional neural network

Abstract

The use of image fusion technology in the area of information processing is continuing to advance in depth thanks to ongoing hardware advancements and related research. An enhanced convolutional neural network approach is developed to fuse visible and infrared images, and image pre-processing is carried out utilising an image alignment method with edge detection in order to gain more accurate and trustworthy image information. The performance of the fast wavelet decomposition, convolutional neural network, and modified convolutional neural network techniques is compared and examined using four objective assessment criteria. The experimental findings demonstrated that the picture alignment was successful with an offset error of fewer than 3 pixels in the horizontal direction and an angle error of less than 0.3∘ in both directions. The revised convolutional neural network method increased the information entropy, mean gradient, standard deviation, and edge detection information by an average of 46.13%, 39.40%, 19.91%, and 3.72%. The runtime of the modified approach was lowered by 19.42% when compared to the convolutional neural network method, which enhanced the algorithm’s performance and boosted the effectiveness of picture fusion. The image fusion accuracy reached 98.61%, indicating that the method has better fusion performance and is of practical value for improving image fusion quality.