Abstract
Thermal infrared (TIR) images are not influenced by the illumination variations and can be used in total darkness. With these advantages, TIR technology has a wide application in surveillance systems and various defense systems. However, there are not enough TIR images for wide range of application because the equipment for thermal infrared imaging is expensive and demands strict imaging conditions. To address this problem, we propose a sparse generative model based on pix2pix framework to produce synthetic TIR data from optical RGB images. Considering little texture and color information in TIR images, this model uses a U-net architecture but only selects partial low-level and high-level information for symmetric connections. Specially, we integrate intensity and gradient losses into the objective to train models, which assists generation models to learn more infrared images’ characteristics. The experiments on public datasets prove that this proposed method can generate TIR data from optical images. Compared with current pix2pix networks, this method achieves increases by over 6.5% and over 1.2% separately on the metrics of SSIM and PSNR based on the public datasets. The SSIM value even gets an increase by 7% for daytime images. Meanwhile the network parameters decent by 13%.
Highlights
Image-to-image translation based on generative adversarial networks (GANs) has received increasing attention
Optical images can present information similar to what the human could see but are sensitive to illumination variation, while Thermal infrared (TIR) images can make up for this weakness by their thermal radiation differences. In certain fields such as military and environmental monitoring, TIR images are more useful than optical images because they are independent of the quality of the environment
In this work, we propose an image-to-image translation model to learn the mapping from the optical images to TIR domains
Summary
Image-to-image translation based on generative adversarial networks (GANs) has received increasing attention. Optical images can present information similar to what the human could see but are sensitive to illumination variation, while TIR images can make up for this weakness by their thermal radiation differences. In certain fields such as military and environmental monitoring, TIR images are more useful than optical images because they are independent of the quality of the environment. Compared with capturing optical images, TIR facility is expensive and demands strict
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
