Cross-Spectrum Thermal Face Pattern Generator

Xingdong Cao,Kenneth Lai,Svetlana N Yanushkevich,Gee-Sern Jison Hsu,Michael Smith

doi:10.1109/access.2022.3144308

Abstract

Conversion of a visible face image into a thermal face image (V2T), or one thermal face image into another one given a different target temperature (T2T), is required in applications such as thermography, human body thermal pattern analysis, and surveillance using cross-spectral imaging. In this work, we propose to use conditional generative adversarial networks (cGAN) with cGAN loss, perceptual loss, and temperature loss to solve the conversion tasks. In our experiment, we used Carl and SpeakingFaces Databases. Frèchet Inception Distance (FID) is used to evaluate the generated images. As well, face recognition was applied to assess the performance of our models. For the V2T task, the FID of the generated thermal images reached a low value of 57.3. For the T2T task, we achieved a rank-1 face recognition rate of 91.0% which indicates that the generated thermal images preserve the majority of the identity information.

Highlights

B OTH visible and thermal spectra provide useful biometric information on human subjects
The first is dedicated to answering the question: How to convert a face image taken under visible spectrum into another face image taken under thermal spectrum? The second task poses the question: How to convert a thermal face image taken at a certain measured body temperature into a thermal image given a different temperature?
We extend our previous work [5], by applying the Frèchet Inception Distance (FID) [6] and face recognition techniques to measure the performance of the proposed conditional generative adversarial networks (cGAN)

Summary

Introduction

B OTH visible and thermal spectra provide useful biometric information on human subjects. Most biometric tasks, such as face detection and recognition, focus on the visible spectrum. Thermal cameras, unlike visible spectrum ones, allow for capturing the low-light scene. In most cases, thermal images cannot be used for face recognition given that legacy databases of faces contain only visible spectra images. The first is dedicated to answering the question: How to convert a face image taken under visible spectrum into another face image taken under thermal spectrum? The second task poses the question: How to convert a thermal face image taken at a certain measured body temperature into a thermal image given a different temperature? The first is dedicated to answering the question: How to convert a face image taken under visible spectrum into another face image taken under thermal spectrum? The second task poses the question: How to convert a thermal face image taken at a certain measured body temperature into a thermal image given a different temperature?

Methods

Results

Conclusion