Anonymization of face images with Contrastive Learning

Abstract

Abstract Photos or videos taken by individuals often carry sensitive details such as facial identities, which has led to an escalating societal interest in privacy protection measures. We suggest an improved face identity transformer that offers password-protected anonymization and de-anonymization of photo-realistic facial images in visual data. Our face identity transformer is designed to (1) erase facial identity information after anonymization, (2) restore the original face when a correct password is provided and (3) generate an incorrect but realistic face when given an incorrect password. The processes of image anonymization and de-anonymization are facilitated through a password scheme, a multi-task learning objective and generative adversarial networks comprising InfoGAN and contrastive learning. In-depth experiments indicate that our methodology can execute anonymization and de-anonymization based on password conditions whilst reducing training time and enhancing image quality compared to existing anonymization procedures. Additionally, it maintains a recognition rate as low as 4.8% for anonymized images without sacrificing the face detection rate of the original method.