Impact and Detection of Facial Beautification in Face Recognition: An Overview

Christoph Busch,Antitza Dantcheva,Christian Rathgeb

doi:10.1109/access.2019.2948526

Abstract

Facial beautification induced by plastic surgery, cosmetics or retouching has the ability to substantially alter the appearance of face images. Such types of beautification can negatively affect the accuracy of face recognition systems. In this work, a conceptual categorisation of beautification is presented, relevant scenarios with respect to face recognition are discussed, and related publications are revisited. Additionally, technical considerations and trade-offs of the surveyed methods are summarized along with open issues and challenges in the field. This survey is targeted to provide a comprehensive point of reference for biometric researchers and practitioners working in the field of face recognition, who aim at tackling challenges caused by facial beautification.

Highlights

Face recognition has been a highly active research field for the last several decades [1]–[3]
Beautification affects facial analysis systems beyond face recognition, such as systems estimating aesthetics in an automated manner [18], which is out of the scope of this survey. The remainder of this survey is organized as follows: research on the recognition of surgically altered faces is surveyed in Section II; subsequently, works investigating the impact of facial cosmetics and facial retouching on face recognition are summarized in Section III and Section IV, respectively
Once a processed face image, which has been altered by the application of facial makeup is detected, the face recognition system can react e.g., by employing feature extraction with different parameters

Summary

INTRODUCTION

Face recognition has been a highly active research field for the last several decades [1]–[3]. Beautification affects facial analysis systems beyond face recognition, such as systems estimating aesthetics in an automated manner [18], which is out of the scope of this survey The remainder of this survey is organized as follows: research on the recognition of surgically altered faces is surveyed in Section II; subsequently, works investigating the impact of facial cosmetics and facial retouching on face recognition are summarized in Section III and Section IV, respectively. Within these sections, background information is given for each type of beautification, in order to stress their relevance in the context of facial recognition.

PLASTIC SURGERY

Findings

FACIAL RETOUCHING