Enhancing eID card mobile-based authentication through 3D facial reconstruction

Abstract

In recent years the number of credentials and digital identities needed to access online services is exploding, increasing the risk of fraud and unauthorized access to personal data.Biometric verification techniques can help to build more secure authentication systems; in particular face recognition algorithms have reached near perfect accuracy under ideal conditions. In Europe 60% of population owns an electronic identification (eID) document which contains biometric data, and almost all member states provide tools to verify the identity of a user who holds an eID card; however, the adoption of biometric authentication schemes is still limited. Reasons for this low adoption are privacy concerns, about the storage or transmission of personal images, and the degradation of performance of facial recognition algorithms with 2D images acquired "in the wild" (real world condition with inconsistency in lighting and positioning, unclear or occluded facial features, noise from the background). In this paper a new authentication scheme is proposed, exploiting images acquired "in the wild" and 3D facial reconstruction techniques which can help in improving the quality of the probed images, as changes in lighting or position have limited impact on facial shape. Several experiments have been conducted in order to investigate the performance of the proposed method, using the Bosphorus and the NIST Face Recognition Grand Challenge (FRGC) datasets. In particular, one of the most accurate ML face recognition algorithms has been selected to compare the performance of 2D snapshot data, obtained from 3D back-projection, against 2D uncontrolled images acquired "in the wild". We show that using 3D facial reconstructions significantly improve face recognition performance, allowing for a more secure and robust authentication system.