Abstract

The development of large-scale facial identification systems that provide privacy protection of the enrolled subjects represents an open challenge. In the context of privacy protection, several template protection schemes have been proposed in the past. However, these schemes appear to be unsuitable for indexing (workload reduction) in biometric identification systems. More precisely, they have been utilized in identification systems performing exhaustive searches, thereby leading to degradations of the computational efficiency. In this work, we propose a privacy-preserving face identification system which utilisers a Product Quantization-based hash look-up table for indexing and retrieval of protected face templates. These face templates are protected through fully homomorphic encryption schemes, thereby guaranteeing high privacy protection of the enrolled subjects. For the best configuration, the experimental evaluation carried out over closed-set and open-set settings shows the feasibility of the proposed technique for the use in large-scale facial identification systems: a workload reduction down to 0.1% of a baseline approach performing an exhaustive search is achieved together with a low pre-selection error rate of less than 1%. In terms of biometric performance, a False Negative Identification Rate (FNIR) in range of 0.0% - 0.2% is obtained for practical False Positive Identification Rate (FPIR) values on the FEI and FERET face databases. In addition, our proposal shows competitive performance on unconstrained databases, e.g., the LFW face database. To the best of the authors’ knowledge, this is the first work presenting a competitive privacy-preserving workload reduction scheme which performs template comparisons in the encrypted domain.

Highlights

  • B IOMETRIC systems have been successfully deployed in numerous applications such as border control [1]– [3], national identity management systems [4], [5], and forensic investigations [6], [7], among others

  • Motivated by the aforementioned issues, we propose in this work a face identification system which combines a preselection-based workload reduction (WR) strategy with a Fully Homomorphic Encryption (FHE) scheme to fulfil the requirements of ISO/IEC IS 24745 [17] regarding privacy protection

  • The proposed scheme consists of four main steps: at the time of enrolment, i) a reference face image is captured, a face is detected, pre-processed, and its feature representation, denoted as S, is extracted (Sect. 3.1); ii) for each S, the hash generation scheme extracts a hash code, H(S), which is stored as an index in a hash look-up table; iii) S is encrypted (i.e., Enc(S)) through the BFV encoding scheme [44] which is used as base in the FHE scheme [46]

Read more

Summary

INTRODUCTION

B IOMETRIC systems have been successfully deployed in numerous applications such as border control [1]– [3], national identity management systems [4], [5], and forensic investigations [6], [7], among others. For the majority of BTP methods, comparisons in the protected domain turn out to be more costly in terms of computational workload compared to the ones carried out by unprotected systems Such BTP schemes are less suitable for large-scale identification systems which perform exhaustive searches. In order to overcome the aforementioned limitations, i.e., provide privacy protection and preserve performance, the use of Fully Homomorphic Encryption (FHE) for face identification was suggested in [22] This technique, unlike other traditional BTP approaches, preserves biometric performance while the biometric comparison is carried out in the encrypted domain [23]. In spite of the results obtained by those studies in terms of privacy protection, these systems still perform an exhaustive search to retrieve the protected face references, thereby leading to a degradation of computational efficiency and in an increase of the false match probability depending on the number of subjects enrolled in the system.

RELATED WORKS
PROPOSED SYSTEM
Feature representation
Hash generation
K-means
K-medoids
Gaussian mixture models
Affinity propagation
Template encryption
Hash look-up table
Workload reduction
EXPERIMENTAL EVALUATION
Experimental Protocol
Datasets
Metrics
Baseline feature extractor
Impact of parameters
Effect of the number of samples for the hash generation training
Effect of the face image quality
Benchmark with the baseline
Biometric performance
Workload Reduction
Security analysis and privacy protection
Data exploration
CONCLUSIONS
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call