Multimodality for Reliable Single Image Based Face Morphing Attack Detection

Abstract

Face morphing attacks have demonstrated a high vulnerability on human observers and commercial off-the-shelf Face Recognition Systems (FRS), especially in the border control scenario. Therefore, detecting face morphing attacks is paramount to achieving a reliable and secure border control operation. This work presents a novel framework for the Single image-based Morphing Attack Detection (S-MAD) based on the multimodal regions such as eyes, nose, and mouth. Each of these regions is processed using colour scale-space representation on which two different types of features are extracted using Binarised Statistical Image Features (BSIF) and Local Binary Features (LBP) techniques. These features are then fed to the classifiers such as Probabilistic Collaborative Representation Classifier (P-CRC) and Spectral Regression Kernel Discriminant Analysis (SRKDA). Their decisions are combined at score level to make the final decision. Extensive experiments are carried out on three different face morphing datasets to benchmark the performance of the proposed method with the existing methods. Further, the proposed method is benchmarked on the Bologna Online Evaluation Platform (BOEP). Obtained results demonstrate the improved performance of the proposed method over existing state-of-the-art methods.