Face reconstruction from image sequences for forensic face comparison

Abstract

The authors explore the possibilities of a dense model-free three-dimensional (3D) face reconstruction method, based on image sequences from a single camera, to improve the current state of forensic face comparison. They propose a new model-free 3D reconstruction method for faces, based on the Lambertian reflectance model to estimate the albedo and to refine the 3D shape of the face. This method avoids any form of bias towards face models and is therefore suitable in a forensic face comparison process. The proposed method can reconstruct frontal albedo images, from multiple non-frontal images. Also a dense 3D shape model of the face is reconstructed, which can be used to generate faces under pose. In the authors’ experiments, the proposed method is able to improve the face recognition scores in more than 90% of the cases. Using the likelihood ratio framework, they show for the same experiment that for data initially unsuitable for forensic use, the reconstructions become meaningful in a forensic context in more than 60% of the cases.