Joint Alignment of Image Faces

Abstract

Researches on face alignment have made great progress, which benefits from the use of prior information and auxiliary models. However, that information lacks in a single face image has always affected the further development of these researches. The methods considering multiple face images provide a feasible way to solve the problem undoubtedly. Joint alignment where multiple face images are considered was presented in the paper. Face alignment was used for each face, and joint face alignment was used for optimizing the alignment results of all faces further. During joint alignment, both rigid variations of faces and non-rigid distortions were considered, however, they were regarded as two independent stages. Joint face alignment was a process where optimization was performed iteratively. In each iteration, both rigid variations and non-rigid distortions were performed sequentially, and moreover, the results of rigid variations were used as input of non-rigid distortions. At the stage of rigid variations, the key points of a face were divided into five groups to reduce the effect of global constraints which was imposed by face shape. After several iterations, the optimal solution of joint alignment can be obtained. The experimental results show that the joint alignment can obtain the optimal results than joint alignment using phased global rigid variations and non-rigid distortions and that using iterative global rigid variations and non-rigid distortions, and it can be used as a novel method for joint alignment.