Fast and robust occluded face detection in ATM surveillance

Abstract

Crimes with respect to ATMs (Automatic Teller Machines) have attracted more and more attention, where criminals deliberately cover their faces in order to avoid being identified. This paper proposes a fast and robust face occlusion detection algorithm for ATM surveillance, which is demonstrated to be effective and efficient to handle arbitrarily occluded faces. In this algorithm, we innovatively propose to make use of the Omega shape formed by the head and shoulder of the person for head localization to tackle severe face occlusion. For this purpose, we first construct a novel energy function for elliptical head contour detection. Then, we develop a fast and robust head tracking algorithm, which utilizes the gradient and shape cues in a Bayesian framework. Lastly, to verify whether a detected head is occluded or not, we propose to fuse information from both skin color and face structure using the AdaBoost algorithm. Experimental results on real world data show that our proposed algorithm can achieve 98.64% accuracy on face detection and 98.56% accuracy on face occlusion detection, even though there are severe occlusions in faces, at a speed of up to 12 frames per second.