Automatic Lip Tracking and Extraction of Lip Geometric Features for Lip Reading

Abstract

Lip tracking is very crucial for visual lip reading recognition system. This paper presents a novel active contour guided geometrical feature extraction approach for lip reading. Three active contour methods are studied, namely snake, region scalable fitting energy method and loacalised active contour model. These methods are adopted for salient geometrical feature calculation. A joint feature model, obtained by combinatining inner area, height and width has been proposed. Results of experimentations on digit utterances are given to show the improvement achieved by visual speech recognition systems.