A Fast Individual Face Modeling and Facial Animation System

Abstract

In this paper, we present a fast individual face modeling and animation system. The input of the system is a single frontal face image, which is captured by an ordinary video camera. And the output is 3D individual facial animation. Firstly, an Adaboost method is used to detect the face in the image. Then the key points of the face are located with the inverse compositional algorithm based active appearance models (AAM). The 3D geometry mesh of the individual face is then generated with morphable models. Finally, the direction and magnitude of existed motion vectors are adjusted according to different 3D face shapes using expression cloning technique. With this system, we can achieve realistic 3D facial animation with minimal and often no manual tuning. The experiments show that our system is fast enough for common applications.