Low Bandwidth Video Streaming using FACS, Facial Expression and Animation Techniques

Abstract

In this paper we describe an easy to use real-time 3D facial expression and animation system that takes the creation of individual facial expressions to the atomic level. That is instead of generating and recording known facial expressions we propose a mechanism that will allow us to create and store each atomic facial distortion. We can then combine some of these singular distortions to create meaningful expressions. FACS Action Units (AUs) is one such technique that describes the simplest visible movement, which cannot be decomposed into more basic ones. We use this as the basis for creating these atomic facial distortions. The Waters muscle based facial model has been used and extended to allow the user to calibrate and record each facial deformation as described in FACS AUs. The user can then create any facial expression by simply stating the series of AUs and its degree of activation in a controlled fashion. These features all form part of the Facial Animation System (FAS). Our FAS is implemented in such a way that enables it to be used as a low bandwidth video streaming player - a real time facial animation player driven only by FACS AUs transmitted as plain text over TCP sockets.