Abstract
In this chapter, we present state-of-the-art technologies in the research of audiovisual interaction for multimedia applications. We show the interaction between audio and video in multimedia communications, especially for person-to-person conversational environment. Topics covered in this chapter include audiovisual bimodality in speech production and perception, automatic lipreading, face animation, and lip synchronization. We present useful tools for image analysis and synthesis that enable these technologies. A new research trend that we discuss is utilization of audiovisual interaction in joint audio-video processing of talking-head sequences. We show that the marriage of speech analysis and image processing opens up numerous new applications.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have