Abstract

In this chapter, we present state-of-the-art technologies in the research of audiovisual interaction for multimedia applications. We show the interaction between audio and video in multimedia communications, especially for person-to-person conversational environment. Topics covered in this chapter include audiovisual bimodality in speech production and perception, automatic lipreading, face animation, and lip synchronization. We present useful tools for image analysis and synthesis that enable these technologies. A new research trend that we discuss is utilization of audiovisual interaction in joint audio-video processing of talking-head sequences. We show that the marriage of speech analysis and image processing opens up numerous new applications.

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call