Abstract

The interactive scenarios realized in the two prototypes of Virtual Human require an approach that allows humans and virtual characters to interact naturally and flexibly. In this article we present how the autonomous control of the virtual characters and the interpretation of user interactions is realized in the Conversational Dialogue Engine (CDE) framework. For each virtual and real interlocutor one CDE is responsible for dialogue processing. We will introduce the knowledge needed for the CDE-approach and present the modules of a CDE. The real-time requirement resulted in the integrated processing of deliberative and reactive processing, which is needed, e.g., to generate an appropriate nonverbal behavior of virtual characters.

Highlights

  • The interactive scenarios realized in the two prototypes of Virtual Human require an approach that allows humans and virtual characters to interact naturally and flexibly

  • In this article we will introduce the technology behind the autonomous control of the virtual characters and will present the Conversational Dialogue Engine (CDE) framework, which realizes the control of the m virtual humans and the interaction with n users

  • The following sections introduce the knowledge sources we use in the CDEs and provide an insight in the details of the main CDE components, namely the multimodal fusion and discourse engine Fusion and Discourse Engine (FADE) and the action manager

Read more

Summary

INTRODUCTION

In this article we will introduce the technology behind the autonomous control of the virtual characters and will present the Conversational Dialogue Engine (CDE) framework, which realizes the control of the m virtual humans and the interaction with n users. One of the main characteristics of Virtual Human is the lifelike interactivity of a group mixed of real people and believable virtual characters. The characters provide realistically all those types of interaction behavior that are expected by real humans and that typically depend upon the interaction situation. The interaction aspect is even more prominent in the scenarios realized during the Virtual Human project. Both the physics lesson and the quiz show do not require a complex, drama-like narrative structure. There is a widespread discussion (see, e.g., [2, 3]) of the advantages and disadvantages of a strong guidance through a narration structure, which guarantees a coherent story experience, and the autonomous approach where

MULTIPARTY INTERACTION BETWEEN HUMANS AND VIRTUAL CHARACTER
INTERACTION EXAMPLES
REPRESENTING KNOWLEDGE
INSIDE THE CONVERSATIONAL DIALOGUE ENGINES
The multimodal generator
Interpreting and Generating Turn-Taking Signals
Identifying the Intended Addressees
Realizing Deliberative Behavior
Resolving Spatial References
COMPARISON WITH RELATED WORK
VIII. SUMMARY
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.