Building Intelligent Multimodal Assistants Based on Logic Programming in the Meme Media Architecture

Abstract

This chapter introduces a software architecture to build intelligent multimodal assistants. The architecture consists of three basic components: a meme media system, an inference system, and an embodied interface agent system that makes multimodal presentations available to users. In an experimental implementation of the architecture, the author uses three components as the basic framework: Intelligent Pad for a meme media system, Prolog for a logic programming system, and Multimodal Presentation Markup Language (MPML) for controlling an interface agent system. The experimental implementation shows how character agents are defined in a simple declarative manner using logic programming on meme media objects.