Interactive edutainment system with enhanced personalized user interface framework

Abstract

We present the Responsive Multimedia System, an interactive edutainment system. The system consists of an AR-based tabletop tangible user interface (ARTable) and a virtual environment manager (VEManager) integrated by enhanced Personalized User Interface Framework. In this system, a user interface and virtual environments are integrated seamlessly by sharing user-centric context. To share user-centric context efficiently, our system optimizes the number of network connection between objects in real and virtual environments. The synchronization problem between ARTable and a virtual environment is solved by calculating coordinates with additional information such as collision with terrain and physics law in a virtual environment as well as user-centric context. Moreover, it reorganizes responses of an object according to a user-centric context and condition-action rules. To demonstrate the effectiveness of the proposed system we developed an application on the subject 'Dream of Mee-luck'. According to the experimental results, we found that the proposed system could be a promising technology that enables users to experience an interactive story. In the future, the proposed system can play an important role in developing interactive applications for edutainment.