Multi-Modal Affective Computing Technology Design the Interaction between Computers and Human of Intelligent Tutoring Systems

Abstract

In this paper, the authors are using emotion recognition in two ways: facial expression recognition and emotion recognition from text. Through this dual-mode operation, not only can strength the effects of recognition, but also increase the types of emotion recognition to handle the learning situation smoothly. Through the training of image processing to identify facial expression, the emotion from text is identifying by emotional keywords, syntax, semantics and calculus with logic. The system identify learns' emotions and learning situations by analyzing, choosing the appropriate instructional strategies and curriculum content, and through agents to communicate between user and system, so that learners can get a well learning. This study uses triangular system evaluation methods, observation, questionnaires and interviews. Experimental design to the subjects by the level of awareness on art and non-art to explore the traditional teaching, affective tutoring system and no emotional factors learning course website these three kinds of ways to get results, analysis and evaluate the data.