Real-time multimodal emotion recognition system based on elderly accompanying robot

Abstract

In recent years, people have been paying more attention to the impact of technological development on human emotion recognition. At the same time, China has become the country with the most elderly population in the world. However, due to the lack of real-time multimodal emotion recognition technology for the elderly accompany robots, this paper proposes a deep learning decision-level fusion of real-time emotion analysis model which is based on the background of the elderly care. The results of image and audio recognition are used for intersection and union operation to get emotional classification result, and the obtained emotional result is corresponding to the feedback behavior of the accompany robot.And after the experiment, the recognition algorithm proposed in this paper accuracy can reach about 90%, which is nearly 10% higher than the single mode, and the feedback of the robot has achieved the expected effect.