A Real-time Interactive Tai Chi Learning System Based on VR and Motion Capture Technology

Abstract

Abstract As a popular traditional Chinese exercise, Tai Chi is of great benefit to physical and mental health. Professional and face-to-face guidance is a traditional and effective way to learn Tai Chi, but it is restricted by factors such as site and time. Although the way to learn Tai Chi by watching videos is not limited by time or place, it is not convenient for learners to observe learning from multiple perspectives since it shows sequences of actions that have been recorded from fixed viewpoints. This paper proposes a real-time interactive Tai Chi learning system based on VR and motion capture technology, in which the learner wears the head-mounted display to follow the virtual coach in the scene, and can watch the demonstration of the virtual coach in all directions; the learner can also drive and watch his own avatar, and can operate the menu by natural interaction in the virtual environment in real time through wearable motion capture device, so that he can know the effects of his training and learning of each action. The actions of the avatar and virtual coach are also compared by using a motion similarity matching algorithm, to evaluate the quality of learning and training and guide the learner to adjust his motion in real time. With the help of our system, learners can practice Tai Chi in the same way as in the real environments and drive their avatars in virtual scenes, so as to achieve effective self-learning and evaluation.