An arm motion learning support system using virtual reality

Abstract

For beginners of sign language, this article proposes the arm motion learning support system to analyze the difference between the example of teacher's motion and user's motion, and to urge the user to improve his/her motion. Using virtual reality (VR) system composed by head-mounted display and motion tracking hardware/software, the proposed system measures how similar between the example motion and user's motion, and gives him/her the result of analysis, followed by the motion replay as visual feedback. For the user's easy understanding, the system scales the character according to the user's physique. Also the system adopts the sight cursor input for hands-free input. Questionary investigation after user test by 21 people shows that the proposed method has the competitive advantage against the conventional learning methods (textbooks and videos) especially in interactivity including visual feedback, depth sense in posing, motivation in learning, and easy user-interface. Detection of fingers' motion should be discussed in the next step. Since heavy and/or bulky devices are unacceptable for the purpose of the self-learning, a suitable device or other methods will be surveyed.