Novel Application of Kinect Sensor for Children to Learn Paleontological Environment: Learning Support System based on Body Experience and Sense of Immersion

Abstract

Abstract The authors are developing a simulation-based environmental learning support system using Kinect sensors. Obviously, it is impossible for learners to experience the actual paleontological environment, and it is therefore difficult for them to learn about the environments and lives. Then, we proposed an immersive animation display system using Kinect sensors and their human skeleton-tracking function. The system animates paleontological animals and their environment on the screen and displays information of the animals in synchronization with learners’ action. Learners are measured their location and action in real time, and then the animation is controlled based on information output from sensors. In this way, the system provides learners with a real body experience and sense of immersion that they have entered the paleontological environment. In order to evaluate the system, we conduct an experiment using the system, and interview the participants about the sense of immersion into environment in the system. The experimental results confirm that most learners feel a tangible improvement in the sense of immersion due to the enjoyment of moving their body and acquisition of body experience.