Embodiment analytics of practicing teachers in a virtual immersive environment

Abstract

AbstractInteractive training environments typically include feedback mechanisms designed to help trainees improve their performance through either guided or self‐reflection. In this context, trainees are candidate teachers who need to hone their social skills for their future classroom. We chose an interactive virtual training system as the basic research environment to investigate the embodiment of the trainees. Using tracking sensors and improvements for existing gesture recognition utilities, we created a gesture database and used it for the implementation of our real‐time feedback application. We also investigated multiple modalities of feedback including visual and haptics. This paper describes the context in which the utilities have been developed, the importance of recognizing nonverbal communication in the teaching context, the means of providing automated feedback associated with nonverbal messaging, and a series of preliminary studies developed to inform the research. Results from the conducted studies indicate the positive impact of the proposed feedback application.