Implementation of performance indicators for automatic assessment

Abstract

Abstract Simulator training is widely used in different industries and in academia as a teaching tool. An expert instructor, who guides the users through the learning process with the simulator by giving verbal feedback, pausing the scenarios if necessary, and sometimes by developing certain evaluations, leads the simulation sessions. However, the availability of instructors is not always enough for the training demand, which can slow down the training process, as the trainees often need to wait for the instructor’s feedback before they can proceed with their tasks. This research evaluates the feasibility of combining the guidance of the instructor with an automatic live assessment tool, based on performance indicators, to improve simulator training. Two simulator training sessions were evaluated. The strategy used for the simulation sessions consists of three stages: briefing, simulation and debriefing. During both sessions, it was observed that the assessment tool makes the users aware of the state of the process and in most of the cases helps them to find faster the source of an abnormality in the system. However, further development of the automatic assessment tool is needed in order to require less instructor guidance during the simulator training.