Reproduction of mental states in driving using a visual filter

Abstract

This study aimed to reproduce driving experiences. A method is proposed to reproduce the mental state in driving and developed a virtual reality (VR) system that reproduces driving situations. A driving event was recorded using a 360-degree camera and the video recording was played on a VR device. Heartrate was recorded during driving using a smart watch and low frequency/high frequency (LF/HF) which indicates stress levels and represents the mental state was calculated. A red visual filter was applied to the driving video recording in the VR device according to the LF/HF. Thus, the mental state was represented using the visual filter. Three methods for applying the visual filter were experimentally evaluated. The method that a dark filter was applied when LF/HF rose above the average value of real driving was most effective in reproducing the mental state in the VR system.