Research on mental load state recognition based on combined information sources

Abstract

Whether from a theoretical research perspective or a practical situation, mental loads lead to lower productivity, worse job quality, and industrial accidents, and evaluating the mental loads of workers is important for task assignment, job performance, and production safety. In this study, impact sensitivity experiments were used to induce emotions such as fear and tension in participants, thus causing them to develop mental load. Prospective time-distance estimation tests and subjective questionnaires were used to validate the induction experiment. EEG signals from three brain regions and eye movements of the subjects made up four single variables, and combinations of different brain regions and eye movements were used as combined variables. Thus, a total of 15 variables were used for the analysis of mental load states. The Relief algorithm was applied to the 15 variables for feature extraction to construct an optimized feature set. Then, 4 types of classifiers were used to identify mental load states. The combination of occipital area and eye movement variables achieved better mental load assessment results than single variables. With this combination variable, the SVM (94.9 %) and RF (94.3 %) classifiers were effective. However, the SVM classification accuracy gradually increased with the number of training sessions, while the RF classifier did not show this trend. Therefore, the SVM classifier was the best mental load classification method. The results of this study can be used to assess the mental loads of workers, reducing the number of accidents and improving productivity.