Different Levels Of Mental Workload Research Articles

EEG Dataset Collection for Mental Workload Predictions in Flight-Deck Environment.

High mental workload reduces human performance and the ability to correctly carry out complex tasks. In particular, aircraft pilots enduring high mental workloads are at high risk of failure, even with catastrophic outcomes. Despite progress, there is still a lack of knowledge about the interrelationship between mental workload and brain functionality, and there is still limited data on flight-deck scenarios. Although recent emerging deep-learning (DL) methods using physiological data have presented new ways to find new physiological markers to detect and assess cognitive states, they demand large amounts of properly annotated datasets to achieve good performance. We present a new dataset of electroencephalogram (EEG) recordings specifically collected for the recognition of different levels of mental workload. The data were recorded from three experiments, where participants were induced to different levels of workload through tasks of increasing cognition demand. The first involved playing the N-back test, which combines memory recall with arithmetical skills. The second was playing Heat-the-Chair, a serious game specifically designed to emphasize and monitor subjects under controlled concurrent tasks. The third was flying in an Airbus320 simulator and solving several critical situations. The design of the dataset has been validated on three different levels: (1) correlation of the theoretical difficulty of each scenario to the self-perceived difficulty and performance of subjects; (2) significant difference in EEG temporal patterns across the theoretical difficulties and (3) usefulness for the training and evaluation of AI models.

Assessment of Drivers' Mental Workload by Multimodal Measures during Auditory-Based Dual-Task Driving Scenarios.

Assessing drivers' mental workload is crucial for reducing road accidents. This study examined drivers' mental workload in a simulated auditory-based dual-task driving scenario, with driving tasks as the main task, and auditory-based N-back tasks as the secondary task. A total of three levels of mental workload (i.e., low, medium, high) were manipulated by varying the difficulty levels of the secondary task (i.e., no presence of secondary task, 1-back, 2-back). Multimodal measures, including a set of subjective measures, physiological measures, and behavioral performance measures, were collected during the experiment. The results showed that an increase in task difficulty led to increased subjective ratings of mental workload and a decrease in task performance for the secondary N-back tasks. Significant differences were observed across the different levels of mental workload in multimodal physiological measures, such as delta waves in EEG signals, fixation distance in eye movement signals, time- and frequency-domain measures in ECG signals, and skin conductance in EDA signals. In addition, four driving performance measures related to vehicle velocity and the deviation of pedal input and vehicle position also showed sensitivity to the changes in drivers' mental workload. The findings from this study can contribute to a comprehensive understanding of effective measures for mental workload assessment in driving scenarios and to the development of smart driving systems for the accurate recognition of drivers' mental states.

Evidence for modulation of EEG microstates by mental workload levels and task types.

Electroencephalography (EEG) microstate analysis has become a popular tool for studying the spatial and temporal dynamics of large-scale electrophysiological activities in the brain in recent years. Four canonical topographies of the electric field (classes A, B, C, and D) have been widely identified, and changes in microstate parameters are associated with several psychiatric disorders and cognitive functions. Recent studies have reported the modulation of EEG microstate by mental workload (MWL). However, the common practice of evaluating MWL is in a specific task. Whether the modulation of microstate by MWL is consistent across different types of tasks is still not clear. Here, we studied the topographies and dynamics of microstate in two independent MWL tasks: NBack and the multi-attribute task battery (MATB) and showed that the modulation of MWL on microstate topographies and parameters depended on tasks. We found that the parameters of microstates A and C, and the topographies of microstates A, B, and D were significantly different between the two tasks. Meanwhile, all four microstate topographies and parameters of microstates A and C were different during the NBack task, but no significant difference was found during the MATB task. Furthermore, we employed a support vector machine recursive feature elimination procedure to investigate whether microstate parameters were suitable for MWL classification. An averaged classification accuracy of 87% for within-task and 78% for cross-task MWL discrimination was achieved with at least 10 features. Collectively, our findings suggest that topographies and parameters of microstates can provide valuable information about neural activity patterns with a dynamic temporal structure at different levels of MWL, but the modulation of MWL depends on tasks and their corresponding functional systems. Moreover, as a potential indicator, microstate parameters could be used to distinguish MWL.

Neck Muscle Coactivation Response to Varied Levels of Mental Workload During Simulated Flight Tasks.

To evaluate neck muscle coactivation across different levels of mental workload during simulated flight tasks. Neck pain (NP) is highly prevalent among military aviators. Given the complex nature within the flight environment, mental workload may be a risk factor for NP. This may induce higher levels of neck muscle coactivity, which over time may accelerate fatigue, increase neck discomfort, and affect flight task performance. Three counterbalanced mental workload conditions represented by simulated flight tasks modulated by interstimulus frequency and complexity were investigated using the Modifiable Multitasking Environment (ModME). The primary measure was a neck coactivation index to describe the neuromuscular effort of the neck muscles as a system. Additional measures included perceived workload (NASA TLX), subjective discomfort, and task performance. Participants (n = 60; 30M, 30F) performed three test conditions over 1hr each while seated in a simulated seating environment. Neck coactivation indices (CoA) and subjective neck discomfort corresponded with increasing level of mental workload. Average CoAs for low, medium, and high workloads were: .0278(SD = .0232), .0286(SD = .0231), and .0295(SD = .0228), respectively. NASA TLX mental, temporal, effort, and overall scores also increased with the level of mental workload assigned. For ModME task performance, the overall performance score, monitoring accuracy, and resource management accuracy decreased while reaction times increased with the increasing level of mental workload. Communication accuracy was lowest with the low mental workload but had higher reaction times relative to increasing workload. Mental workload affects neck muscle coactivation during combinations of simulated flight tasks within a simulated helicopter seating environment. The results of this study provide insights into the physical response to mental workload. With increasing multisensory modalities within the work environment, these insights may assist the consideration of physical effects from cognitive factors.

Cognitive Analyses for Interface Design Using Dual N-Back Tasks for Mental Workload (MWL) Evaluation.

In the manufacturing environments of today, human-machine systems are constituted with complex and advanced technology, which demands workers' considerable mental workload. This work aims to design and evaluate a Graphical User Interface developed to induce mental workload based on Dual N-Back tasks for further analysis of human performance. This study's contribution lies in developing proper cognitive analyses of the graphical user interface, identifying human error when the Dual N-Back tasks are presented in an interface, and seeking better user-system interaction. Hierarchical task analysis and the Task Analysis Method for Error Identification were used for the cognitive analysis. Ten subjects participated voluntarily in the study, answering the NASA-TLX questionnaire at the end of the task. The NASA-TLX results determined the subjective participants' mental workload proving that the subjects were induced to different levels of mental workload (Low, Medium, and High) based on the ANOVA statistical results using the mean scores obtained and cognitive analysis identified redesign opportunities for graphical user interface improvement.

Measuring Mental Workload Using ERPs Based on FIR, ICA, and MARA

Mental workload is considered to be strongly linked to human performance, and the ability to measure it accurately is key for balancing human health and work. In this study, brain signals were elicited by mental arithmetic tasks of varying difficulty to stimulate different levels of mental workload. In addition, a finite impulse response (FIR) filter, independent component analysis (ICA), and multiple artifact rejection algorithms (MARAs) were used to filter event-related potentials (ERPs). Then, the data consisting of ERPs, subjective ratings of mental workload, and task performance, were analyzed through the use of variance and Spearman’s correlation during a simulated computer task. We found that participants responded faster and performed better in the easy task condition, followed by the medium and high-difficulty conditions, which verifies the validity of the ERP filtering. Moreover, larger P2 and P3 waveforms were evoked as the task difficulty increased, and a higher task difficulty elicited a more enhanced N300. Correlation analysis revealed a negative relationship between the amplitude of P3 and the subjective ratings, and a positive relationship between the P3 amplitude and accuracy. The results presented in this paper demonstrate that a combination of FIR, ICA, and MARA methods can filter ERPs in the non-invasive real-time measurement of workload. Additionally, frontocentral P2, N3, and parietal P3 components showed differences between genders. The proposed measurement of mental workload can be useful for real-time identification of mental states and can be applied to human–computer interaction in the future.

Measuring Mental Workload and Heart Rate Variability of Officers During Different Navigation Conditions

Mental workload (MWL) has a negative effect on the functional states of watchkeeping officers that ultimately causes collisions and groundings at sea. The aim of this study is to measure the MWL of officers during different navigation conditions. This study was conducted in a bridge simulator with 11 participants. Heart rate variability (HRV) measurements were taken during the 4 steps which have different difficulty levels and subjective assessments were taken at the end of each step by using NASA-TLX. The results of the measurements showed that different levels of navigation tasks caused significantly different levels of MWL and HRV values and MWL and HRV increased when task difficulty increased. Additionally, the correlation between MWL perceived by the participants and the heart rate variability values of the participants was found statistically significant. This study provides an example of predicting MWL for routine navigation operations by using physiological measures in maritime transportation.

Wearable Technologies for Mental Workload, Stress, and Emotional State Assessment during Working-Like Tasks: A Comparison with Laboratory Technologies.

The capability of monitoring user’s performance represents a crucial aspect to improve safety and efficiency of several human-related activities. Human errors are indeed among the major causes of work-related accidents. Assessing human factors (HFs) could prevent these accidents through specific neurophysiological signals’ evaluation but laboratory sensors require highly-specialized operators and imply a certain grade of invasiveness which could negatively interfere with the worker’s activity. On the contrary, consumer wearables are characterized by their ease of use and their comfortability, other than being cheaper compared to laboratory technologies. Therefore, wearable sensors could represent an ideal substitute for laboratory technologies for a real-time assessment of human performances in ecological settings. The present study aimed at assessing the reliability and capability of consumer wearable devices (i.e., Empatica E4 and Muse 2) in discriminating specific mental states compared to laboratory equipment. The electrooculographic (EOG), electrodermal activity (EDA) and photoplethysmographic (PPG) signals were acquired from a group of 17 volunteers who took part to the experimental protocol in which different working scenarios were simulated to induce different levels of mental workload, stress, and emotional state. The results demonstrated that the parameters computed by the consumer wearable and laboratory sensors were positively and significantly correlated and exhibited the same evidences in terms of mental states discrimination.

Tracing the physiological response and behavioral performance of drivers at different levels of mental workload using driving simulators

Introduction: The use of mobile phones while driving is known to be a distraction factor and a cause of accidents. The way in which different kinds of conversations affect the behavioral performance of the driver as well as the persistence of the effects are not yet fully understood. Method: In this study, in addition to comparing brain function and behavioral function in dual task conditions in three conversations types, the persistent effects of these types of conversations have also been traced. Results: The results show that the content of the mobile phone conversation while driving is the cause of the persistent changes in behavioral and brain functions. Increased time headway and lane departure was observed during and up to 5 min after the emotional conversation was finished. EEG bands also varied in different types of conversations. Cognitive conversations caused an increase in the activity of the alpha and beta bands while emotional conversations enhanced the rate of gamma and beta bands. A meaningful correlation was found between changes in the theta and alpha bands and changes in behavioral performance both during the dual task condition and after the conversation was finished, was also observed. Conclusions: The content of the conversation is one of the most important factors that increase the risk of road accidents. This can also deteriorate the behavioral performance of the driver and can have persistent effects on behavioral performance and the brain. Practical applications: The findings of this study provide a basis to measure and tracing drivers’ cognitive distractions induced by different levels of mental workload through physiological and behavioral performances.

Assessment and monitoring of mental workload in subway train operations using physiological, subjective, and performance measures

AbstractSubway train operation is a complex, sociotechnical system that involves a variety of cognitively demanding tasks. The train operators are responsible for continuously monitoring the surrounding environment, maintaining awareness, processing information, and making decisions under risk. The resulting mental strain on operators can negatively affect their performance and the interaction of the human–machine system. The objective of this study was to evaluate if physiological, subjective, and performance measures could identify the level of mental workloads arising from routine and nonroutine operations in the subway system. A total of 11 subway train operators underwent different driving scenarios in a high‐fidelity simulator. The simulated tasks were divided into two categories: routine operations (preparing to drive and driving between stations without interruptions or emergencies) and nonroutine operation (responding to a tunnel fire, dealing with a high density of passengers, encountering a passenger/technician on the track, and responding to train failure). The mental workload was monitored and evaluated in these tasks using an electrocardiogram, subjective self‐rating scales, and driving performance. Both heart rate variability and performance measures (including reaction time and error rate) detected mental workload variations in the different operations. On the other hand, the subjective ratings (including NASA‐TLX) assessed the overall mental workload associated with a task, without explaining the mental demand variations within the task over time. Subway train drivers experienced different levels of mental workload during routine and nonroutine driving conditions. The findings of this study can be used to extract mental workload limits to optimize workload levels during train operations.

Mind over motor mapping: Driver response to changing vehicle dynamics.

Improvements in vehicle safety require understanding of the neural systems that support the complex, dynamic task of real-world driving. We used functional near infrared spectroscopy (fNIRS) and pupilometry to quantify cortical and physiological responses during a realistic, simulated driving task in which vehicle dynamics were manipulated. Our results elucidate compensatory changes in driver behavior in response to changes in vehicle handling. We also describe associated neural and physiological responses under different levels of mental workload. The increased cortical activation we observed during the late phase of the experiment may indicate motor learning in prefrontal-parietal networks. Finally, relationships among cortical activation, steering control, and individual personality traits suggest that individual brain states and traits may be useful in predicting a driver's response to changes in vehicle dynamics. Results such as these will be useful for informing the design of automated safety systems that facilitate safe and supportive driver-car communication.

The sensitivity of Galvanic Skin Response forassessing mental workload in Indonesia.

Objective measures have been shown to be equally sensitive in different cultures. However, these measures need special devices that are relatively expensive and need expertise to analyze the result. In Indonesia, there is a need for a sensitive and affordable mental workload measure. To evaluate the sensitivity of Galvanic Skin Response (GSR) in assessing mental workload in Indonesia. A total of 72 Indonesian students with normal visual capability. Participants were asked to work on visual memory search task with a secondary task of counting with three different levels of difficulty. GSR, Heart Rate Variability (HRV), and the NASA-TLX were administered prior to, during, and after the tasks. GSR measure was compared to NASA-TLX and HRV measures. Like the HRV, GSR showed to be sensitive in distinguishing rest and task condition significantly but not sensitive in distinguishing different levels of mental workload. In contrast, both the NASA-TLX and performance measure were sensitive in differentiating different levels of mental workload. GSR has potential as a simple, cost-effective tool for measuring mental workload in Indonesia.

Electrocardiographic features for the measurement of drivers' mental workload

This study examines the effect of mental workload on the electrocardiogram (ECG) of participants driving the Lane Change Task (LCT). Different levels of mental workload were induced by a secondary task (n-back task) with three levels of difficulty. Subjective data showed a significant increase of the experienced workload over all three levels. An exploratory approach was chosen to extract a large number of rhythmical and morphological features from the ECG signal thereby identifying those which differentiated best between the levels of mental workload. No single rhythmical or morphological feature was able to differentiate between all three levels. A group of parameters were extracted which were at least able to discriminate between two levels. For future research, a combination of features is recommended to achieve best diagnosticity for different levels of mental workload.

Psycho Physiological and Subjective Responses to Mental Workload Levels during N-Back Task

The present study investigated the effects of mental workload levels on psychophysiological and subjective responses during n-Back task. Heart rate, heart rate variability, shoulder muscle activity, EEG and EOG were measured during performing four mental tasks by 32 males. NASA-TLX completed at the end of each mental task. Using NASA-TLX the subjects stated that the task demands of very high mental task were higher than those of low, medium and high mental tasks. By increasing mental workload LF/HF ratio, shoulder muscle activity, eye activity and alpha activity significantly changed. It suggests that mentioned indices have enough sensitivity to quantify mental workload. Future studies should implement to determine the long-term effects such as cardiovascular and mental disorders in both males and females which experience different levels of mental workload in daily working condition. To get better results suggested those parameters such as: cultural differences, anthropometric data, body mass index, alertness, shift work and menstrual cycle take into account.

Towards a multimodal bioelectrical framework for the online mental workload evaluation.

In this study, a framework able to classify online different levels of mental workload induced during a simulated flight by using the combination of the Electroencephalogram (EEG) and the Heart Rate (HR) biosignals has been proposed. Ten healthy subjects were involved in the experimental protocol, performing the NASA - Multi Attribute Task Battery (MATB) over three different difficulty levels in order to simulate three classic showcases in a flight scene (cruise flight phase, flight level maintaining, and emergencies). The analyses showed that the proposed system is able to estimate online the mental workload of the subjects over the three different conditions reaching a high discriminability (p<.05). In addition, it has been found that the classification parameters remained stable within a week, without recalibrating the system with new parameters.

Using near infrared spectroscopy and heart rate variability to detect mental overload

Mental workload is a key factor influencing the occurrence of human error, especially during piloting and remotely operated vehicle (ROV) operations, where safety depends on the ability of pilots to act appropriately. In particular, excessively high or low mental workload can lead operators to neglect critical information. The objective of the present study is to investigate the potential of functional near infrared spectroscopy (fNIRS) – a non-invasive method of measuring prefrontal cortex activity – in combination with measurements of heart rate variability (HRV), to predict mental workload during a simulated piloting task, with particular regard to task engagement and disengagement. Twelve volunteers performed a computer-based piloting task in which they were asked to follow a dynamic target with their aircraft, a task designed to replicate key cognitive demands associated with real life ROV operating tasks. In order to cover a wide range of mental workload levels, task difficulty was manipulated in terms of processing load and difficulty of control – two critical sources of workload associated with piloting and remotely operating a vehicle. Results show that both fNIRS and HRV are sensitive to different levels of mental workload; notably, lower prefrontal activation as well as a lower LF/HF ratio at the highest level of difficulty, suggest that these measures are suitable for mental overload detection. Moreover, these latter measurements point toward the existence of a quadratic model of mental workload.

Assessment of human operator functional state using a novel differential evolution optimization based adaptive fuzzy model

With the development of human–machine systems, there has been a growing concern about the consequences of operator performance breakdown under excessive level of workload, especially in safety-critical situations. Assessment and detection of the operator functional state (OFS) enable us to predict the high operational risks of operator. This paper adopts the psychophysiological signals and task performance measures to evaluate OFS under different levels of mental workload. Four indices extracted from electrocardiogram and electroencephalogram, including heart rate (HR), ratio of the standard deviation to the average of HR segment, task load indices (TLI1 and TLI2), are chosen as the inputs of the proposed model. A technique of differential evolution with ant colony search (DEACS) is developed to optimize the parameters of Adaptive-Network-based Fuzzy Inference System (ANFIS). The optimized ANFIS model is employed to estimate the OFS under a series of process control tasks on a simulated software platform of AUTOmation-enhanced Cabin Air Management System. The results showed that the proposed adaptive fuzzy model based on ANFIS and DEACS algorithm is applicable for the operator functional state assessment.

Monitoring of mental workload levels during an everyday life office-work scenario

Personal and ubiquitous healthcare applications offer new opportunities to prevent long-term health damage due to increased mental workload by continuously monitoring physiological signs related to prolonged high workload and providing just-in-time feedback. In order to achieve a quantification of mental load, different load levels that occur during a workday have to be discriminated. In this work, we present how mental workload levels in everyday life scenarios can be discriminated with data from a mobile ECG logger by incorporating individual calibration measures. We present an experiment design to induce three different levels of mental workload in calibration sessions and to monitor mental workload levels in everyday life scenarios of seven healthy male subjects. Besides the recording of ECG data, we collect subjective ratings of the perceived workload with the NASA Task Load Index (TLX), whereas objective measures are assessed by collecting salivary cortisol. According to the subjective ratings, we show that all participants perceived the induced load levels as intended from the experiment design. The heart rate variability (HRV) features under investigation can be classified into two distinct groups. Features in the first group, representing markers associated with parasympathetic nervous system activity, show a decrease in their values with increased workload. Features in the second group, representing markers associated with sympathetic nervous system activity or predominance, show an increase in their values with increased workload. We employ multiple regression analysis to model the relationship between relevant HRV features and the subjective ratings of NASA-TLX in order to predict the mental workload levels during office-work. The resulting predictions were correct for six out of the seven subjects. In addition, we compare the performance of three classification methods to identify the mental workload level during office-work. The best results were obtained with linear discriminant analysis (LDA) that yielded a correct classification for six out of the seven subjects. The k-nearest neighbor algorithm (k-NN) and the support vector machine (SVM) resulted in a correct classification of the mental workload level during office-work for five out of the seven subjects.

DISCRIMINATION OF MENTAL WORKLOAD LEVELS IN HUMAN SUBJECTS WITH FUNCTIONAL NEAR-INFRARED SPECTROSCOPY

We have applied functional near-infrared spectroscopy (fNIRS) to the human forehead to distinguish different levels of mental workload on the basis of hemodynamic changes occurring in the prefrontal cortex. We report data on 3 subjects from a protocol involving 3 mental workload levels based on to working memory tasks. To quantify the potential of fNIRS for mental workload discrimination, we have applied a 3-nearest neighbor classification algorithm based on the amplitude of oxyhemoglobin ( HbO 2) and deoxyhemoglobin ( HbR ) concentration changes associated with the working memory tasks. We have found classification success rates in the range of 44–72%, which are significantly higher than the corresponding chance level (for random data) of 19.1%. This work shows the potential of fNIRS for mental workload classification, especially when more parameters (rather than just the amplitude of concentration changes used here) and more sophisticated classification algorithms (rather than the simple 3-nearest neighbor algorithm used here) are considered and optimized for this application.

Effect of varying levels of mental workload on startle eyeblink modulation

Previous research using punctuate reaction time and counting tasks has found that the startle eyeblink reflex is sensitive to attentional demands. The present experiment explored whether startle eyeblink is also modulated during a complex continuous task and is sensitive to different levels of mental workload. Participants (N = 14) performed a visual horizontal tracking task either alone (single-task condition) or in combination with a visual gauge monitoring task (multiple-task condition) for three minutes. On some task trials, the startle eyeblink reflex was elicited by a noise burst. Results showed that startle eyeblink was attenuated during both tasks and that the attenuation was greater during the multiple-task condition than during the single-task condition. Subjective ratings, endogenous eyeblink rate, heart period, and heart period variability provided convergent validity of the workload manipulations. The findings suggest that the startle eyeblink is sensitive to the workload demands associated with a continuous visual task. The application of startle eyeblink modulation as a workload metric and the possibility that it may be diagnostic of workload demands in different stimulus modalities is discussed.