Levels Of Cognitive Workload Research Articles

Evaluating the Effects of Different Cognitive Tasks on Autonomic Nervous System Responses: Implementation of a High-Precision, Low-Cost Complementary Method.

We developed a low-cost, user-friendly complementary research tool to evaluate autonomic nervous system (ANS) activity at varying levels of cognitive workload. This was achieved using visual stimuli as cognitive tasks, administered through a specially designed computer-based test battery. To assess sympathetic stress responses, skin conductance response (SCR) was measured, and electrocardiograms (ECG) were recorded to evaluate heart rate variability (HRV), an indicator of cardiac vagal tone. Twenty-five healthy adults participated in the study. SCR and ECG recordings were made during both tonic and phasic phases using a computer-based system designed for visual stimuli. Participants performed a button-pressing task upon seeing the target stimulus, and the relationship between reaction time (RT) and cognitive load was evaluated. Analysis of the data showed higher skin conductance levels (SCLs) during tasks compared to baseline, indicating successful elicitation of sympathetic responses. RTs differed significantly between simple and cognitive tasks, increasing with mental load. Additionally, significant changes in vagally mediated HRV parameters during tasks compared to baseline highlighted the impact of cognitive load on the parasympathetic branch of the ANS, thereby influencing the brain-heart connection. Our findings indicate that the developed research tool can successfully induce cognitive load, significantly affecting SCL, RTs, and HRV. This validates the tool's effectiveness in evaluating ANS responses to cognitive tasks.

Assessment of cognitive workload using simultaneous EEG and fNIRS: A comparison of feature combinations

The assessment of cognitive workload is a critical component in evaluating mental activity. It is essential in psychology, especially in professions with heightened cognitive demands, such as aviation and surgery. Even marginal improvements in workload assessment can substantially enhance safety and overall performance. This study aimed to improve the accuracy of cognitive workload assessment by employing a combined EEG+fNIRS approach with a minimal number of features. The Tunable Q-factor Wavelet Transform (TQWT) was applied to signals from EEG and fNIRS to extract relevant features. TQWT was chosen for its ability to adapt to the oscillatory behavior of the signal, and the features extracted from the transform facilitated the differentiation between different signal classes. This study introduced six proposed approaches, with the first focusing on EEG signals, the second on fNIRS signals, and the subsequent three to six approaches involving combinations of these two signals. Features evaluation highlighted the pivotal role of channels related to the frontal region and sub-bands associated with alpha and theta rhythms in EEG signals. Additionally, the very low-frequency range and the primary undecomposed signal in fNIRS signals contributed significantly to cognitive workload classification. The classification results demonstrated the efficacy of combining EEG and fNIRS signals in cognitive workload detection, providing higher accuracy than single-signal approaches. Compared to other feature combination approaches, the proposed approach based on Canonical Correlation Analysis (CCA) with a linear SVM classifier achieved superior accuracy across all investigated cognitive workload levels, with accuracies of 99.6 %, 99.4 %, 98.9 %, and 97.5 % for the 0-back vs. 3-back, 0-back vs. 2-back, 2-back vs. 3-back, and 0-back vs. 2-back vs. 3-back comparisons, respectively.

Cardiac autonomic responses in relation to cognitive workload during simulated military flight

Understanding the operator's cognitive workload is crucial for efficiency and safety in human–machine systems. This study investigated how cognitive workload modulates cardiac autonomic regulation during a standardized military simulator flight. Military student pilots completed simulated flight tasks in a Hawk flight simulator. Continuous electrocardiography was recorded to analyze time and frequency domain heart rate variability (HRV). After the simulation, a flight instructor used a standardized method to evaluate student pilot's individual cognitive workload from video-recorded flight simulator data. Results indicated that HRV was able to differentiate flight phases that induced varying levels of cognitive workload; an increasing level of cognitive workload caused significant decreases in many HRV variables, mainly reflecting parasympathetic deactivation of cardiac autonomic regulation. In conclusion, autonomic physiological responses can be used to examine reactions to increased cognitive workload during simulated military flights. HRV could be beneficial in assessing individual responses to cognitive workload and pilot performance during simulator training.

EEG-CogNet: A deep learning framework for cognitive state assessment using EEG brain connectivity

The assessment of cognitive states such as workload, attention, and fatigue is crucial in cognitive science and human performance fields due to its significant impact on work efficiency and decision-making. This paper introduces a deep learning framework for cognitive state assessment using Electroencephalogram (EEG) brain connectivity. The framework was evaluated using EEG data from 26 participants through three computer-based tasks: the Dual N-Back Task, Visual Search Task, and Continuous Performance Task, each designed to induce varying levels of cognitive workload, attention, and fatigue, respectively. A comprehensive dataset was meticulously compiled, including physiological, behavioral, and subjective data to ensure robust analyses. The EEG data underwent rigorous pre-processing and feature extraction processes, focusing on brain connectivity metrics such as Coherence and Phase-Locking Value across multiple frequency bands and employing three neural network architectures: Convolutional Neural Networks (CNN), Graph Convolutional Networks (GCN), and Convolutional Long Short-Term Memory networks (ConvLSTM) for classification. The proposed work achieved classification accuracies of 96.53% for workload, 98.40% for attention, and 97.86% for fatigue in the combined frequency bands. The study’s findings underscore the potential of EEG-based methods for non-invasive cognitive state monitoring. By addressing existing limitations such as small sample sizes and task-specific models, this research enhances the generalizability and applicability of EEG-based cognitive assessments. The implications of these advancements are significant for fields requiring continuous cognitive monitoring, such as defense, healthcare, and high-risk operational environments.

The influence of multiple cognitive workload levels of an exergame on dorsal attention network connectivity at the source level

This study investigates how adding a cognitive task on a balance board (exergame) affects connectivity in the dorsal attention network (DAN) during an exergame task. Healthy young adults performed a soccer ball-moving task by tilting a balance board with their feet while their brain activity was measured using electroencephalography (EEG). In this exergame, the speed of obstacles in front of the goal manipulated the cognitive workload. Higher speed means a higher cognitive workload. The study found significant changes in functional connectivity within DAN regions, specifically in the alpha band. During the shift from easy to medium cognitive task, we observed a significant increase in connectivity (p= 0.0436) between the right inferior temporal (ITG R) and the Left middle temporal (MTG L). During the transition from easy to hard cognitive tasks, strengthened interactions (p= 0.0324) between inferior temporal (ITG) and parsopercularis (pOPPER) were found. This suggests that the proposed balanceboard-based exergame enhances the functionality of specific brain regions, such as ITG and MTG regions, and improves connectivity in the frontal cortex. We also found a correlation between brain activity and performance data, highlighting that increased cognitive workload resulted in decreased performance and heightened frontal alpha activity. These findings align with research suggesting that adding cognitive games to physical activity-based tasks in rehabilitation programs can boost brain activity, resulting in improved decision-making and visual processing skills. This information can help clinicians tailor rehabilitation methods that target specific brain regions.

Brainwaves in the Cloud: Cognitive Workload Monitoring Using Deep Gated Neural Network and Industrial Internet of Things

Monitoring and classifying cognitive workload in real time is vital for optimizing human–machine interactions and enhancing performance while ensuring safety, particularly in industrial scenarios. Considering this significance, the authors aim to formulate a cognitive workload monitoring system (CWMS) by leveraging the deep gated neural network (DGNN), a hybrid model integrating bi-directional long short-term memory (Bi-LSTM) and gated recurrent unit (GRU) networks. In our experimental setup, each of the four virtual users is equipped with a Raspberry Pi Zero W module to ensure efficient data transmission, thereby enhancing the reliability and efficacy of the monitoring process. This seamless monitoring framework utilizes the constrained application protocol (CoAP) and the Things Board platform to evaluate cognitive workload in real time. The most popular EEG benchmark dataset, the STEW is utilized for workload classification in this study. We employ the short-time Fourier transformation (STFT) to extract frequency bands corresponding to users in both high and low cognitive workload modes. The proposed DGNN models achieve a perfect accuracy of 99.45%, outperforming every previous state-of-the-art model. We meticulously monitored critical parameters, including latency, classification processing time, and cognitive workload levels. This research demonstrates the importance of continuous monitoring for increasing productivity and safety in industries by introducing a novel method of real-time cognitive workload monitoring. The implementation codes for each experiment are documented and made available for reproducibility.

Towards ubiquitous and nonintrusive measurements of brain function in the real world: assessing blink-related oscillations during simulated flight using portable low-cost EEG.

Blink-related oscillations (BRO) are newly discovered neurophysiological phenomena associated with spontaneous blinking and represent cascading neural mechanisms including visual sensory, episodic memory, and information processing responses. These phenomena have been shown to be present at rest and during tasks and are modulated by cognitive load, creating the possibility for brain function assessments that can be integrated seamlessly into real-world settings. Prior works have largely examined the BRO phenomenon within controlled laboratory environments using magnetoencephalography and high-density electroencephalography (EEG) that are ill-suited for real-world deployment. Investigating BROs using low-density EEG within complex environments reflective of the real-world would further our understanding of how BRO responses can be utilized in real-world settings. We evaluated whether the BRO response could be captured in a high-fidelity flight simulation environment using a portable, low-density wireless EEG system. The effects of age and task demands on BRO responses were also examined. EEG data from 30 licensed pilots (age 43.37 +/- 17.86, 2 females) were collected during simulated flights at two cognitive workload levels. Comparisons of signal amplitudes were undertaken to confirm the presence of BRO responses and mixed model ANOVAs quantified the effects of workload and age group on BRO amplitudes. Significant increases in neural activity were observed post-blink compared to the baseline period (p < 0.05), confirming the presence of BRO responses. In line with prior studies, results showed BRO time-domain responses from the delta band (0.5-4 Hz) consisting of an early negative peak followed by a positive peak post-blink in temporal and parietal electrodes. Additionally, task workload and age-related effects were also found, with observations of the enhancement of BRO amplitudes with older age and attenuation of BRO responses in high workloads (p < 0.05). These findings demonstrate that it is possible to capture BRO responses within simulated flight environments using portable, low-cost, easy-to-use EEG systems. Furthermore, biological and task salience were reflected in these BRO responses. The successful detection and demonstration of both task-and age-related modulation of BRO responses in this study open the possibility of assessing human brain function across the lifespan with BRO responses in complex and realistic environments.

A Dual-Adversarial Model for Cross-time and Cross-subject Cognitive Workload Decoding.

Electroencephalogram (EEG) signals are widely utilized in the field of cognitive workload decoding (CWD). However, when the recognition scenario is shifted from subject-dependent to subject-independent or spans a long period, the accuracy of CWD deteriorates significantly. Current solutions are either dependent on extensive training datasets or fail to maintain clear distinctions between categories, additionally lacking a robust feature extraction mechanism. In this paper, we tackle these issues by proposing a Bi-Classifier Joint Domain Adaptation (BCJDA) model for EEG-based cross-time and cross-subject CWD. Specifically, the model consists of a feature extractor, a domain discriminator, and a Bi-Classifier, containing two sets of adversarial processes for domain-wise alignment and class-wise alignment. In the adversarial domain adaptation, the feature extractor is forced to learn the common domain features deliberately. The Bi-Classifier also fosters the feature extractor to retain the category discrepancies of the unlabeled domain, so that its classification boundary is consistent with the labeled domain. Furthermore, different adversarial distance functions of the Bi-Classifier are adopted and evaluated in this model. We conduct classification experiments on a publicly available BCI competition dataset for recognizing low, medium, and high cognitive workload levels. The experimental results demonstrate that our proposed BCJDA model based on cross-gradient difference maximization achieves the best performance.

Cognitive workload estimation using physiological measures: a review.

Estimating cognitive workload levels is an emerging research topic in the cognitive neuroscience domain, as participants' performance is highly influenced by cognitive overload or underload results. Different physiological measures such as Electroencephalography (EEG), Functional Magnetic Resonance Imaging, Functional near-infrared spectroscopy, respiratory activity, and eye activity are efficiently used to estimate workload levels with the help of machine learning or deep learning techniques. Some reviews focus only on EEG-based workload estimation using machine learning classifiers or multimodal fusion of different physiological measures for workload estimation. However, a detailed analysis of all physiological measures for estimating cognitive workload levels still needs to be discovered. Thus, this survey highlights the in-depth analysis of all the physiological measures for assessing cognitive workload. This survey emphasizes the basics of cognitive workload, open-access datasets, the experimental paradigm of cognitive tasks, and different measures for estimating workload levels. Lastly, we emphasize the significant findings from this review and identify the open challenges. In addition, we also specify future scopes for researchers to overcome those challenges.

Adaptive Human-Robotic Interaction for Robotic-assisted Surgical Settings.

Increased complexity in robotic-assisted surgical system interfaces introduces problems with human-robot collaboration that result in excessive mental workload (MWL), adversely impacting a surgeon's task performance and increasing error probability. Real-time monitoring of the operator's MWL will aid in identifying when and how interventions can be best provided to moderate MWL. In this study, an MWL-based adaptive automation system is constructed and evaluated for its effectiveness during robotic-assisted surgery. This study recruited 10 participants firstto perform surgical tasks under different cognitive workload levels. Physiological signals were obtained and employed to build a real-time system for cognitive workload monitoring. To evaluate the effectiveness of the proposed system, 15 participants were recruited to perform the surgical task with and without the proposed system. The participants' task performance and perceived workload were collected and compared. The proposed neural network model achieved an accuracy of 77.9% in cognitive workload classification. In addition, better task performance and lower perceived workload were observed when participants completed the experimental task under the task condition supplemented with adaptive aiding using the proposed system. The proposed MWL monitoring system successfully diminished the perceived workload of participants and increased their task performance under high-stress conditions via interventions by a semi-autonomous suction tool. The preliminary results from the comparative study show the potential impact of automated adaptive aiding systems in enhancing surgical task performance via cognitive workload-triggered interventions in robotic-assisted surgery.

A review of physiological measures for mental workload assessment in aviation

AbstractThe relevant growth of human-machine interaction (HMI) systems in recent years is leading to the necessity of being constantly aware of the cognitive workload level of an operator, especially in a safety-critical context such as aviation. Since the confusion in the definition of this concept, this paper clarifies this terminology and also highlights its relationship with stress. Thus, we analysed the state-of-the-art of cognitive workload evaluations, showing three up-to-date methodologies: subjective, behavioural and physiological. In particular, the physiological approach is increasingly gaining attention in the literature due to today’s exponential growth of biomedical sensors. Therefore, a review of the most adopted physiological signals in the workload evaluation is provided, focusing on the aeronautical field. We conclude by highlighting the necessity of a multimodal approach for mental workload assessment as a result of this analysis.

Assessing focus through ear-EEG: a comparative study between conventional cap EEG and mobile in- and around-the-ear EEG systems.

As our attention is becoming a commodity that an ever-increasing number of applications are competing for, investing in modern day tools and devices that can detect our mental states and protect them from outside interruptions holds great value. Mental fatigue and distractions are impacting our ability to focus and can cause workplace injuries. Electroencephalography (EEG) may reflect concentration, and if EEG equipment became wearable and inconspicuous, innovative brain-computer interfaces (BCI) could be developed to monitor mental load in daily life situations. The purpose of this study is to investigate the potential of EEG recorded inside and around the human ear to determine levels of attention and focus. In this study, mobile and wireless ear-EEG were concurrently recorded with conventional EEG (cap) systems to collect data during tasks related to focus: an N-back task to assess working memory and a mental arithmetic task to assess cognitive workload. The power spectral density (PSD) of the EEG signal was analyzed to isolate consistent differences between mental load conditions and classify epochs using step-wise linear discriminant analysis (swLDA). Results revealed that spectral features differed statistically between levels of cognitive load for both tasks. Classification algorithms were tested on spectral features from twelve and two selected channels, for the cap and the ear-EEG. A two-channel ear-EEG model evaluated the performance of two dry in-ear electrodes specifically. Single-trial classification for both tasks revealed above chance-level accuracies for all subjects, with mean accuracies of: 96% (cap-EEG) and 95% (ear-EEG) for the twelve-channel models, 76% (cap-EEG) and 74% (in-ear-EEG) for the two-channel model for the N-back task; and 82% (cap-EEG) and 85% (ear-EEG) for the twelve-channel, 70% (cap-EEG) and 69% (in-ear-EEG) for the two-channel model for the arithmetic task. These results suggest that neural oscillations recorded with ear-EEG can be used to reliably differentiate between levels of cognitive workload and working memory, in particular when multi-channel recordings are available, and could, in the near future, be integrated into wearable devices.

Intraoperative workload in elective open vascular and endovascular surgery: A study of procedural drivers

This study investigated vascular surgeon workload and its association with specific procedural drivers over different procedure types. Thirteen attending vascular surgeons (two females) were emailed a survey over a 3-month period. Data from 253 surgical procedures (118 open, 85 endovascular, 18 hybrid, and 32 venous) revealed high physical and cognitive workload among vascular surgeons. Based on the statistically significant findings and similar non-significant trends in the data (significance level of 0.01), open and hybrid vascular procedures showed higher levels of physical and cognitive workload compared to venous cases, while endovascular procedures were relatively more moderate. Additionally, the workload subscales for five subcategories of open procedures (e.g., arteriovenous access) as well as three subcategories of endovascular procedures (e.g., aortic) were compared. The granularity of the intraoperative workload drivers across various vascular procedure types and adjunct equipment could be the key to create targeted ergonomic interventions to reduce workload during vascular surgeries.

Micromovements and discomfort associated with flight mission with helmet operation tasks with different levels of cognitive workload

When performing stationary tasks under elevated cognitive workload, individuals must perform continual muscle contractions to maintain stability of the body, resulting in fatigue of the postural muscles. When the muscles perform these contractions in a prolonged manner, the body potentially responds through small changes in body movements—micromovements that may lead to discomfort. The study purpose was to evaluate impact of cognitive load on micromovements. The micromovements were measured during three different cognitive workloads; low, medium, and high. The NASA-TLX score was used to evaluate the perceived mental workload and discomfort was assessed by visual analog scale. In total, 60 subjects (30 males and 30 females) were recruited and performed cognitive tasks that simulated flight operations such as changing the radio frequency based on air traffic control messages, balancing the fuel levels in simulated fuel tanks, and aiming a reticle in a designated moving target using the cyclic control. Cognitive load was defined by the frequency of events. Micromovements were defined by changes in the center of pressure (COP) of the seat pan and COP standard deviation. It was found that the high cognitive workloads had the highest NASA-TLX scores including mental demands, temporal demands, and effort. The neck area had the highest overall levels of discomfort followed by upper back. The highest standard deviation for COP shift and number of micromovements occurred for medium cognitive workloads. While there were some interesting trends, few trends reached a statistical significance due to high variability among subjects for the outcome variables.

Raw Electroencephalogram-Based Cognitive Workload Classification Using Directed and Nondirected Functional Connectivity Analysis and Deep Learning.

With the phenomenal rise in internet-of-things devices, the use of electroencephalogram (EEG) based brain-computer interfaces (BCIs) can empower individuals to control equipment with thoughts. These allow BCI to be used and pave the way for pro-active health management and the development of internet-of-medical-things architecture. However, EEG-based BCIs have low fidelity, high variance, and EEG signals are very noisy. These challenges compel researchers to design algorithms that can process big data in real-time while being robust to temporal variations and other variations in the data. Another issue in designing a passive BCI is the regular change in user's cognitive state (measured through cognitive workload). Though considerable amount of research has been conducted on this front, methods that could withstand high variability in EEG data and still reflect the neuronal dynamics of cognitive state variations are lacking and much needed in literature. In this research, we evaluate the efficacy of a combination of functional connectivity algorithms and state-of-the-art deep learning algorithms for the classification of three different levels of cognitive workload. We acquire 64-channel EEG data from 23 participants executing the n-back task at three different levels; 1-back (low-workload condition), 2-back (medium-workload condition), and 3-back (high-workload condition). We compared two different functional connectivity algorithms, namely phase transfer entropy (PTE) and mutual information (MI). PTE is a directed functional connectivity algorithm, whereas MI is non-directed. Both methods are suitable for extracting functional connectivity matrices in real-time, which could eventually be used for rapid, robust, and efficient classification. For classification, we use the recently proposed BrainNetCNN deep learning model, designed specifically to classify functional connectivity matrices. Results reveal a classification accuracy of 92.81% with MI and BrainNetCNN and a staggering 99.50% with PTE and BrainNetCNN on test data. PTE can yield a higher classification accuracy due to its robustness to linear mixing of the data and its ability to detect functional connectivity across a range of analysis lags.

Drivers’ Workload Electroencephalogram Characteristics in Cognitive Tasks Based on Improved Multiscale Sample Entropy

Cognitive workload is an internal factor that can be influenced by external factors. When drivers are distracted by these internal and external influences, their ability to drive safely can be compromised. Electroencephalogram (EEG) is a non-invasive neuroimaging technique that measures the electrical activity of the brain. and it can provide information about brain activity related to various cognitive and motor functions. In this study, on-road driving experiments were conducted to investigate the EEG characteristics of drivers under different levels of cognitive workload generated through mathematical calculations with varying difficulties. The collected EEG signals were processed using continuous wavelet transform to decompose them into delta, theta, alpha, beta, and gamma waveforms. Numerical values and power spectral characteristics of each waveband in the left and right frontal regions of the driver were then analyzed. Furthermore, the study utilized an improved multiscale sample entropy algorithm to analyze the EEG entropy characteristics of drivers in different states. The results indicate that under different degrees of cognitive workload, the amplitude of delta, theta, and alpha waves decreased, while beta and gamma waves showed significant changes. The improved multiscale sample entropy algorithm provided a more objective assessment of changes in entropy across different wavebands and stages, with smaller entropy fluctuation ranges and more accurate complexity changes. Overall, this research provides valuable insights into the characteristics of drivers under cognitive workload, contributing to the analysis of human factors in driving safety. These findings can inform the development of strategies to mitigate the adverse effects of cognitive workload on driving performance and enhance overall road safety.

Enhanced Teleoperation Interfaces for Multi-Second Latency Conditions: System Design and Evaluation

Adding human cognitive skills to planetary exploration through remote teleoperation can lead to more valuable scientific data acquisition. Still, even small amounts of latency can significantly affect real-time operations, often leading to compromised robot safety, goal overshoot, and high levels of cognitive workload. Thus, novel operational strategies are necessary to cope with these effects. This paper proposes three augmented teleoperation interfaces that allow the user to operate a robot subject to 3 seconds of latency: (1) Avatar-Aided Interface (AAI), a semi-autonomous approach based on a virtual element; (2) Predictive Interface (PI), an approach with direct control and predictive elements; and (3) Hybrid Interface (HI), where operators can easily switch between PI and AAI. We conducted a systematic within-subject experiment to evaluate the proposed interfaces in a realistic virtual environment with frequent traction losses. The user study compared AAI and PI to a Control Interface (CI), which did not display any augmented elements. The main results of this comparison showed that: (1) AAI led to a significant reduction in workload and a significant increase in usability and robot safety; (2) the use of the PI caused a significant increase in path length, indicating that operators overshoot their goals more often with this approach; (3) PI and AAI had lower reported effort; and (4) AAI is more flexible and effortless than PI and CI. Finally, during traction loss periods, PI and AAI had shortcomings that led to confusion from the operator, showing the need to integrate uncertainty measures in future interface design.

The Impact of Psychological Factors on Sleep Quality among Public University Students in Klang Valley, Malaysia

A good night's sleep is essential for human mental and physical health, and chronic sleep deprivation has been related to impaired neurobehavioral function. This study aims to determine the relationship between internet addiction, loneliness, and cognitive workload on sleep quality among public university students in Klang Valley. A total of 400 respondents involved from three public universities in Klang valley. A self-administered questionnaire was used as a tool for data collection. The result revealed that most of the respondents had moderate level of internet addiction, loneliness, and cognitive workload. Meanwhile, the result also showed that majority of the respondents scored low level severity of sleep quality. In addition, cognitive workload, loneliness and internet addiction were positively correlated with sleep quality issues. Multiple regression analysis showed that loneliness and cognitive workload were significant predictors of sleep quality issues among the students with cognitive workload as the strongest predictor. This study concluded that undergraduate students’ cognitive workload, loneliness and internet addiction were important in influencing the undergraduate students’ sleep quality issues. By understanding the impact of these psychological factors on sleep quality particularly among the undergraduate students, it helped to minimize the possibility of undergraduate students' sleep quality issues in order to promote and maintain a healthy lifestyle for them. Thus, the impact and implications of this study will be discussed.

Does it deliver what it promises? Evaluation of cognitive distraction caused by speech-based interfaces with detection response and box task

Speech is considered a promising modality for human-machine interaction while driving, especially in reducing visual and manual distraction. However, speech-based user interfaces themselves have shown to increase cognitive distraction. There remains a lack of standardized and unambiguous methods for measuring the impact of speech-based assistants on cognitive distraction while driving. This work aims to investigate whether the combination of the box task and the detection response task (DRT) is a suitable method for assessing the cognitive distraction caused by speech-based assistants. For this purpose, participants (N = 39) engaged in artificial (n-back tasks) and natural speech-based secondary tasks (interaction with Android’s Google Assistant and Apple's Siri) differing in predefined levels of cognitive workload while performing the box task and the DRT. The results showed that DRT performance differed between the 0-back and 1-back task but not between the different cognitive workload levels of the speech-based assistants. No clear effects emerged for the box task parameters. Thus, the combination of the box task and DRT is well-suited for measuring cognitive distraction caused by artificial secondary tasks but not by natural interactions with speech-based assistants.

Assessing Cognitive Workload Using Cardiovascular Measures and Voice.

Monitoring cognitive workload has the potential to improve both the performance and fidelity of human decision making. However, previous efforts towards discriminating further than binary levels (e.g., low/high or neutral/high) in cognitive workload classification have not been successful. This lack of sensitivity in cognitive workload measurements might be due to individual differences as well as inadequate methodology used to analyse the measured signal. In this paper, a method that combines the speech signal with cardiovascular measurements for screen and heartbeat classification is introduced. For validation, speech and cardiovascular signals from 97 university participants and 20 airline pilot participants were collected while cognitive stimuli of varying difficulty level were induced with the Stroop colour/word test. For the trinary classification scheme (low, medium, high cognitive workload) the prominent result using classifiers trained on each participant achieved 15.17 ± 0.79% and 17.38 ± 1.85% average misclassification rates indicating good discrimination at three levels of cognitive workload. Combining cardiovascular and speech measures synchronized to each heartbeat and consolidated with short-term dynamic measures might therefore provide enhanced sensitivity in cognitive workload monitoring. The results show that the influence of individual differences is a limiting factor for a generic classification and highlights the need for research to focus on methods that incorporate individual differences to achieve even better results. This method can potentially be used to measure and monitor workload in real time in operational environments.