Primary Task Performance Research Articles

Effects of secondary task eccentricity and visual salience on attention allocation in multitasking across screens

In digital control rooms, operators often need to monitor multiple information sources, which are spatially distributed on multiple screens, to manage multiple tasks simultaneously. Operators’ attention allocation between tasks are likely to be affected by the visual salience and eccentricity of secondary task screens. Their exact impacts and underlying mechanisms need to be investigated to inform system design to support balanced attention allocation strategies for optimal multitasking performance. This study aims to address these issues through a laboratory experiment using a simulated unmanned aerial vehicle monitoring platform. The participants performed a primary task and two secondary tasks concurrently, each shown on a separated screen. The visual salience and eccentricity of the maintenance task (one of the secondary tasks) were manipulated within-groups. Attention allocation behaviors were captured by eye movement data, and performance of both primary and secondary tasks were recorded. The participants were more likely to switch to and spent more time on the maintenance task of lower salience, showing a tendency to override the bottom-up influence of secondary task salience with top-down control. Large eccentricity of the secondary task, however, led to less attention allocation and lower task prioritization in paired event conflicts. The interaction effect of the salience and eccentricity of the maintenance task was significant for the accuracy of the primary task and the other secondary task. These findings offered insights into the joint design of salience and eccentricity of secondary tasks to enhance overall multitasking performance.

Let’s Get Physical: The Influence of Embodiment on Industrial Human-Robot Interaction

In recent years, an increasing number of studies in human-robot interaction (HRI) have used images or videos of robots as a simple, inexpensive, and customizable substitute for physically embodied robots. Thus, the question arises whether results from studies using depictions can be validly applied to interactions with embodied robots. This study investigated the effect of embodiment in HRI within an industrial interaction scenario, focusing on perception, trust, and task performance. Eighty-five participants interacted either with an embodied robot or its depiction via a computer screen. Results showed that the embodied robot was perceived as more likable, intelligent, and safer, eliciting higher initial trust. Primary task performance was observed to be higher in interaction with the embodied robot, while secondary task performance was higher in interaction with the robot’s depiction. These findings challenge the generalizability of depiction-based HRI research, highlighting the importance of considering embodiment in future research designs.

Be prepared for interruptions: EEG correlates of anticipation when dealing with task interruptions and the role of aging

Dealing with task interruptions requires the flexible use of working memory and attentional control mechanisms, which are prone to age-related changes. We investigated effects of age on dealing with task interruptions and potential advantages of anticipating an interruption using EEG and a retrospective cueing (retro-cue) paradigm. Thirty-two young (18–30 years) and 28 older (55–70 years) participants performed a visual working memory task, where they had to report the orientation of a target following a retro-cue. Within blocks of 10 trials, they were always, never, or randomly interrupted with an arithmetic task before the onset of the retro-cue. The interruption-induced decline in primary task performance was more pronounced in older participants, while only these benefited from anticipation. The EEG analysis revealed reduced theta and alpha/beta response to the retro-cue following interruptions, especially for the older participants. In both groups, anticipated interruptions were associated with increased theta and alpha/beta power prior and during the interruption, and stronger beta suppression to the retro-cue. The results indicate that interruptions impede the refocusing of attention on the task-relevant representation of the primary task, especially in older people, while anticipation facilitates preparation for the interruption task and resumption of the primary task.

Human and machine-induced social stress in complex work environments: Effects on performance and subjective state

Social stress at work can lead to severe consequences. As a result of technological developments, social stress will increasingly be induced by machines. It is therefore crucial to understand how machine-induced social stress affects operators. The present study aimed to compare human and machine-induced social stress with regard to its effect on primary and secondary task performance, and on subjective state (e.g., self-esteem, mood and justice). 90 participants worked on a high-fidelity simulation of a complex work environment, on which they had received extensive training (2h15). Social stress was induced by a human or a machine using a combination of negative performance feedback and ostracism. Results indicate that social stress did not affect performance, affect or state self-esteem. Machine-induced and human-induced social stress overall had similar effects, except for the latter impairing perceived justice. We discuss implications of these results for automation at the workplace and outline future research directions.

Voice quality and its effects on university students' listening effort in a virtual seminar room

A teacher’s poor voice quality may increase listening effort in pupils, but it is unclear whether this effect persists in adult listeners. Thus, the goal of this study is to examine the impact of vocal hoarseness on university students' listening effort in a virtual seminar room. An audio-visual immersive virtual reality environment is utilized to simulate a typical seminar room with common background sounds and fellow students represented as wooden mannequins. Participants wear a head-mounted display and are equipped with two controllers to engage in a dual-task paradigm. The primary task is to listen to a virtual professor reading short texts and retain relevant content information to be recalled later. The texts are presented either in a normal or an imitated hoarse voice. In parallel, participants perform a secondary task which is responding to tactile vibration patterns via the controllers. It is hypothesized that listening to the hoarse voice induces listening effort, resulting in more cognitive resources needed for primary task performance while secondary task performance is hindered. Results are presented and discussed in light of students’ cognitive performance and listening challenges in higher education learning environments.

Transfer of task-probability-induced biases in parallel dual-task processing occurs in similar, but is constraint in distinct task sets.

Although humans often multitask, little is known about how the processing of concurrent tasks is managed. The present study investigated whether adjustments in parallel processing during multitasking are local (task-specific) or global (task-unspecific). In three experiments, participants performed one of three tasks: a primary task or, if this task did not require a response, one of two background tasks (i.e., prioritized processing paradigm). To manipulate the degree of parallel processing, we presented blocks consisting mainly of primary or background task trials. In Experiment 1, the frequency manipulation was distributed equally across the two background tasks. In Experiments 2 and 3, only one background task was frequency-biased (inducer task). The other background task was presented equally often in all blocks (diagnostic task) and served to test whether processing adjustments transferred. In all experiments, blocks with frequent background tasks yielded stronger interference between primary and background tasks (primary task performance) and improved background task performance. Thus, resource sharing appeared to increase with high background task probabilities even under triple task requirements. Importantly, these adjustments generalized across the background tasks when they were conceptually and visually similar (Experiment 2). Implementing more distinct background tasks limited the transfer: Adjustments were restricted to the inducer task in background task performance and only small transfer was observed in primary task performance (Experiment 3). Overall, the results indicate that the transfer of adjustments in parallel processing is unrestricted for similar, but limited for distinct tasks, suggesting that task similarity affects the generality of resource allocation in multitasking. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Impact of incidental visualizations on primary tasks

Incidental visualizations are meant to be seen at-a-glance, on-the-go, and during short exposure times. They will always appear side-by-side with an ongoing primary task while providing ancillary information relevant to those tasks. They differ from glanceable visualizations because looking at them is never their major focus, and they differ from ambient visualizations because they are not embedded in the environment, but appear when needed. However, unlike glanceable and ambient visualizations that have been studied in the past, incidental visualizations have yet to be explored in-depth. In particular, it is still not clear what is their impact on the users’ performance of primary tasks. Therefore, we conducted an empirical online between-subjects user study where participants had to play a maze game as their primary task. Their goal was to complete several mazes as quickly as possible to maximize their score. This game was chosen to be a cognitively demanding task, bound to be significantly affected if incidental visualizations have a meaningful impact. At the same time, they had to answer a question that appeared while playing, regarding the path followed so far. Then, for half the participants, an incidental visualization was shown for a short period while playing, containing information useful for answering the question. We analyzed various metrics to understand how the maze performance was impacted by the incidental visualization. Additionally, we aimed to understand if working memory would influence how the maze was played and how visualizations were perceived. We concluded that incidental visualizations of the type used in this study do not disrupt people while they played the maze as their primary task. Furthermore, our results strongly suggested that the information conveyed by the visualization improved their performance in answering the question. Finally, working memory had no impact on the participants’ results.

Task-Relevant Smartphone Messages Within Work Zones: A Driving Simulation Study.

This study explored the impact of in-vehicle messages relative to roadside messages to alert drivers to events within a simulated work zone, in order to determine if these messages can improve driving performance within the work zone. Safety risks in work zones are usually mitigated by design standards and clear signage to communicate work zone information to drivers. Due to distraction and other driving task demands, these signs are not always noticed by motorists, nor are they always followed when they are noticed. The driving simulation tested drivers in two different types of work zones, shoulder work, and lane closure. Participants drove through these work zones three times, each with different messaging interfaces to communicate hazardous events to the driver. The interfaces included a roadside, portable changeable message sign, a smartphone presenting only auditory messages, and a smartphone presenting audio-visual messages. There was significantly better driving performance on key metrics including lane deviation for the in-vehicle message conditions relative to the roadside signs. Furthermore, drivers directed visual attention toward the roadway for the in-vehicle message conditions relative to the roadside sign condition. The results indicate that in-vehicle messaging could provide benefits to primary task performance in driving if the message content is appropriately designed. The findings provide support for a design framework to support in-vehicle communication to drivers approaching work zones and other environments to safely alert them to hazards.

The art of transfer learning: An adaptive and robust pipeline

Transfer learning is an essential tool for improving the performance of primary tasks by leveraging information from auxiliary data resources. In this work, we propose Adaptive Robust Transfer Learning (ART), a flexible pipeline of performing transfer learning with generic machine learning algorithms. We establish the nonasymptotic learning theory of ART, providing a provable theoretical guarantee for achieving adaptive transfer while preventing negative transfer. Additionally, we introduce an ART‐integrated‐aggregating machine that produces a single final model when multiple candidate algorithms are considered. We demonstrate the promising performance of ART through extensive empirical studies on regression, classification, and sparse learning. We further present a real‐data analysis for a mortality study.

Immersive Real-Time Biofeedback Optimized With Enhanced Expectancies Improves Motor Learning: A Feasibility Study.

An Optimizing Performance through Intrinsic Motivation and Attention for Learning theory-based motor learning intervention delivering autonomy support and enhanced expectancies (EE) shows promise for reducing cognitive-motor dual-task costs, or the relative difference in primary task performance when completed with and without a secondary cognitive task, that facilitate adaptive injury-resistant movement response. The current pilot study sought to determine the effectiveness of an autonomy support versus an EE-enhanced virtual reality motor learning intervention to reduce dual-task costs during single-leg balance. Within-subjects 3 × 3 trial. Twenty-one male and 24 female participants, between the ages of 18 and 30years, with no history of concussion, vertigo, lower-extremity surgery, or lower-extremity injuries the previous 6months, were recruited for training sessions on consecutive days. Training consisted of 5 × 8 single-leg squats on each leg, during which all participants mimicked an avatar through virtual reality goggles. The autonomy support group chose an avatar color, and the EE group received positive kinematic biofeedback. Baseline, immediate, and delayed retention testing consisted of single-leg balancing under single- and dual-task conditions. Mixed-model analysis of variances compared dual-task costs for center of pressure velocity and SD between groups on each limb. On the right side, dual-task costs for anterior-posterior center of pressure mean and SD were reduced in the EE group (mean Δ = -51.40, Cohen d = 0.80 and SD Δ = -66.00%, Cohen d = 0.88) compared with the control group (mean Δ = -22.09, Cohen d = 0.33 and SD Δ = -36.10%, Cohen d = 0.68) from baseline to immediate retention. These findings indicate that EE strategies that can be easily implemented in a clinic or sport setting may be superior to task-irrelevant AS approaches for influencing injury-resistant movement adaptations.

Distance estimation from monocular cues in an ethological visuomotor task.

In natural contexts, sensory processing and motor output are closely coupled, which is reflected in the fact that many brain areas contain both sensory and movement signals. However, standard reductionist paradigms decouple sensory decisions from their natural motor consequences, and head-fixation prevents the natural sensory consequences of self-motion. In particular, movement through the environment provides a number of depth cues beyond stereo vision that are poorly understood. To study the integration of visual processing and motor output in a naturalistic task, we investigated distance estimation in freely moving mice. We found that mice use vision to accurately jump across a variable gap, thus directly coupling a visual computation to its corresponding ethological motor output. Monocular eyelid suture did not affect gap jumping success, thus mice can use cues that do not depend on binocular disparity and stereo vision. Under monocular conditions, mice altered their head positioning and performed more vertical head movements, consistent with a shift from using stereopsis to other monocular cues, such as motion or position parallax. Finally, optogenetic suppression of primary visual cortex impaired task performance under both binocular and monocular conditions when optical fiber placement was localized to binocular or monocular zone V1, respectively. Together, these results show that mice can use monocular cues, relying on visual cortex, to accurately judge distance. Furthermore, this behavioral paradigm provides a foundation for studying how neural circuits convert sensory information into ethological motor output.

Mental workload variations during different cognitive office tasks with social media interruptions

Interruption at work by social media (SM) is a pervasive phenomenon. This study investigated the impact of SM interruptions and task cognitive levels on mental workload (MWL) and physiological indexes. Each subject performed six simulated computer tasks differentiated by two factors: task cognitive level and performing condition. MWL was reflected through three categories of data: perceived mental workload, physiological indexes, and primary task performance. The results revealed significant effects of SM interruptions on heart rate, low-frequency/high-frequency (LF/HF) ratio, and skin conductance. ANOVA results showed there were main effects of task cognitive level on LF/HF and skin conductance. These effects during interrupted tasks were more profound. In addition, participants experienced higher MWL and recorded lower primary task performance in the knowledge-based task than the rule- and skill-based tasks. Our findings can guide managers and employees regarding appropriate use of SM in the workplace and better managing interruption and workload. Practitioner Summary: Office workers suffer from increased overall mental workload due to unpredictable interruptions while working. This study shows that participants’ mental workload increased when receiving SM interruptions, which was more profound during complex tasks. This highlights the importance of SM interruptions management for employees’ health, performance, and mobile application developers. Abbreviations: ANOVA: analysis of variance; DSSQ: dundee stress state questionnaire; ECG: electrocardiographic; EDA: electrodermal activity; EEG: electroencephalographic; HPA: hypothalamus-pituitaryadrenocortical; HR: heart rate; HRV: heart rate variability; LF/HF: low frequency/high frequency; MSDs: musculoskeletal disorders; MWL: mental workload; NN: normal to normal; RMS: root means square; RR: time duration between two successive R peaks; RT: response time; SC: skin conductance; SDNN: standard deviation of normal to normal; SM: social media; TCL: task cognitive level; TPC: task performing condition; WMC: working memory capacity

Response preparation of a secondary reaction time task is influenced by movement phase within a continuous visuomotor tracking task.

The simultaneous performance of two motor tasks is challenging. Currently, it is unclear how response preparation of a secondary task is impacted by the performance of a continuous primary task. The purpose of the present experiment was to investigate whether the position of the limb performing the primary cyclical tracking task impacts response preparation of a secondary reaction time task. Participants (n = 20) performed a continuous tracking task with their left hand that involved cyclical and targeted wrist flexion and extension. Occasionally, a probe reaction time task requiring isometric wrist extension was performed with the right hand in response to an auditory stimulus (80 or 120 dB) that was triggered when the left hand passed through one of 10 locations identified within the movement cycle. On separate trials, transcranial magnetic stimulation was applied over the left primary motor cortex and triggered at the same 10 stimulus locations to assess corticospinal excitability associated with the probe reaction time task. Results revealed that probe reaction times were significantly longer and motor-evoked potential amplitudes were significantly larger when the left hand was in the middle of a movement cycle compared with an endpoint, suggesting that response preparation of a secondary probe reaction time task was modulated by the phase of movement within the continuous primary task. These results indicate that primary motor task requirements can impact preparation of a secondary task, reinforcing the importance of considering primary task characteristics in dual-task experimental design.

Cognitive Load Assessment Scales in Simulation: Validity Evidence for a Novel Measure of Cognitive Load Types.

Cognitive load (CL) theory provides a framework to inform simulation instructional design. Reliable measures of CL types (intrinsic [IL], extraneous [EL], and germane load [GL]) in simulation are lacking. We developed the novel Cognitive Load Assessment Scales in Simulation (CLAS-Sim) and report validity evidence using Kane's framework. This quasi-experimental study tested the effect of a segmented/pause-and-debrief or standard/end-of-case-debrief intervention on pediatric residents' performance and self-rated CL in 2 complex- and simple-case simulations. After each simulation, participants completed 22 items measuring CL types. Three validity inferences were examined: scoring (instrument development and principal component analysis); generalization (internal consistency reliability of CL-component items across cases); and extrapolation [CLAS-Sim correlations with the single-item Paas scale, which measures overall CL; differences in primary task performance (high vs low); and discriminant validity of IL under different instructional-design conditions]. Seventy-four residents completed both simulations and postcase CLAS-Sim measures. The principal component analysis yielded 3 components: 4-item IL, 4-item EL, and 3-item GL scales (Cronbach's α, 0.68-0.77). The Paas scores correlated with CLAS-Sim IL and total CL scores in both cases ( rs range, 0.39-0.70; P ≤ 0.001). High complex-case performers reported lower IL and total CL (analyses of variance, each P < 0.001). In multivariate analyses of variance, CLAS-Sim IL, GL, and total CL varied across both cases by arm (each P ≤ 0.018); the segmented-debrief arm reported lower IL than the standard-debrief arm in both cases (each P ≤ 0.01). The CLAS-Sim demonstrates preliminary validity evidence for distinguishing 3 CL types but requires further study to evaluate the impact of simulation-design elements on CL and learning.

The moderation effects of task attributes and mental fatigue on post-interruption task performance in a concurrent multitasking environment

In a concurrent multitasking environment, performing many types of tasks increases task complexity, and working long hours makes a person susceptible to mental fatigue. Emerging technologies may lead to more task interruptions. This study examines the effects of task attributes and mental fatigue on interrupted task performance in a concurrent multitasking environment. Thirty-four participants performed the MATB-Ⅱ under eight conditions (two-level task interruption, two-level task complexity, two-level fatigue). The results revealed the significant interaction effects of interruption × task complexity and of interruption × fatigue state. The findings show that more time is required to return to a complex primary task, and there are differences among subtask types. Mental fatigue negatively affects primary task performance, workload, and the resumption lag after an interruption. The findings are explained by the increasing information cues needed to resume complex tasks and the negative effect of fatigue on memory activation.

Relationship between Muscle Strength of Knee Stabilizers and Quality of Vertical Jump Performance in Physically Active Female Population

High relationships between muscle strength and various forms of jumps are usually based on the research samples of professional athletes or students of sports and physical education. However such studies are less known in the case of recreational women. This study aimed to determine the relationship between isokinetic parameters of knee joint muscle strength with the efficiency of performing vertical jumps. The sample represents a group of 16 healthy and physically active women (age=31.04±3.71; height 168.13±8.34; weight 59.80±9.80). Knee extensors and flexors were evaluated by using an isokinetic dynamometer, while the two-foot vertical jump performance was measured using the Opto Jump System. Pearson's correlation coefficient was used to determine correlation magnitude (p&lt;.05). The obtained results indicated high correlations of the knee extension peak torque dominant leg (KEPT D), knee extension peak torque non-dominant leg (KEPT ND) and knee flexion peak torque non-dominant leg (KFPT ND) with counter movement jump free arms (CMJFA) (r=.525; r=.511; r=.594; p&lt;.05). High correlations was also indicated between KFPT ND with counter movement jump (CMJ) (r=.514; p&lt;.05). Given that these are recreational women, we can assume that the countermovement free arm jump type was the most natural form of expressing their explosive potential. It is certainly important that future studies further examine the relationships between muscle strength and performance of primary and specific motor tasks in recreational women.

How to refocus attention on working memory representations following interruptions—Evidence from frontal theta and posterior alpha oscillations

Interruptions lead to a deterioration of primary task performance. Applied research usually describes a delay in primary task resumption as an essential component of this performance deficit. Here, we investigate this approach using electrophysiological correlates of the focusing of attention within working memory, a process that is fundamental to switching between different tasks. A lateralized working memory task was frequently interrupted by either a high- or low-demanding arithmetic task and a subsequent retrospective cue indicated the working memory item required for later report. The detrimental effect of interruptions on primary task performance was most pronounced for high-demanding interruptions. After retro-cue presentation, fronto-central theta power (4-7Hz) was lowest following high-demanding interruptions and posterior alpha power (8-14 Hz) was less suppressed in the two interruption conditions. These effects might be related to a deficit in attentional control processes following the retrospective cue. Furthermore, we introduce the suppression of posterior alpha power contralateral to the remembered primary task stimuli during the interruption phase as a temporal marker for primary task resumption. Especially for cognitively demanding interruption tasks, this effect seems to overlap in time with the processing of the interruption, which should contribute to the primary task performance deficit.

Increased reliance on top-down information to compensate for reduced bottom-up use of acoustic cues in dyslexia

Speech recognition is a complex human behavior in the course of which listeners must integrate the detailed phonetic information present in the acoustic signal with their general linguistic knowledge. It is commonly assumed that this process occurs effortlessly for most people, but it is still unclear whether this also holds true in the case of developmental dyslexia (DD), a condition characterized by perceptual deficits. In the present study, we used a dual-task setting to test the assumption that speech recognition is effortful for people with DD. In particular, we tested the Ganong effect (i.e., lexical bias on phoneme identification) while participants performed a secondary task of either low or high cognitive demand. We presumed that reduced efficiency in perceptual processing in DD would manifest in greater modulation in the performance of primary task by cognitive load. Results revealed that this was indeed the case. We found a larger Ganong effect in the DD group under high than under low cognitive load, and this modulation was larger than it was for typically developed (TD) readers. Furthermore, phoneme categorization was less precise in the DD group than in the TD group. These findings suggest that individuals with DD show increased reliance on top-down lexically mediated perception processes, possibly as a compensatory mechanism for reduced efficiency in bottom-up use of acoustic cues. This indicates an imbalance between bottom-up and top-down processes in speech recognition of individuals with DD.

The role of task similarity for ego depletion: A registered report

Ego depletion refers to decrements in self-control performance resulting from prior use of self-control. The ego depletion effect has received much research attention, but the more recent literature reports small or null effects. This registered report examined the moderating effect of task similarity on the ego depletion effect. We predicted a crossover interaction between type of primary and secondary task such that engaging in a demanding self-control task should lead to better performance in the secondary task when it is similar to the primary task (facilitation effect) but worse performance when it is dissimilar (ego depletion). In a preregistered pilot study, N = 80 participants first completed either a visual stop-signal task (SST) or a simple lexical categorization task. They proceeded with one of four tasks classified as increasingly dissimilar based on their underlying operations and executive functions: (1) auditory stop-signal task, (2) Stroop task, (3) Eriksen flanker task, and (4) unsolvable anagrams. Both the pilot study and a high-powered registered replication (N = 300) revealed the predicted interaction effect. However, evidence for facilitation from similar tasks was stronger than evidence for depletion from dissimilar tasks. Together, these findings highlight the important role of task similarity for the study of ego depletion and related phenomena.

Eye Tracking to Evaluate the Effects of Interruptions and Workload in a Complex Task.

To use eye tracking to understand the effects of interruptions in different workload conditions as part of a monitoring and change detection task. Interruptions are detrimental to performance in complex, multitasking domains. There is a need for better display design techniques that help users overcome interruptions regardless of their workload level. This requires understanding a user's attentional state immediately after an interruption in order to determine what type of display adjustments are most suitable. An emergency dispatching simulator was developed with a visual primary task and auditory interruptive task. Two levels of workload were induced by varying the number of emergency vehicles to monitor for changes and the rate of changes to monitor. Eye tracking, performance, and subjective measures (NASA-Task Load Index) were collected and analyzed for 41 participants. As expected, high workload interacted with interruptions to further degrade primary task performance and alter participants' attention allocation immediately after the interruption. Participants in the high workload condition had more narrowed, slower scan patterns immediately after the interruption as compared to before the interruption, as evidenced by lower scanpath length per second and mean saccade amplitude. However, this change was not observed in low workload. High workload modulates the effects of interruptions on performance and eye movements. Users in the high workload condition struggle to quickly scan the display in the seconds following an interruption. The results can provide insight into the type of display adjustments needed right after an interruption in a high-workload environment.