Dual-task Manipulation Research Articles

Advanced workstations and collaborative robots: exploiting eye-tracking and cardiac activity indices to unveil senior workers' mental workload in assembly tasks.

Introduction: As a result of Industry 5.0's technological advancements, collaborative robots (cobots) have emerged as pivotal enablers for refining manufacturing processes while re-focusing on humans. However, the successful integration of these cutting-edge tools hinges on a better understanding of human factors when interacting with such new technologies, eventually fostering workers' trust and acceptance and promoting low-fatigue work. This study thus delves into the intricate dynamics of human-cobot interactions by adopting a human-centric view. Methods: With this intent, we targeted senior workers, who often contend with diminishing work capabilities, and we explored the nexus between various human factors and task outcomes during a joint assembly operation with a cobot on an ergonomic workstation. Exploiting a dual-task manipulation to increase the task demand, we measured performance, subjective perceptions, eye-tracking indices and cardiac activity during the task. Firstly, we provided an overview of the senior workers' perceptions regarding their shared work with the cobot, by measuring technology acceptance, perceived wellbeing, work experience, and the estimated social impact of this technology in the industrial sector. Secondly, we asked whether the considered human factors varied significantly under dual-tasking, thus responding to a higher mental load while working alongside the cobot. Finally, we explored the predictive power of the collected measurements over the number of errors committed at the work task and the participants' perceived workload. Results: The present findings demonstrated how senior workers exhibited strong acceptance and positive experiences with our advanced workstation and the cobot, even under higher mental strain. Besides, their task performance suffered increased errors and duration during dual-tasking, while the eye behavior partially reflected the increased mental demand. Some interesting outcomes were also gained about the predictive power of some of the collected indices over the number of errors committed at the assembly task, even though the same did not apply to predicting perceived workload levels. Discussion: Overall, the paper discusses possible applications of these results in the 5.0 manufacturing sector, emphasizing the importance of adopting a holistic human-centered approach to understand the human-cobot complex better.

Restricted Access to Working Memory Does Not Prevent Cumulative Score Improvement in a Cultural Evolution Task.

Some theories propose that human cumulative culture is dependent on explicit, system-2, metacognitive processes. To test this, we investigated whether access to working memory is required for cumulative cultural evolution. We restricted access to adults’ working-memory (WM) via a dual-task paradigm, to assess whether this reduced performance in a cultural evolution task, and a metacognitive monitoring task. In total, 247 participants completed either a grid search task or a metacognitive monitoring task in conjunction with a WM task and a matched control. Participants’ behaviour in the grid search task was then used to simulate the outcome of iterating the task over multiple generations. Participants in the grid search task scored higher after observing higher-scoring examples, but could only beat the scores of low-scoring example trials. Scores did not differ significantly between the control and WM distractor blocks, although more errors were made when under WM load. The simulation showed similar levels of cumulative score improvement across conditions. However, scores plateaued without reaching the maximum. Metacognitive efficiency was low in both blocks, with no indication of dual-task interference. Overall, we found that taxing working-memory resources did not prevent cumulative score improvement on this task, but impeded it slightly relative to a control distractor task. However, we found no evidence that the dual-task manipulation impacted participants’ ability to use explicit metacognition. Although we found minimal evidence in support of the explicit metacognition theory of cumulative culture, our results provide valuable insights into empirical approaches that could be used to further test predictions arising from this account.

Cognitive load decreases cooperation and moral punishment in a Prisoner\u2019s Dilemma game with punishment option

The present study serves to test whether cooperation and moral punishment are affected by cognitive load. Dual-process theories postulate that moral behavior is intuitive which leads to the prediction that cooperation and moral punishment should remain unaffected or may even increase when cognitive load is induced by a secondary task. However, it has also been proposed that cognitive control and deliberation are necessary to choose an economically costly but morally justified option. A third perspective implies that the effects of cognitive load may depend on the specific processes involved in social dilemmas. In the present study, participants played a simultaneous Prisoner’s Dilemma game with a punishment option. First, both players decided to cooperate or defect. Then they had the opportunity to punish the partners. In the cognitive-load group, cognitive load was induced by a continuous tone classification task while the no-load group had no distractor task. Under cognitive load, cooperation and moral punishment decreased in comparison to the no-load condition. By contrast, hypocritical and antisocial punishment were not influenced by the dual-task manipulation. Increased cognitive load was associated with a bias to punish the partners irrespective of the outcome of the Prisoner’s Dilemma game, suggesting that punishment was applied less purposefully in the cognitive-load condition. The present findings are thus in line with the idea that the availability of cognitive resources does not always have a suppressive effect on moral behaviors, but can have facilitating effects on cooperation and moral punishment.

Neural and biomechanical tradeoffs associated with human-exoskeleton interactions

Industrial passive low-back exoskeletons have gained recent attention as ergonomic interventions to manual handling tasks. This research utilized a two-armed experimental approach (single vs dual-task paradigms) to quantify neural and biomechanical tradeoffs associated with short-term human-exoskeleton interaction (HEI) during asymmetrical lifting in twelve healthy adults balanced by gender. A dynamic, electromyography-assisted spine model was employed that indicated statistical, but marginal, biomechanical benefits of the tested exoskeleton, which diminished with the introduction of the cognitive dual-task. Using Near Infrared Spectroscopy (fNIRS)-based brain connectivity analyses, we found that the tested exoskeleton imposed greater neurocognitive and motor adaptation efforts by engaging action monitoring and error processing brain networks. Collectively, these findings indicate that a wearer's biomechanical response to increased cognitive demands in the workplace may offset the mechanical advantages of exoskeletons. We also demonstrate the utility of ambulatory fNIRS to capture the neural cost of HEI without the need for elaborate dual-task manipulations.

Is masked priming modulated by memory load? A test of the automaticity of masked identity priming in lexical decision.

One of the key assumptions of the masked priming lexical decision task (LDT) is that primes are processed without requiring attentional resources. Here, we tested this assumption by presenting a dual-task manipulation to increase memory load and measure the change in masked identity priming on the targets in the LDT. If masked priming does not require attentional resources, increased memory load should have no influence on the magnitude of the observed identity priming effects. We conducted two LDT experiments, using a within-subjects design, to investigate the effect of memory load (via a concurrent matching task Experiment 1 and a concurrent search task in Experiment 2) on masked identity priming. Results showed that the magnitude of masked identity priming on word targets was remarkably similar under high and low memory load. Thus, these experiments provide empirical evidence for the automaticity assumption of masked identity priming in the LDT.

Flexible explicit but rigid implicit learning in a visuomotor adaptation task.

There is mounting evidence for the idea that performance in a visuomotor rotation task can be supported by both implicit and explicit forms of learning. The implicit component of learning has been well characterized in previous experiments and is thought to arise from the adaptation of an internal model driven by sensorimotor prediction errors. However, the role of explicit learning is less clear, and previous investigations aimed at characterizing the explicit component have relied on indirect measures such as dual-task manipulations, posttests, and descriptive computational models. To address this problem, we developed a new method for directly assaying explicit learning by having participants verbally report their intended aiming direction on each trial. While our previous research employing this method has demonstrated the possibility of measuring explicit learning over the course of training, it was only tested over a limited scope of manipulations common to visuomotor rotation tasks. In the present study, we sought to better characterize explicit and implicit learning over a wider range of task conditions. We tested how explicit and implicit learning change as a function of the specific visual landmarks used to probe explicit learning, the number of training targets, and the size of the rotation. We found that explicit learning was remarkably flexible, responding appropriately to task demands. In contrast, implicit learning was strikingly rigid, with each task condition producing a similar degree of implicit learning. These results suggest that explicit learning is a fundamental component of motor learning and has been overlooked or conflated in previous visuomotor tasks.

Speed Matters: Relationship between Speed of Eye Movements and Modification of Aversive Autobiographical Memories.

Eye movement desensitization and reprocessing (EMDR) is an efficacious treatment for post-traumatic stress disorder. In EMDR, patients recall a distressing memory and simultaneously make eye movements (EM). Both tasks are considered to require limited working memory (WM) resources. Because this leaves fewer resources available for memory retrieval, the memory should become less vivid and less emotional during future recall. In EMDR analogue studies, a standardized procedure has been used, in which participants receive the same dual task manipulation of 1 EM cycle per second (1 Hz). From a WM perspective, the WM taxation of the dual task might be titrated to the WM taxation of the memory image. We hypothesized that highly vivid images are more affected by high WM taxation and less vivid images are more affected by low WM taxation. In study 1, 34 participants performed a reaction time task, and rated image vividness, and difficulty of retrieving an image, during five speeds of EM and no EM. Both a high WM taxing frequency (fast EM; 1.2 Hz) and a low WM taxing frequency (slow EM; 0.8 Hz) were selected. In study 2, 72 participants recalled three highly vivid aversive autobiographical memory images (n = 36) or three less vivid images (n = 36) under each of three conditions: recall + fast EM, recall + slow EM, or recall only. Multi-level modeling revealed a consistent pattern for all outcome measures: recall + fast EM led to less emotional, less vivid and more difficult to retrieve images than recall + slow EM and recall only, and the effects of recall + slow EM felt consistently in between the effects of recall + fast EM and recall only, but only differed significantly from recall + fast EM. Crucially, image vividness did not interact with condition on the decrease of emotionality over time, which was inconsistent with the prediction. Implications for understanding the mechanisms of action in memory modification and directions for future research are discussed.

Taxing Working Memory during Retrieval of Emotional Memories Does Not Reduce Memory Accessibility When Cued with Reminders.

Earlier studies have shown that when individuals recall an emotional memory while simultaneously doing a demanding dual-task [e.g., playing Tetris, mental arithmetic, making eye movements (EM)], this reduces self-reported vividness and emotionality of the memory. These effects have been found up to 1 week later, but have largely been confined to self-report ratings. This study examined whether this dual-tasking intervention reduces memory performance (i.e., accessibility of emotional memories). Undergraduates (N = 60) studied word-image pairs and rated the retrieved image on vividness and emotionality when cued with the word. Then they viewed the cues and recalled the images with or without making EM. Finally, they re-rated the images on vividness and emotionality. Additionally, fragments from images from all conditions were presented and participants identified which fragment was paired earlier with which cue. Findings showed no effect of the dual-task manipulation on self-reported ratings and latency responses. Several possible explanations for the lack of effects are discussed, but the cued recall procedure in our experiment seems to explain the absence of effects best. The study demonstrates boundaries to the effects of the “dual-tasking” procedure.

Auditory temporal preparation induced by rhythmic cues during concurrent auditory working memory tasks.

The present study investigated whether participants can develop temporal preparation driven by auditory isochronous rhythms when concurrently performing an auditory working memory (WM) task. In Experiment 1, participants had to respond to an auditory target presented after a regular or an irregular sequence of auditory stimuli while concurrently performing a Sternberg-type WM task. Results showed that participants responded faster after regular compared with irregular rhythms and that this effect was not affected by WM load; however, the lack of a significant main effect of WM load made it difficult to draw any conclusion regarding the influence of the dual-task manipulation in Experiment 1. In order to enhance dual-task interference, Experiment 2 combined the auditory rhythm procedure with an auditory N-Back task, which required WM updating (monitoring and coding of the information) and was presumably more demanding than the mere rehearsal of the WM task used in Experiment 1. Results now clearly showed dual-task interference effects (slower reaction times [RTs] in the high- vs. the low-load condition). However, such interference did not affect temporal preparation induced by rhythms, with faster RTs after regular than after irregular sequences in the high-load and low-load conditions. These results revealed that secondary tasks demanding memory updating, relative to tasks just demanding rehearsal, produced larger interference effects on overall RTs in the auditory rhythm task. Nevertheless, rhythm regularity exerted a strong temporal preparation effect that survived the interference of the WM task even when both tasks competed for processing resources within the auditory modality.

Functional dissociations in temporal preparation: Evidence from dual-task performance

Implicit preparation over time is a complex cognitive capacity important to optimize behavioral responses to a target occurring after a temporal interval, the so-called foreperiod (FP). If the FP occurs randomly and with the same a priori probability, shorter response times are usually observed with longer FPs than with shorter ones (FP effect). Moreover, responses are slower when the preceding FP was longer than the current one (sequential effects). It is still a matter of debate how different processes influence these temporal preparation phenomena. The present study used a dual-task procedure to understand how different processes, along the automatic-controlled continuum, may contribute to these temporal preparation phenomena. Dual-task demands were manipulated in two experiments using a subtraction task during the FP. This secondary task was administered in blocks (Experiment 1) or was embedded together with a baseline single-task in the same experimental session (Experiment 2). The results consistently showed that the size of the FP effect, but not that of sequential effects, is sensitive to dual-task manipulations. This functional dissociation unveils the multi-faceted nature of implicit temporal preparation: while the FP effect is due to a controlled, resource-consuming preparatory mechanism, a more automatic mechanism underlies sequential effects.

Investigating the influence of a glucose drink on emotional memory

The ingestion of a glucose drink has been shown to reliably facilitate declarative memory. However, it remains unclear as to how circulatory levels of glucose influences memory for emotional material, with contradictory findings reported in the literature. Emotional material evokes a natural memory advantage, with measurable increases in circulatory glucose levels being observed in response to emotional words (in the absence of glucose administration). Increased glucose levels (naturally occurring or through an intervention) however, have not been shown to reliably facilitate emotional material. This randomised, placebo-controlled, crossover design, was employed to further investigate the influence of glucose ingestion on memory for emotional words in healthy adults (N = 29; age: 18–49 years). This population is most susceptible to glucose facilitation during more cognitively demanding tasks. A dual task manipulation (alternating hand movement sequences) was introduced during the encoding phase. The glucose drink did not influence memory for emotional words in this study. A main effect of emotion was found, with memory for emotional words (positive and negative) being greater than for neutral words, both at immediate and delayed recall. The results contrast with similar research, which has previously observed improved memory for only negative items. It may be that the memory measures utilised in this study were not sensitive enough to detect any subtle changes to memory induced by a glucose load. Differential physiological responses were observed in response to drink type. Heart rate was found to decrease upon presentation of negative words, following placebo but not glucose. The mechanism underlying this effect is unclear.

Found and missed: Failing to recognize a search target despite moving it

We present results from five search experiments using a novel ‘unpacking’ paradigm in which participants use a mouse to sort through random heaps of distractors to locate the target. We report that during this task participants often fail to recognize the target despite moving it, and despite having looked at the item. Additionally, the missed target item appears to have been processed as evidenced by post-error slowing of individual moves within a trial. The rate of this ‘unpacking error’ was minimally affected by set size and dual task manipulations, but was strongly influenced by perceptual difficulty and perceptual load. We suggest that the error occurs because of a dissociation between perception for action and perception for identification, providing further evidence that these processes may operate relatively independently even in naturalistic contexts, and even in settings like search where they should be expected to act in close coordination.

Visuospatial over verbal demands in predicting Tower of London planning tasks

The role of verbal and visuospatial information processing in Tower of London (TOL) tasks was investigated. The first part of the investigation examined the verbal and visuospatial abilities and preferred cognitive style (visualizer vs. verbalizer) of 79 participants, in an inter-individual differences approach. Visuospatial abilities significantly predicted TOL performance, but the impact of cognitive style was negligible. The second part applied a dual-task manipulation of concurrent interference of TOL planning tasks on verbal and visuospatial memory, using the same participants. Concurrent processing of the TOL tasks diminished visuospatial memory performance considerably but had no effect on verbal memory, and there was no interaction between cognitive style and memory. These findings clearly underscore the role of visuospatial information processing in TOL tasks and indicate little bearing of verbal or visual cognitive style on TOL problem solving. These results have important implications for TOL and cognitive style in clinical application and cognitive neuroimaging research.

Increased attentional demands impair contralesional space awareness following stroke

Rate and severity of contralesional loss of awareness following stroke is highly variable across patients and assessment methods. We studied whether the degree of impairment for contralesional space awareness depends on the quantity of attentional resources that are available for task performance. A new computer-based paradigm was used to assess visual extinction and single-target detection rate in four right hemisphere stroke patients. In the single-task condition, they had to report only the position of the target(s) (“right”, “left”, or “both” sides). In the dual-task conditions, patients also performed a second task, visual or auditory, that recruited additional attentional resources. The same tasks were also performed by healthy controls and by a left hemisphere stroke patient. Patients’ performance was apparently unimpaired in the single-task condition. In contrast, dramatic failures to report the left-sided target emerged in the dual-task conditions. The performance of control participants was unaffected by the dual-task manipulation, whereas the left stroke patient showed the opposite pattern (i.e., unawareness of right-sided targets). Severe contralesional space unawareness under dual-task conditions reveals that visuospatial deficits can dramatically emerge when attentional resources are consumed by a concurrent task. Apparently spared contralesional awareness may simply reflect the availability of resources that are just sufficient to perform a single-task. This finding has important implications for the assessment of contralesional space awareness following stroke, because everyday life activities are often more demanding than most of the tests adopted for diagnosing space awareness disorders.

Cognitive load modulates attentional capture by color singletons during effortful visual search

Color singletons that are irrelevant to locating a visual target do not typically capture attention if visual search is effortful. In contrast, when search is efficient color singletons are often found to capture attention. Such distraction by a color singleton can be modulated by single-task vs. dual-task manipulations when visual search is efficient. This is due, presumably, to the increased cognitive load in the dual-task condition, which interferes with top-down attentional control. This study investigated whether capture by a color singleton is also modulated by single-task vs. dual-task manipulations when visual search was effortful. The results of three experiments revealed that attentional capture effects were absent in a single-task condition and were present in a dual-task condition, but only when the identity of the color singleton is not associated with the target response-set. When the identity of the color singleton was relevant to the response-set it captured attention in both the single-task and in dual-task conditions.

The role of control functions in mentalizing: Dual-task studies of Theory of Mind and executive function

Conflicting evidence has arisen from correlational studies regarding the role of executive control functions in Theory of Mind. The current study used dual-task manipulations of executive functions (inhibition, updating and switching) to investigate the role of these control functions in mental state and non-mental state tasks. The ‘Eyes’ pictorial test of Theory of Mind showed specific dual-task costs when concurrently performed with an inhibitory secondary task. In contrast, interference effects on a verbal ‘Stories’ task were general, occurring on both mental state and non-mental state tasks, and across all types of executive function. These findings from healthy functioning adults should help to guide decisions about appropriate methods of assessing ToM in clinical populations, and interpreting deficits in performance in such tasks in the context of more general cognitive dysfunction.

Emotional Arousal and Memory: A Test of the Poststimulus Processing Hypothesis

Emotional arousal is believed to enhance memory for details central to an episode but impair memory for peripheral details. However, new research suggests that arousal induced thematically (i.e., through involvement with an unfolding event) produces only memory enhancements. This article examines whether consciously controlled elaborative processing in the aftermath of an arousing experience is responsible. A dual task manipulation was used to prevent participants from ruminating over a video that depicted an abduction and attack. Several indices of recall showed greater memory for emotional event details than for details from a neutral control video, which remained the case when the opportunity for post-stimulus elaboration was prevented. Thus, superior retention of the content of emotional experiences may arise from the way in which arousal is induced rather than through immediate postevent cognitions.

Response-specific sources of dual-task interference in human pre-motor cortex

It is difficult to perform two tasks at the same time. Such performance limitations are exemplified by the psychological refractory period (PRP): when participants make distinct motor responses to two stimuli presented in rapid succession, the response to the second stimulus is increasingly slowed as the time interval between the two stimuli is decreased. This impairment is thought to reflect a central limitation in selecting the appropriate response to each stimulus, but not in perceptually encoding the stimuli. In the present study, it was sought to determine which brain regions are specifically involved in response selection under dual-task conditions by contrasting fMRI brain activity measured from a response selection manipulation that increased dual-task costs, with brain activity measured from an equally demanding manipulation that affected perceptual visibility. While a number of parieto-frontal areas involved in response selection were activated by both dual-task manipulations, the dorsal pre-motor cortex, and to a lesser extent the inferior frontal cortex, were specifically engaged by the response selection manipulation. These results suggest that the pre-motor cortex is an important neural locus of response selection limitation under dual-task situations.

The Role of Memory in the Tower of London Task

The Tower of London (TOL) task is widely used as a neuropsychological test of planning. Relatively little is known of the cognitive components of the task, and in particular the role of memory in performance. The current studies on normal adults looked at the role of verbal and spatial working memory in the TOL. The effects of verbal and visuospatial dual-task manipulations on TOL performance were examined in an experiment with 36 participants. Both verbal and visuospatial executive secondary tasks caused poorer performance on the TOL; however, concurrent articulatory suppression enhanced performance. The results suggest that executive and spatial components are important in the task, and raise questions about the role of preplanning in the TOL.

The Phenomenology of Attention

The effect of attention on perceived brightness and contrast was investigated in eight experiments. Attention was manipulated by engaging observers in an attention-demanding concurrent task (letter detection) or by directing attention to a location with a peripheral cue. In all of the dual-task manipulations, attention reduced the variability of responses. However, attention did not affect the brightness of stimuli, nor did it affect the amount of simultaneous brightness contrast. Results with peripheral location cues were similar; however, the effect of attention in these experiments could be attributed to nonperceptual factors. The metaphorical “spotlight” of attention reduces observers' uncertainty about the brightness of a stimulus, but it does not “illuminate” in terms of brightness or contrast.