Task-evoked Pupillary Responses Research Articles

Mental effort during mindless reading? Pupil fluctuations indicate internal processing during levels of inattention.

Mind wandering, an experience characterized by a reduced external focus of attention and an increased internal focus, has seen significant theoretical advancement in understanding its underlying cognitive processes. The levels-of-inattention hypothesis posits that in mind wandering, external attention is reduced in a graded fashion, reflecting different levels of weak versus deep attentional decoupling. However, it has remained unclear whether internal processing during mind wandering, and mindless reading in particular, requires effort and, if so, whether it is graded or distinct. To address this, we analyzed pupil size as a measure of cognitive load in the sustained-attention-to-stimulus task during text reading. We examined whether decoupled external attention is linked to an overall reduction in workload and whether internal focus of attention is graded or represents a distinct cognitive process. Overall, overlooking errors in the text was associated with a small pupil size, indicating reduced effortful processing. However, this effect varied with error type: overlooking high- or medium-level errors (weak decoupling) resulted in reduced pupil size, while overlooking low-level errors (deep decoupling) had no effect on pupil size. Moreover, detecting an error (at any processing level) elicited a task-evoked pupillary response, which was absent when it was overlooked. These findings suggest that weak decoupling reduces internal resource-demanding processing and are in line with the hypothesis that large pupils during deep decoupling may be associated with distinct states of effortful internal processing. They further support both the levels-of-inattention hypothesis and the notion that internal focus is a distinct mode of deeply decoupled processing. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Pupillary response to cognitive control in depression-prone individuals

Revealing the pupillary correlates of depression-prone individuals is conducive to the early intervention and treatment of depression. This study recruited 31 depression-prone and 31 healthy individuals. They completed an emotional task-switching task combined with a go/no-go task, and task-evoked pupillary responses (TEPR) were recorded. Behavioral results showed no significant differences in behavioral performance in terms of cognitive flexibility and inhibition between the depression-prone group and the healthy control group. The pupillary results revealed that (1) the depression-prone group showed slightly lower TEPRs to positive stimuli than the healthy controls during cue presentation; (2) during target presentation, the depression-prone group did not show an effect of emotional valence on the pupillary response in the task-repeat trials; and (3) compared to the healthy controls, the depression-prone group showed significantly smaller TEPRs to negative no-go stimuli and had a longer latency of the second peak of pupil dilation in no-go trials. These results imply that depression-prone individuals may have slower neural responses in cognitive control tasks and emotion-specific weakened cognitive control than healthy individuals.

Estimating Cognitive Workload Using Task-Related Pupillary Responses in Simulated Drilling in Cochlear Implantation.

Training of temporal bone drilling requires more than mastering technical skills with the drill. Skills such as visual imagery, bimanual dexterity, and stress management need to be mastered along with precise knowledge of anatomy. In otorhinolaryngology, these psychomotor skills underlie performance in the drilling of the temporal bone for access to the inner ear in cochlear implant surgery. However, little is known about how psychomotor skills and workload management impact the practitioners' continuous and overall performance. To understand how the practitioner's workload and performance unfolds over time, we examine task-evoked pupillary responses (TEPR) of 22 medical students who performed transmastoid-posterior tympanotomy (TMPT) and removal of the bony overhang of the round window niche in a 3D-printed model of the temporal bone. We investigate how students' TEPR metrics (Average Pupil Size [APS], Index of Pupil Activity [IPA], and Low/High Index of Pupillary Activity [LHIPA]) and time spent in drilling phases correspond to the performance in key drilling phases. All TEPR measures revealed significant differences between key drilling phases that corresponded to the anticipated workload. Enlarging the facial recess lasted significantly longer than other phases. IPA captured significant increase of workload in thinning of the posterior canal wall, while APS revealed increased workload during the drilling of the bony overhang. Our findings contribute to the contemporary competency-based medical residency programs where objective and continuous monitoring of participants' progress allows to track progress in expertise acquisition. Laryngoscope, 2024.

The resolution of proactive interference in a novel visual working memory task: A behavioral and pupillometric study.

Proactive interference (PI) occurs when previously learned information impairs memory for more recently learned information. Most PI studies have employed verbal stimuli, while the role of PI in visual working memory (VWM) has had relatively little attention. In the verbal domain, Johansson and colleagues (2018) found that pupil diameter - a real-time neurophysiological index of cognitive effort - reflects the accumulation and resolution of PI. Here we use a novel, naturalistic paradigm to test the behavioral and pupillary correlates of PI resolution for what-was-where item-location bindings in VWM. Importantly, in our paradigm, trials (PI vs. no-PI condition) are mixed in a block, and participants are naïve to the condition until they are tested. This design sidesteps concerns about differences in encoding strategies or generalized effort differences between conditions. Across three experiments (N = 122 total) we assessed PI's effect on VWM and whether PI resolution during memory retrieval is associated with greater cognitive effort (as indexed by the phasic, task-evoked pupil response). We found strong support for PI's detrimental effect on VWM (even with our spatially distributed stimuli), but no consistent link between interference resolution and effort during memory retrieval (this, even though the pupil was a reliable indicator that higher-performing individuals tried harder during memory encoding). We speculate that when explicit strategies are minimized, and PI resolution relies primarily on implicit processing, the effect may not be sufficient to trigger a robust pupillometric response.

Auditory Challenges and Listening Effort in School-Age Children With Autism: Insights From Pupillary Dynamics During Speech-in-Noise Perception.

This study aimed to investigate challenges in speech-in-noise (SiN) processing faced by school-age children with autism spectrum conditions (ASCs) and their impact on listening effort. Participants, including 23 Mandarin-speaking children with ASCs and 19 age-matched neurotypical (NT) peers, underwent sentence recognition tests in both quiet and noisy conditions, with a speech-shaped steady-state noise masker presented at 0-dB signal-to-noise ratio in the noisy condition. Recognition accuracy rates and task-evoked pupil responses were compared to assess behavioral performance and listening effort during auditory tasks. No main effect of group was found on accuracy rates. Instead, significant effects emerged for autistic trait scores, listening conditions, and their interaction, indicating that higher trait scores were associated with poorer performance in noise. Pupillometric data revealed significantly larger and earlier peak dilations, along with more varied pupillary dynamics in the ASC group relative to the NT group, especially under noisy conditions. Importantly, the ASC group's peak dilation in quiet mirrored that of the NT group in noise. However, the ASC group consistently exhibited reduced mean dilations than the NT group. Pupillary responses suggest a different resource allocation pattern in ASCs: An initial sharper and larger dilation may signal an intense, narrowed resource allocation, likely linked to heightened arousal, engagement, and cognitive load, whereas a subsequent faster tail-off may indicate a greater decrease in resource availability and engagement, or a quicker release of arousal and cognitive load. The presence of noise further accentuates this pattern. This highlights the unique SiN processing challenges children with ASCs may face, underscoring the importance of a nuanced, individual-centric approach for interventions and support.

The Effects of Light Level and Signal-to-Noise Ratio on the Task-Evoked Pupil Response in a Speech-in-Noise Task.

There is increasing interest in the measurement of cognitive effort during listening tasks, for both research and clinical purposes. Quantification of task-evoked pupil responses (TEPRs) is a psychophysiological method that can be used to study cognitive effort. However, light level during cognitively demanding listening tasks may affect TEPRs, complicating interpretation of listening-related changes. The objective of this study was to examine the effects of light level on TEPRs during effortful listening across a range of signal-to-noise ratios (SNRs). Thirty-six adults without hearing loss were asked to repeat target sentences presented in background babble noise while their pupil diameter was recorded. Light level and SNRs were manipulated in a 4 × 4 repeated-measures design. Repeated-measures analyses of variance were used to measure the effects. Peak and mean dilation were typically larger in more adverse SNR conditions (except for SNR -6 dB) and smaller in higher light levels. Differences in mean and peak dilation between SNR conditions were larger in dim light than in brighter light. Brighter light conditions make TEPRs less sensitive to variations in listening effort across levels of SNR. Therefore, light level must be considered and reported in detail to ensure sensitivity of TEPRs and for comparisons of findings across different studies. It is recommended that TEPR testing be conducted in relatively low light conditions, considering both background illumination and screen luminance. https://doi.org/10.23641/asha.25676538.

Music in the eye of the beholder: a pupillometric study on preferred background music, attentional state, and arousal

Although background music listening during attention-demanding tasks is common, there is little research on how it affects fluctuations in attentional state and how these fluctuations are linked to physiological arousal. The present study built on Kiss and Linnell (2021) - showing a decrease in mind-wandering and increase in task-focus states with background music - to explore the link between attentional state and arousal with and without background music. 39 students between the ages of 19–32 completed a variation of the Psychomotor Vigilance Task in silence and with their self-selected background music (music they would normally listen to during attention-demanding tasks). Objective arousal measures (pretrial pupil diameter and task-evoked pupillary responses) and subjective attentional state measures (mind-wandering, task-focus, and external-distraction states) were collected throughout the task. Results showed a link between attentional state and arousal and indicated that background music increased arousal. Importantly, arousal mediated the effect of music to decrease mind-wandering and increase task-focus attentional states, suggesting that the arousal increase induced by music was behind the changes in attentional states. These findings show, for the first time in the context of background music listening, that there is a link between arousal and attentional state.

Are the P600 and P3 ERP components linked to the task-evoked pupillary response as a correlate of norepinephrine activity?

During language comprehension, anomalies and ambiguities in the input typically elicit the P600 event-related potential component. Although traditionally interpreted as a specific signal of combinatorial operations in sentence processing, the component has alternatively been proposed to be a variant of the oddball-sensitive, domain-general P3 component. In particular, both components might reflect phasic norepinephrine release from the locus coeruleus (LC/NE) to motivationally significant stimuli. In this preregistered study, we tested this hypothesis by relating both components to the task-evoked pupillary response, a putative biomarker of LC/NE activity. 36 participants completed a sentence comprehension task (containing 25% morphosyntactic violations) and a non-linguistic oddball task (containing 20% oddballs), while the EEG and pupil size were co-registered. Our results showed that the task-evoked pupillary response and the ERP amplitudes of both components were similarly affected by both experimental tasks. In the oddball task, there was also a temporally specific relationship between the P3 and the pupillary response beyond the shared oddball effect, thereby further linking the P3 to NE. Because this link was less reliable in the linguistic context, we did not find conclusive evidence for or against a relationship between the P600 and the pupillary response. Still, our findings further stimulate the debate on whether language-related ERPs are indeed specific to linguistic processes or shared across cognitive domains. However, further research is required to verify a potential link between the two ERP positivities and the LC/NE system as the common neural generator.

Effect of recurrent task-induced acute stress on task performance, vagally mediated heart rate variability, and task-evoked pupil response

Advances in wearable sensor technologies can be leveraged to investigate behavioral and physiological responses in task-induced stress environments. Reliable and valid multidimensional assessments are required to detect stress given its multidimensional nature. This study investigated the effect of recurrent task-induced acute stress on task performance, vagally mediated heart variability measures (vmHRV) and task-evoked pupillary response (TEPR). Task performance, vmHRV measures, and TEPR were collected from 32 study participants while they performed a computer-based task in a recurrent task-induced acute stress environment. Mixed-effects modeling was used to assess the sensitivity of each outcome variable to experimental conditions. Repeated measures correlation tests were used to examine associations between outcome variables. Task performance degraded under stress. vmHRV measures were lower in the stress conditions relative to the no stress conditions. TEPR was found to be higher in the stress conditions compared to the no stress conditions. Task performance was negatively associated with the vmHRV measures, and degraded task performance was linked to increased TEPR in the stress conditions. There were positive associations between vmHRV measures. TEPR was negatively associated with vmHRV measures. Although task-induced stress degrades task performance, recurrent exposure to that stress could alter this effect via habituation. Further, our findings suggest that vmHRV measures and TEPR are sensitive enough to quantify psychophysiological responses to recurrent task-induced stress.

Listening effort for L2 accents: Adults’ adaptation to Mandarin accented english

Using task-evoked pupillary response (TEPR) and dual-task procedures, prior research has shown that adults recruit additional cognitive resources when processing fully intelligible L2-accented speech compared to speech in their own L1 accent (McLaughlin and Van Engen, 2020; Brown et al., 2020). In this study, we investigated the relationship between three prosodic measures (relative word duration variance, pitch stability, and pitch range) and changes in listening effort for L1 and L2 speakers over the course of an experiment. Using growth curve analysis, we found significant interactions between each of the three measures and trial number, indicating that prosodic factors influence speech adaptation. However, these interactions were in opposite directions for the L1 and L2 speakers. Thus, adult monolingual English listeners rely on prosodic information to adapt to a particular speaker’s voice, but use that information differently based on speaker identity.

The effect of talker intelligibility on adaptation to an unfamiliar accent

Listening effort, as indexed by task-evoked pupil response, increases as the intelligibility of second language (L2) speech decreases, and this processing cost is mitigated by experience with talkers of the same accent (Porretta and Tucker, 2019). Prior research has shown that listeners can adapt to unfamiliar L2-accented speech and generalize the adaptation to different L2-accented talkers with the same L1 (Bradlow and Bent, 2008). The current study investigates what type of L2-accented speech exposure (high or low intelligibility) best reduces later listening effort to a novel talker of the same accent. We hypothesize that exposure to highly intelligible L2 speech supports adaptation to the features of an accent because it allows listeners to map accented tokens to the talker’s intended lexical representations. Alternatively, adaptation to a less intelligible talker may require exposure to other low-intelligibility speech, which is characterized by features that deviate more significantly from L1 norms. To test this, participants were exposed to simple sentences spoken in English by either L1 talkers, highly intelligible L2 talkers, or less intelligible L2 talkers. At test, all participants listened to different sentences spoken by a previously unheard L2 talker while listening effort was measured via pupillometry. Data collection is ongoing.

Pupillary correlates of individual differences in n-back task performance.

We used pupillometry during a 2-back task to examine individual differences in the intensity and consistency of attention and their relative role in a working memory task. We used sensitivity, or the ability to distinguish targets (2-back matches) and nontargets, as the measure of task performance; task-evoked pupillary responses (TEPRs) as the measure of attentional intensity; and intraindividual pretrial pupil variability as the measure of attentional consistency. TEPRs were greater on target trials compared with nontarget trials, although there was no difference in TEPR magnitude when participants answered correctly or incorrectly to targets. Importantly, this effect interacted with performance: high performers showed a greater separation in their TEPRs between targets and nontargets, whereas there was little difference for low performers. Further, in regression analysis, larger TEPRs on target trials predicted better performance, whereas larger TEPRs on nontarget trials predicted worse performance. Sensitivity positively correlated with average pretrial pupil diameter and negatively correlated with intraindividual variability in pretrial pupil diameter. Overall, we found evidence that both attentional intensity (TEPRs) and consistency (pretrial pupil variation) predict performance on an n-back working memory task.

Effects of linguistic context and noise type on speech comprehension.

Understanding speech in background noise is an effortful endeavor. When acoustic challenges arise, linguistic context may help us fill in perceptual gaps. However, more knowledge is needed regarding how different types of background noise affect our ability to construct meaning from perceptually complex speech input. Additionally, there is limited evidence regarding whether perceptual complexity (e.g., informational masking) and linguistic complexity (e.g., occurrence of contextually incongruous words) interact during processing of speech material that is longer and more complex than a single sentence. Our first research objective was to determine whether comprehension of spoken sentence pairs is impacted by the informational masking from a speech masker. Our second objective was to identify whether there is an interaction between perceptual and linguistic complexity during speech processing. We used multiple measures including comprehension accuracy, reaction time, and processing effort (as indicated by task-evoked pupil response), making comparisons across three different levels of linguistic complexity in two different noise conditions. Context conditions varied by final word, with each sentence pair ending with an expected exemplar (EE), within-category violation (WV), or between-category violation (BV). Forty young adults with typical hearing performed a speech comprehension in noise task over three visits. Each participant heard sentence pairs presented in either multi-talker babble or spectrally shaped steady-state noise (SSN), with the same noise condition across all three visits. We observed an effect of context but not noise on accuracy. Further, we observed an interaction of noise and context in peak pupil dilation data. Specifically, the context effect was modulated by noise type: context facilitated processing only in the more perceptually complex babble noise condition. These findings suggest that when perceptual complexity arises, listeners make use of the linguistic context to facilitate comprehension of speech obscured by background noise. Our results extend existing accounts of speech processing in noise by demonstrating how perceptual and linguistic complexity affect our ability to engage in higher-level processes, such as construction of meaning from speech segments that are longer than a single sentence.

Attention Mobilization as a Modulator of Listening Effort: Evidence From Pupillometry.

Listening to speech in noise can require substantial mental effort, even among younger normal-hearing adults. The task-evoked pupil response (TEPR) has been shown to track the increased effort exerted to recognize words or sentences in increasing noise. However, few studies have examined the trajectory of listening effort across longer, more natural, stretches of speech, or the extent to which expectations about upcoming listening difficulty modulate the TEPR. Seventeen younger normal-hearing adults listened to 60-s-long audiobook passages, repeated three times in a row, at two different signal-to-noise ratios (SNRs) while pupil size was recorded. There was a significant interaction between SNR, repetition, and baseline pupil size on sustained listening effort. At lower baseline pupil sizes, potentially reflecting lower attention mobilization, TEPRs were more sustained in the harder SNR condition, particularly when attention mobilization remained low by the third presentation. At intermediate baseline pupil sizes, differences between conditions were largely absent, suggesting these listeners had optimally mobilized their attention for both SNRs. Lastly, at higher baseline pupil sizes, potentially reflecting overmobilization of attention, the effect of SNR was initially reversed for the second and third presentations: participants initially appeared to disengage in the harder SNR condition, resulting in reduced TEPRs that recovered in the second half of the story. Together, these findings suggest that the unfolding of listening effort over time depends critically on the extent to which individuals have successfully mobilized their attention in anticipation of difficult listening conditions.

Impact of light on task-evoked pupil responses during cognitive tasks.

Light has many non-image-forming functions including modulation of pupil size and stimulation of alertness and cognition. Part of these non-image-forming effects may be mediated by the brainstem locus coeruleus. The processing of sensory inputs can be associated with a transient pupil dilation that is likely driven in part by the phasic activity of the locus coeruleus. In the present study, we aimed to characterise the task-evoked pupil response associated with auditory inputs under different light levels and across two cognitive tasks. We continuously monitored the pupil of 20 young healthy participants (mean [SD] 24.05 [4.0] years; 14 women) whilst they completed an attentional and an emotional auditory task whilst exposed to repeated 30-40-s blocks of light interleaved with darkness periods. Blocks could either consist of monochromatic orange light (0.16 melanopic equivalent daylight illuminance (EDI) lux) or blue-enriched white light of three different levels [37, 92, 190 melanopic EDI lux; 6500 K]. For the analysis, 15 and then 14 participants were included in the attentional and emotional tasks, respectively. Generalised linear mixed models showed a significant main effect of light level on the task-evoked pupil responses triggered by the attentional and emotional tasks (p ≤ 0.0001). The impact of light was different for the target versus non-target stimulus of the attentional task but was not different for the emotional and neutral stimulus of the emotional task. There is a smaller sustained pupil size during brighter light blocks but, a higher light level triggers a stronger task-evoked pupil response to auditory stimulation, presumably through the recruitment of the locus coeruleus.

Dysregulated noradrenergic response is associated with symptom severity in individuals with schizophrenia.

The locus coeruleus-noradrenaline (LC-NA) system is involved in a wide range of cognitive functions and may be altered in schizophrenia. A non-invasive method to indirectly measure LC activity is task-evoked pupillary response. Individuals with schizophrenia present reduced pupil dilation compared to healthy subjects, particularly when task demand increases. However, the extent to which alteration in LC activity contributes to schizophrenia symptomatology remains largely unexplored. We aimed to investigate the association between symptomatology, cognition, and noradrenergic response in individuals with schizophrenia. We assessed task-evoked pupil dilation during a pro- and antisaccade task in 23 individuals with schizophrenia and 28 healthy subjects. Both groups showed similar preparatory pupil dilation during prosaccade trials, but individuals with schizophrenia showed significantly lower pupil dilation compared to healthy subjects in antisaccade trials. Importantly, reduced preparatory pupil dilation for antisaccade trials was associated with worse general symptomatology in individuals with schizophrenia. Our findings suggest that changes in LC-NA activity - measured by task-evoked pupil dilation - when task demand increases is associated with schizophrenia symptoms. Interventions targeting the modulation of noradrenergic responses may be suitable candidates to reduce schizophrenia symptomatology.

Pupil Dilation as an Index of Examinee's Cognitive Load in Answering a Mathematics Question: A Comparison Study of Different Approaches

ABSTRACTStudies have demonstrated that task‐evoked pupillary responses (TEPRs) can be adopted to measure the examinee's cognitive load. This study compared three approaches for the measurement of TEPRs, mean pupil diameter, mean pupil dilation, and mean percentage of pupil dilation, to determine the best‐fit measuring method. The valid participants of this study were eight sixth‐grade elementary students. The experimental materials used were two mathematics questions with differing difficulty. The generalized estimating equation (GEE) was employed to compare the goodness of fit of each approach. The results revealed that the measurement of TEPRs based on the mean percentage of pupil dilation measured every 4 s provided the best fit.

Children's listening effort for L2-accented speech

Speech perception is a complex task that can become challenging in certain conditions, such as listening to speech in unfamiliar accents. Using task-evoked pupillary response (TEPR) and dual-task procedures, prior research has shown that adults recruit additional cognitive resources when processing fully intelligible L2-accented speech compared to speech in their own L1 accent (McLaughlin and Van Engen, 2020; Brown et al., 2020). In the current study, we used pupillometry to investigate this effect in children (n = 35, ages 5;0 – 8;11) and ask whether prosodic variation can explain any differences in listening effort. Using Growth Curve Analysis, we found that unlike adults, children do not appear to recruit extra cognitive resources to process intelligible L2-accented speech. Like adults, however, pupillary response declined more rapidly for L2-accented speech across the experiment than for L1-accented speech, indicating either rapid adaptation or fatigue. Additionally, we identified three prosodic measures (relative word duration, pitch stability, and pitch range) that were related to speech adaptation/fatigue for both accent conditions, but in opposite directions. Although children do not appear to upregulate listening effort for L2-accented speech like adults, they appear to use prosodic cues differently for L1- versus L2- accented speech as they adapt to speech.

Investigating Human Physiological Responses to Work-Related Stress

Studies have shown that work-related stress is one of the causes of employee burnout, fatigue, and cognitive dysfunction, among other negative effects. Physiological features have been used to investigate stress, but more knowledge is needed in understanding physiological indicators of work-related stress. Moreover, to the best of our knowledge, no study is available that integrates both pupillometry and heart rate in investigating work-related stress. We, therefore, utilized task-evoked pupillary response (TEPR) from pupillometry and heart rate (HR), in the assessment of physiological responses of 32 subjects during the performance of Multi-Attribute Task Battery-II consisting of working baseline and stress conditions. A comparison of results of both conditions showed that TEPR and mean HR significantly increased during stress condition, as compared to working baseline condition. These results are attributed to the work related-stressors integrated in our study, thereby bolstering the applicability of heart rate and pupillometry in studies of work-related stress.

Competition and reward structures nearly eliminate time-on-task performance decrements: Implications for theories of vigilance and mental effort.

Across four experiments, we manipulated features of a simple reaction time (RT) task to examine the effects of such features on sustained attention. In Experiment 1, we created simple RT "game" that pitted participants against two computerized avatars. In one condition, participants were awarded points, while the other condition did not receive points. Performance in the two conditions did not differ, but both conditions showed shorter RTs and shallower time-on-task performance decrements compared to a standard psychomotor vigilance task. In Experiment 2, we removed the competitive feature but retained the point system. In this case, participants without a point system showed a steeper performance decrement than those with a point system. Experiments 3 and 4 replicated these effects and corroborated their findings with pupillometry. Participants in both conditions of Experiment 3 (competitive task) and the points condition of Experiment 4 showed larger task-evoked pupillary responses than participants in the no-points condition of Experiment 4. These findings challenge the notion that time-on-task performance decrements are caused by resource depletion (Smit et al., 2004) and are better explained by motivational control (Hockey, 2011) or cost-benefit theories (Boksem & Tops, 2008; Kurzban et al., 2013) of mental effort and sustained attention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).