Attention To Cues Research Articles

Brainsourcing for temporal visual attention estimation

AbstractThe concept of temporal visual attention in dynamic contents, such as videos, has been much less studied than its spatial counterpart, i.e., visual salience. Yet, temporal visual attention is useful for many downstream tasks, such as video compression and summarisation, or monitoring users’ engagement with visual information. Previous work has considered quantifying a temporal salience score from spatio-temporal user agreements from gaze data. Instead of gaze-based or content-based approaches, we explore to what extent only brain signals can reveal temporal visual attention. We propose methods for (1) computing a temporal visual salience score from salience maps of video frames; (2) quantifying the temporal brain salience score as a cognitive consistency score from the brain signals from multiple observers; and (3) assessing the correlation between both temporal salience scores, and computing its relevance. Two public EEG datasets (DEAP and MAHNOB) are used for experimental validation. Relevant correlations between temporal visual attention and EEG-based inter-subject consistency were found, as compared with a random baseline. In particular, effect sizes, measured with Cohen’s d, ranged from very small to large in one dataset, and from medium to very large in another dataset. Brain consistency among subjects watching videos unveils temporal visual attention cues. This has relevant practical implications for analysing attention for visual design in human-computer interaction, in the medical domain, and in brain-computer interfaces at large.

Attention–language interface in Multilingual Assessment instrument for Narratives

The current study employed the Multilingual Assessment Instrument for Narratives (MAIN) to test comprehension of narrative macrostructure in Russian in a visual world eye-tracking paradigm. The four MAIN visual narratives are structurally similar and question referents’ goals and internal states (IS). Previous research revealed that children’s MAIN comprehension differed among the four narratives in German, Swedish, Russian, and Turkish, but it is not clear why. We tested whether the difference in comprehension was (a) present, (b) caused by complicated inferences in understanding IS compared with goals, and (c) ameliorated by orienting visual attention to the referents whose IS was critical for accurate comprehension. Our findings confirmed (a) and (b) but found no effect of attentional cues on accuracy for (c). The multidimensional theory of narrative organization of children’s knowledge of macrostructure needs to consider the type of inferences necessary for IS that are influenced by subjective interpretation and reasoning.

Satiety-enhancing placebo intervention decreases selective attention to food cues

BackgroundAs placebo interventions could influence appetite and satiety in first studies, they are a promising tool for the future treatment of obesity. Furthermore, individuals with heightened body weight show increased selective attention for food cues. This study aimed to investigate whether placebo induced changes of appetite and satiety can affect attention allocation and to examine correlating factors.MethodsIn a double-blind design, 63 healthy participants were randomized into one of three groups: the enhanced appetite placebo group, the enhanced satiety placebo group, or the control group. Appetite and satiety were induced by administering a placebo capsule along with a group specific expectancy manipulation. One hour later, participants performed a visual probe task to measure attentional bias by comparing reaction times for different conditions. Correlations between reaction times and subjective hunger and satiety ratings, as well as current food craving and plasma ghrelin levels, were explored.ResultsThe induction of attentional bias toward non-food stimuli was successful in women in the enhanced satiety placebo group but not in the enhanced appetite placebo group. Women of the enhanced satiety placebo group showed significantly higher reaction times for food cues compared to non-food cues. Across conditions, reaction times were associated with subjective hunger ratings and current food craving in women. No attentional bias was induced in men in either placebo group.ConclusionPlacebo-induced satiety inhibited attention allocation toward food in healthy women, potentially mediated by reduced hunger and food craving. Placebo effects on satiety could thus be demonstrated on a highly complex cognitive process.

Front-back asymmetries in endogenous auditory spatial attention.

Research on endogenous auditory spatial attention typically uses headphones or sounds in the frontal hemispace, which undersamples panoramic spatial hearing. Crossmodal attention studies also show that visual information impacts spatial hearing and attention. Given the overlap between vision and audition in frontal space, we tested the hypothesis that the distribution of endogenous auditory spatial attention would differ when attending to the front versus back hemispace. Participants performed a non-spatial discrimination task where most sounds were presented at a standard location, but occasionally shifted to other locations. Auditory spatial attention cueing and gradient effects across locations were measured in five experiments. Accuracy was greatest at standard versus shift locations, and was comparable when attending to the front or back. Reaction time measures of cueing and gradient effects were larger when attending to the front versus back midline, a finding that was evident when the range of spatial locations was 180° or 360°. When participants were blindfolded, the front/back differences were still present. Sound localization and divided attention tasks showed that the front/back differences were attentional, rather than perceptual, in nature. Collectively, the findings reveal that the impact of endogenous auditory spatial attention depends on where attention is being focused.

Space- and object-based attention in patients with a single hemisphere following childhood resection.

The neural processes underlying attentional processing are typically lateralized in adults, with spatial attention associated with the right hemisphere (RH) and object-based attention with the left hemisphere (LH). Using a modified two-rectangle attention paradigm, we compared the lateralization profiles of individuals with childhood hemispherectomy (either LH or RH) and age-matched, typically developing controls. Although patients exhibited slower reaction times (RTs) compared to controls, both groups benefited from valid attentional cueing. However, patients experienced significantly higher costs for invalid trials-reflected by larger RT differences between validly and invalidly cued targets. This was true for invalid trials on both cued and uncued objects, probes of object- and space-based attentional processes, respectively. Notably, controls showed no significant RT cost differences between invalidly cued locations on cued versus uncued objects. By contrast, patients exhibited greater RT costs for targets on uncued versus cued objects, suggesting greater difficulty shifting attention across objects. We explore potential explanations for this group difference and the lack of difference between patients with LH or RH resection. These findings enhance our understanding of spatial and object-based attention in typical development and reveal how significant neural injury affects the development of attentional systems in the LH and RH.

An audiovisual cognitive optimization strategy guided by salient object ranking for intelligent visual prothesis systems

Objective.Visual prostheses are effective tools for restoring vision, yet real-world complexities pose ongoing challenges. The progress in AI has led to the emergence of the concept of intelligent visual prosthetics with auditory support, leveraging deep learning to create practical artificial vision perception beyond merely restoring natural sight for the blind.Approach.This study introduces an object-based attention mechanism that simulates human gaze points when observing the external world to descriptions of physical regions. By transforming this mechanism into a ranking problem of salient entity regions, we introduce prior visual attention cues to build a new salient object ranking (SaOR) dataset, and propose a SaOR network aimed at providing depth perception for prosthetic vision. Furthermore, we propose a SaOR-guided image description method to align with human observation patterns, toward providing additional visual information by auditory feedback. Finally, the integration of the two aforementioned algorithms constitutes an audiovisual cognitive optimization strategy for prosthetic vision.Main results.Through conducting psychophysical experiments based on scene description tasks under simulated prosthetic vision, we verify that the SaOR method improves the subjects' performance in terms of object identification and understanding the correlation among objects. Additionally, the cognitive optimization strategy incorporating image description further enhances their prosthetic visual cognition.Significance.This offers valuable technical insights for designing next-generation intelligent visual prostheses and establishes a theoretical groundwork for developing their visual information processing strategies. Code will be made publicly available.

Contextual cuing survives an interruption from an endogenous cue for attention.

Three experiments explored how the repetition of a visual search display guides search during contextual cuing under conditions in which the search process is interrupted by an instructional (endogenous) cue for attention. In Experiment 1, participants readily learned about repeated configurations of visual search, before being presented with an endogenous cue for attention towards the target on every trial. Participants used this cue to improve search times, but the repeated contexts continued to guide attention. Experiment 2 demonstrated that the presence of the endogenous cue did not impede the acquisition of contextual cuing. Experiment 3 confirmed the hypothesis that the contextual cuing effect relies largely on localized distractor contexts, following the guidance of attention. Together, the experiments point towards an interplay between two drivers of attention: after the initial guidance of attention, memory representations of the context continue to guide attention towards the target. This suggests that the early part of visual search is inconsequential for the development and maintenance of the contextual cuing effect, and that memory representations are flexibly deployed when the search procedure is dramatically interrupted.

Exploring horses' (Equus caballus) gaze and asymmetric ear position in relation to human attentional cues.

Studies have shown that horses are sensitive to human attentional cues. Also, there is some evidence that they might be able to infer the knowledge state of a human and communicate intentionally with us. However, this ability is not fully characterized and certain behaviors, like gaze, asymmetric ears position or vocalizations, which could work as attention-getting behaviors, have been scarcely studied in this context. The aim of the present study was to assess whether horses' gaze toward a person, asymmetric ears position and vocalizations are subject to audience effects and adjust to human attentional cues, which would suggest a communicative function. For this purpose, we adapted a protocol used with domestic dogs [Kaminski et al. 2017] and observed horses' spontaneous behavior (gaze, asymmetric ears position and vocalizations) in the presence of a human holding and not holding food in an attentive position (facing the horse with open eyes) and in a non-attentive position (with her back turned towards the horse). We found significant evidence of horses being sensitive to human attentional cues (reflected in the horses' gaze duration and asymmetric position of the ears), but not of intentional communication towards humans.

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

Abstract Vehicle recognition technology is widely applied in automatic parking, traffic restrictions, and public security investigations, playing a significant role in the construction of intelligent transportation systems. Fine-grained vehicle recognition seeks to surpass conventional vehicle recognition by concentrating on more detailed sub-classifications. This task is more challenging due to the subtle inter-class differences and significant intra-class variations. Localization-classification subnetworks represent an efficacious approach frequently employed for this task, but previous research has typically relied on CNN deep feature maps for object localization, which suffer from the low resolution, leading to poor localization accuracy. The multi-layer feature fusion localization method proposed by us fuses the high-resolution feature map of the shallow layer of CNN with the deep feature map, and makes full use of the rich spatial information of the shallow feature map to achieve more precise object localization. In addition, traditional methods acquire local attention information through the design of complex models, frequently resulting in regional redundancy or information omission. To address this, we introduce an attention module that adaptively enhances the expressiveness of global features and generates global attention features. These global attention features are then integrated with object-level features and local attention cues to achieve a more comprehensive attention enhancement. Lastly, we devise a multi-branch model and employ the aforementioned object localization and attention enhancement methods for end-to-end training to make the multiple branches collaborate seamlessly to adequately extract fine-grained features. Extensive experiments conducted on the Stanford Cars dataset and the self-built Cars-126 dataset have demonstrated the effectiveness of our method, achieving a leading position among existing methods with 97.7% classification accuracy on the Stanford Cars dataset.

Alpha-band fluctuations represent behaviorally relevant excitability changes as a consequence of top–down guided spatial attention in a probabilistic spatial cueing design

Abstract Spatial attention is a key function enabling the selection of relevant information and meaningful behavioral responses and is likely implemented by different neural mechanisms. In previous work, attention led to robust but uncorrelated modulations of Steady-State-Visual-Evoked-Potentials (SSVEPs) as a marker of early sensory gain and visual as well as motor alpha-band activity. We probed the behavioral relevance of attention-modulated trial-by-trial fluctuations of these measures. For this purpose, in an experiment with a classical probabilistic visuospatial attention cueing task, a to-be-discriminated target stimulus was validly, neutrally, or invalidly cued, while behavioral responses and EEG were recorded. Single-trial flicker-driven SSVEPs, visual and motor alpha-band activity were measured and the relationship between their amplitudes and reaction times was modeled via Bayesian regression models, respectively. We replicated previous findings that these neural measures and behavioral responses were overall modulated by the attentional cue. Beyond that, SSVEP amplitudes were not associated with behavior, while single-trial alpha-band amplitudes were predictive of reaction times: For trials with a valid or neutral cue, lower visual and motor alpha-band amplitudes measured contralateral to the target in the cue–target interval were associated with faster responses (and for valid cues also higher amplitudes ipsilateral to the target). For invalid cues, which required attentional reallocating to the uncued side, no such relationship was found. We argue that behavioral relevance of alpha-band modulations is a consequence but not a mechanism of top–down guided spatial attention, representing neural excitability in cortical areas activated by the attentional shift.

Application of deep learning for automatic detection of table tennis balls from an intelligent serving machine

The Intelligent Table Tennis Serving Machine (TTSM) has revolutionized table tennis training by simulating the variability and precision of human opponents. However, current systems lack the capability to track and analyze ball landing points, limiting comprehensive performance evaluation. To address this, we propose a novel approach utilizing YOLOv8 as the benchmark model for detecting table tennis balls launched by a TTSM, tailored to meet the demands of intelligent training systems. Our key innovation involves integrating a Res2Net architecture enhanced with a Non-local Attention Module (NLAM) and a Dilated Atrous Spatial Pyramid Pooling (DASPP) unit into the neck network. This design improves the network’s ability to integrate multi-scale local features, thereby enhancing global information processing. The DASPP module, with adaptive dilation convolution, ensures thorough context comprehension. Additionally, we incorporate an Omni-dimensional Dynamic Convolution (ODConv) module in the detection head, employing parallel strategies to learn diverse and complementary attention cues, further enhancing detection accuracy and robustness. To validate our method, we conducted evaluations using the publicly available OpenTTGames dataset and a self-constructed dataset comprising over 10,000 table tennis ball images captured in various environments. Experimental results indicate that our method enhances mAP0.5, Precision, and Recall by 2.3%, 5.1%, and 0.9% on the OpenTTGames dataset, and by 3%, 2%, and 1.6% on the self-built dataset, respectively. Finally, we describe the optimization process of the intelligent TTSM system, which leverages keyframe analysis of ball landing points to provide feedback, thereby enabling continuous performance improvement in subsequent phases.

Dynamic estimation of the attentional field from visual cortical activity.

This study explores whether spatial attention can dynamically adapt by shifting and broadening the attentional field. While previous research has focused on the modulation of neural responses at attended locations, less is known about how the size of the attentional field is represented within visual cortex. Using fMRI, we developed a novel paradigm to estimate the spatial tuning of the attentional field and demonstrate that we were able to recover both the location as well as the width of the attentional field. Our findings offer new insights into the neural mechanisms underlying the deployment of spatial attention, contributing to a deeper understanding of how spatial attention supports visual perception.

General and specific effects of meditation on gaze cueing of attention

General and specific effects of meditation on gaze cueing of attention

Pre-stimulus EEG phase coherence predicts visual target detection failures in schizophrenia: A pilot study

Impaired visual target detection is a common finding in schizophrenia that is linked to poor functional outcomes. However, the neural mechanisms that contribute to this deficit remain unclear. Recent research in healthy samples has identified relationships between the phase of pre-stimulus electroencephalographic (EEG) activity in the alpha band (8-12 Hz) or theta band (4-7 Hz) and the likelihood of visual target detection with and without attentional cueing, but these effects have not yet been explored in schizophrenia. We performed a study to investigate such effects in schizophrenia (n = 19) and healthy participants (n = 14), using a visual target detection task with attentional cues. We found significant relationships between pre-stimulus EEG phase properties and visual target detection in both groups, but also clear differences in the effects as a function of frequency, group, and attentional cueing. Alpha-band phase effects were relatively uniform across groups and conditions. By contrast, theta-band phase effects showed differences by group and attentional condition which could be consistent with attentional hyperfocusing in the schizophrenia group. Thus, our results elucidate a novel neural mechanism that may help to explain known impairments affecting both visual target detection and attention in schizophrenia.

Social face processing in chronic severe traumatic brain injury: Altered decoding of emotions and mental states but preserved gaze cueing of attention

The processing of social information transmitted by facial stimuli is altered in individuals with traumatic brain injury (TBI). This study investigated whether these alterations also affect the mechanisms underlying the orienting of visual attention in response to eye-gaze signals. TBI patients and a control group of healthy individuals matched on relevant criteria completed a spatial cueing task. In this task, a lateral visual target was presented along with a task-irrelevant face, with the gaze averted to the left or right. Arrows pointing towards the left or right were also used as non-social control stimuli. Social cognition abilities were further investigated through tests based on decoding emotional expressions and mental states conveyed by facial stimuli. The decoding of emotions and mental states was worse in the TBI group than in the control group. However, both groups demonstrated reliable and comparable orienting of attention to both eye-gaze and arrow stimuli. Despite impairments in certain aspects of social face processing among TBI patients, gaze cueing of attention appears to be preserved in this neuropsychological population.

Impact of attention cues on empathy for pain in college students with implicit weight stigma

Impact of attention cues on empathy for pain in college students with implicit weight stigma

Happy facial expressions and mouse pointing enhance EFL vocabulary learning from instructional videos

AbstractGiven their easy accessibility and dual‐channel model of content presentation, instructional videos have become a favoured tool for EFL vocabulary learning tool among many students. Teachers often use various nonverbal behaviours to elicit social reactions and guide learners' attention in instructional videos. The current study conducted three eye‐tracking experiments to examine the circumstances under which a teacher's happy facial expressions are beneficial in instructional videos, with or without pointing gestures and mouse pointing. Experiments 1 and 2 demonstrated that the combination of happy facial expressions and pointing gestures attracted learners' attention to the teacher and hindered students' learning performance, regardless of the complexity of slides. Experiment 3 showed that in instructional videos with complex slides, using happy facial expressions along with mouse pointing can enhance students' learning performance. Teachers are advised to show happy facial expressions and avoid using pointing gestures when designing instructional videos. Practitioner notesWhat is already known about this topic Given easy accessibility and dual‐channel model of content presentation, instructional videos have become a favoured tool for EFL vocabulary learning. When teachers record instructional videos while standing alongside slides, they often use nonverbal cues to support their speech. Teachers' social and attentional cues interactively influence students' learning processes and performance. What this paper adds A teacher's happy facial expressions evoke more positive emotions and greater motivation in learners compared to bored expressions. A teacher's pointing gestures, when combined with happy facial expressions, divert students' attention away from slides and towards the teacher. A teacher's happy facial expressions enhance students' learning performance when no pointing gestures are used in videos with simple slides. Implications for practice/policy Teachers are advised to display happy facial expressions and avoid using pointing gestures in instructional videos, regardless of the complexity of the slides. Practitioners should consider how to incorporate teachers' facial expressions pointing gestures and mouse pointing effectively.

2D and 3D Augmented Reality Attention Cueing Comparisons in 3D Target Search

This study compared three attentional cueing types to assist the user/participant in visually searching for a target within a simulated naturalistic scene. Participants had to locate a hostile combatant appearing in one of several building windows on an AR-simulated building. Other non-target windows either contain no people or people dressed in non-hostile clothes. We compare the effectiveness of three commonly used attention cues placed in simulated augmented reality on a head mounted display (Magic Leap 2): a 2D wedge arrow pointing toward the target, a 3D Arrow pointing toward the target, and a 3D gaze guidance line, connecting the center of the momentary field of view to the target. Results revealed that the gaze guidance line significantly supported the most rapid cueing and the 3D arrow was slowest and least accurate. The gaze guidance line also induced the fewest head movements. This pattern of results is explained via three mechanisms: the ambiguity of depth perception and the complexity of the 3D arrow, and the ability of the gaze guidance line to always indicate the direction of the target, even when the latter is not in the initial field of view.

Consistent metacognitive efficiency and variable response biases in peripheral vision.

Across the visual periphery, perceptual and metacognitive abilities differ depending on the locus of visual attention, the location of peripheral stimulus presentation, the task design, and many other factors. In this investigation, we aimed to illuminate the relationship between attention and eccentricity in the visual periphery by estimating perceptual sensitivity, metacognitive sensitivity, and response biases across the visual field. In a 2AFC detection task, participants were asked to determine whether a signal was present or absent at one of eight peripheral locations (±10°, 20°, 30°, and 40°), using either a valid or invalid attentional cue. As expected, results revealed that perceptual sensitivity declined with eccentricity and was modulated by attention, with higher sensitivity on validly cued trials. Furthermore, a significant main effect of eccentricity on response bias emerged, with variable (but relatively unbiased) c'a values from 10° to 30°, and conservative c'a values at 40°. Regarding metacognitive sensitivity, significant main effects of attention and eccentricity were found, with metacognitive sensitivity decreasing with eccentricity, and decreasing in the invalid cue condition. Interestingly, metacognitive efficiency, as measured by the ratio of meta-d'a/d'a, was not modulated by attention or eccentricity. Overall, these findings demonstrate (1) that in some circumstances, observers have surprisingly robust metacognitive insights into how performance changes across the visual field and (2) that the periphery may be subject to variable detection biases that are contingent on the exact location in peripheral space.

Using a linear dynamic system to measure functional connectivity from M/EEG

Objective. Measures of functional connectivity (FC) can elucidate which cortical regions work together in order to complete a variety of behavioral tasks. This study’s primary objective was to expand a previously published model of measuring FC to include multiple subjects and several regions of interest. While FC has been more extensively investigated in vision and other sensorimotor tasks, it is not as well understood in audition. The secondary objective of this study was to investigate how auditory regions are functionally connected to other cortical regions when attention is directed to different distinct auditory stimuli. Approach. This study implements a linear dynamic system (LDS) to measure the structured time-lagged dependence across several cortical regions in order to estimate their FC during a dual-stream auditory attention task. Results. The model’s output shows consistent functionally connected regions across different listening conditions, indicative of an auditory attention network that engages regardless of endogenous switching of attention or different auditory cues being attended. Significance. The LDS implemented in this study implements a multivariate autoregression to infer FC across cortical regions during an auditory attention task. This study shows how a first-order autoregressive function can reliably measure functional connectivity from M/EEG data. Additionally, the study shows how auditory regions engage with the supramodal attention network outlined in the visual attention literature.