Deployment Of Visual Attention Research Articles

Impaired visuospatial processing in cerebral visual impairment revealed by performance on a conjunction visual search task

Cerebral visual impairment (CVI) is a brain-based visual disorder associated with injury and/or maldevelopment of central visual pathways. Visuospatial processing impairments are a cardinal feature of the complex clinical profile of individuals with CVI. Here, we assessed visuospatial processing abilities using a classic conjunction search task. Twenty-three individuals previously diagnosed with CVI (mean age 18.55 years ± 4.98 SD) and 37 controls with neurotypical development (mean age 21.11 years ± 4.56 SD) participated in the study. Subjects were instructed to search for a two-feature target (a white or black letter “O” or “C”) presented among a varying number of surrounding distractors (set sizes ranging from 1 to 32 items). Behavioral outcomes collected were reaction time (RT), accuracy, as well as slope and intercept values derived from the RT × set size function. Overall, participants with CVI took longer and were less accurate in finding the target than controls. Analysis of RT × set size functions revealed a profile consistent with less efficient search and slower visual orienting responses as indexed by higher slope and intercept values, respectively. These results are consistent with clinical reports of impaired visuospatial processing abilities and deployment of visual selective attention in individuals with CVI.

Probing the deployment of peripheral visual attention during obstacle-crossing planning.

Gaze is directed to one location at a time, making peripheral visual input important for planning how to negotiate different terrain during walking. Whether and how the brain attends to this input is unclear. We developed a novel paradigm to probe the deployment of sustained covert visual attention by testing orientation discrimination of a Gabor patch at stepping and non-stepping locations during obstacle-crossing planning. Compared to remaining stationary, obstacle-crossing planning decreased visual performance (percent correct) and sensitivity (d') at only the first of two stepping locations. Given the timing of the first and second steps before obstacle crossing relative to the Gabor patch presentation, the results suggest the brain uses peripheral vision to plan one step at a time during obstacle crossing, in contrast to how it uses central vision to plan two or more steps in advance. We propose that this protocol, along with multiple possible variations, presents a novel behavioral approach to identify the role of covert visual attention during obstacle-crossing planning and other goal-directed walking tasks.

Effects of Virtual Reality-Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study.

BackgroundVirtual reality (VR) devices are increasingly being used in medicine and other areas for a broad spectrum of applications. One of the possible applications of VR involves the creation of an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention (so-called hemispatial neglect). One approach to ameliorate neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one, eg, auditory and tactile) to guide visual attention toward the neglected space. So far, no study has investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients.ObjectiveThis pilot study aimed to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a 3D VR setting, in patients with neglect, and obtain preliminary results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions.MethodsPatients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at 4 different presentation angles (lateral and paracentral on the left and right sides), and with (auditory, tactile, or audio-tactile cue) or without (no cue) a spatially meaningful cue. The task usability and feasibility, and 2 simple in-task measures (performance and early orientation) were assessed in 12 right-hemispheric stroke patients with neglect (5 with and 7 without additional somatosensory impairment).ResultsThe new VR setup showed high usability (mean score 10.2, SD 1.85; maximum score 12) and no relevant side effects (mean score 0.833, SD 0.834; maximum score 21). A repeated measures ANOVA on task performance data, with presentation angle, cue type, and group as factors, revealed a significant main effect of cue type (F30,3=9.863; P<.001) and a significant 3-way interaction (F90,9=2.057; P=.04). Post-hoc analyses revealed that among patients without somatosensory impairment, any cue led to better performance compared with no cue, for targets on the left side, and audio-tactile cues did not seem to have additive effects. Among patients with somatosensory impairment, performance was better with both auditory and audio-tactile cueing than with no cue, at every presentation angle; conversely, tactile cueing alone had no significant effect at any presentation angle. Analysis of early orientation data showed that any type of cue triggered better orientation in both groups for lateral presentation angles, possibly reflecting an early alerting effect.ConclusionsOverall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on method that supports attentional orientation during established therapeutic approaches.

Weakly Supervised Visual Saliency Prediction.

The success of current deep saliency models heavily depends on large amounts of annotated human fixation data to fit the highly non-linear mapping between the stimuli and visual saliency. Such fully supervised data-driven approaches are annotation-intensive and often fail to consider the underlying mechanisms of visual attention. In contrast, in this paper, we introduce a model based on various cognitive theories of visual saliency, which learns visual attention patterns in a weakly supervised manner. Our approach incorporates insights from cognitive science as differentiable submodules, resulting in a unified, end-to-end trainable framework. Specifically, our model encapsulates the following important components motivated from biological vision. (a) As scene semantics are closely related to visually attentive regions, our model encodes discriminative spatial information for scene understanding through spatial visual semantics embedding. (b) To model the objectness factors in visual attention deployment, we incorporate object-level semantics embedding and object relation information. (c) Considering the "winner-take-all" mechanism in visual stimuli processing, we model the competition mechanism among objects with softmax based neural attention. (d) Lastly, a conditional center prior is learned to mimic the spatial distribution bias of visual attention. Furthermore, we propose novel loss functions to utilize supervision cues from image-level semantics, saliency prior knowledge, and self-information compression. Experiments show that our method achieves promising results, and even outperforms many of its fully supervised counterparts. Overall, our weakly supervised saliency method makes an essential step towards reducing the annotation budget of current approaches, as well as providing a more comprehensive understanding of the visual attention mechanism. Our code is available at: https://github.com/ashleylqx/WeakFixation.git.

Atypical viewing position effect in developmental dyslexia: A behavioural and modelling investigation

ABSTRACT The probability of recognizing a word depends on the position of fixation during processing. In typical readers, the resulting word-recognition curves are asymmetrical, showing a left-of-centre optimal viewing position (OVP). First, we report behavioural results from dyslexic participants who show atypical word-recognition curves characterized by the OVP being right of centre with recognition probability being higher on the rightmost than on the leftmost letters. Second, we used BRAID, a Bayesian model of word recognition that implements gaze position, an acuity gradient, lateral interference and a visual attention component, to examine how variations in the deployment of visual attention would affect the OVP curves. We show that the atypical dyslexic curves are well simulated assuming a narrow distribution of visual attention and a shifting of visual attention towards the left visual field. These behavioural and modelling findings are discussed in light of current theories of visual attention deficits in developmental dyslexia.

Different computations underlie overt presaccadic and covert spatial attention.

Perception and action are tightly coupled: visual responses at the saccade target are enhanced right before saccade onset. This phenomenon, presaccadic attention, is a form of overt attention-deployment of visual attention with concurrent eye movements. Presaccadic attention is well-documented, but its underlying computational process remains unknown. This is in stark contrast to covert attention-deployment of visual attention without concurrent eye movements-for which the computational processes are well characterized by a normalization model. Here, a series of psychophysical experiments reveal that presaccadic attention modulates visual performance only via response gain changes. A response gain change was observed even when attention field size increased, violating the predictions of a normalization model of attention. Our empirical results and model comparisons reveal that the perceptual modulations by overt presaccadic and covert spatial attention are mediated through different computations.

Neurobehavioral correlates of impaired emotion recognition in pediatric PTSD.

Despite broad evidence suggesting that adversity-exposed youth experience an impaired ability to recognize emotion in others, the underlying biological mechanisms remains elusive. This study uses a multimethod approach to target the neurological substrates of this phenomenon in a well-phenotyped sample of youth meeting diagnostic criteria for posttraumatic stress disorder (PTSD). Twenty-one PTSD-afflicted youth and 23 typically developing (TD) controls completed clinical interview schedules, an emotion recognition task with eye-tracking, and an implicit emotion processing task during functional magnetic resonance imaging )fMRI). PTSD was associated with decreased accuracy in identification of angry, disgust, and neutral faces as compared to TD youth. Of note, these impairments occurred despite the normal deployment of visual attention in youth with PTSD relative to TD youth. Correlation with a related fMRI task revealed a group by accuracy interaction for amygdala-hippocampus functional connectivity (FC) for angry expressions, where TD youth showed a positive relationship between anger accuracy and amygdala-hippocampus FC; this relationship was reversed in youth with PTSD. These findings are a novel characterization of impaired threat recognition within a well-phenotyped population of severe pediatric PTSD. Further, the differential amygdala-hippocampus FC identified in youth with PTSD may imply aberrant efficiency of emotional contextualization circuits.

Priming with Horizontal Reading Influences the Deployment of Visual Attention During Word Processing1

AbstractPrevious studies on parallel processing of words have demonstrated that the orthographic properties of multiple words can be processed simultaneously. However, whether parallel lexical processing (which requires attentional allocation towards a subsequent N + 1 word) is possible has been much debated. We examined this controversy in the Japanese language with the flanker lexical decision task and investigated whether the deployment of attention changed after priming with horizontal reading. Participants allocated to the priming group read short passages written in Japanese before the flanker task. The results showed that the parallel processing of a lexical property was observed after priming, which implicates that reading facilitates the attentional allocation to the right during the processing of a current word. The results suggested that strategies to allocate attention to the right are at work during reading. Furthermore, the current study points to the possibility that word processing during reading can be assessed by combining the priming procedure and flanker lexical decision task.

Theory of visual attention (TVA) in action: Assessing premotor attention in simultaneous eye-hand movements

Attention shifts that precede goal-directed eye and hand movements are regarded as markers of motor target selection. Whether effectors compete for a single, shared attentional resource during simultaneous eye-hand movements or whether attentional resources can be allocated independently towards multiple target locations is controversially debated. Independent, effector-specific target selection mechanisms underlying parallel allocation of visuospatial attention to saccade and reach targets would predict an increase of the overall attention capacity with the number of active effectors. We test this hypothesis in a modified Theory of Visual Attention (TVA; Bundesen, 1990) paradigm. Participants reported briefly presented letters during eye, hand, or combined eye-hand movement preparation to centrally cued locations. Modeling the data according to TVA allowed us to assess both the overall attention capacity and the deployment of visual attention to individual locations in the visual work space. In two experiments, we show that attention is predominantly allocated to the motor targets–without pronounced competition between effectors. The parallel benefits at eye and hand targets, however, have concomitant costs at non-motor locations, and the overall attention capacity does not increase by the simultaneous recruitment of both effector systems. Moreover, premotor shifts of attention dominate over voluntary deployment of processing resources, yielding severe impairments of voluntary attention allocation. We conclude that attention shifts to multiple effector targets without mutual competition given that sufficient processing resources can be withdrawn from movement-irrelevant locations.

Visual attention and eye movement control during oculomotor competition.

Saccadic eye movements are typically preceded by selective shifts of visual attention. Recent evidence, however, suggests that oculomotor selection can occur in the absence of attentional selection when saccades erroneously land in between nearby competing objects (saccade averaging). This study combined a saccade task with a visual discrimination task to investigate saccade target selection during episodes of competition between a saccade target and a nearby distractor. We manipulated the spatial predictability of target and distractor locations and asked participants to execute saccades upon variably delayed go-signals. This allowed us to systematically investigate the capacity to exert top-down eye movement control (as reflected in saccade endpoints) based on the spatiotemporal dynamics of visual attention during movement preparation (measured as visual sensitivity). Our data demonstrate that the predictability of target and distractor locations, despite not affecting the deployment of visual attention prior to movement preparation, largely improved the accuracy of short-latency saccades. Under spatial uncertainty, a short go-signal delay likewise enhanced saccade accuracy substantially, which was associated with a more selective deployment of attentional resources to the saccade target. Moreover, we observed a systematic relationship between the deployment of visual attention and saccade accuracy, with visual discrimination performance being significantly enhanced at the saccade target relative to the distractor only before the execution of saccades accurately landing at the saccade target. Our results provide novel insights linking top-down eye movement control to the operation of selective visual attention during movement preparation.

The Deployment of Young Readers´ Visual Attention across Orthographic Strings: The Influence of Stems and Suffixes

ABSTRACT The goal of the paper was to investigate whether morphological units – stems and suffixes – influence orthographic processing by modulating visual attention demands to the task. Orthographic processing was measured with a visual one-back task requiring letters to be detected within pseudowords not including stems/suffixes, or containing real stems or real suffixes. Fourth grade children (between 9.5 and 10.5 years old) who read in a transparent orthography of a morphologically rich and agglutinative language (Basque) were tested. The results showed that the presence of morphemes in the strings did not improve letter detection performance though it slightly modulated the distribution of visual attention, showing a bias toward the processing of central letters in the presence of a stem. We suggest that the presence of highly regular and recurrent structures prioritizes stem identification, which when achieved, reduces visual attention deployment across the remaining letters.

The Impact of Cognitive Load on the Spatial Deployment of Visual Attention: Testing the Role of Interhemispheric Balance With Biparietal Transcranial Direct Current Stimulation.

In healthy individuals, increasing cognitive load induces an asymmetric deployment of visuospatial attention, which favors the right visual space. To date, the neural mechanisms of this left/right attentional asymmetry are poorly understood. The aim of the present study was thus to investigate whether a left/right asymmetry under high cognitive load is due to a shift in the interhemispheric balance between the left and right posterior parietal cortices (PPCs), favoring the left PPC. To this end, healthy participants completed a visuospatial attention detection task under low and high cognitive load, whilst undergoing biparietal transcranial direct current stimulation (tDCS). Three different tDCS conditions were applied in a within-subjects design: sham, anodal left/cathodal right, and cathodal left/anodal right stimulation. The results revealed a left/right attentional asymmetry under high cognitive load in the sham condition. This asymmetry disappeared during cathodal left/anodal right tDCS, yet was not influenced by anodal left/cathodal right tDCS. There were no left/right asymmetries under low cognitive load in any of the conditions. Overall, these findings demonstrate that attentional asymmetries under high cognitive load can be modulated in a polarity-specific fashion by means of tDCS. They thus support the assumption that load-related asymmetries in visuospatial attention are influenced by interhemispheric balance mechanisms between the left and right PPCs.

Sensitivity measures of visuospatial attention.

Measuring visual sensitivity has become popular to determine the spatial deployment of visual attention. Critically, the accuracy of the measurement depends on the quality of the stimulus used. We evaluated the strengths and weaknesses of six commonly used stimuli for assessing visual attention. While preparing an eye movement to a cued item, participants discriminated a stimulus-specific visual feature, either at the cued location or at other equidistant uncued locations. Stimuli differed in their visual features (digital letters, Gabors, crosses, pink noise, random dot kinematograms, and Gabor streams) and their presentation mode (static or dynamic stimuli). We evaluated these stimuli regarding their temporal and spatial specificity and their impact on saccade preparation. We assessed presaccadic visual sensitivity as a correlate of visual spatial attention and discuss the stimulus-specific time course, spatial specificity, and magnitude of the measured attention modulation. Irrespective of the stimulus type, we observed a clear increase of visual sensitivity at the cued location. Time course, spatial specificity, and magnitude of this improvement, however, were specific to each stimulus. Based on our findings, we present guidelines to select the stimulus best suited to measure visuospatial attention depending on the respective research question.

How the deployment of visual attention modulates auditory distraction

Classically, attentional selectivity has been conceptualized as a passive by-product of capacity limits on stimulus processing. Here, we examine the role of more active cognitive control processes in attentional selectivity, focusing on how distraction from task-irrelevant sound is modulated by levels of task engagement in a visually presented short-term memory task. Task engagement was varied by manipulating the load involved in the encoding of the (visually presented) to-be-remembered items. Using a list of Navon letters (where a large letter is composed of smaller, different-identity letters), participants were oriented to attend and serially recall the list of large letters (low encoding load) or to attend and serially recall the list of small letters (high encoding load). Attentional capture by a single deviant noise burst within a task-irrelevant tone sequence (the deviation effect) was eliminated under high encoding load (Experiment 1). However, distraction from a continuously changing sequence of tones (the changing-state effect) was immune to the influence of load (Experiment 2). This dissociation in the amenability of the deviation effect and the changing-state effect to cognitive control supports a duplex-mechanism over a unitary-mechanism account of auditory distraction in which the deviation effect is due to attentional capture whereas the changing-state effect reflects direct interference between the processing of the sound and processes involved in the focal task. That the changing-state effect survives high encoding load also goes against an alternative explanation of the attenuation of the deviation effect under high load in terms of the depletion of a limited perceptual resource that would result in diminished auditory processing.

Expectations and perceptual priming in a visual search task: Evidence from eye movements and behavior.

An extensive amount of research indicates that repeating target and distractor features facilitates pop-out search while switching these features slows the search. Following the seminal study by Maljkovic and Nakayama (1994), this "priming of pop-out" effect (PoP) has been widely described as an automatic bottom-up process that is independent of the observers' expectations. At the same time, numerous studies highlight the crucial role of expectations in visual attention deployment. Our experiment shows that in contrast to previous claims, PoP in a classic color singleton search task is a mix of automatic processing and expectations. Participants searched for a uniquely colored diamond among 2 same-colored distractors. Target color sequences were either predictable (e.g., 2 red-target-green-distractors trials, followed by 2 green-target-red-distractors trials, and so on) or random. Responses were faster in predictable color sequences than randomly changing ones with equal number of repetitions of target colors on preceding trials. Analyses of observers' eye movements showed that predictability of target color affected both latency and accuracy of the first saccade during a search trial. Our results support the idea that PoP is governed not only by automatic effects from previous target or distractor features but also by top-down expectations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Investigating the Deployment of Visual Attention Before Accurate and Averaging Saccades via Eye Tracking and Assessment of Visual Sensitivity.

This experimental protocol was designed to investigate whether visual attention is obligatorily deployed at the endpoint of saccades. To this end, we recorded the eye position of human participants engaged in a saccade task via eye tracking and assessed visual orientation discrimination performance at various locations during saccade preparation. Importantly, instead of using a single saccade target paradigm for which the saccade endpoint typically coincides roughly with the target, this protocol comprised the presentation of two nearby saccade targets, leading to a distinct spatial dissociation between target locations and saccade endpoint on a substantial number of trials. The paradigm allowed us to compare presaccadic visual discrimination performance at the endpoint of accurate saccades (landing at one of the saccade targets) and of averaging saccades (landing at an intermediate location in between the two targets). We observed a selective enhancement of visual sensitivity at the endpoint of accurate saccades but not at the endpoint of averaging saccades. Rather, before the execution of averaging saccades, visual sensitivity was equally enhanced at both targets, suggesting that saccade averaging follows from unresolved attentional selection among the saccade targets. These results argue against a mandatory coupling between visual attention and saccade programming based on a direct measure of presaccadic visual sensitivity rather than saccadic reaction times, which have been used in other protocols to draw similar conclusions. While our protocol provides a useful framework to investigate the relationship between visual attention and saccadic eye movements at the behavioral level, it can also be combined with electrophysiological measures to extend insights at the neuronal level.

Investigating the Deployment of Visual Attention Before Accurate and Averaging Saccades via Eye Tracking and Assessment of Visual Sensitivity

Investigating the Deployment of Visual Attention Before Accurate and Averaging Saccades via Eye Tracking and Assessment of Visual Sensitivity

Perceptually Improved 3D Object Representation Based on Guided Adaptive Weighting of Feature Channels of a Visual-Attention Model

Real-time interaction in virtual environments composed of numerous objects modeled with a high number of faces remains an important issue in interactive virtual environment applications. A well-established approach to deal with this problem is to simplify small or distant objects where minor details are not informative for users. Several approaches exist in literature to simplify a 3D mesh uniformly. A possible improvement to this approach is to take advantage of a visual attention model to distinguish regions of a model which are considered important from the point of view of the human visual system. These regions can then be preserved during simplification to improve the perceived quality of the model. In the present article, we present an original application of biologically-inspired visual attention for improved perception-based representation of 3D objects. An enhanced visual attention model extracting information about color, intensity, orientation, as in the classical bottom-up visual attention model, but that also considers supplementary features believed to guide the deployment of human visual attention (such as symmetry, curvature, contrast, entropy and edge information), is introduced to identify such salient regions. Unlike the classical model where these features contribute equally to the identification of salient regions, a novel solution is proposed to adjust their contribution to the visual-attention model based on their compliance with points identified as salient by human subjects. An iterative approach is then proposed to extract salient points from salient regions. Salient points derived from images taken from best viewpoints of a 3D object are then projected to the surface of the object to identify salient vertices which will be preserved in the mesh simplification. The obtained results are compared with existing solutions from the literature to demonstrate the superiority of the proposed approach.

Independent selection of eye and hand targets suggests effector-specific attentional mechanisms

Both eye and hand movements bind visual attention to their target locations during movement preparation. However, it remains contentious whether eye and hand targets are selected jointly by a single selection system, or individually by independent systems. To unravel the controversy, we investigated the deployment of visual attention – a proxy of motor target selection – in coordinated eye-hand movements. Results show that attention builds up in parallel both at the eye and the hand target. Importantly, the allocation of attention to one effector’s motor target was not affected by the concurrent preparation of the other effector’s movement at any time during movement preparation. This demonstrates that eye and hand targets are represented in separate, effector-specific maps of action-relevant locations. The eye-hand synchronisation that is frequently observed on the behavioral level must emerge from mutual influences of the two effector systems at later, post-attentional processing stages.

Interindividual differences among native right-to-left readers and native left-to-right readers during free viewing task

ABSTRACTHuman visual exploration is not homogeneous but displays spatial biases. Specifically, early after the onset of a visual stimulus, the majority of eye movements target the left visual space. This horizontal asymmetry of image exploration is rather robust with respect to multiple image manipulations, yet can be dynamically modulated by preceding text primes. This characteristic points to an involvement of reading habits in the deployment of visual attention. Here, we report data of native right-to-left (RTL) readers with a larger variation and stronger modulation of horizontal spatial bias in comparison to native left-to-right (LTR) readers after preceding text primes. To investigate the influences of biological and cultural factors, we measure the correlation of the modulation of the horizontal spatial bias for native RTL readers and native LTR readers with multiple factors: age, gender, second language proficiency, and age at which the second language was acquired. The results demonstrate only weak or no correlations between the magnitude of the horizontal bias and the previously mentioned factors. We conclude that the spatial bias of viewing behaviour for native RTL readers is more variable than for native LTR readers, and this variance could not be demonstrated to be associated with interindividual differences. We speculate the role of strength of habit and/or the interindividual differences in the structural and functional brain regions as a cause of the RTL spatial bias among RTL native readers.