Eye Movements In Search Research Articles

Eye-Movements Search for Comprehension during Bridging Inference Generation in Wordless Visual Sequential Narratives

Eye-Movements Search for Comprehension during Bridging Inference Generation in Wordless Visual Sequential Narratives

Visual reinforcement shapes eye movements in visual search.

We use eye movements to gain information about our visual environment; this information can indirectly be used to affect the environment. Whereas eye movements are affected by explicit rewards such as points or money, it is not clear whether the information gained by finding a hidden target has a similar reward value. Here we tested whether finding a visual target can reinforce eye movements in visual search performed in a noise background, which conforms to natural scene statistics and contains a large number of possible target locations. First we tested whether presenting the target more often in one specific quadrant would modify eye movement search behavior. Surprisingly, participants did not learn to search for the target more often in high probability areas. Presumably, participants could not learn the reward structure of the environment. In two subsequent experiments we used a gaze-contingent display to gain full control over the reinforcement schedule. The target was presented more often after saccades into a specific quadrant or a specific direction. The proportions of saccades meeting the reinforcement criteria increased considerably, and participants matched their search behavior to the relative reinforcement rates of targets. Reinforcement learning seems to serve as the mechanism to optimize search behavior with respect to the statistics of the task.

Distractor Dwelling, Skipping, and Revisiting Determine Target Absent Performance in Difficult Visual Search.

Some targets in visual search are more difficult to find than others. In particular, a target that is similar to the distractors is more difficult to find than a target that is dissimilar to the distractors. Efficiency differences between easy and difficult searches are manifest not only in target-present trials but also in target-absent trials. In fact, even physically identical displays are searched through with different efficiency depending on the searched-for target. Here, we monitored eye movements in search for a target similar to the distractors (difficult search) versus a target dissimilar to the distractors (easy search). We aimed to examine three hypotheses concerning the causes of differential search efficiencies in target-absent trials: (a) distractor dwelling (b) distractor skipping, and (c) distractor revisiting. Reaction times increased with target similarity which is consistent with existing theories and replicates earlier results. Eye movement data indicated guidance in target trials, even though search was very slow. Dwelling, skipping, and revisiting contributed to low search efficiency in difficult search, with dwelling being the strongest factor. It is argued that differences in dwell time account for a large amount of total search time differences.

From brain synapses to systems for learning and memory: Object recognition, spatial navigation, timed conditioning, and movement control

This article provides an overview of neural models of synaptic learning and memory whose expression in adaptive behavior depends critically on the circuits and systems in which the synapses are embedded. It reviews Adaptive Resonance Theory, or ART, models that use excitatory matching and match-based learning to achieve fast category learning and whose learned memories are dynamically stabilized by top-down expectations, attentional focusing, and memory search. ART clarifies mechanistic relationships between consciousness, learning, expectation, attention, resonance, and synchrony. ART models are embedded in ARTSCAN architectures that unify processes of invariant object category learning, recognition, spatial and object attention, predictive remapping, and eye movement search, and that clarify how conscious object vision and recognition may fail during perceptual crowding and parietal neglect. The generality of learned categories depends upon a vigilance process that is regulated by acetylcholine via the nucleus basalis. Vigilance can get stuck at too high or too low values, thereby causing learning problems in autism and medial temporal amnesia. Similar synaptic learning laws support qualitatively different behaviors: Invariant object category learning in the inferotemporal cortex; learning of grid cells and place cells in the entorhinal and hippocampal cortices during spatial navigation; and learning of time cells in the entorhinal–hippocampal system during adaptively timed conditioning, including trace conditioning. Spatial and temporal processes through the medial and lateral entorhinal–hippocampal system seem to be carried out with homologous circuit designs. Variations of a shared laminar neocortical circuit design have modeled 3D vision, speech perception, and cognitive working memory and learning. A complementary kind of inhibitory matching and mismatch learning controls movement.This article is part of a Special Issue entitled SI: Brain and Memory.

Higher set sizes in pop-out search displays do not eliminate priming or enhance target selection

Previous research shows that salient stimuli do not pop out solely in virtue of their feature contrast. Rather, visual selection of a pop-out target is strongly modulated by feature priming: Repeating the target feature (e.g., red) across trials primes attention shifts to the target but delays target selection when the target feature changes (e.g., from red to green). However, it has been argued that priming modulated target selection only because the stimuli were too sparsely packed, suggesting that pop-out is still mostly determined by the target’s saliency (i.e., local feature contrast). Here, we tested these different views by measuring the observer’s eye movements in search for a colour target (Exp. 1) or size target (Exp. 2), when the target was similar versus dissimilar to the target, and when the displays contained 6 or 12 search items. The results showed that making the target less similar to the nontargets indeed eliminated priming effects in search for colour, but not in search for size. Moreover, increasing the set size neither increased search efficiency nor eliminated feature priming effects. Taken together, the results indicated that priming can still modulate target selection even in search for salient targets.

Neural dynamics of object-based multifocal visual spatial attention and priming: Object cueing, useful-field-of-view, and crowding

How are spatial and object attention coordinated to achieve rapid object learning and recognition during eye movement search? How do prefrontal priming and parietal spatial mechanisms interact to determine the reaction time costs of intra-object attention shifts, inter-object attention shifts, and shifts between visible objects and covertly cued locations? What factors underlie individual differences in the timing and frequency of such attentional shifts? How do transient and sustained spatial attentional mechanisms work and interact? How can volition, mediated via the basal ganglia, influence the span of spatial attention? A neural model is developed of how spatial attention in the where cortical stream coordinates view-invariant object category learning in the what cortical stream under free viewing conditions. The model simulates psychological data about the dynamics of covert attention priming and switching requiring multifocal attention without eye movements. The model predicts how “attentional shrouds” are formed when surface representations in cortical area V4 resonate with spatial attention in posterior parietal cortex (PPC) and prefrontal cortex (PFC), while shrouds compete among themselves for dominance. Winning shrouds support invariant object category learning, and active surface-shroud resonances support conscious surface perception and recognition. Attentive competition between multiple objects and cues simulates reaction-time data from the two-object cueing paradigm. The relative strength of sustained surface-driven and fast-transient motion-driven spatial attention controls individual differences in reaction time for invalid cues. Competition between surface-driven attentional shrouds controls individual differences in detection rate of peripheral targets in useful-field-of-view tasks. The model proposes how the strength of competition can be mediated, though learning or momentary changes in volition, by the basal ganglia. A new explanation of crowding shows how the cortical magnification factor, among other variables, can cause multiple object surfaces to share a single surface-shroud resonance, thereby preventing recognition of the individual objects.

Learned reorganization of invariant object category selectivity in inferotemporal cortex during eye movement search

Learned reorganization of invariant object category selectivity in inferotemporal cortex during eye movement search

Optimizing eye movements in search for rewards

Optimizing eye movements in search for rewards

Distracted by relatives: Effects of frontal lobe damage on semantic distraction

When young adults carry out visual search, distractors that are semantically related, rather than unrelated, to targets can disrupt target selection (see Belke, Humphreys, Watson, Meyer, & Telling, 2008; Moores, Laiti, & Chelazzi, 2003). This effect is apparent on the first eye movements in search, suggesting that attention is sometimes captured by related distractors. Here we assessed effects of semantically related distractors on search in patients with frontal-lobe lesions and compared them to the effects in age-matched controls. Compared with the controls, the patients were less likely to make a first saccade to the target and they were more likely to saccade to distractors (whether related or unrelated to the target). This suggests a deficit in a first stage of selecting a potential target for attention. In addition, the patients made more errors by responding to semantically related distractors on target-absent trials. This indicates a problem at a second stage of target verification, after items have been attended. The data suggest that frontal lobe damage disrupts both the ability to use peripheral information to guide attention, and the ability to keep separate the target of search from the related items, on occasions when related items achieve selection.

Latency and accuracy of search eye movements across the macaque visual field

Latency and accuracy of search eye movements across the macaque visual field

Short article: Does conspicuity enhance distraction? Saliency and eye landing position when searching for objects

While visual saliency may sometimes capture attention, the guidance of eye movements in search is often dominated by knowledge of the target. How is the search for an object influenced by the saliency of an adjacent distractor? Participants searched for a target amongst an array of objects, with distractor saliency having an effect on response time and on the speed at which targets were found. Saliency did not predict the order in which objects in target-absent trials were fixated. The within-target landing position was distributed around a modal position close to the centre of the object. Saliency did not affect this position, the latency of the initial saccade, or the likelihood of the distractor being fixated, suggesting that saliency affects the allocation of covert attention and not just eye movements.

An Insight into Forensic Document Examiner Expertise for Discriminating Between Forged and Disguised Signatures

It has previously been shown that forensic document examiners (FDEs) have expertise in providing opinions about whether questioned signatures are genuine or simulated. This study extends the exploration of FDE expertise by evaluating the performance of eight FDEs and 12 control subjects at identifying signatures as either forgeries or the disguised writing of a specimen provider. Subject eye movements and response times were recorded with a Tobii 1750 eye tracker during the signature evaluations. Using a penalty scoring system, FDEs performed significantly better than control subjects (t = 2.465, p = 0.024), with one FDE able to correctly call 13 of the 16 test stimuli (and three inconclusive calls). An analysis of eye movement search patterns by the subjects indicated that a very similar search strategy was employed by both groups, suggesting that visual inspection of signatures is mediated by a bottom up search strategy. However, FDEs spent greater than 50% longer to make a decision than the control group. The findings are suggestive that for some stimuli FDEs can discriminate between forgeries and disguises, and that this ability is due to a careful inspection and consideration of multiple features within a signature.

Sensitivity to Object Viewpoint and Action Instructions During Search for Targets in the Lower Visual Field

We contrasted visual search for targets presented in prototypical views and targets presented in nonprototypical views, when targets were defined by their names and when they were defined by the action that would normally be performed on them. The likelihood of the first fixation falling on the target was increased for prototypical-view targets falling in the lower visual field. When targets were defined by actions, the durations of fixations were reduced for targets in the lower field. The results are consistent with eye movements in search being affected by representations within the dorsal visual stream, where there is strong representation of the lower visual field. These representations are sensitive to the familiarity or the affordance offered by objects in prototypical views, and they are influenced by action-based templates for targets.

Eye movements in search in visual neglect

We report data on eye movements in a patient (MP) with unilateral visual neglect, in a task of searching a real-world scene. We demonstrate that MP missed some contralesional targets after fixating on them. On such “miss”; trials, MP's eye movements were similar to those on objects in target-absent trials trials, where MP was cued to search for a target that was not actually present. In addition, MP showed little evidence of memory for the locations of objects that remained across a trial, though poor memory fails to explain performance on trials where targets were fixated. We suggest that, in this case, neglect reflected the poor uptake of information from the contralesional side of space, so that even fixated targets sometimes failed to match a “template” held in his memory.

Eye Movements in Search and Target Acquisition

The frequency distribution of eye fixations and fixation durations during a search and target acquisition task was examined to determine if the allocation of visual attention was related to target, scene, and/or observer characteristics. Ninety computer-generated scenes simulating infrared imagery and containing different levels of clutter and zero, one, two, or three targets were produced. Targets were embedded in these scenes counterbalancing for range and position. Global and local clutter were measured using both statistical variance and probability of edge metrics. Thirty-three aviators, tankers, and infantry soldiers were shown still video images of the 90 scenes and were instructed to search for targets. Results of multiple regression analyses of global clutter, local clutter, range, number of targets, target dimensions, target complexity, and group membershi on eye fixations and fixation durations are given and discussed in terms of search strategies.