Theories Of Visual Search Research Articles

Those pernicious items.

Hulleman & Olivers (H&O) identify a number of problems with item-based thinking and its impact on our understanding of visual search. I detail ways in which item-thought is worse than the authors suggest. I concur with the broad strokes of the theory they set out, and also clarify the relationship between their view and our recent theory of visual search.

Oculomotor measures reveal the temporal dynamics of preparing for search.

Theories of visual search assume that selection is driven by an active template representation of the target object. Earlier studies suggest that template activation occurs prior to search, but the temporal dynamics of such preactivation remain unclear. Two experiments employed microsaccades to track both general preparation (i.e., anticipation of the search task as such) and template-specific preparation (i.e., anticipation of target selection) of visual search. Participants memorized a target color (i.e., the template) for an upcoming search task. During the delay period, we presented an irrelevant rapid serial visual presentation (RSVP) of lateralized colored disks. Crucially, at different time points into the RSVP, the template color was inserted, allowing us to measure attentional biases toward the template match as a function of time. Results showed a general suppression of saccades: the closer in time to the search display, the less saccades were produced. This suppression was stronger when a template-matching color was present compared to when absent. However, when microsaccades occurred, they were biased toward the template-matching color and more so just prior to the search display. We conclude that observers adapt search template activation to the anticipated moment of search, and that microsaccades reflect general as well as target-specific preparation effects.

Competing Distractors Facilitate Visual Search in Heterogeneous Displays.

In the present study, we examine how observers search among complex displays. Participants were asked to search for a big red horizontal line among 119 distractor lines of various sizes, orientations and colours, leading to 36 different feature combinations. To understand how people search in such a heterogeneous display, we evolved the search display by using a genetic algorithm (Experiment 1). The best displays (i.e., displays corresponding to the fastest reaction times) were selected and combined to create new, evolved displays. Search times declined over generations. Results show that items sharing the same colour and orientation as the target disappeared over generations, implying they interfered with search, but items sharing the same colour and were 12.5° different in orientation only interfered if they were also the same size. Furthermore, and inconsistent with most dominant visual search theories, we found that non-red horizontal distractors increased over generations, indicating that these distractors facilitated visual search while participants were searching for a big red horizontally oriented target. In Experiments 2 and 3, we replicated these results using conventional, factorial experiments. Interestingly, in Experiment 4, we found that this facilitation effect was only present when the displays were very heterogeneous. While current models of visual search are able to successfully describe search in homogeneous displays, our results challenge the ability of these models to describe visual search in heterogeneous environments.

Memory-based attention capture when multiple items are maintained in visual working memory.

Efficient visual search requires that attention is guided strategically to relevant objects, and most theories of visual search implement this function by means of a target template maintained in visual working memory (VWM). However, there is currently debate over the architecture of VWM-based attentional guidance. We contrasted a single-item-template hypothesis with a multiple-item-template hypothesis, which differ in their claims about structural limits on the interaction between VWM representations and perceptual selection. Recent evidence from van Moorselaar, Theeuwes, and Olivers (2014) indicated that memory-based capture during search, an index of VWM guidance, is not observed when memory set size is increased beyond a single item, suggesting that multiple items in VWM do not guide attention. In the present study, we maximized the overlap between multiple colors held in VWM and the colors of distractors in a search array. Reliable capture was observed when 2 colors were held in VWM and both colors were present as distractors, using both the original van Moorselaar et al. singleton-shape search task and a search task that required focal attention to array elements (gap location in outline square stimuli). In the latter task, memory-based capture was consistent with the simultaneous guidance of attention by multiple VWM representations. (PsycINFO Database Record

Task-irrelevant memories rapidly gain attentional control with learning.

Although many of our perceptual biases stem from long-term, repeated exposure, current theories of visual search assume a central role for visual working memory (VWM) in guiding attention to target information. Crucially, whether a VWM representation guides attention depends on the relative priority that the memory has within VWM. Here, in a combined visual search/VWM task, we used attentional guidance by irrelevant memories to measure how long a target representation remains prioritized in VWM when observers repeatedly search for the same target. Irrelevant memories started guiding attention already when the target was repeated once, indicating that the target representation rapidly lost priority within VWM as it moved to long-term memory. By showing that training can lead to interference from irrelevant memories, the findings resolve a long-standing paradox on why VWM appears central to, yet at the same time not sufficient nor necessary for attentional guidance.

Similarity and heterogeneity effects in visual search are mediated by "segmentability".

The heterogeneity of our visual environment typically reduces the speed with which a singleton target can be found. Visual search theories explain this phenomenon via nontarget similarities and dissimilarities that affect grouping, perceptual noise, and so forth. In this study, we show that increasing the heterogeneity of a display can facilitate rather than inhibit visual search for size and orientation singletons when heterogeneous features smoothly fill the transition between highly distinguishable nontargets. We suggest that this smooth transition reduces the "segmentability" of dissimilar items to otherwise separate subsets, causing the visual system to treat them as a near-homogenous set standing apart from a singleton. (PsycINFO Database Record

False pop out.

A single, unique target often pops out quickly and efficiently from a field of homogenous distractors in visual search. Pop out has helped shape theories of visual attention and feature integration as well as to identify basic features in human vision. Here we report a new phenomenon, false pop out, wherein one of the homogenous distractors competes with the singleton target to pop out, perhaps by breaking an overall grouping or pattern emerging from the display. We show the effect occurs with more than 1 type of stimulus, and we discuss the implications of such a counterintuitive finding for theories of visual search.

There's Waldo! A Normalization Model of Visual Search Predicts Single-Trial Human Fixations in an Object Search Task

When searching for an object in a scene, how does the brain decide where to look next? Visual search theories suggest the existence of a global "priority map" that integrates bottom-up visual information with top-down, target-specific signals. We propose a mechanistic model of visual search that is consistent with recent neurophysiological evidence, can localize targets in cluttered images, and predicts single-trial behavior in a search task. This model posits that a high-level retinotopic area selective for shape features receives global, target-specific modulation and implements local normalization through divisive inhibition. The normalization step is critical to prevent highly salient bottom-up features from monopolizing attention. The resulting activity pattern constitues a priority map that tracks the correlation between local input and target features. The maximum of this priority map is selected as the locus of attention. The visual input is then spatially enhanced around the selected location, allowing object-selective visual areas to determine whether the target is present at this location. This model can localize objects both in array images and when objects are pasted in natural scenes. The model can also predict single-trial human fixations, including those in error and target-absent trials, in a search task involving complex objects.

Finding a link between guided search and perceptual load theory

Perceptual load theory claims that attentional processing of distractors in the visual environment is dependent upon the availability of perceptual resources, and recent research has attempted to link this selective attention theory to more classic ideas on visual search. In the present study, we investigated how perceptual load could be linked to a prominent visual search theory: guided search. Our findings suggest that any volitional attempt at attentional guidance only hindered attention under low perceptual load, whereas attentional guidance could be highly effective under high perceptual load. Importantly, guided search only proved effective when participants could utilise knowledge about the display consistently from trial-to-trial. This finding parallels previous evidence about visual search, extends it to perceptual load theory and further demonstrates the rich potential in uniting visual search and visual selection studies.

Applying visual attention theory to transportation safety research and design: Evaluation of alternative automobile rear lighting systems

This field experiment takes a novel approach in applying methodologies and theories of visual search to the subject of conspicuity in automobile rear lighting. Traditional rear lighting research has not used the visual search paradigm in experimental design. It is our claim that the visual search design uniquely uncovers visual attention processes operating when drivers search the visual field that current designs fail to capture. This experiment is a validation and extension of previous simulator research on this same topic and demonstrates that detection of red automobile brake lamps will be improved if tail lamps are another color (in this test, amber) rather than the currently mandated red. Results indicate that when drivers miss brake lamp onset in low ambient light, RT and error are reduced in detecting the presence and absence of red brake lamps with multiple lead vehicles when tail lamps are not red compared to current rear lighting which mandates red tail lamps. This performance improvement is attributed to efficient visual processing that automatically segregates tail (amber) and brake (red) lamp colors into distractors and targets respectively.

Centre-of-Gravity Fixations in Visual Search: When Looking at Nothing Helps to Find Something.

In visual search, some fixations are made between stimuli on empty regions, commonly referred to as “centre-of-gravity” fixations (henceforth: COG fixations). Previous studies have shown that observers with task expertise show more COG fixations than novices. This led to the view that COG fixations reflect simultaneous encoding of multiple stimuli, allowing more efficient processing of task-related items. The present study tested whether COG fixations also aid performance in visual search tasks with unfamiliar and abstract stimuli. Moreover, to provide evidence for the multiple-item processing view, we analysed the effects of COG fixations on the number and dwell times of stimulus fixations. The results showed that (1) search efficiency increased with increasing COG fixations even in search for unfamiliar stimuli and in the absence of special higher-order skills, (2) COG fixations reliably reduced the number of stimulus fixations and their dwell times, indicating processing of multiple distractors, and (3) the proportion of COG fixations was dynamically adapted to potential information gain of COG locations. A second experiment showed that COG fixations are diminished when stimulus positions unpredictably vary across trials. Together, the results support the multiple-item processing view, which has important implications for current theories of visual search.

Feature-based attention: it is all bottom-up priming.

Feature-based attention (FBA) enhances the representation of image characteristics throughout the visual field, a mechanism that is particularly useful when searching for a specific stimulus feature. Even though most theories of visual search implicitly or explicitly assume that FBA is under top-down control, we argue that the role of top-down processing in FBA may be limited. Our review of the literature indicates that all behavioural and neuro-imaging studies investigating FBA suffer from the shortcoming that they cannot rule out an effect of priming. The mere attending to a feature enhances the mandatory processing of that feature across the visual field, an effect that is likely to occur in an automatic, bottom-up way. Studies that have investigated the feasibility of FBA by means of cueing paradigms suggest that the role of top-down processing in FBA is limited (e.g. prepare for red). Instead, the actual processing of the stimulus is needed to cause the mandatory tuning of responses throughout the visual field. We conclude that it is likely that all FBA effects reported previously are the result of bottom-up priming.

Competitive guided search: Meeting the challenge of benchmark RT distributions

Historically, visual search models were mainly evaluated based on their account of mean reaction times (RTs) and accuracy data. More recently, Wolfe, Palmer, and Horowitz (2010) have demonstrated that the shape of the entire RT distributions imposes important constraints on visual search theories and can falsify even successful models such as guided search, raising a challenge to computational theories of search. Competitive guided search is a novel model that meets this important challenge. The model is an adaptation of guided search, featuring a series of item selection and identification iterations with guidance towards targets. The main novelty of the model is its termination rule: A quit unit, which aborts the search upon selection, competes with items for selection and is inhibited by the saliency map of the visual display. As the trial proceeds, the quit unit both increases in strength and suffers less saliency-based inhibition and hence the conditional probability of quitting the trial accelerates. The model is fitted to data the data from three classical search task that have been traditionally considered to be governed by qualitatively different mechanisms, including a spatial configuration, a conjunction, and a feature search (Wolfe et al., 2010). The model is mathematically tractable and it accounts for the properties of RT distributions and for error rates in all three search tasks, providing a unifying theoretical framework for visual search.

Visual search.

Visual search is the act of looking for a predefined target among other objects. This task has been widely used as an experimental paradigm to study visual attention, and because of its influence has also become a subject of research itself. When used as a paradigm, visual search studies address questions including the nature, function, and limits of preattentive processing and focused attention. As a subject of research, visual search studies address the role of memory in search, the procedures involved in search, and factors that affect search performance. In this article, we review major theories of visual search, the ways in which preattentive information is used to guide attentional allocation, the role of memory, and the processes and decisions involved in its successful completion. We conclude by summarizing the current state of knowledge about visual search and highlight some unresolved issues. WIREs Cogn Sci 2013, 4:415-429. doi: 10.1002/wcs.1235 The authors have declared no conflicts of interest for this article. For further resources related to this article, please visit the WIREs website.

Pigeons show efficient visual search by category: Effects of typicality and practice

Three experiments investigated category search in pigeons, using an artificial category created by morphing of human faces. Four pigeons were trained to search for category members among nonmembers, with each target item consisting of an item-specific component and a common component diagnostic of the category. Experiment 1 found that search was more efficient with homogeneous than heterogeneous distractors. In Experiment 2, the pigeons successfully searched for target exemplars having novel item-specific components. Practice including these items enabled the pigeons to efficiently search for the highly familiar members. The efficient search transferred immediately to more typical novel exemplars in Experiment 3. With further practice, the pigeons eventually developed efficient search for individual less typical exemplars. Results are discussed in the context of visual search theories and automatic processing of individual exemplars.

The Design of Product Comparison Tables and its Effects on Decision Making

Consumers are constantly presented with new information about new products. The presentation of this information can affect decision making processes by varying the form, organization, and sequence of the information (Kleinmuntz & Schkade, 1993). One organization strategy frequently used in marketing is a product comparison table which allows for side-by-side comparisons to be made. Two decision making heuristics which can occur when using such tables are the “as-if (AI) heuristic,” where all features are treated “as if” they are equal in importance or value, and the other is the “elimination-by-aspect (EBA) heuristic,” where a preferred feature must be present for an alternative to be considered further. One design manipulation that could affect such heuristics when using a table is shading. When applying the Proximity Compatibility Principle (PCP) and theories of visual search, it is easy to see how shading can influence or shape the perceptual acquisition of information and, in turn, affect decision making strategies. This research looked at shading orientation and its effects on decision making during a guided choice task. The study of spontaneous choice is ongoing.

Visual search at the airport: Testing TSA officers

A significant challenge for laboratory-based research is to adequately replicate conditions found in the real world. Likewise, a challenge for field-based research is to appropriately maintain the precision and control found within the laboratory. These hurdles are easily noticed when studying visual search, the act of finding a target amongst distractors. Decades of laboratory-based research have revealed many factors affecting visual search (see Nakayama & Martini, 2011 for a recent review); yet, these ‘sterile’ tasks conducted with novice participants can at times bear little resemblance to the tasks of professional searchers such as baggage screeners, radiologists, lifeguards, and military personnel. Conversely, conducting research with expert searchers in their natural environment can be logistically complex, which limits the scope of questions that can be asked. We are bridging this gap by conducting laboratory-based research with professional, expert searchers: employed Transportation Security Administration (TSA) officers at Raleigh-Durham International Airport. We have established a cognitive psychology laboratory within the airport, and the TSA officers participate in our research studies during their normal work hours. We are assessing a variety of visual and attentional abilities, including several measures of visual search. For example, in one task we employed a simplified visual search experiment to directly compare novice searchers (Duke University undergraduates) to expert searchers (TSA officers). Participants looked for ‘T’s amongst ‘L’s with set sizes of 8, 16, 24, and 32. Compared to undergraduates, TSA officers were slower to respond, with search slopes approximately 1.5 times larger. Importantly, the TSA agents were also more accurate at each set size, suggesting a greater search diligence. Through tasks such as these, combined with measures of individual differences (e.g., personality and clinical assessments), the goal of this project is to inform both cognitive theories of visual search and the TSA’s standard operating procedures.

On the limits of top-down control of visual selection

In the present study, observers viewed displays in which two equally salient color singletons were simultaneously present. Before each trial, observers received a word cue (e.g., the word red, or green) or a symbolic cue (a circle colored red or green) telling them which color singleton to select on the upcoming trial. Even though many theories of visual search predict that observers should be able to selectively attend the target color singleton, the results of the present study show that observers could not select the target singleton without interference from the irrelevant color singleton. The results indicate that the irrelevant color singleton captured attention. Only when the color of the target singleton remained the same from one trial to the next was selection perfect—an effect that is thought to be the result of passive automatic intertrial priming. The results of the present study demonstrate the limits of top-down attentional control.

On the limits of top-down control of visual selection

In the present study, observers viewed displays in which two equally salient color singletons were simultaneously present. Before each trial, observers received a word cue (e.g., the word red, or green) or a symbolic cue (a circle colored red or green) telling them which color singleton to select on the upcoming trial. Even though many theories of visual search predict that observers should be able to selectively attend the target color singleton, the results of the present study show that observers could not select the target singleton without interference from the irrelevant color singleton. The results indicate that the irrelevant color singleton captured attention. Only when the color of the target singleton remained the same from one trial to the next was selection perfect—an effect that is thought to be the result of passive automatic intertrial priming. The results of the present study demonstrate the limits of top-down attentional control.

Determinants of Dwell Time in Visual Search: Similarity or Perceptual Difficulty?

The present study examined the factors that determine the dwell times in a visual search task, that is, the duration the gaze remains fixated on an object. It has been suggested that an item’s similarity to the search target should be an important determiner of dwell times, because dwell times are taken to reflect the time needed to reject the item as a distractor, and such discriminations are supposed to be harder the more similar an item is to the search target. In line with this similarity view, a previous study shows that, in search for a target ring of thin line-width, dwell times on thin linewidth Landolt C’s distractors were longer than dwell times on Landolt C’s with thick or medium linewidth. However, dwell times may have been longer on thin Landolt C’s because the thin line-width made it harder to detect whether the stimuli had a gap or not. Thus, it is an open question whether dwell times on thin line-width distractors were longer because they were similar to the target or because the perceptual decision was more difficult. The present study de-coupled similarity from perceptual difficulty, by measuring dwell times on thin, medium and thick line-width distractors when the target had thin, medium or thick line-width. The results showed that dwell times were longer on target-similar than target-dissimilar stimuli across all target conditions and regardless of the line-width. It is concluded that prior findings of longer dwell times on thin linewidth-distractors can clearly be attributed to target similarity. As will be discussed towards the end, the finding of similarity effects on dwell times has important implications for current theories of visual search and eye movement control.