Visual Search Selection Research Articles

Do We Prepare for What We Predict? How Target Expectations Affect Preparatory Attentional Templates and Target Selection in Visual Search.

Visual search is guided by representations of target-defining features (attentional templates) that are activated in a preparatory fashion. Here, we investigated whether these template activation processes are modulated by probabilistic expectations about upcoming search targets. We tracked template activation while observers prepared to search for one or two possible color-defined targets by measuring N2pc components (markers of attentional capture) to task-irrelevant color probes flashed every 200 msec during the interval between search displays. These probes elicit N2pcs only if the corresponding color template is active at the time when the probe appears. Probe N2pcs emerged from about 600 msec before search display onset. They did not differ between one-color and two-color search, indicating that two color templates can be activated concurrently. Critically, probe N2pcs measured during two-color search were identical for probes matching an expected or unexpected color (target color probability: 80% vs. 20%), or one of two equally likely colors. This strongly suggests that probabilistic target color expectations had no impact on search preparation. In marked contrast, subsequent target selection processes were strongly affected by these expectations. We discuss possible explanations for this clear dissociation in the effects of expectations on preparatory search template activation and search target selection, respectively.

Attentional selection is a sufficient cause for visual working memory interference.

Visual attention and visual working memory (VWM) are intertwined processes that allow navigation of the visual world. These systems can compete for highly limited cognitive resources, creating interference effects when both operate in tandem. Performing an attentional task while maintaining a VWM load often leads to a loss of memory information. These losses are seen even with very simple visual search tasks. Previous research has argued that this may be due to the attentional selection process, of choosing the target item out of surrounding nontarget items. Over two experiments, the current study disentangles the roles of search and selection in visual search and their influence on a retained VWM load. Experiment 1 revealed that, when search stimuli were relatively simple, target-absent searches (which did not require attentional selection) did not provoke memory interference, whereas target-present search did. In Experiment 2, the number of potential targets was varied in the search displays. In one condition, participants were required to select any one of the items displayed, requiring an attentional selection but no need to search for a specific item. Importantly, this condition led to memory interference to the same extent as a condition where a single target was presented among nontargets. Together, these results show that the process of attentional selection is a sufficient cause for interference with a concurrently maintained VWM load.

Temporal preparation accelerates spatial selection by facilitating bottom-up processing

Temporal preparation facilitates spatial selection in visual search. This selection benefit has not only been observed for targets, but also for task-irrelevant, salient distractors. This result suggests that temporal preparation influences bottom-up salience in spatial selection. To test this assumption, we conducted an event-related-potential (ERP) study in which we measured the joint effect of temporal preparation and target salience on the N2pc as an index of spatial selection and the N1 as an index of perceptual discrimination. To manipulate target salience, we employed two different setsizes (i.e., a small or large number of homogeneous distractors). To manipulate temporal preparation, we presented a warning signal before the search display and we varied the length of the interval (foreperiod) between warning signal and search display in different blocks of trials (constant foreperiod paradigm). Replicating previous results, we observed that the N1 and the N2pc arose earlier in case of good temporal preparation. Importantly, the beneficial effect on the N2pc onset latency was stronger when the target salience was initially low (i.e., small setsize). This result provides evidence that temporal preparation influences bottom-up processing and, thereby, facilitates spatial selection.

PD components and distractor inhibition in visual search: New evidence for the signal suppression hypothesis.

The hypothesis that salient distractors in visual search are actively suppressed is supported by the fact that these objects elicit PD components believed to be associated with inhibition. This account was challenged by researchers who found that a PD to lateral color singleton distractors was followed by a contralateral negativity, which they interpreted as an N2pc indicative of attentional capture. As this would be at odds with successful distractor suppression, they proposed an alternative lateral-first serial scanning hypothesis, which assumes that the PD might actually be an N2pc elicited when a lateral context item is selected. We tested this hypothesis by measuring lateralized ERP components to search displays with two lateral and two vertical midline items, including a color singleton and a shape-defined target. Color singletons triggered PD components not only in blocks where attention was unfocused because target location was unpredictable, but critically also in blocks where targets only appeared on the midline and participants had no reason to attend to lateral items. This is inconsistent with the serial scanning hypothesis and supports the idea that the PD reflects signal suppression. PD components to singleton distractors were followed by a contralateral negativity, which we interpreted as a second PD elicited by nonsalient distractors on the opposite side. Our sequential inhibition account reconciles conflicting results of recent studies and emphasizes the role of inhibitory processes during attentional target selection in visual search.

Reduction of temporal uncertainty facilitates stimulus-driven processes in spatial selection

Previous studies have shown that the reduction of temporal uncertainty facilitates target selection in visual search. We investigated whether this beneficial effect is caused by an effect on stimulus-driven processes or on goal-driven processes in spatial selection. To discriminate between these processes, we employed a visual search task in which participants searched for a shape target while ignoring a color singleton distractor. As an index of stimulus-driven processes, we measured the N2pc evoked by the singleton distractor (ND). As indices of goal-driven processes, we measured the N2pc evoked by the target (NT) and the distractor positivity (PD) evoked by the singleton distractor, respectively. We observed that reducing temporal uncertainty modulated the amplitude of ND and the onset latency of the NT, but did not modulate the amplitude of the PD. These results are consistent with the view that a reduction of temporal uncertainty influences non-selective, stimulus-driven processes in spatial selection.

Parallel fast and slow recurrent cortical processing mediates target and distractor selection in visual search

Visual search has been commonly used to study the neural correlates of attentional allocation in space. Recent electrophysiological research has disentangled distractor processing from target processing, showing that these mechanisms appear to operate in parallel and show electric fields of opposite polarity. Nevertheless, the localization and exact nature of this activity is unknown. Here, using MEG in humans, we provide a spatiotemporal characterization of target and distractor processing in visual cortex. We demonstrate that source activity underlying target- and distractor-processing propagates in parallel as fast and slow sweep from higher to lower hierarchical levels in visual cortex. Importantly, the fast propagating target-related source activity bypasses intermediate levels to go directly to V1, and this V1 activity correlates with behavioral performance. These findings suggest that reentrant processing is important for both selection and attenuation of stimuli, and such processing operates in parallel feedback loops.

Visual and central attention share a capacity limitation when the demands for serial item selection in visual search are high.

Visual and central attention are limited in capacity. In conjunction search, visual attention is required to select the items and to bind their features (e.g., color, form, size), which results in a serial search process. In dual-tasks, central attention is required for response selection, but because central attention is limited in capacity, response selection can only be carried out for one task at a time. Here, we investigated whether visual and central attention rely on a common or on distinct capacity limitations. In two dual-task experiments, participants completed an auditory two-choice discrimination Task 1 and a conjunction search Task 2 that were presented with an experimentally modulated temporal interval between them (stimulus onset asynchrony [SOA]). In Experiment 1, Task 2 was a triple conjunction search task. Each item consisted of a conjunction of three features, so that target and distractors shared two features. In Experiment 2, Task 2 was a plus conjunction search task, in which target and distractors shared the same four features. The hypotheses for conjunction search time were derived from the locus-of-slack method. While plus conjunction search was performed after response selection in Task 1, a small part of triple conjunction search was still performed in parallel to response selection in Task 1. However, the between-experiment comparison was not significant, indicating that both search tasks may require central attention. Taken together, the present study provides evidence that visual and central attention share a common capacity limitation when conjunction search relies strongly on serial item selection.

A bilateral N2pc (N2pcb) component is elicited by search targets displayed on the vertical midline.

The study of visually elicited event-related potentials (ERPs) detected at posterior recording sites during visual search has enormously advanced our knowledge about how and when visuo-spatial attention locks onto one or more laterally presented target objects. The N2pc component to lateral targets has been pivotal to further our understanding of the mechanisms and time course of target selection in visual search. However, the N2pc cannot track visuo-spatial attention deployment to targets displayed along the vertical midline. Here, we introduce a new ERP marker (N2pcb component) that is elicited during the selection of such midline targets. In line with retinal and callosal projections from striate to ventral extrastriate cortex, this component reflects an enhanced negativity elicited by midline targets over both posterior hemispheres. By comparing the attentional selection of lateral and midline targets in a singleton search condition and a feature search condition, we show that the N2pcb is triggered at the same time as the N2pc to lateral targets, and shows the same onset latency difference between singleton and feature search. We conclude that the N2pcb and N2pc components reflect the same attentional target selection processes in visual search.

The spatially global control of attentional target selection in visual search

ABSTRACTGlyn Humphreys and his co-workers have made numerous important theoretical and empirical contributions to research on visual search. They have introduced the concept of attentional target templates and investigated the nature of these templates and how they are involved in the control of search performance. In the experiments reported here, we investigated whether feature-specific search templates for particular colours can guide target selection independently for different regions of visual space. We employed behavioural and electrophysiological markers of attentional selection in tasks with targets defined by specific colour/location combinations. In Experiment 1, participants searched for pairs of colour targets in a particular spatial configuration (e.g., red in the upper and blue in the lower visual field). In Experiment 2, they searched for single colour-defined targets at specific locations (e.g., red on the left or blue on the right). Target displays were preceded by non-informative cues containing target-colour items at task-set matching or mismatching locations. Contingent attentional capture was observed only for matching cues. However, both matching and mismatching cues elicited identical N2pc components, indicating equivalent attentional capture. This shows that the rapid deployment of attention towards target features is spatially non-selective, and that selection of colour/location combinations occurs at later post-perceptual stages. This was further corroborated in search displays where targets were accompanied by target-colour distractors at nonmatching locations. Here, spatial biases towards the target emerged late and were strongly attenuated relative to displays without such distractors. These results demonstrate that attentional templates for target-defining features operate in a spatially-global fashion. Feature-based guidance of visual search cannot be restricted to particular locations even when this is required by the demands of an attentional selection task.

Why the item will remain the unit of attentional selection in visual search.

Hulleman & Olivers (H&O) reject item-based serial models of visual search, and they suggest that items are processed equally and globally during each fixation period. However, neuroscientific studies have shown that attentional biases can emerge in parallel but in a spatially selective item-based fashion. Even within a parallel architecture for visual search, the item remains the critical unit of selection.

The Control of Single-color and Multiple-color Visual Search by Attentional Templates in Working Memory and in Long-term Memory

The question whether target selection in visual search can be effectively controlled by simultaneous attentional templates for multiple features is still under dispute. We investigated whether multiple-color attentional guidance is possible when target colors remain constant and can thus be represented in long-term memory but not when they change frequently and have to be held in working memory. Participants searched for one, two, or three possible target colors that were specified by cue displays at the start of each trial. In constant-color blocks, the same colors remained task-relevant throughout. In variable-color blocks, target colors changed between trials. The contralateral delay activity (CDA) to cue displays increased in amplitude as a function of color memory load in variable-color blocks, which indicates that cued target colors were held in working memory. In constant-color blocks, the CDA was much smaller, suggesting that color representations were primarily stored in long-term memory. N2pc components to targets were measured as a marker of attentional target selection. Target N2pcs were attenuated and delayed during multiple-color search, demonstrating less efficient attentional deployment to color-defined target objects relative to single-color search. Importantly, these costs were the same in constant-color and variable-color blocks. These results demonstrate that attentional guidance by multiple-feature as compared with single-feature templates is less efficient both when target features remain constant and can be represented in long-term memory and when they change across trials and therefore have to be maintained in working memory.

Evidence for distinct mechanisms underlying attentional priming and sensory memory for bistable perception.

Attentional selection in visual search paradigms and perceptual selection in bistable perception paradigms show functional similarities. For example, both are sensitive to trial history: They are biased toward previously selected targets or interpretations. We investigated whether priming by target selection in visual search and sensory memory for bistable perception are related. We did this by presenting two trial types to observers. We presented either ambiguous spheres that rotated over a central axis and could be perceived as rotating in one of two directions, or search displays in which the unambiguously rotating target and distractor spheres closely resembled the two possible interpretations of the ambiguous stimulus. We interleaved both trial types within experiments, to see whether priming by target selection during search trials would affect the perceptual outcome of bistable perception and, conversely, whether sensory memory during bistable perception would affect target selection times during search. Whereas we found intertrial repetition effects among consecutive search trials and among consecutive bistable trials, we did not find cross-paradigm effects. Thus, even though we could ascertain that our experiments robustly elicited processes of both search priming and sensory memory for bistable perception, these same experiments revealed no interaction between the two.

Conjunction-guided selection in visual search

Conjunction-guided selection in visual search

In defense of the salience map: Salience rather than visibility determines selection.

The aim of the present study was to investigate whether time-dependent biases of oculomotor selection as typically observed during visual search are better accounted for by an absolute-processing-speed account (J. P. de Vries, I. T. C. Hooge, M. A. Wiering, & F. A. J. Verstraten, 2011, How longer saccade latencies lead to a competition for salience. Psychological Science, 22, 916-923) or a relative-salience account (e.g., M. Donk, & W. van Zoest, 2008, Effects of salience are short-lived. Psychological Science, 19, 733-739; M. Donk & W. van Zoest, 2011, No control in orientation search: The effects of instruction on oculomotor selection in visual search. Vision Research, 51, 2156-2166). In order to test these two models, we performed an experiment in which participants were instructed to make a speeded eye movement to any of two orientation singletons presented among a homogeneous set of vertically oriented background lines. One singleton, the fixed singleton, remained identical across conditions, whereas the other singleton, the variable singleton, varied such that its orientation contrast relative to the background lines was either smaller or larger than that of the fixed singleton. The results showed that the proportion of eye movements directed toward the fixed singleton varied substantially depending on the orientation contrast of the variable singleton. A model assuming selection behavior to be determined by relative salience provided a better fit to the individual data than the absolute processing speed model. These findings suggest that relative salience rather than the visibility of an element is crucial in determining temporal variations in oculomotor selection behavior and that an explanation of visual selection behavior is insufficient without the concept of a salience map.

A robotics-based approach to modeling of choice reaching experiments on visual attention.

The paper presents a robotics-based model for choice reaching experiments on visual attention. In these experiments participants were asked to make rapid reach movements toward a target in an odd-color search task, i.e., reaching for a green square among red squares and vice versa (e.g., Song and Nakayama, 2008). Interestingly these studies found that in a high number of trials movements were initially directed toward a distractor and only later were adjusted toward the target. These “curved” trajectories occurred particularly frequently when the target in the directly preceding trial had a different color (priming effect). Our model is embedded in a closed-loop control of a LEGO robot arm aiming to mimic these reach movements. The model is based on our earlier work which suggests that target selection in visual search is implemented through parallel interactions between competitive and cooperative processes in the brain (Heinke and Humphreys, 2003; Heinke and Backhaus, 2011). To link this model with the control of the robot arm we implemented a topological representation of movement parameters following the dynamic field theory (Erlhagen and Schoener, 2002). The robot arm is able to mimic the results of the odd-color search task including the priming effect and also generates human-like trajectories with a bell-shaped velocity profile. Theoretical implications and predictions are discussed in the paper.

No control in orientation search: The effects of instruction on oculomotor selection in visual search

The present study aimed to investigate whether people can selectively use salience information in search for a target. Observers were presented with a display consisting of multiple homogeneously oriented background lines and two orientation singletons. The orientation singletons differed in salience, where salience was defined by their orientation contrast relative to the background lines. Observers had the task to make a speeded eye movement towards a target, which was either the most or the least salient element of the two orientation singletons. The specific orientation of the target was either constant or variable over a block of trials such that observers had varying knowledge concerning the target identity. The results demonstrated that instruction – whether people were instructed to move to the most or the least salient item – only minimally affected the results. Short-latency eye movements were completely salience driven; here it did not matter whether people were searching for the most or least salient element. Long-latency eye movements were marginally affected by instruction, in particular when observers knew the target identity. These results suggest that even though people use salience information in oculomotor selection, they cannot use this information in a goal-driven manner. The results are discussed in terms of current models on visual selection.

Perceiving Spatial Relations via Attentional Tracking and Shifting

Perceiving which of a scene's objects are adjacent may require selecting them with a limited-capacity attentional process. Previous results support this notion [1-3] but leave open whether the process operates simultaneously on several objects or proceeds one by one. With arrays of colored discs moving together, we first tested the effect of moving the discs faster than the speed limit for following them with attentional selection [4]. At these high speeds, participants could identify which colors were present and determine whether identical arrays were aligned or offset by one disc. They could not, however, apprehend which colors in the arrays were adjacent, indicating that attentional selection is required for this judgment. If selection operates serially to determine which colors are neighbors, then after the color of one disc is identified, attention must shift to the adjacent disc. As a result of the motion, attention might occasionally miss its target and land on the trailing disc. We cued attention to first select one or the other of a pair of discs and found the pattern of errors predicted. Perceiving these spatial relationships evidently requires selecting and processing objects one by one and is only possible at low object speeds.

What top-down task sets do for us: An ERP study on the benefits of advance preparation in visual search.

When target-defining features are specified in advance, attentional target selection in visual search is controlled by preparatory top-down task sets. We used ERP measures to study voluntary target selection in the absence of such feature-specific task sets, and to compare it to selection that is guided by advance knowledge about target features. Visual search arrays contained two different color singleton digits, and participants had to select one of these as target and report its parity. Target color was either known in advance (fixed color task) or had to be selected anew on each trial (free color-choice task). ERP correlates of spatially selective attentional target selection (N2pc) and working memory processing (SPCN) demonstrated rapid target selection and efficient exclusion of color singleton distractors from focal attention and working memory in the fixed color task. In the free color-choice task, spatially selective processing also emerged rapidly, but selection efficiency was reduced, with nontarget singleton digits capturing attention and gaining access to working memory. Results demonstrate the benefits of top-down task sets: Feature-specific advance preparation accelerates target selection, rapidly resolves attentional competition, and prevents irrelevant events from attracting attention and entering working memory.

Reward has a residual impact on target selection in visual search, but not on the suppression of distractors

In the reinforcement learning literature, good outcome following selection of a visual object is thought to bias perception and attention in favour of similar objects in later experience. This impact of reward might be instantiated in two ways: Reward could prime target features or it could act to facilitate suppression of distractors present when reward was received. Here we report results from an experiment in which reward outcome was selectively associated either with the colour defining a visual search target or with the colour defining a salient distractor in the display. Reward's impact on search was evident only when it was tied to the target; reward made it no easier to ignore a distractor when it subsequently reappeared as a distractor. This suggests that reward acts largely to prime target representations, consistent with the idea that objects associated with good outcome become visually salient.

Mandatory Processing of Irrelevant Fearful Face Features in Visual Search

Faces expressing fear may attract attention in an automatic bottom-up fashion. Here we address this issue with magneto-encephalographic (MEG) recordings in subjects performing a demanding visual search combined with the presentation of irrelevant neutral or fearful faces. The impact of the faces' emotional expression on attentional selection was assessed by analyzing the N2pc component--a modulation of the event-related magnetic field response known to reflect attentional focusing in visual search. We observed that lateralized fearful faces elicited an N2pc approximately between 240 and 400 msec in ventral extrastriate cortex that was independent of the N2pc reflecting target selection in visual search. Despite their clear influence on neural processing, fearful faces did not significantly influence behavioral performance. To clarify this discrepancy, we further performed an MEG experiment in which the demands of the search task were reduced. Under those conditions, lateralized fearful faces elicited an N2pc response that was again independent of the N2pc response to the search target. Behavioral performance was, however, influenced in a significant manner, suggesting that for behavioral effects to appear, sufficient attentional resources need to be left unoccupied by the search task--a notion put forward by the perceptual load theory. Our observations are taken to indicate that irrelevant fearful faces influence attentional processing in extrastriate visual cortex in an automatic fashion and independent of other task-relevant attentional operations. However, this may not necessarily be echoed at the behavioral level as long as task-relevant selection operations exhaust attentional resources.