Attentional Object Selection Research Articles

A Neural Dynamic Model of the Perceptual Grounding of Spatial and Movement Relations.

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say "the cup to the left of the computer" to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time- and state-continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of highercognition.

Individual Differences in Working Memory and the N2pc.

The lateralized ERP N2pc component has been shown to be an effective marker of attentional object selection when elicited in a visual search task, specifically reflecting the selection of a target item among distractors. Moreover, when targets are known in advance, the visual search process is guided by representations of target features held in working memory at the time of search, thus guiding attention to objects with target-matching features. Previous studies have shown that manipulating working memory availability via concurrent tasks or within task manipulations influences visual search performance and the N2pc. Other studies have indicated that visual (non-spatial) vs. spatial working memory manipulations have differential contributions to visual search. To investigate this the current study assesses participants' visual and spatial working memory ability independent of the visual search task to determine whether such individual differences in working memory affect task performance and the N2pc. Participants (n = 205) completed a visual search task to elicit the N2pc and separate visual working memory (VWM) and spatial working memory (SPWM) assessments. Greater SPWM, but not VWM, ability is correlated with and predicts higher visual search accuracy and greater N2pc amplitudes. Neither VWM nor SPWM was related to N2pc latency. These results provide additional support to prior behavioral and neural visual search findings that spatial WM availability, whether as an ability of the participant's processing system or based on task demands, plays an important role in efficient visual search.

Sex Differences in Attentional Selection Following Gaze and Arrow Cues.

Although most studies on social attention have shown undistinguishable attentional effects in response to eye-gaze and arrow cues, recent research has found that whereas the orienting of attention triggered by eye-gaze is directed to the specific position, or part of the object looked at, arrows unselectively elicit attention toward parts of the environment. However, it is unclear whether this dissociation between gaze and arrow cues is related to social cognitive mechanisms such as mental state attribution (Theory of Mind, ToM). We aimed at replicating the dissociation between gaze and arrow cues and investigating if the attentional object selection elicited by these two types of stimuli differs depending on the sex of observers. To make our research plan transparent, our hypotheses, together with the plans of analyses, were registered before data exploration. While we replicated the arrow–gaze dissociation, this was equivalent in the male and female population. These results seem to contradict the intuition that ToM skills can be associated with the differences observed between orienting to eyes and arrows since greater ToM abilities have been generally shown in females. However, this conclusion must be interpreted with caution, since, in our sample, it was not possible to observe any differences in autistic quotient scores and ToM abilities between male and female participants. Further research is needed in order to clarify this issue.

Brain and Cognitive Mechanisms of Top-Down Attentional Control in a Multisensory World: Benefits of Electrical Neuroimaging.

In real-world environments, information is typically multisensory, and objects are a primary unit of information processing. Object recognition and action necessitate attentional selection of task-relevant from among task-irrelevant objects. However, the brain and cognitive mechanisms governing these processes remain not well understood. Here, we demonstrate that attentional selection of visual objects is controlled by integrated top-down audiovisual object representations ("attentional templates") while revealing a new brain mechanism through which they can operate. In multistimulus (visual) arrays, attentional selection of objects in humans and animal models is traditionally quantified via "the N2pc component": spatially selective enhancements of neural processing of objects within ventral visual cortices at approximately 150-300 msec poststimulus. In our adaptation of Folk et al.'s [Folk, C. L., Remington, R. W., & Johnston, J. C. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030-1044, 1992] spatial cueing paradigm, visual cues elicited weaker behavioral attention capture and an attenuated N2pc during audiovisual versus visual search. To provide direct evidence for the brain, and so, cognitive, mechanisms underlying top-down control in multisensory search, we analyzed global features of the electrical field at the scalp across our N2pcs. In the N2pc time window (170-270 msec), color cues elicited brain responses differing in strength and their topography. This latter finding is indicative of changes in active brain sources. Thus, in multisensory environments, attentional selection is controlled via integrated top-down object representations, and so not only by separate sensory-specific top-down feature templates (as suggested by traditional N2pc analyses). We discuss how the electrical neuroimaging approach can aid research on top-down attentional control in naturalistic, multisensory settings and on other neurocognitive functions in the growing area of real-world neuroscience.

The guidance of visual search by shape features and shape configurations.

Representations of target features (attentional templates) guide attentional object selection during visual search. In many search tasks, targets objects are defined not by a single feature but by the spatial configuration of their component shapes. We used electrophysiological markers of attentional selection processes to determine whether the guidance of shape configuration search is entirely part-based or sensitive to the spatial relationship between shape features. Participants searched for targets defined by the spatial arrangement of two shape components (e.g., hourglass above circle). N2pc components were triggered not only by targets but also by partially matching distractors with one target shape (e.g., hourglass above hexagon) and by distractors that contained both target shapes in the reverse arrangement (e.g., circle above hourglass), in line with part-based attentional control. Target N2pc components were delayed when a reverse distractor was present on the opposite side of the same display, suggesting that early shape-specific attentional guidance processes could not distinguish between targets and reverse distractors. The control of attention then became sensitive to spatial configuration, which resulted in a stronger attentional bias for target objects relative to reverse and partially matching distractors. Results demonstrate that search for target objects defined by the spatial arrangement of their component shapes is initially controlled in a feature-based fashion but can later be guided by templates for spatial configurations. (PsycINFO Database Record

Salience drives overt selection of two equally relevant visual targets.

In the present study, we investigated whether salience determines the sequence of selection when participants search for two equally relevant visual targets. To do this, attentional selection was tracked overtly as observers inspected two items of differing physical salience: one a highly salient color singleton, and the other a less salient shape singleton. Participants were instructed to make natural eye movements in order to determine whether two line segments contained within the two singletons were oriented in the same or in different directions. Because both singleton items were task-relevant, participants had no reason to inspect one item before the other. As expected, observers fixated both targets on the majority of trials. Critically, saccades to the color singleton preceded saccades to the less salient shape singleton on the majority of trials. This demonstrates that the order of attentional object selection is largely determined by stimulus salience when task relevance is equated.

The speed of voluntary and priority-driven shifts of visual attention.

The question how fast spatial attention moves between different visual objects remains debated. We used electrophysiological measures to determine the speed of voluntary and visually guided shifts of attention. Participants shifted attention from a known benchmark object (T1) to a benchmark-defined target object (T2) in tasks where these shifts had to be controlled endogenously and tasks where they could be guided by visible stimulus attributes (target features or arrow cues). To track the speed of these attention shifts, we measured event-related potential (ERP) markers of attentional object selection (N2pc components). The N2pc to T1 emerged earlier than the N2pc to T2, confirming the presence of serial attention shifts. N2pc onset differences between T1 and T2 revealed that shifts guided by target features were triggered within 50 ms, whereas voluntary movements of attention took substantially longer (150 ms). Attention shifts signaled by arrow cues were initiated within about 100 ms. Results show that genuinely voluntary shifts of attention are slower than shifts that are guided by cues or target features, but can still be initiated more rapidly than has previously been assumed. They also demonstrate that EEG markers can track different types of serial attentional selection processes with high temporal precision. (PsycINFO Database Record

Target objects defined by a conjunction of colour and shape can be selected independently and in parallel.

It is generally assumed that during search for targets defined by a feature conjunction, attention is allocated sequentially to individual objects. We tested this hypothesis by tracking the time course of attentional processing biases with the N2pc component in tasks where observers searched for two targets defined by a colour/shape conjunction. In Experiment 1, two displays presented in rapid succession (100 ms or 10 ms SOA) each contained a target and a colour-matching or shape-matching distractor on opposite sides. Target objects in both displays elicited N2pc components of similar size that overlapped in time when the SOA was 10 ms, suggesting that attention was allocated in parallel to both targets. Analogous results were found in Experiment 2, where targets and partially matching distractors were both accompanied by an object without target-matching features. Colour-matching and shape-matching distractors also elicited N2pc components, and the target N2pc was initially identical to the sum of the two distractor N2pcs, suggesting that the initial phase of attentional object selection was guided independently by feature templates for target colour and shape. Beyond 230 ms after display onset, the target N2pc became superadditive, indicating that attentional selection processes now started to be sensitive to the presence of feature conjunctions. Results show that independent attentional selection processes can be activated in parallel by two target objects in situations where these objects are defined by a feature conjunction.

A Neural Dynamic Architecture for Reaching and Grasping Integrates Perception and Movement Generation and Enables On-Line Updating.

Reaching for objects and grasping them is a fundamental skill for any autonomous robot that interacts with its environment. Although this skill seems trivial to adults, who effortlessly pick up even objects they have never seen before, it is hard for other animals, for human infants, and for most autonomous robots. Any time during movement preparation and execution, human reaching movement are updated if the visual scene changes (with a delay of about 100 ms). The capability for online updating highlights how tightly perception, movement planning, and movement generation are integrated in humans. Here, we report on an effort to reproduce this tight integration in a neural dynamic process model of reaching and grasping that covers the complete path from visual perception to movement generation within a unified modeling framework, Dynamic Field Theory. All requisite processes are realized as time-continuous dynamical systems that model the evolution in time of neural population activation. Population level neural processes bring about the attentional selection of objects, the estimation of object shape and pose, and the mapping of pose parameters to suitable movement parameters. Once a target object has been selected, its pose parameters couple into the neural dynamics of movement generation so that changes of pose are propagated through the architecture to update the performed movement online. Implementing the neural architecture on an anthropomorphic robot arm equipped with a Kinect sensor, we evaluate the model by grasping wooden objects. Their size, shape, and pose are estimated from a neural model of scene perception that is based on feature fields. The sequential organization of a reach and grasp act emerges from a sequence of dynamic instabilities within a neural dynamics of behavioral organization, that effectively switches the neural controllers from one phase of the action to the next. Trajectory formation itself is driven by a dynamical systems version of the potential field approach. We highlight the emergent capacity for online updating by showing that a shift or rotation of the object during the reaching phase leads to the online adaptation of the movement plan and successful completion of the grasp.

Category-based guidance of spatial attention during visual search for feature conjunctions.

The question whether alphanumerical category is involved in the control of attentional target selection during visual search remains a contentious issue. We tested whether category-based attentional mechanisms would guide the allocation of attention under conditions where targets were defined by a combination of alphanumerical category and a basic visual feature, and search displays could contain both targets and partially matching distractor objects. The N2pc component was used as an electrophysiological marker of attentional object selection in tasks where target objects were defined by a conjunction of color and category (Experiment 1) or shape and category (Experiment 2). Some search displays contained the target or a nontarget object that matched either the target color/shape or its category among 3 nonmatching distractors. In other displays, the target and a partially matching nontarget object appeared together. N2pc components were elicited not only by targets and by color- or shape-matching nontargets, but also by category-matching nontarget objects, even on trials where a target was present in the same display. On these trials, the summed N2pc components to the 2 types of partially matching nontargets were initially equal in size to the target N2pc, suggesting that attention was allocated simultaneously and independently to all objects with target-matching features during the early phase of attentional processing. Results demonstrate that alphanumerical category is a genuine guiding feature that can operate in parallel with color or shape information to control the deployment of attention during visual search. (PsycINFO Database Record

The control of attentional target selection in a colour/colour conjunction task.

To investigate the time course of attentional object selection processes in visual search tasks where targets are defined by a combination of features from the same dimension, we measured the N2pc component as an electrophysiological marker of attentional object selection during colour/colour conjunction search. In Experiment 1, participants searched for targets defined by a combination of two colours, while ignoring distractor objects that matched only one of these colours. Reliable N2pc components were triggered by targets and also by partially matching distractors, even when these distractors were accompanied by a target in the same display. The target N2pc was initially equal in size to the sum of the two N2pc components to the two different types of partially matching distractors and became superadditive from approximately 250ms after search display onset. Experiment 2 demonstrated that the superadditivity of the target N2pc was not due to a selective disengagement of attention from task-irrelevant partially matching distractors. These results indicate that attention was initially deployed separately and in parallel to all target-matching colours, before attentional allocation processes became sensitive to the presence of both matching colours within the same object. They suggest that attention can be controlled simultaneously and independently by multiple features from the same dimension and that feature-guided attentional selection processes operate in parallel for different target-matching objects in the visual field.

Visual search and the N2pc in children.

While there is growing understanding of visual selective attention in children, some aspects such as selection in the presence of distractors are not well understood. Adult studies suggest that when presented with a visual search task, an enhanced negativity is seen beginning around 200 ms (the N2pc) that reflects selection of a target item among distractors. However, it is not known if similar selective attention-related activity is seen in children during visual search. This study was designed to investigate the presence of the N2pc in children. Nineteen children (ages 9–12 years) and 21 adults (ages 18–22 years) completed a visual search task in which they were asked to attend to a fixation surrounded by both a target and a distractor stimulus. Three types of displays were analyzed at parietal electrodes P7 and P8; lateral target/lateral distractor, lateral target/midline distractor, and midline target/lateral distractor. Both adults and children showed a significant increased negativity contralateral compared to ipsilateral to the target (reflected in the N2pc) in both displays with a lateral target while no such effect was seen in displays with a midline target. This suggests that children also utilized additional resources to select a target item when distractors are present. These findings demonstrate that the N2pc can be used as a marker of attentional object selection in children.

The gradual emergence of spatially selective target processing in visual search: From feature-specific to object-based attentional control.

To dissociate feature-based and object-based stages in the control of spatial attention during visual search, we employed the N2pc component as an electrophysiological marker of attentional object selection. Participants searched for a target object that was defined by a conjunction of color and shape. Some search displays contained the target or a nontarget object that matched either the target color or its shape among 3 nonmatching distractors. In other displays, the target and a partially target-matching nontarget object appeared together. N2pc results demonstrated that the initial stage of attentional object selection is controlled by local feature-specific signals. Attention is allocated in parallel and independently to objects with target-matching features during this early stage, irrespective of whether another target-matching object is simultaneously present elsewhere. From around 250 ms poststimulus, information is integrated across feature dimensions, and spatially selective attentional processing becomes object-based. These findings demonstrate that feature-based and object-based stages of attentional selectivity in visual search can be dissociated in real time.

Spatial Attention Can Be Allocated Rapidly and in Parallel to New Visual Objects

In real-life visual environments, where multiple objects compete for processing, new objects that require immediate attention often appear when attention is already focused elsewhere. The question of whether spatial attention can be directed independently to different locations in the visual field remains controversial. Serial models assume a unitary attentional focus that is directed to one object at a time and moves rapidly between objects. According to parallel models, attention can be simultaneously allocated to several visual objects, but the distribution of attention cannot change rapidly when new objects arrive. Here we demonstrate the existence of a fast and flexible mechanism of attentional object selection, where focal attention is allocated in parallel and independently to different target objects. Using event-related brain potential (ERP) markers of visual attention, we show that when two targets appear in rapid succession at different locations, two separate foci of attention are established, each with its own independent time course. Attention can be maintained at its previous location while it is simultaneously allocated to a new target object. Our results challenge the view that the attentional focus is always unitary and that the spatial selection of multiple visual objects operates in a strictly serial fashion.

Top-down task sets for combined features: Behavioral and electrophysiological evidence for two stages in attentional object selection

We studied whether visual search for targets defined by a combination of features from different dimensions is guided by separately represented target features or by an integrated representation of the target objects. In Experiment 1, participants searched for target singleton bars that were defined by a specific combination of color (red or blue) and size (small or large). The target arrays were preceded by cue arrays that contained a spatially uninformative color/size singleton. Behavioral spatial-cueing effects indicative of attentional capture were triggered only by cues that matched both target-defining features, but not by partially target-matching cues, suggesting that attention was guided by integrated object representations. However, the presence of reliable N2pc components for partially matching cues demonstrated that these cues did capture attention, in line with independent feature-based guidance of attention. This dissociation between the electrophysiological and behavioral markers of attentional capture was confirmed in Experiment 2, in which targets were defined by a color/size disjunction. Our results suggest that the attentional selection of targets that are defined by a combination of features is a two-stage process: Attention is initially captured by all target-matching features, but is then rapidly withdrawn from nontarget objects that share some but not all features with the current target.

Cortical Mechanisms Underlying the Attentional Selection of Objects Embedded In Visual Noise

Cortical Mechanisms Underlying the Attentional Selection of Objects Embedded In Visual Noise

The top-down control of visual selection and how it is linked to the N2pc component

Is the spatial selection of visual objects fully under the control of top-down factors such as current tasks sets? In his admirably clear and systematic review (Theeuwes, 2010), Jan Theeuwes claims that the selection of visual objects is determined solely by bottom-up mechanisms that are independent of observers' selection intentions, and that top-down control only comes into play at later stages of attentional processing. His argument starts with the assumption that visual information is initially processed in a parallel and feedforward fashion, and that this early stage is entirely stimulus-driven. That much is not contentious — in fact, many models of visual processing and attentional selectivity assume the existence of an early fast feedforward sweep that is essentially non-selective. Theeuwes' central and controversial claim concerns the factors that drive the subsequent attentional selection of visual objects. He argues that this selection is determined by bottom-up salience maps that are computed during the initial parallel visual processing stage. Crucially, this salience-driven attentional object selection cannot be prevented or even modulated by top-down task set. Top-down factors can only influence what happens after an object has been selected; for example, attention can be rapidly disengaged from objects that do not possess currently task-relevant attributes. But intentional factors have no role whatsoever in the attentional selection of visual objects. It is unusual to define a psychological concept (bottom-up visual selection) by applying a negative criterion (the absence of intentional modulation). As a result, there is a surprisingly wide range of cases that appear to meet this criterion. For example, Theeuwes considers phenomena such as intertrial feature priming or memory-driven attentional capture to be instances of bottom-up selection, even though here the selection of visual objects is not determined by their salience. Such an extension of the concept of bottom-up selection

Visual Perception: Converging Mechanisms of Attention, Binding, and Segmentation?

Visual scenes are cluttered. Recent evidence suggests that areas as early as V1 and V2 help making sense of the scene by segmenting them into distinct objects, separating foreground and background, and binding features.

Attentional selection of objects or features: evidence from a modified search task.

Three experiments examined the domain of visual selective attention (i.e., feature-based selection vs. object-based selection). Experiment 1 extended the requirements of the visual search task by requiring a feature discrimination response to target elements presented for short durations (30-105 msec). Targets were embedded in 47 distractor elements and were defined by either a distinct color or a distinct orientation. Observers made a discrimination response to either the target's color or its orientation. When the target-defining feature and the feature to be discriminated were the same (matched conditions), accuracy was enhanced relative to when these features belonged to separate dimensions (mismatched conditions). In Experiment 2, similar results were found in a task in which the target-defining dimension varied from trial to trial and observers performed both color and orientation discriminations on every trial. The results from these two experiments are consistent with feature-based attentional selection, but not with object-based selection. Experiment 3 extended these findings by showing that the effect is rooted in the overlap between target and distractor values in the stimulus set. The results are discussed in the context of recent models of visual selective attention.

Long-range competition among the neurons projecting centrifugally to the quail retina

Birds have a well-developed centrifugal pathway from the isthmo-optic nucleus to the retina. In the present study, receptive-field properties of the isthmo-optic (IO) neurons and suppressive effect of remote stimuli far beyond the "classical" receptive fields were examined electrophysiologically in the Japanese quail. Receptive fields emitting more than half the maximal ON-OFF response to a small spot of light measured 4.3+/-1.9 deg (n = 37) in diameter. A stationary spot of light was presented at a remote point (35-76 deg) away from the receptive-field center, besides a stimulus for the receptive-field center, with various onset time difference. The peripheral spot, when turned on 50-100 ms before the center spot, maximally suppressed the ON and OFF responses to the center spot. In most of the IO neurons examined (13 out of 15 units), even small remote stimuli (2-5 deg in diameter) significantly suppressed the ON-OFF responses to the center stimulus. The suppressive effects of remote stimuli were seen to be extended to, at least, two thirds of the entire visual field of a single eye. Such wide suppressive fields indicate that the IO neurons may compete with each other for activity in a very long-range scale. Simulation using a simple static model based on three basic principles of processing of the centrifugal visual system-topographical input, long-range competition, and local gain enhancement-suggests that the system could function as an autonomous mechanism for attentional object selection.