Distractor Representations Research Articles

Manipulating attentional priority creates a trade-off between memory and sensory representations in human visual cortex.

People often remember visual information over brief delays while actively engaging with ongoing inputs from the surrounding visual environment. Depending on the situation, one might prioritize mnemonic contents (i.e., remembering details of a past event), or preferentially attend sensory inputs (i.e., minding traffic while crossing a street). Previous fMRI work has shown that early sensory regions can simultaneously represent both mnemonic and passively viewed sensory information. Here we test the limits of such simultaneity by manipulating attention towards sensory distractors during a working memory task performed by human subjects during fMRI scanning. Participants remembered the orientation of a target grating while a distractor grating was shown during the middle portion of the memory delay. Critically, there were several subtle changes in the contrast and the orientation of the distractor, and participants were cued to either ignore the distractor, detect a change in contrast, or detect a change in orientation. Despite sensory stimulation being matched in all three conditions, the fidelity of memory representations in early visual cortex was highest when the distractor was ignored, intermediate when participants attended distractor contrast, and lowest when participants attended the orientation of the distractor during the delay. In contrast, the fidelity of distractor representations was lowest when ignoring the distractor, intermediate when attending distractor-contrast, and highest when attending distractor-orientation. These data suggest a trade-off in early sensory representations when engaging top-down feedback to attend both seen and remembered features and may partially explain memory failures that occur when subjects are distracted by external events.

Goal-directed attention transforms both working and long-term memory representations in the human parietal cortex.

The abundance of distractors in the world poses a major challenge to our brain's limited processing capacity, but little is known about how selective attention modulates stimulus representations in the brain to reduce interference and support durable target memory. Here, we collected functional magnetic resonance imaging (fMRI) data in a selective attention task in which target and distractor pictures of different visual categories were simultaneously presented. Participants were asked to selectively process the target according to the effective cue, either before the encoding period (i.e., perceptual attention) or the maintenance period (i.e., reflective attention). On the next day, participants were asked to perform a memory recognition task in the scanner in which the targets, distractors, and novel items were presented in a pseudorandom order. Behavioral results showed that perceptual attention was better at enhancing target memory and reducing distractor memory than reflective attention, although the overall memory capacity (memory for both target and distractor) was comparable. Using multiple-voxel pattern analysis of the neural data, we found more robust target representation and weaker distractor representation in working memory for perceptual attention than for reflective attention. Interestingly, perceptual attention partially shifted the regions involved in maintaining the target representation from the visual cortex to the parietal cortex. Furthermore, the targets and distractors simultaneously presented in the perceptual attention condition showed reduced pattern similarity in the parietal cortex during retrieval compared to items not presented together. This neural pattern repulsion positively correlated with individuals' recognition of both targets and distractors. These results emphasize the critical role of selective attention in transforming memory representations to reduce interference and improve long-term memory performance.

Neural evidence for attentional capture by salient distractors.

Salient objects often capture our attention, serving as distractors and hindering our current goals. It remains unclear when and how salient distractors interact with our goals, and our knowledge on the neural mechanisms responsible for attentional capture is limited to a few brain regions recorded from non-human primates. Here we conducted a multivariate analysis on human intracranial signals covering most brain regions and successfully dissociated distractor-specific representations from target-arousal signals in the high-frequency (60-100 Hz) activity. We found that salient distractors were processed rapidly around 220 ms, while target-tuning attention was attenuated simultaneously, supporting initial capture by distractors. Notably, neuronal activity specific to the distractor representation was strongest in the superior and middle temporal gyrus, amygdala and anterior cingulate cortex, while there were smaller contributions from the parietal and frontal cortices. These results provide neural evidence for attentional capture by salient distractors engaging a much larger network than previously appreciated.

Learning to Reuse Distractors to Support Multiple-Choice Question Generation in Education

Multiple choice questions (MCQs) are widely used in digital learning systems, as they allow for automating the assessment process. However, due to the increased digital literacy of students and the advent of social media platforms, MCQ tests are widely shared online, and teachers are continuously challenged to create new questions, which is an expensive and time-consuming task. A particularly sensitive aspect of MCQ creation is to devise relevant distractors, i.e., wrong answers that are not easily identifiable as being wrong. This paper studies how a large existing set of manually created answers and distractors for questions over a variety of domains, subjects, and languages can be leveraged to help teachers in creating new MCQs, by the smart reuse of existing distractors. We built several data-driven models based on context-aware question and distractor representations, and compared them with static feature-based models. The proposed models are evaluated with automated metrics and in a realistic user test with teachers. Both automatic and human evaluations indicate that context-aware models consistently outperform a static feature-based approach. For our best-performing context-aware model, on average 3 distractors out of the 10 shown to teachers were rated as high-quality distractors. We create a performance benchmark, and make it public, to enable comparison between different approaches and to introduce a more standardized evaluation of the task. The benchmark contains a test of 298 educational questions covering multiple subjects & languages and a 77k multilingual pool of distractor vocabulary for future research.

Lingering distractor representations bias memory reports

Lingering distractor representations bias memory reports

Time Courses of Attended and Ignored Object Representations.

Selective attention prioritizes information that is relevant to behavioral goals. Previous studies have shown that attended visual information is processed and represented more efficiently, but distracting visual information is not fully suppressed, and may also continue to be represented in the brain. In natural vision, to-be-attended and to-be-ignored objects may be present simultaneously in the scene. Understanding precisely how each is represented in the visual system, and how these neural representations evolve over time, remains a key goal in cognitive neuroscience. In this study, we recorded EEG while participants performed a cued object-based attention task that involved attending to target objects and ignoring simultaneously presented and spatially overlapping distractor objects. We performed support vector machine classification on the stimulus-evoked EEG data to separately track the temporal dynamics of target and distractor representations. We found that (1) both target and distractor objects were decodable during the early phase of object processing (∼100 msec to ∼200 msec after target onset), and (2) the representations of both objects were sustained over time, remaining decodable above chance until ∼1000-msec latency. However, (3) the distractor object information faded significantly beginning after about 300-msec latency. These findings provide information about the fate of attended and ignored visual information in complex scene perception.

Target-Distractor Aware Deep Tracking With Discriminative Enhancement Learning Loss

Numerous tracking approaches attempt to improve target representation through target-aware or distractor-aware. However, the unbalanced considerations of target or distractor information make it diffcult for these methods to benefit from the two aspects at the same time. In this paper, we propose a target-distractor aware model with discriminative enhancement learning loss to learn target representation, which can better distinguish the target in complex scenes. Firstly, to enlarge the gap between the target and distractor, we design a discriminative enhancement learning loss. By highlighting the hard negatives that are similar to the target and shrinking the easy negatives that are pure background, the features sensitive to the target or distractor representation can be more conveniently mined. On this basis, we further propose a target-distractor aware model. Unlike existing methods of preference target or distractor, we construct the target-specific feature space by activating the target-sensitive and the distractor-silence feature. Therefore, the appearance model can not only represent the target well but also suppress the background distractor. Finally, the target-distractor aware target representation model is integrated with a Siamese matching network for visual tracking for achieving robust and realtime visual tracking. Extensive experiments are performed on eight tracking benchmarks show that the proposed algorithm achieves favorable performance.

Integrated neural dynamics for behavioural decisions and attentional competition in the prefrontal cortex.

In the behaving monkey, complex neural dynamics in the prefrontal cortex contribute to context-dependent decisions and attentional competition. We used demixed principal component analysis to track prefrontal activity dynamics in a cued target detection task. In this task, the animal combined identity of a visual object with a prior instruction cue to determine a target/nontarget decision. From population activity, we extracted principal components for each task feature and examined their time course and sensitivity to stimulus and task variations. For displays containing a single choice object in left or right hemifield, object identity, cue identity and decision were all encoded in population activity, with different dynamics and lateralisation. Object information peaked at 100-200 ms from display onset and was largely confined to the contralateral hemisphere. Cue information was weaker and present even prior to display onset. Integrating information from cue and object, decision information arose more slowly and was bilateral. Individual neurons contributed independently to coding of the three task features. The analysis was then extended to displays with a target in one hemifield and a competing distractor in the other. In this case, the data suggest that each hemisphere initially encoded the identity of the contralateral object. The distractor representation was then rapidly suppressed, with the final target decision again encoded bilaterally. The results show how information is coded along task-related dimensions while competition is resolved and suggest how information flows within and across frontal lobes to implement a learned behavioural decision.

Attention modulates the contextual similarity effect in negative priming: evidence from task demand and attentional capture

ABSTRACT Negative priming refers to the delayed response to a probe target that was previously a prime distractor. Memory retrieval has been proposed as one critical mechanism for the manifestation of negative priming. This perspective perpetuates that the contextual similarity between prime and probe trials should modulate memory retrieval, and therefore, affect negative priming. However, evidence for the contextual similarity effect in negative priming is mixed. The present study tested the hypothesis that attended contextual cues are more likely to be encoded into a distractor representation, and thus, are more likely to modulate the negative priming effect. By manipulating whether the contextual cues were relevant to the task demand in Section 1, and by manipulating whether cues had an abrupt or simultaneous onset, and by analysing reaction time (RT) distributions of the data in Section 2, our results demonstrated that attended cues produced the contextual similarity effect in negative priming, especially when RTs were long.

Representational dynamics preceding conscious access

Our senses are continuously bombarded with more information than our brain can process up to the level of awareness. The present study aimed to enhance understanding on how attentional selection shapes conscious access under conditions of rapidly changing input. Using an attention task, EEG, and multivariate decoding of individual target- and distractor-defining features, we specifically examined dynamic changes in the representation of targets and distractors as a function of conscious access and the task-relevance (target or distractor) of the preceding item in the RSVP stream. At the behavioral level, replicating previous work and suggestive of a flexible gating mechanism, we found a significant impairment in conscious access to targets (T2) that were preceded by a target (T1) followed by one or two distractors (i.e., the attentional blink), but striking facilitation of conscious access to targets shown directly after another target (i.e., lag-1 sparing and blink reversal). At the neural level, conscious access to T2 was associated with enhanced early- and late-stage T1 representations and enhanced late-stage D1 representations, and interestingly, could be predicted based on the pattern of EEG activation well before T1 was presented. Yet, across task conditions, we did not find convincing evidence for the notion that conscious access is affected by rapid top-down selection-related modulations of the strength of early sensory representations induced by the preceding visual event. These results cannot easily be explained by existing accounts of how attentional selection shapes conscious access under rapidly changing input conditions, and have important implications for theories of the attentional blink and consciousness more generally.

Effects of transcranial magnetic stimulation over the left posterior superior temporal gyrus on picture-word interference.

Word-production theories argue that during language production, a concept activates multiple lexical candidates in left temporal cortex, and the intended word is selected from this set. Evidence for theories on spoken-word production comes, for example, from the picture-word interference task, where participants name pictures superimposed by congruent (e.g., picture: rabbit, distractor "rabbit"), categorically related (e.g., distractor "sheep"), or unrelated (e.g., distractor "fork") words. Typically, whereas congruent distractors facilitate naming, related distractors slow down picture naming relative to unrelated distractors, resulting in semantic interference. However, the neural correlates of semantic interference are debated. Previous neuroimaging studies have shown that the left mid-to-posterior STG (pSTG) is involved in the interference associated with semantically related distractors. To probe the functional relevance of this area, we targeted the left pSTG with focal repetitive transcranial magnetic stimulation (rTMS) while subjects performed a picture-word interference task. Unexpectedly, pSTG stimulation did not affect the semantic interference effect but selectively increased the congruency effect (i.e., faster naming with congruent distractors). The facilitatory TMS effect selectively occurred in the more difficult list with an overall lower name agreement. Our study adds new evidence to the causal role of the left pSTG in the interaction between picture and distractor representations or processing streams, only partly supporting previous neuroimaging studies. Moreover, the observed unexpected condition-specific facilitatory rTMS effect argues for an interaction of the task- or stimulus-induced brain state with the modulatory TMS effect. These issues should be systematically addressed in future rTMS studies on language production.

Changes in visual cortical processing attenuate singleton distraction during visual search

The ability to suppress distractions is essential to successful completion of goal-directed behaviors. Several behavioral studies have recently provided strong evidence that learned suppression may be particularly efficient in reducing distractor interference. Expectations about a distractor's repeated location, color, or even presence are rapidly learned and used to attenuate interference. In this study, we use a visual search paradigm in which a color singleton, which is known to capture attention, occurs within blocks with high or low frequency. The behavioral results show reduced singleton interference during the high compared to the low frequency block (Won et al., 2019). The fMRI results provide evidence that the attenuation of distractor interference is supported by changes in singleton, target, and non-salient distractor representations within retinotopic visual cortex. These changes in visual cortex are accompanied by findings that singleton-present trials compared to non-singleton trials produce greater activation in bilateral parietal cortex, indicative of attentional capture, in low frequency, but not high frequency blocks. Together, these results suggest that the readout of saliency signals associated with an expected color singleton from visual cortex is suppressed, resulting in less competition for attentional priority in frontoparietal attentional control regions.

A simple rule to describe interactions between visual categories.

Humans can rapidly categorise visual objects when presented in isolation. However, in everyday life we encounter multiple objects at the same time. Far less is known about how simultaneously active object representations interact. We examined such interactions by asking participants to categorise a target object at the basic (Experiment 1) or the superordinate (Experiment 2) level while the representation of another object was still active. We found that the "prime" object strongly modulated the response to the target implying that the prime's category was rapidly and automatically accessed, influencing subsequent categorical processing. Using drift diffusion modelling, we show that a prime, whose category is different from that of the target, interferes with target processing primarily during the evidence accumulation stage. This suggests that the state of category-processing neurons is altered by an active representation and this modifies the processing of other categories. Interestingly, the strength of interference increases with the similarity between the distractor and the target category. Considering these results and previous studies, we propose a general principle that category interactions are determined by the distance from a distractor's representation to the target's task-relevant categorical boundary. We argue that this principle arises from the specific architectural organisation of categories in the brain.

Inhibition in selective attention.

Our ability to focus on goal‐relevant aspects of the environment is critically dependent on our ability to ignore or inhibit distracting information. One perspective is that distractor inhibition is under similar voluntary control as attentional facilitation of target processing. However, a rapidly growing body of research shows that distractor inhibition often relies on prior experience with the distracting information or other mechanisms that need not rely on active representation in working memory. Yet, how and when these different forms of inhibition are neurally implemented remains largely unclear. Here, we review findings from recent behavioral and neuroimaging studies to address this outstanding question. We specifically explore how experience with distracting information may change the processing of that information in the context of current predictive processing views of perception: by modulating a distractor's representation already in anticipation of the distractor, or after integration of top‐down and bottom‐up sensory signals. We also outline directions for future research necessary to enhance our understanding of how the brain filters out distracting information.

Value-driven attentional capture enhances distractor representations in early visual cortex.

When a behaviorally relevant stimulus has been previously associated with reward, behavioral responses are faster and more accurate compared to equally relevant but less valuable stimuli. Conversely, task-irrelevant stimuli that were previously associated with a high reward can capture attention and distract processing away from relevant stimuli (e.g., seeing a chocolate bar in the pantry when you are looking for a nice, healthy apple). Although increasing the value of task-relevant stimuli systematically up-regulates neural responses in early visual cortex to facilitate information processing, it is not clear whether the value of task-irrelevant distractors influences behavior via competition in early visual cortex or via competition at later stages of decision-making and response selection. Here, we measured functional magnetic resonance imaging (fMRI) in human visual cortex while subjects performed a value-based learning task, and we applied a multivariate inverted encoding model (IEM) to assess the fidelity of distractor representations in early visual cortex. We found that the fidelity of neural representations related to task-irrelevant distractors increased when the distractors were previously associated with a high reward. This finding suggests that value-driven attentional capture begins with sensory modulations of distractor representations in early areas of visual cortex.

Strategic deployment of feature-based attentional gain in primate visual cortex

Attending to visual stimuli enhances the gain of those neurons in primate visual cortex that preferentially respond to the matching locations and features (on-target gain). Although this is well suited to enhance the neuronal representation of attended stimuli, it is nonoptimal under difficult discrimination conditions, as in the presence of similar distractors. In such cases, directing attention to neighboring neuronal populations (off-target gain) has been shown to be the most efficient strategy, but although such a strategic deployment of attention has been shown behaviorally, its underlying neural mechanisms are unknown. Here, we investigated how attention affects the population responses of neurons in the middle temporal (MT) visual area of rhesus monkeys to bidirectional movement inside the neurons’ receptive field (RF). The monkeys were trained to focus their attention onto the fixation spot or to detect a direction or speed change in one of the motion directions (the “target”), ignoring the distractor motion. Population activity profiles were determined by systematically varying the patterns’ directions while maintaining a constant angle between them. As expected, the response profiles show a peak for each of the 2 motion directions. Switching spatial attention from the fixation spot into the RF enhanced the peak representing the attended stimulus and suppressed the distractor representation. Importantly, the population data show a direction-dependent attentional modulation that does not peak at the target feature but rather along the slopes of the activity profile representing the target direction. Our results show that attentional gains are strategically deployed to optimize the discriminability of target stimuli, in line with an optimal gain mechanism proposed by Navalpakkam and Itti.

Disentangling inhibition-based and retrieval-based aftereffects of distractors: Cognitive versus motor processes.

Selective attention refers to the ability to selectively act upon relevant information at the expense of irrelevant information. Yet, in many experimental tasks, what happens to the representation of the irrelevant information is still debated. Typically, 2 approaches to distractor processing have been suggested, namely distractor inhibition and distractor-based retrieval. However, it is also typical that both processes are hard to disentangle. For instance, in the negative priming literature (for a review Frings, Schneider, & Fox, 2015) this has been a continuous debate since the early 1980s. In the present study, we attempted to prove that both processes exist, but that they reflect distractor processing at different levels of representation. Distractor inhibition impacts stimulus representation, whereas distractor-based retrieval impacts mainly motor processes. We investigated both processes in a distractor-priming task, which enables an independent measurement of both processes. For our argument that both processes impact different levels of distractor representation, we estimated the exponential parameter (τ) and Gaussian components (μ, σ) of the exponential Gaussian reaction-time (RT) distribution, which have previously been used to independently test the effects of cognitive and motor processes (e.g., Moutsopoulou & Waszak, 2012). The distractor-based retrieval effect was evident for the Gaussian component, which is typically discussed as reflecting motor processes, but not for the exponential parameter, whereas the inhibition component was evident for the exponential parameter, which is typically discussed as reflecting cognitive processes, but not for the Gaussian parameter. (PsycINFO Database Record

Prefrontal Control of Visual Distraction

Avoiding distraction by conspicuous but irrelevant stimuli is critical to accomplishing daily tasks. Regions of prefrontal cortex control attention by enhancing the representation of task-relevant information in sensory cortex, which can be measured in modulation of both single neurons and event-related electrical potentials (ERPs) on the cranial surface [1, 2]. When irrelevant information is particularly conspicuous, it can distract attention and interfere with the selection of behaviorally relevant information. Such distraction can be minimized via top-down control [3-5], but the cognitive and neural mechanisms giving rise to this control over distraction remain uncertain and debated [6-9]. Bridging neurophysiology to electrophysiology, we simultaneously recorded neurons in prefrontal cortex and ERPs over extrastriate visual cortex to track the processing of salient distractors during a visual search task. Critically, when the salient distractor was successfully ignored, but not otherwise, we observed robust suppression of salient distractor representations. Like target selection, the distractor suppression was observed in prefrontal cortex before it appeared over extrastriate cortical areas. Furthermore, all prefrontal neurons that showed suppression of the task-irrelevant distractor also contributed to selecting the target. This suggests a common prefrontal mechanism is responsible for both selecting task-relevant and suppressing task-irrelevant information in sensory cortex. Taken together, our results resolve a long-standing debate over the mechanisms that prevent distraction, and provide the first evidence directly linking suppressed neural firing in prefrontal cortex with surface ERP measures of distractor suppression.

Protecting visual short-term memory during maintenance: Attentional modulation of target and distractor representations

In the presence of distraction, attentional filtering is a key predictor of efficient information storage in visual short-term memory (VSTM). Yet, the role of attention in distractor filtering, and the extent to which attentional filtering continues to protect information during post-perceptual stages of VSTM, remains largely unknown. In the current study, we investigated the role of spatial attention in distractor filtering during VSTM encoding and maintenance. Participants performed a change detection task with varying distractor load. Attentional deployment to target and distractor locations was tracked continuously by means of Steady-State Visual Evoked Potentials (SSVEPs). Analyses revealed that attention strongly modulated the amplitude of the second harmonic SSVEP response, with larger amplitudes at target compared to distractor locations. These attentional modulations commenced during encoding, and remained present during maintenance. Furthermore, the amount of attention paid to distractor locations was directly related to behavioral distractor costs: Individuals who paid more attention to target compared to distractor locations during VSTM maintenance generally suffered less from the presence of distractors. Together, these findings support an important role of spatial attention in distractor filtering at multiple stages of VSTM, and highlight the usefulness of SSVEPs in continuously tracking attention to multiple locations during VSTM.

Degradation of neural representations in higher visual cortex by sleep deprivation

A night of total sleep deprivation (TSD) impairs selective attention and is accompanied by attenuated activation within ventral visual cortex (VVC). However, finer details of how TSD compromises selectivity of visual processing remain unclear. Drawing from prior work in cognitive aging, we predicted that TSD would result in dedifferentiation of neural responses for faces and houses within the VVC. Instead, we found preservation of category selectivity. This was observed both in voxels highly selective for each category, and also across multiple voxels evaluated using MVPA. Based on prior findings of impaired attentional modulation following TSD, we also predicted reduced biasing of neural representations towards the attended category when participants viewed ambiguous face/house images. When participants were well rested, attention to houses (or faces) caused activation patterns to more closely resemble those elicited by isolated house (face) images than face (house) images. During TSD, attention to faces enhanced neural similarity to both target (face) and distractor (house) representations, signifying reduced suppression of irrelevant information. Degraded sensory processing reflected in reduced VVC activation following TSD, thus appears to be a result of impaired top-down modulation of sensory representations instead of degraded selectivity of maximally category sensitive voxels, or the dedifferentiation of neural activation patterns.