Contents Of Visual Working Memory Research Articles

Neural and behavioral evidence for an online resetting process in visual working memory

Visual working memory (VWM) guides behavior by holding a set of active representations and modifying them according to changes in the environment. This updating process relies on a unique mapping between each VWM representation and an actual object in the environment. Here, we destroyed this mapping by either presenting a coherent object but then breaking it into independent parts or presenting an object but then abruptly replacing it with a different object. This allowed us to introduce the neural marker and behavioral consequence of an online resetting process in humans9 VWM. Across seven experiments, we demonstrate that this resetting process involves abandoning the old VWM contents because they no longer correspond to the objects in the environment. Then, VWM encodes the novel information and reestablishes the correspondence between the new representations and the objects. The resetting process was marked by a unique neural signature: a sharp drop in the amplitude of the electrophysiological index of VWM contents (the contralateral delay activity), presumably indicating the loss of the existent object-to-representation mappings. This marker was missing when an updating process occurred. Moreover, when tracking moving items, VWM failed to detect salient changes in the object9s shape when these changes occurred during the resetting process. This happened despite the object being fully visible, presumably because the mapping between the object and a VWM representation was lost. Importantly, we show that resetting, its neural marker, and the behavioral cost it entails, are specific to situations that involve a destruction of the objects-to-representations correspondence. SIGNIFICANCE STATEMENT Visual working memory (VWM) maintains task-relevant information in an online state. Previous studies showed that VWM representations are accessed and modified after changes in the environment. Here, we show that this updating process critically depends on an ongoing mapping between the representations and the objects in the environment. When this mapping breaks, VWM cannot access the old representations and instead resets. The novel resetting process that we introduce removes the existing representations instead of modifying them and this process is accompanied by a unique neural marker. During the resetting process, VWM was blind to salient changes in the object9s shape. The resetting process highlights the flexibility of our cognitive system in handling the dynamic environment by abruptly abandoning irrelevant schemas.

Tuning perception: Visual working memory biases the quality of visual awareness.

Studies of consciousness reveal that it is possible to manipulate subjective awareness of a visual stimulus. For example, items held in visual working memory (VWM) that match target features increase the speed with which the target reaches visual awareness. To examine the effect of VWM on perception, previous studies have mainly used coarse measures of awareness, such as present/absent or forced-choice judgments. These methods can reveal whether or not an individual has seen an item, but they do not provide information about the quality with which the item was seen. Using continuous report methods it has been shown that the fidelity of a perceived item can be affected by whether or not that item is masked. In the present study, we used an object-substitution masking task to examine whether items held in VWM would influence the quality with which a masked target reached awareness, or whether the threshold for awareness was instead affected by stimuli held in memory. We observed that targets matching the contents of VWM were recalled with greater precision compared to items that did not match the contents of VWM. Importantly, this effect occurred without affecting the likelihood of the target being perceived. These results suggest that VWM plays a greater role in modulating the fidelity of perceived representations than in lowering the overall threshold of awareness.

Visual working memory simultaneously guides facilitation and inhibition during visual search.

During visual search, visual working memory (VWM) supports the guidance of attention in two ways: It stores the identity of the search target, facilitating the selection of matching stimuli in the search array, and it maintains a record of the distractors processed during search so that they can be inhibited. In two experiments, we investigated whether the full contents of VWM can be used to support both of these abilities simultaneously. In Experiment 1, participants completed a preview search task in which (a) a subset of search distractors appeared before the remainder of the search items, affording participants the opportunity to inhibit them, and (b) the search target varied from trial to trial, requiring the search target template to be maintained in VWM. We observed the established signature of VWM-based inhibition-reduced ability to ignore previewed distractors when the number of distractors exceeds VWM's capacity-suggesting that VWM can serve this role while also representing the target template. In Experiment 2, we replicated Experiment 1, but added to the search displays a singleton distractor that sometimes matched the color (a task-irrelevant feature) of the search target, to evaluate capture. We again observed the signature of VWM-based preview inhibition along with attentional capture by (and, thus, facilitation of) singletons matching the target template. These findings indicate that more than one VWM representation can bias attention at a time, and that these representations can separately affect selection through either facilitation or inhibition, placing constraints on existing models of the VWM-based guidance of attention.

Feature-based and spatial attentional selection in visual working memory.

The contents of visual working memory (VWM) can be modulated by spatial cues presented during the maintenance interval ("retrocues"). Here, we examined whether attentional selection of representations in VWM can also be based on features. In addition, we investigated whether the mechanisms of feature-based and spatial attention in VWM differ with respect to parallel access to noncontiguous locations. In two experiments, we tested the efficacy of valid retrocues relying on different kinds of information. Specifically, participants were presented with a typical spatial retrocue pointing to two locations, a symbolic spatial retrocue (numbers mapping onto two locations), and two feature-based retrocues: a color retrocue (a blob of the same color as two of the items) and a shape retrocue (an outline of the shape of two of the items). The two cued items were presented at either contiguous or noncontiguous locations. Overall retrocueing benefits, as compared to a neutral condition, were observed for all retrocue types. Whereas feature-based retrocues yielded benefits for cued items presented at both contiguous and noncontiguous locations, spatial retrocues were only effective when the cued items had been presented at contiguous locations. These findings demonstrate that attentional selection and updating in VWM can operate on different kinds of information, allowing for a flexible and efficient use of this limited system. The observation that the representations of items presented at noncontiguous locations could only be reliably selected with feature-based retrocues suggests that feature-based and spatial attentional selection in VWM rely on different mechanisms, as has been shown for attentional orienting in the external world.

Memory-based attentional capture by colour and shape contents in visual working memory

ABSTRACTCurrent theories assume that there is substantial overlap between visual working memory (VWM) and visual attention functioning, such that active representations in VWM automatically act as an attentional set, resulting in attentional biases towards objects that match the mnemonic content. Most evidence for this comes from visual search tasks in which a distractor similar to the memory interferes with the detection of a simultaneous target. Here we provide additional evidence using one of the most popular paradigms in the literature for demonstrating an active attentional set: The contingent spatial orienting paradigm of Folk and colleagues. This paradigm allows memory-based attentional biases to be more directly attributed to spatial orienting. Experiment 1 demonstrated a memory-contingent spatial attention effect for colour but not for shape contents of VWM. Experiment 2 tested the hypothesis that the placeholders used for spatial cueing interfered with the shape processing, and showed that memory-based attentional capture for shape returned when placeholders were removed. The results of the present study are consistent with earlier findings from distractor interference paradigms, and provide additional evidence that biases in spatial orienting contribute to memory-based influences on attention.

Ventral fronto-parietal contributions to the disruption of visual working memory storage

The ability to maintain information in visual working memory (VWM) in the presence of ongoing visual input allows for flexible goal-directed behavior. Previous evidence suggests that categorical overlap between visual distractors and the contents of VWM is associated with both the degree to which distractors disrupt VWM performance and activation among fronto-parietal regions of cortex. While within-category distractors have been shown to elicit a greater response in ventral fronto-parietal regions, to date, no study has linked distractor-evoked response of these regions to VWM performance costs. Here we examined the contributions of ventral fronto-parietal cortex to the disruption of VWM storage by manipulating memoranda–distractor similarity. Our results revealed that the degree of activation across cortex was graded in a manner suggesting that similarity between the contents of VWM and visual distractors influenced distractor processing. While abrupt visual onsets failed to engage ventral fronto-parietal regions during VWM maintenance, objects sharing categorical- (Related objects) and feature-overlap (Matched objects) with VWM elicited a significant response in the right TPJ and right AI. Of central relevance, the magnitude of activation in the right AI elicited by both types of distractor objects subsequently predicted costs to binding change detection accuracy. In addition, Related and Matched distractors differentially affected ventral–dorsal connectivity between the right AI and dorsal parietal regions, uniquely contributing to disruption of VWM storage. Together, our current results implicate activation of ventral fronto-parietal cortex in disruption of VWM storage, and disconnection between ventral frontal and dorsal parietal cortices as a mechanism to protect the contents of VWM.

Inhibition has negative affective consequences for task-irrelevant stimuli that are similar to the active contents of visual working memory

Ignoring a visual stimulus causes it to subsequently receive more negative affective ratings than novel items or prior targets of attention. This has been taken as evidence that attentional inhibition alters the coding of stimulus-associated value to ensure that previously distracting stimuli can be effectively avoided in future encounters. Previous results have suggested that this ‘inhibitory devaluation’ effect may operate through affective associations with specific perceptual features that allow distractors to be differentiated from targets. Prior inhibition can thereby impact the affective value both of specific items that have appeared as distractors and of novel items that share a previously ignored feature. But what happens when a distractor shares the same perceptual features as a target being held in visual working memory? Recent electrophysiological evidence suggests that while the similarity may initially cause selective attention to be biased toward such task-irrelevant items, active inhibition may then be triggered to prevent them from interfering with the ongoing task. If inhibition causes affective devaluation, then such findings predict greater devaluation of task-irrelevant stimuli that share the same perceptual features as a target being held in visual working memory than those that do not. To test this, we utilized delayed-match-to-sample trials that required participants to maintain a uniquely-coloured stimulus in working memory while task-irrelevant probe arrays were presented. The probe arrays contained abstract shapes whose colour either matched or did not match that of the stimulus being held in memory. Subsequent affective-evaluation trials revealed that prior memory-matching distractors received more negative ratings than non-matching distractors or a set of previously-unseen shapes. These results converge with prior electrophysiological evidence to suggest that distractors matching the contents of visual working memory are subjected to greater levels of attentional inhibition than other task-irrelevant stimuli, and that the consequences of this inhibition include alterations in affective value. Meeting abstract presented at VSS 2015

A new model for the contents of visual working memory.

A new model for the contents of visual working memory.

The working memory Ponzo illusion: Involuntary integration of visuospatial information stored in visual working memory

Visual working memory (VWM) has been traditionally viewed as a mental structure subsequent to visual perception that stores the final output of perceptual processing. However, VWM has recently been emphasized as a critical component of online perception, providing storage for the intermediate perceptual representations produced during visual processing. This interactive view holds the core assumption that VWM is not the terminus of perceptual processing; the stored visual information rather continues to undergo perceptual processing if necessary. The current study tests this assumption, demonstrating an example of involuntary integration of the VWM content, by creating the Ponzo illusion in VWM: when the Ponzo illusion figure was divided into its individual components and sequentially encoded into VWM (so that the four lines in Ponzo figure components were never simultaneously presented), the temporally separated components were involuntarily integrated, leading to the distorted length perception of the two horizontal lines. This VWM Ponzo illusion was replicated when the figure components were presented in different combinations and presentation order. The magnitude of the illusion was significantly correlated between VWM and perceptual versions of the Ponzo illusion. These results suggest that the information integration underling the VWM Ponzo illusion is constrained by the laws of visual perception and similarly affected by the common individual factors that govern its perception. Thus, our findings provide compelling evidence that VWM functions as a buffer serving perceptual processes at early stages. Meeting abstract presented at VSS 2015

The working memory Ponzo illusion: Involuntary integration of visuospatial information stored in visual working memory

Visual working memory (VWM) has been traditionally viewed as a mental structure subsequent to visual perception that stores the final output of perceptual processing. However, VWM has recently been emphasized as a critical component of online perception, providing storage for the intermediate perceptual representations produced during visual processing. This interactive view holds the core assumption that VWM is not the terminus of perceptual processing; the stored visual information rather continues to undergo perceptual processing if necessary. The current study tests this assumption, demonstrating an example of involuntary integration of the VWM content, by creating the Ponzo illusion in VWM: when the Ponzo illusion figure was divided into its individual components and sequentially encoded into VWM, the temporally separated components were involuntarily integrated, leading to the distorted length perception of the two horizontal lines. This VWM Ponzo illusion was replicated when the figure components were presented in different combinations and presentation order. The magnitude of the illusion was significantly correlated between VWM and perceptual versions of the Ponzo illusion. These results suggest that the information integration underling the VWM Ponzo illusion is constrained by the laws of visual perception and similarly affected by the common individual factors that govern its perception. Thus, our findings provide compelling evidence that VWM functions as a buffer serving perceptual processes at early stages.

Visual working memory modulates within-object metrics of saccade landing position.

In two experiments, we examined the influence of visual working memory (VWM) on oculomotor selection, testing whether the landing positions of rapidly generated saccades are biased toward the region of an object that matches a feature held in VWM. Participants executed a saccade to the center of a single saccade target, divided into two colored regions and presented on the horizontal midline. Concurrently, participants maintained a color in VWM for an unrelated memory task. This color either matched one of the two regions or neither of the regions. Relative to the no-match baseline, the landing positions of rapidly generated saccades (mean latency < 150 ms) were biased toward the region that matched the remembered color. The results support the hypothesis that VWM modulates early, spatially organized sensory representations to bias selection toward locations with features that match VWM content. In addition, the results demonstrate that saccades to spatially extended objects are sensitive to within-object differences in salience.

Rapid influences of cued visual memories on attentional guidance.

There is evidence that the deployment of attention can be biased by the content of visual working memory. Recently, it has been shown that focusing internal attention to a specific item in memory not only increases the accessibility of that specific item for retrieval, but also results in increased attentional guidance toward matching external stimuli by that item. Here, we investigated the time course of attentional guidance by cued memories. Following a retro-cue that prioritized one of two memory items, participants performed a visual search task. The interval between the cue and the search display was varied. Consistent with earlier findings, we observed memory-related capture when the search display contained a distractor that was related to the cued item in memory. No such effects were found for the uncued items or when none of the memory items were prioritized by a retro-cue. Results suggest that the prioritization by a retro-cue is a very rapid process that starts to affect perceptual selection within the first 100-200 ms following the cue.

Gamma Oscillations Underlie the Maintenance of Feature-Specific Information and the Contents of Visual Working Memory.

Visual working memory (VWM) sustains information online as integrated object representations. Neuronal mechanisms supporting the maintenance of feature-specific information have remained unidentified. Synchronized oscillations in the gamma band (30-120 Hz) characterize VWM retention and predict task performance, but whether these oscillations are specific to memorized features and VWM contents or underlie general executive VWM functions is not known. In the present study, we investigated whether gamma oscillations reflect the maintenance of feature-specific information in VWM. Concurrent magneto- and electroencephalography was recorded while subjects memorized different object features or feature conjunctions in identical VWM experiments. Using a data-driven source analysis approach, we show that the strength, load-dependence, and source topographies of gamma oscillations in the visual cortex differentiate these memorized features. Load-dependence of gamma oscillations in feature-specific visual and prefrontal areas also predicts VWM accuracy. Furthermore, corroborating the hypothesis that gamma oscillations support the perceptual binding of feature-specific neuronal assemblies, we also show that VWM for color-location conjunctions is associated with stronger gamma oscillations than that for these features separately. Gamma oscillations hence support the maintenance of feature-specific information and reflect VWM contents. The results also suggest that gamma oscillations contribute to feature binding in the formation of memory representations.

Invalid retro-cues can eliminate the retro-cue benefit: Evidence for a hybridized account.

The contents of visual working memory (VWM) are capacity limited and require frequent updating. The retrospective cueing (retro-cueing) paradigm clarifies how directing internal attention among VWM items boosts VWM performance. In this paradigm a cue appears prior to retrieval, but after encoding and maintenance. The retro-cue effect (RCE) refers to superior VWM after valid versus neutral retro-cues. Here we investigated the effect of the invalid retro-cues' inclusion on VWM performance. We conducted 2 pairs of experiments, changing both probe type (recognition and recall) as well as presence and absence of invalid retro-cue trials. Furthermore, to fully characterize these effects over time, we used extended post-retro-cue delay durations. In the first set of experiments, probing VWM using recognition indicated that the RCE remained consistent in magnitude with or without invalid retro-cue trials. In the second set of experiments, VWM was probed with recall. Here, the RCE was eliminated when invalid retro-cues were included. This finer-grained measure of VWM fidelity showed that all items were subject to decay over time. We conclude that the invalid retro-cues impaired the protection of validly cues items, but they remain accessible, suggesting greater concordance with a prioritization account.

Probability of guessing, not precision, changes in mixture models of visual working memory during cognitive control of attentional guidance

The contents of visual working memory (WM) have been found to guide visual attention towards memory-matching objects, but only sometimes (see Olivers, Peters, Houtkamp, & Roelfsema, 2011; Soto, Hod...

Perception during binocular rivalry is biased by the content of visual working memory.

Perception during binocular rivalry is biased by the content of visual working memory.

Perception during binocular rivalry is biased by the content of visual working memory

Perception during binocular rivalry is biased by the content of visual working memory

Words, shape, visual search and visual working memory in 3‐year‐old children

Do words cue children's visual attention, and if so, what are the relevant mechanisms? Across four experiments, 3-year-old children (N = 163) were tested in visual search tasks in which targets were cued with only a visual preview versus a visual preview and a spoken name. The experiments were designed to determine whether labels facilitated search times and to examine one route through which labels could have their effect: By influencing the visual working memory representation of the target. The targets and distractors were pictures of instances of basic-level known categories and the labels were the common name for the target category. We predicted that the label would enhance the visual working memory representation of the target object, guiding attention to objects that better matched the target representation. Experiments 1 and 2 used conjunctive search tasks, and Experiment 3 varied shape discriminability between targets and distractors. Experiment 4 compared the effects of labels to repeated presentations of the visual target, which should also influence the working memory representation of the target. The overall pattern fits contemporary theories of how the contents of visual working memory interact with visual search and attention, and shows that even in very young children heard words affect the processing of visual information.

视觉工作记忆内容引导情绪面孔的视觉搜索

本文通过采用记忆任务和视觉搜索任务相结合的方式，以简笔画情绪面孔为材料，探讨了视觉工作记忆内容对情绪面孔视觉搜索的影响。结果发现：不同工作记忆内容条件下对情绪面孔搜索的反应时存在显著差异，对两种情绪面孔搜索的反应时在无效信息条件下显著慢于有效信息条件下。结果表明，工作记忆内容能够引导情绪面孔的视觉搜索,实验结果拓展了偏向竞争理论模型的适用范围。 With the combined memory task and visual search paradigm, this study aimed to discuss the influence of contents of visual working memory to visual search of emotional faces. The results showed that the effect of the contents of visual working memory was significant. And the RTs were significantly longer in the invalid condition than in the valid condition for not only happy face but also angry face. The results suggested that the information which was maintained in visual working memory could affect the visual search efficiency of emotional faces. The findings broaden biased competition model.

In competition for the attentional template: can multiple items within visual working memory guide attention?

Recent studies have revealed that the deployment of attention can be biased by the content of visual working memory (VWM), but that stored memories do not always interact with attention. This has led to a model which proposes a division within VWM between a single active template that interacts with perception and multiple accessory representations that do not. The present study was designed to study whether multiple memory representations are able to bias attention. Participants performed a visual search task while maintaining a variable number of colors in VWM. Consistent with earlier findings, we observed increased attentional capture by memory related distractors when VWM was filled with a single item. However, memory related capture was no longer present for memory loads beyond a single item. The absence of memory related capture at higher VWM loads was independent of individual VWM capacity, nor was it attributable to weaker encoding, forgetting, or reduced precision of memory representations. When analyses were limited to those trials in which participants had a relatively precise memory, there was still no sign of attentional guidance at higher loads. However, when observers were cued toward a specific memory item after encoding, interference with search returned. These results are consistent with a distinction within VWM between representations that interact with perception and those that do not, and show that only a single VWM representation at a time can interact with visual attention.