Visual Working Memory Representations Research Articles

Assessing the interaction between working memory and perception through time.

Content maintained in visual working memory changes concurrent visual processing, suggesting that visual working memory may recruit an overlapping neural representation with visual perception. However, it remains unclear whether visual working memory representations persist as a sensory code through time, or are recoded later into an abstract code. Here, we directly contrasted a temporal decay + visual code account and a temporal decay + abstract code account within the temporal dynamics of the interaction between working memory and perception. By manipulating the ISI (inter-stimulus interval) between working memory encoding and a perceptual discrimination task, we found that task-relevant and therefore actively maintained perceptual information parametrically altered participants' ability to discriminate perceptual stimuli even 4 s after encoding, whereas task-irrelevant information caused only an acutely transient effect. While continuously present, the size of this shift in discrimination thresholds gradually decreased over time. Concomitantly, the size of the bias in working memory reports increased over time. The opposing directions of threshold and bias effects are consistent with the local maintenance of information in perceptual areas, explained by a temporal decay + visual code account. As the maintained representation decays over time, its ability to alter incoming perceptual signals decreases (reduced threshold effects) while its likelihood of being impacted by those same signals increases (increased bias effects).Altogether, these results suggest that the readout of working memory relies on a sensory representation at a cost of increased interference by ongoing perception.

Alternating capture of attention by multiple visual working memory representations

Can we look for multiple objects simultaneously? Previous studies have proposed that the representation of an item in visual working memory (VWM) can bias the deployment of attention to memory-matching items in visual search. However, it is still controversial whether multiple VWM item representations are able to capture attention. In the present study, we adopted an eye-tracking technique to reveal this issue. In Experiment 1, we replicated Chen and Du’s Experiment 2 and adopted an eye-tracking technique to determine whether multiple VWM item representations are able to bias attention. In Chen and Du’s paradigm, the memory test was always followed by the search test, and the participants might intentionally prepare for the search task, which can affect the results of the research. Thus, in Experiment 2, we prevented participants from predicting the temporal occurrence of the visual search task by randomly conducting a search test or a memory test after memoranda. The findings of the present study suggested that only one working memory item at a time influences attention and multiple working memory items may affect attention through alternation.Protocol registrationThe stage 1 protocol for this Registered Report was accepted in principle on September 5, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/BE529.

Bend but don't break: Prioritization protects working memory from displacement but leaves it vulnerable to distortion from distraction

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased towards passively viewed visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. We designed a study with five different types of visual distraction that varied in engagement and found evidence for both subtle distortions and catastrophic failures of memory. Importantly, prioritization protected working memories from catastrophic loss (fewer “swap errors”) but rendered them more vulnerable to distortion (greater attractive “biases” towards the distractor). Our findings demonstrate that prioritization does not simply protect working memory from any and all interference, but rather it reduces the likelihood of catastrophic disruption from perceptual distraction at the cost of an increased likelihood of distortion.

The effects of saccades on visual working memory representations

The effects of saccades on visual working memory representations

Parietal impact on visual working memory representation in occipito-temporal cortex

Parietal impact on visual working memory representation in occipito-temporal cortex

Comparing visual memories to similar visual inputs risks lasting memory distortion.

Maintaining perceptual experiences in visual working memory (VWM) allows us to flexibly accomplish various tasks, but some tasks come at a price. For example, comparing VWM representations to novel perceptual inputs can induce inadvertent memory distortions. If these distortions can persist, they may explain why everyday memories often become unreliable after people perform perceptual comparisons (e.g., eyewitness testimony). Here, we conducted two experiments to assess the consequences of perceptual comparisons using real-world objects that were temporarily maintained in VWM (n = 32) or recalled from visual long-term memory back into VWM (n = 30). In each experiment, young adults reported systematic memory distortions following perceptual comparisons. These distortions increased in magnitude with the delay between encoding and comparisons and were preserved when memories were retrieved again a day later. These findings suggest that perceptual comparisons play a mechanistic role in everyday memory distortions, including situations where memory accuracy is vital. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Mechanisms of Cognitive Change: Training Improves the Quality But Not the Quantity of Visual Working Memory Representations.

As of yet, visual working memory (WM) training has failed to yield consistent cognitive benefits to performance in untrained tasks, despite large improvements in trained tasks. Investigating the mechanisms underlying training effects can help explain these inconsistencies. In this pre-registered, pre-test/post-test online training study, we examined how training affects the quantity and quality of representations in visual WM using continuous-reproduction tasks. N = 64 young healthy adults were randomly assigned to an experimental group or an active control group to complete four training sessions of practce in an orientation-reproduction or a visual search task, respectively. We observed that, in the trained task, only the quality, but not the quantity, of visual WM representations significantly increased in the experimental group relative to the control group. These improvements did not generalise to untrained stimuli or paradigms. Therefore, our findings suggest that training gains are not driven by enhanced capacity. Instead, gains in the quality of visual WM representations that are tied to specific stimuli and paradigms may reflect enhanced efficiency in using the existing visual WM capacity.

Long-term high-altitude exposure influences task-related representations in visual working memory.

Human working memory is impaired when individuals are exposed to high altitudes, however, whether the capacity of visual working memory is affected remains unclear. This study combined a lateralized change detection task and event-related potentials analysis to explore changes in visual working memory capacity among individuals who emigrated from a low-altitude environment to Tibet (a high-altitude environment). Thirty-five college students were recruited from Tibet University as the high-altitude (HA) group, and thirty-six low-altitude (LA) students were enrolled from South China Normal University (sea level) as the LA group. We measured participants' contralateral delay activity (CDA) under different memory loads. ERP component analysis showed that both the HA and LA groups reached an asymptote at memory load four. However, the contralateral and ipsilateral activity of the HA and LA groups shows different patterns. The results showed a significantly larger contralateral activity for the LA group than for the HA group at memory load one (p = 0.04, Cohen's d = 0.52) and load three (p = 0.02, Cohen's d = 0.61). Additionally, we found marginally larger contralateral activity at memory load four for the LA group (p = 0.06, Cohen's d = 0.47), but not at memory load two (p = 0.10) or load five (p = 0.12). No significant differences were observed for ipsilateral activity. In addition, we observed that the HA group performed larger ipsilateral activity than contralateral activity under each memory load, compared with the LA group. These findings demonstrated that the attentional resource of long-term HA exposure is more captured by task-irrelevant information, potentially due to impaired inhibitory control, which makes it difficult for them to exclude the interference of task-irrelevant information.

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory.

In visual working memory (VWM) tasks, participants' performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and 2 with masks) or interruption (Experiments 3 and 4 with an odd-even task) occurred concurrently with the stages for the maintenance of prioritized information (long cue-and-interference/interruption interstimulus interval, e.g., Experiments 1 and 3) or the deployment of attention (short cue-and-interference/interruption interstimulus interval, e.g., Experiments 2 and 4). Our results demonstrate that perceptual interference or cognitive interruption attenuates the dimension-based RCB. These findings suggest that sustained attention is necessary for the effective prioritization of a specific dimension of VWM representations.

Prioritization sharpens working memories but does not protect them from distraction.

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased toward visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. In five behavioral experiments, we used different forms of retrospective cues (indicating the likelihood of testing each item and/or the reward for responding correctly to each item) to manipulate the prioritization of items in working memory before visual distraction. We examined the effects of distraction with nonparametric analyses and a novel distractor intrusion model. We found that memory responses were more precise (lower absolute response errors and stronger memory signals) for items that were prioritized. However, these prioritized items were not immune to distraction, and their memory responses were biased toward the visual distractors to the same degree as were unprioritized items. Our findings demonstrate that the benefits associated with prioritization in working memory do not include protection from distraction biases. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

White matter microstructure is associated with the precision of visual working memory

Visual working memory is critical for goal-directed behavior as it maintains continuity between previous and current visual input. Functional neuroimaging studies have shown that visual working memory relies on communication between distributed brain regions, which implies an important role for long-range white matter connections in visual working memory performance. Here, we characterized the relationship between the microstructure of white matter association tracts and the precision of visual working memory representations. To that purpose, we devised a delayed estimation task which required participants to reproduce visual features along a continuous scale. A sample of 80 healthy adults performed the task and underwent diffusion-weighted MRI. We applied mixture distribution modelling to quantify the precision of working memory representations, swap errors, and guess rates, all of which contribute to observed responses. Latent components of microstructural properties in sets of anatomical tracts were identified by principal component analysis. We found an interdependency between fibre coherence in the bilateral superior longitudinal fasciculus (SLF) I, SLF II, and SLF III, on one hand, and the bilateral inferior fronto-occipital fasciculus (IFOF), on the other, in mediating the precision of visual working memory in a functionally specific manner. We also found that individual differences in axonal density in a network comprising the bilateral inferior longitudinal fasciculus (ILF) and SLF III and right SLF II, in combination with a supporting network located elsewhere in the brain, form a common system for visual working memory to modulate response precision, swap errors, and random guess rates.

Familiarity enhances mnemonic precision but impairs mnemonic accuracy in visual working memory.

Prior stimulus familiarity has a variety of effects on visual working memory representations and processes. However, it is still unclear how familiarity interacts with the veridical correspondence between mnemonic representation and external stimuli. Here, we examined the effect of familiarity on two aspects of mnemonic correspondence, precision and accuracy, in visual working memory. Specifically, we used a hierarchical Bayesian method to model task performance in a change detection task with celebrity lookalikes (morphed faces between celebrities and noncelebrities with various ratios) as the memory stimuli. We found that familiarity improves memory precision by sharpening mnemonic representation but impairs memory accuracy by biasing mnemonic representation toward familiar faces (i.e., celebrity faces). These findings provide an integrated account of the puzzling celebrity sighting phenomena with the dissociable effects on mnemonic imprecision and bias and further highlight the importance of assessing these two aspects of memory correspondence in future research.

Exploring how visual working memory performance differs with response type

Visual working memory (VWM) holds visual information in mind to achieve task goals. Performance varies based on factors such as stimulus modality and distractor number. Several different tasks have been used to measure VWM, each resulting in differing estimates of capacity. Our goal was to examine how task demands can influence neurocognitive measures of VWM during early childhood. We administered two tasks to 4- and 5-year-olds that were identical during visual encoding and maintenance, only differing in type of response required during recall. In the change detection task (CD), a visual stimulus was compared with a VWM representation. In the cued-recall task (CR) a VWM representation was verbally labeled. Six canonical colors were used (red, orange, yellow, green, blue, purple). Neural data were collected from bilateral frontal, temporal, and parietal regions using functional near-infrared spectroscopy (fNIRS). VWM capacity was estimated to be higher in the change detection task (k4=2.48, k5=2.54) compared to the cued recall task (k4=1.13, k5=1.84) (p < .001). A network of frontal, temporal, and parietal regions was engaged across tasks. When comparing the tasks, CR showed increased activation in both the left supramarginal gyrus, F(1,35) = 11.642, p = 0.002, and the right superior parietal cortex, F(1,35) = 7.915, p = 0.008. Further, higher activation was observed for 5-year-olds during CR in right supramarginal gyrus, F(1,34) = 8.295, p = 0.007. During the CD task, right inferior frontal gyrus showed increased activation at set size two, F(2,64) = 3.643, p = 0.032, which is around capacity for this task. Thus, the CR task was observed to be more difficult than the CD task, and 5-year-olds showed increased activation in right parietal cortex during the CR task. These data suggest that children improve at engaging compensatory neural mechanisms during more challenging tasks involving the labelling of VWM representations.

EEG amplitude, not power, predicts updated memory representations in visual working memory

EEG amplitude, not power, predicts updated memory representations in visual working memory

The mechanisms of selection-for-action on visual working memory representations

The mechanisms of selection-for-action on visual working memory representations

Action intention strengthens visual working memory representations

Action intention strengthens visual working memory representations

Oculomotor rehearsal in visuospatial working memory

The neural and cognitive mechanisms of spatial working memory are tightly coupled with the systems that control eye movements, but the precise nature of this coupling is not well understood. It has been argued that the oculomotor system is selectively involved in rehearsal of spatial but not visual material in visuospatial working memory. However, few studies have directly compared the effect of saccadic interference on visual and spatial memory, and there is little consensus on how the underlying working memory representation is affected by saccadic interference. In this study we aimed to examine how working memory for visual and spatial features is affected by overt and covert attentional interference across two experiments. Participants were shown a memory array, then asked to either maintain fixation or to overtly or covertly shift attention in a detection task during the delay period. Using the continuous report task we directly examined the precision of visual and spatial working memory representations and fit psychophysical functions to investigate the sources of recall error associated with different types of interference. These data were interpreted in terms of embodied theories of attention and memory and provide new insights into the nature of the interactions between cognitive and motor systems.

Visual working memory representations bias attention more when they are the target of an action plan

Attention has frequently been regarded as an emergent property of linking sensory representations to action plans. It has recently been proposed that similar mechanisms may operate within visual working memory (VWM), such that linking an object in VWM to an action plan strengthens its sensory memory representation, which then expresses as an attentional bias. Here we directly tested this hypothesis by comparing attentional biases induced by VWM representations which were the target of a future action, to those induced by VWM representations that were equally task-relevant, but not the direct target of action. We predicted that the first condition would result in a more prioritized memory state and hence stronger attentional biases. Specifically, participants memorized a geometric shape for a subsequent memory test. At test, in case of a match, participants either had to perform a grip movement on the matching object (action condition), or perform the same movement, but on an unrelated object (control condition). To assess any attentional biases, during the delay period between memorandum and test, participants performed a visual selection task in which either the target was surrounded by the memorized shape (congruent trials) or a distractor (incongruent trials). Eye movements were measured as a proxy for attentional priority. We found a significant interaction for saccade latencies between action condition and shape congruency, reflecting more pronounced VWM-based attentional biases in the action condition. Our results are consistent with the idea that action plans prioritize sensory representations in VWM.

Perceptual comparisons modulate memory biases induced by new visual inputs.

It is well-established that stimulus-specific information in visual working memory (VWM) can be systematically biased by new perceptual inputs. These memory biases are commonly attributed to interference that arises when perceptual inputs are physically similar to VWM contents. However, recent work has suggested that explicitly comparing the similarity between VWM contents and new perceptual inputs modulates the size of memory biases above and beyond stimulus-driven effects. Here, we sought to directly investigate this modulation hypothesis by comparing the size of memory biases following explicit comparisons to those induced when new perceptual inputs are ignored (Experiment 1) or maintained in VWM alongside target information (Experiment 2). We found that VWM reports showed larger attraction biases following explicit perceptual comparisons than when new perceptual inputs were ignored or maintained in VWM. An analysis of participants' perceptual comparisons revealed that memory biases were amplified after perceptual inputs were endorsed as similar-but not dissimilar-to one's VWM representation. These patterns were found to persist even after accounting for variability in the physical similarity between the target and perceptual stimuli across trials, as well as the baseline memory precision between the distinct task demands. Together, these findings illustrate a causal role of perceptual comparisons in modulating naturally-occurring memory biases.

Attention rhythmically samples multi-feature objects in working memory

Attention allows us to selectively enhance processing of specific locations or features in our external environment while filtering out irrelevant information. It is currently hypothesized that this is achieved through boosting of relevant sensory signals which biases the competition between neural representations. Recent neurophysiological and behavioral studies revealed that attention is a fundamentally rhythmic process, tightly linked to neural oscillations in frontoparietal networks. Instead of continuously highlighting a single object or location, attention rhythmically alternates between multiple relevant representations at a frequency of 3–8 Hz. However, attention cannot only be directed towards the external world but also towards internal visual working memory (VWM) representations, e.g. when selecting one of several search templates to find corresponding objects in the external world. Two recent studies demonstrate that single-feature objects in VWM are attended in a similar rhythmic fashion as perceived objects. Here we add to the literature by showing that non-spatial retro-cues initiate comparable theta-rhythmic sampling of multi-feature objects in VWM. Our findings add to the converging body of evidence that external and internal visual representations are accessed by similar rhythmic attentional mechanisms and present a potential solution to the binding problem in working memory.