Items In Visual Working Memory Research Articles

Just-in-Time Encoding Into Visual Working Memory Is Contingent Upon Constant Availability of External Information.

Humans maintain an intricate balance between storing information in visual working memory (VWM) and just-in-time sampling of the external world, rooted in a trade-off between the cost of maintaining items in VWM versus retrieving information as it is needed. Previous studies have consistently shown that one prerequisite of just-in-time sampling is a high degree of availability of external information, and that introducing a delay before being able to access information led participants to rely less on the external world and more on VWM. However, these studies manipulated availability in such a manner that the cost of sampling was stable and predictable. It is yet unclear whether participants become less reliant on external information when it is more difficult to factor in the cost of sampling that information. In two experiments, participants copied an example layout from the left to the right side of the screen. In Experiment 1, intermittent occlusion of the example layout led participants to attempt to encode more items per inspection than when the layout was constantly available, but this did not consistently result in more correct placements. However, these findings could potentially be explained by inherent differences in how long the example layout could be viewed. Therefore in Experiment 2, the example layout only became available after a gaze-contingent delay, which could be constant or variable. Here, the introduction of any delay led to increased VWM load compared to no delay, although the degree of variability in the delay did not alter behaviour. These results reaffirm that the nature of when we engage VWM is dynamical, and suggest that any disruption to the continuous availability of external information is the main driver of increased VWM usage relative to whether availability is predictable or not.

Alternating capture of attention by multiple visual working memory representations

Can we look for multiple objects simultaneously? Previous studies have proposed that the representation of an item in visual working memory (VWM) can bias the deployment of attention to memory-matching items in visual search. However, it is still controversial whether multiple VWM item representations are able to capture attention. In the present study, we adopted an eye-tracking technique to reveal this issue. In Experiment 1, we replicated Chen and Du’s Experiment 2 and adopted an eye-tracking technique to determine whether multiple VWM item representations are able to bias attention. In Chen and Du’s paradigm, the memory test was always followed by the search test, and the participants might intentionally prepare for the search task, which can affect the results of the research. Thus, in Experiment 2, we prevented participants from predicting the temporal occurrence of the visual search task by randomly conducting a search test or a memory test after memoranda. The findings of the present study suggested that only one working memory item at a time influences attention and multiple working memory items may affect attention through alternation.Protocol registrationThe stage 1 protocol for this Registered Report was accepted in principle on September 5, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/BE529.

Can items in visual working memory be shielded from visual interference while in use?

Can items in visual working memory be shielded from visual interference while in use?

Spatial Configuration Effects on the Dissociation between Active and Latent States in Visual Working Memory.

Visual working memory includes both active, recallable items and latent items not directly available for recall. During the online manipulation of active working memory, latent items gain robust retention. According to the dissociation account, active and passive memories exist in independent states, both of which take up their own cognitive resources. However, it is unclear whether dissociation is a universal phenomenon during memory maintenance. Given that memory information is retained as a binding of identity and location, the spatial proximity of memory items might shield the dissociation property. To test this, we adopted a retro-cue memory task where the cued and uncued items were separated in the active and latent states. In Experiment 1, the memory items were presented at a relatively large spatial distance. The results supported the dissociation account for well-separated items. However, Experiment 2 rejected the dissociation for closer-in items, possibly because items in visual working memory were spatially labeled. These findings suggest that while memory maintenance generally conforms to the dissociation account, the spatial configuration of memory items can affect the dissociation property between the active and latent neural states in visual working memory.

The linear impact of visual working memory load on visual awareness: Evidence from motion-induced blindness

Despite the close relationship between visual working memory (VWM) and visual awareness, the question of how these two constructs interact with each other is still under debate. The current study aimed to further address this issue by investigating whether and how visual awareness is influenced by VWM load. In Experiment 1, participants were asked to perform a motion-induced blindness (MIB) task while simultaneously memorizing different numbers of items in VWM. The results indicated that the latency of MIB was prolonged gradually as the VWM load increased, revealing a linear trend in the modulation effect of VWM load on visual awareness. Experiments 2 and 3 tested the other potential explanations and validated the initial finding by confirming that VWM load was indeed responsible for the observed effect on visual awareness. These findings have important implications for a better understanding of the relationship between VWM and visual awareness.

Mountains of memory in a sea of uncertainty: Sampling the external world despite useful information in visual working memory

A large part of research on visual working memory (VWM) has traditionally focused on estimating its maximum capacity. Yet, humans rarely need to load up their VWM maximally during natural behavior, since visual information often remains accessible in the external world. Recent work, using paradigms that take into account the accessibility of information in the outside world, has indeed shown that observers utilize only one or two items in VWM before sampling from the external world again. One straightforward interpretation of this finding is that, in daily behavior, much fewer items are memorized than the typically reported capacity limits. Here, we first investigate whether this lower reliance on VWM when information is externally accessible might instead reflect resampling before VWM is actually depleted. To this aim we devised an online task, in which participants copied a model (six items in a 4x4 grid; always accessible) in an adjacent empty 4x4 grid. A key aspect of our paradigm is that we (unpredictably) interrupted participants just before inspection of the model with a 2-alternative-forced-choice (2-AFC) question, probing their VWM content. Critically, we observed above-chance performance on probes appearing just before model inspection. This finding shows that the external world was resampled, despite VWM still containing relevant information. We then asked whether increasing the cost of sampling causes participants to load up more information in VWM or, alternatively, to squeeze out more information from VWM (at the cost of making more errors). To manipulate the cost of resampling, we made it more difficult (specifically, more time-consuming) to access the model. We show that with increased cost of accessing the model (which lead to fewer, but longer model inspections), participants could place more items correctly immediately after sampling, and they kept attempting to place items for longer after their first error. These findings demonstrate that participants both encoded more information in VWM and made attempts to squeeze out more information from VWM when sampling became more costly. We argue that human observers constantly evaluate how certain they are of their VWM contents, and only use that VWM content of which their certainty exceeds a context-dependent “action threshold”. This threshold, in turn, depends on the trade-off between the cost of resampling and the benefits of making an action. We argue that considering the interplay between the available VWM contents and a context-dependent action threshold, is key for reconciling the traditional VWM literature with VWM use in our day-to-day behavior.

Task difficulty rather than reward method modulates the reward boosts in visual working memory.

Both monetary and notional rewards are important to motivate individuals to prioritize specific items in visual working memory (VWM). However, whether the reward method and task difficulty are the key factors that modulate the reward boosts in VWM is unclear. In this study, we designed two experiments to explore this question. Experiment 1 examined whether the reward method modulates reward boosts in VWM by manipulating the item type (high reward, low reward, equal reward) and reward method (monetary and notional). Experiment 2 examined whether task difficulty modulates reward boosts in VWM by manipulating the number of high-reward items (1, 2, 3), reward method, and item type. The results indicated reward boosts for high-reward items compared to low- and equal-reward items. Moreover, the VWM performance was higher in the monetary reward condition than in the notional reward condition; however, there was no interaction between the reward method and item type. Additionally, a significant interaction was found between the reward number and item type: Reward boosts on VWM performance occurred only when one or two higher reward items were present. In conclusion, reward boosts in VWM tasks are modulated by task difficulty but not the reward method.

An adaptive perspective on visual working memory distortions.

When holding multiple items in visual working memory, representations of individual items are often attracted to, or repelled from, each other. While this is empirically well-established, existing frameworks do not account for both types of distortions, which appear to be in opposition. Here, we demonstrate that both types of memory distortion may confer functional benefits under different circumstances. When there are many items to remember and subjects are near their capacity to accurately remember each item individually, memories for each item become more similar (attraction). However, when remembering smaller sets of highly similar but discernible items, memory for each item becomes more distinct (repulsion), possibly to support better discrimination. Importantly, this repulsion grows stronger with longer delays, suggesting that it dynamically evolves in memory and is not just a differentiation process that occurs during encoding. Furthermore, both attraction and repulsion occur even in tasks designed to mitigate response bias concerns, suggesting they are genuine changes in memory representations. Together, these results are in line with the theory that attraction biases act to stabilize memory signals by capitalizing on information about an entire group of items, whereas repulsion biases reflect a tradeoff between maintaining accurate but distinct representations. Both biases suggest that human memory systems may sacrifice veridical representations in favor of representations that better support specific behavioral goals. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Storage in Visual Working Memory Recruits a Content-Independent Pointer System

Past work has shown that storage in working memory elicits stimulus-specific neural activity that tracks the stored content. Here, we present evidence for a distinct class of load-sensitive neural activity that indexes items without representing their contents per se. We recorded electroencephalogram (EEG) activity while adult human subjects stored varying numbers of items in visual working memory. Multivariate analysis of the scalp topography of EEG voltage enabled precise tracking of the number of individuated items stored and robustly predicted individual differences in working memory capacity. Critically, this signature of working memory load generalized across variations in both the type and number of visual features stored about each item, suggesting that it tracked the number of individuated memory representations and not the content of those memories. We hypothesize that these findings reflect the operation of a capacity-limited pointer system that supports on-line storage and attentive tracking.

Modulation of similarity on the distraction resistance of visual working memory representation.

Controversy exists regarding the distraction resistance of priority items in visual working memory (VWM). The protection account proposes that high-priority items resist distraction more than low-priority items, while the vulnerability account proposes that distractors impair high-priority items more. We proposed another available resource threshold account: distraction will not impair items if available resources exceed their threshold needed for sufficient processing. Using a change-detection paradigm, we manipulated item priority by color similarity and inserted distractors during VWM retention. We investigated the effect of similarity on distraction resistance of relevant (color) and irrelevant (shape) feature representations (Experiments 1-2), and the neural mechanism of this effect using event-related potentials (ERPs; Experiment 3). Behavioral results showed distractors impaired the accuracy of dissimilar items when relevant features were memorized and of similar items when irrelevant features were memorized under simultaneous presentation of similar and dissimilar items. Moreover, distractors impaired the accuracy of dissimilar items when relevant features were memorized and of both similar and dissimilar items when irrelevant features were memorized under separate presentation of items. ERP results showed a smaller negative slow wave and P2 but larger N2 under the similar condition. Similarity protected relevant features of similar items against distraction by reducing memory load, decreasing attentional resources allocated to distractors, and strengthening inhibition of distractors. However, similarity did not protect irrelevant features of similar items. Our results support the available resource threshold account, suggesting that VWM is a flexible and intelligent system despite its limited capacity.

Continuous manipulation of mental representations is compromised in cerebellar degeneration.

We introduce a novel perspective on how the cerebellum might contribute to cognition, hypothesizing that this structure supports dynamic transformations of mental representations. In support of this hypothesis, we report a series of neuropsychological experiments comparing the performance of individuals with degenerative cerebellar disorders on tasks that either entail continuous, movement-like mental operations or more discrete mental operations. In the domain of visual cognition, the cerebellar disorders group exhibited an impaired rate of mental rotation, an operation hypothesized to require the continuous manipulation of a visual representation. In contrast, the cerebellar disorders group showed a normal processing rate when scanning items in visual working memory, an operation hypothesized to require the maintenance and retrieval of remembered items. In the domain of mathematical cognition, the cerebellar disorders group was impaired at single-digit addition, an operation hypothesized to primarily require iterative manipulations along a mental number-line; this group was not impaired on arithmetic tasks linked to memory retrieval (e.g. single-digit multiplication). These results, obtained in tasks from two disparate domains, point to a potential constraint on the contribution of the cerebellum to cognitive tasks. Paralleling its role in motor control, the cerebellum may be essential for coordinating dynamic, movement-like transformations in a mental workspace.

A direct comparison of attentional orienting to spatial and temporal positions in visual working memory

Different visual attributes effectively guide attention to specific items in visual working memory (VWM), ensuring that particularly important memory contents are readily available. Predictable temporal structures contribute to this efficient use of VWM: items are prospectively prioritized when they are expected to be needed. Occasionally, however, visual events only gain relevance through their timing after they have passed. We investigated retrospective attentional orienting based on temporal position by directly comparing it with orienting to spatial locations, which is typically considered the most powerful selection mechanism. In a colour-change-detection task, in which items appeared sequentially at different locations, symbolic number cues validly indicated the temporal or spatial location of the upcoming probe item either before encoding (precues; Experiment 1) or during maintenance (retrocues; Experiments 1–3). Temporal and spatial cues were physically identical and only differed in their mapping onto either temporal or spatial positions. Predictive cues yielded cueing benefits (i.e., higher accuracy and shorter reaction times) as compared with neutral cues, with larger benefits for precues than for retrocues. Importantly, spatial and temporal cueing benefits did not differ. Equivalent retrocueing benefits were also observed across different cue-probe intervals and irrespective of whether spatial or temporal position was used as retrieval cue, indicating that items were directly bound to temporal position and not prioritized via a space-based mechanism. These findings show that spatial and temporal properties can be used equally well to flexibly prioritise representations held in VWM and they highlight the functional similarities of space and time in VWM.

Supplemental Material for Visual Working Memory Items Drift Apart Due to Active, Not Passive, Maintenance

Supplemental Material for Visual Working Memory Items Drift Apart Due to Active, Not Passive, Maintenance

Individual items in visual working memory inherit ensemble properties

Prevailing theories of visual working memory assume that each encoded item is stored or forgotten as a separate unit independent from other items. Here, we show that items are not independent, and that the recalled orientation of an individual item is strongly influenced by the summary statistical representation of all items (ensemble representation). In Experiment 1, we briefly shown our participants a set of four triangles of various orientations and asked them to remember an orientation of (1) a single triangle, (2) all four individual triangles, or (3) the mean orientation of the four triangles. The orientations were distributed with equal steps along a range of 30, 60, and 120 degrees. When observers remembered one orientation, their memories had always the same precision regardless of range and were mostly unbiased. However, when observers had to remember all four orientations, not only was memory for an individual orientation substantially biased towards the mean orientation, but the precision of memory for an individual item also closely tracked the precision with which people stored the mean orientation (which was, in turn, correlated with the physical range of orientations). Thus, individual items are reported more precisely when items on a trial are more similar. Moreover, the narrower the range of orientations present on a trial, the more participants appear to rely on the mean orientation as representative of all individuals. This pattern was replicated when we discouraged observers from explicit encoding of the mean (Experiment 2). This ensemble influence can also be observed not only when the range is carefully controlled, but also shown even in randomly generated, unstructured displays (Experiment 3). Our results suggest that the information about a set of items is represented hierarchically, and that ensemble information can be an important source of information to constrain uncertain information about individuals.

The priority for access to awareness of information matching VWM is mirror-invariant

Previous studies suggest that 1) storing a visual representation of an item in visual working memory (VWM) prioritizes access to visual awareness for this item and that 2) VWM can contain representations of bound items instead of separate features. It is currently unclear whether VWM affects access to visual awareness at the individual feature level, the conjunction of multiple features level or the object level. To investigate this question, we conducted a series of experiments in which we combined a delayed match to sample task with a breaking Continuous Flash Suppression (b-CFS) task. On each trial, subjects memorized an object consisting of a disk with two halves with different colors for the later recall test and, between them, had to detect the location of a target initially presented under suppression. We varied the congruence in colors between the memory representation and to-be-detected target. Our results show that memory congruent objects (consisting of a conjunction of features) break CFS faster than memory incongruent objects. Interestingly, we also observe this congruence effect when we presented the memorized object in a horizontally-mirrored configuration of colors. However, we do not observe a faster effect when the target shares only a single feature of a memorized object (semi-congruent) or when the memory congruent target is rotated by 90°. Our results suggest that VWM prioritizes access to visual awareness for complex visual memoranda for which the spatial lay-out of the individual features does not need to exactly match the lay-out of the memoranda.

Concurrent guidance of attention by multiple working memory items: Behavioral and computational evidence

During visual search, task-relevant representations in visual working memory (VWM), known as attentional templates, are assumed to guide attention. A current debate concerns whether only one (Single-Item-Template hypothesis; SIT) or multiple (Multiple-Item-Template hypothesis; MIT) items can serve as attentional templates simultaneously. The current study was designed to test these two hypotheses. Participants memorized two colors, prior to a visual-search task in which the target and the distractor could match or not match the colors held in VWM. Robust attentional guidance was observed when one of the memory colors was presented as the target (reduced response times (RTs) on target-match trials) or the distractor (increased RTs on distractor-match trials). We constructed two drift-diffusion models that implemented the MIT and SIT hypotheses, which are similar in their predictions about overall RTs, but differ in their predictions about RTs on individual trials. Critically, simulated RT distributions and error rates revealed a better match of the MIT hypothesis to the observed data than the SIT hypothesis. Taken together, our findings provide behavioral and computational evidence for the concurrent guidance of attention by multiple items in VWM.

The architecture of working memory: Features from multiple remembered objects produce parallel, coactive guidance of attention in visual search.

Theories of working memory (WM) differ in their claims about the number of items that can be maintained in a state that directly interacts with other, ongoing cognitive operations (termed the focus of attention). A similar debate has arisen in the literature on visual working memory (VWM), focused on the number of items that can simultaneously interact with attentional priority. In 3 experiments, we used a redundancy-gain paradigm to provide a comprehensive test of the latter question. Participants searched for 2 cued features (e.g., a color and a shape) within a search array. The cued feature values changed on a trial-by-trial basis, requiring VWM. The target (when present) could match 1 of the cued features (single-target trials) or both cued features (redundant-target trials). We tested whether response time distributions contained a substantial proportion of trials with redundant-target responses that were faster than predicted by 2 independent guidance processes operating in parallel (i.e., violations of the race-model inequality). Violations are consistent with a coactive architecture in which both cued values guide attention in parallel and sum on the priority map. Robust violations were observed in all cases predicted by the hypothesis that multiple items in VWM can guide attention simultaneously, and these results were inconsistent with the hypothesis that guidance is limited to a single item simultaneously. When considered in the larger context of the literature on VWM and attention, the present results are consistent with a model of WM architecture in which the focus of attention can maintain multiple, independent representations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Gray Matter Volume in Different Cortical Structures Dissociably Relates to Individual Differences in Capacity and Precision of Visual Working Memory.

Visual working memory (VWM) refers to our ability to selectively maintain visual information in a mental representation. While cognitive limits of VWM greatly influence a variety of mental operations, it remains controversial whether the quantity or quality of representations in mind constrains VWM. Here, we examined behavior-to-brain anatomical relations as well as brain activity to brain anatomy associations with a "neural" marker specific to the retention interval of VWM. Our results consistently indicated that individuals who maintained a larger number of items in VWM tended to have a larger gray matter (GM) volume in their left lateral occipital region. In contrast, individuals with a superior ability to retain with high precision tended to have a larger GM volume in their right parietal lobe. These results indicate that individual differences in quantity and quality of VWM may be associated with regional GM volumes in a dissociable manner, indicating willful integration of information in VWM may recruit separable cortical subsystems.

Interactions between visual working memory and visual attention among survivors of pediatric acute lymphoblastic leukemia (ALL) and their healthy peers

ABSTRACTIntroduction: There is increasing concern for adverse cognitive late effects among survivors of pediatric acute lymphoblastic leukemia (ALL) given the widespread impact they have on academic achievement, particularly working memory and attention. We assessed performance among survivors and their healthy peers on a dual task paradigm measuring visual working memory (VWM) and visual attention independently and the dynamic relationship between the two. Assessing specific subsets within cognitive domains allows for understanding the distinct nature of cognitive impairments.Method: Participants were 34 survivors of ALL who have been off-treatment and disease free for 7.5 years; and 20 healthy controls, all between the ages of 10 and 18 years. We utilized behavioral single- and dual-task paradigms. In the dual tasks, participants maintained several items in VWM while performing a visual attention task (Eriksen Flanker Task) that required processing of a target stimulus while inhibiting the processing of distractor stimuli. The single tasks involved performing only the VWM task or only the visual attention task.Results: Results revealed survivors of ALL performed significantly worse than their healthy peers on the single visual attention task but not the single VWM task. Of particular interest, group differences were obtained on the dual VWM and visual attention tasks, such that the VWM and attention tasks reciprocally interfered with each other only among survivors and not their healthy peers.Conclusions: Our results highlight a core deficit in visual attention that is exacerbated by VWM demands among survivors of ALL. The implementation of tasks from cognitive neuroscience paradigms may be sensitive to cognitive impairments experienced by cancer survivors. Assessment and intervention practices among survivors of pediatric ALL are discussed.

Can you have multiple attentional templates? Large-scale replications of Van Moorselaar, Theeuwes, and Olivers (2014) and Hollingworth and Beck (2016)

Stimuli that resemble the content of visual working memory (VWM) capture attention. However, theories disagree on how many VWM items can bias attention simultaneously. According to some theories, there is a distinction between active and passive states in VWM, such that only items held in an active state can bias attention. The single-item-template hypothesis holds that only one item can be in an active state and thus can bias attention. In contrast, the multiple-item-template hypothesis posits that multiple VWM items can be in an activate state simultaneously, and thus can bias attention. Recently, Van Moorselaar, Theeuwes, and Olivers (Journal of Experimental Psychology: Human Perception and Performance, 40(4):1450, 2014) and Hollingworth and Beck (Journal of Experimental Psychology: Human Perception and Performance, 42(7):911–917, 2016) tested these accounts, but obtained seemingly contradictory results. Van Moorselaar et al. (2014) found that a distractor in a visual-search task captured attention more when it matched the content of VWM (memory-driven capture). Crucially, memory-driven capture disappeared when more than one item was held in VWM, in line with the single-item-template hypothesis. In contrast, Hollingworth and Beck (2016) found memory-driven capture even when multiple items were kept in VWM, in line with the multiple-item-template hypothesis. Considering these mixed results, we replicated both studies with a larger sample, and found that all key results are reliable. It is unclear to what extent these divergent results are due to paradigm differences between the studies. We conclude that is crucial to our understanding of VWM to determine the boundary conditions under which memory-driven capture occurs.