Visual Working Memory Load Research Articles

Electrophysiological Correlates of Visual Memory Search.

In everyday life, we frequently engage in 'hybrid' visual and memory search, where we look for multiple items stored in memory (e.g., a mental shopping list) in our visual environment. Across three experiments, we used event-related potentials to better understand the contributions of visual working memory (VWM) and long-term memory (LTM) during the memory search component of hybrid search. Experiments 1 and 2 demonstrated that the FN400 - an index of LTM recognition - and the CDA -an index of VWM load - increased with memory set size (target load), suggesting that both VWM and LTM are involved in memory search, even when target load exceeds capacity limitations of VWM. In Experiment 3, we used these electrophysiological indices to test how categorical similarity of targets and distractors affects memory search. The CDA and FN400 were modulated by memory set size only if items resembled targets. This suggests that dissimilar distractor items can be rejected before eliciting a memory search. Together, our findings demonstrate the interplay of VWM and LTM processes during memory search for multiple targets.

Visual working memory load persists during the comparison phase

Visual working memory load persists during the comparison phase

Serial dependence: A matter of memory load

In serial dependence, perceptual decisions are biased towards stimuli encountered in the recent past. Here, we investigate whether and how serial dependence is affected by the availability of visual working memory (VWM) resources. In two experiments, participants reproduced the orientation of a series of stimuli. On alternating trials, we included an additional VWM task with randomly varying levels of load. Serial dependence was not only affected by the additional load task but also clearly modulated by the level of load: a high load in the previous trial reduced serial dependence while a high load in the present increased it. These results were independent of the effects of VWM load on the precision of reproduction responses. Our findings provide new insights into the mechanisms that may regulate serial dependence, revealing its intimate link with VWM resources. Significance statementOur perception, thoughts, and behavior are continuously influenced by recent events. For instance, the way we process and understand current visual information depends on what we have seen in the preceding seconds, a phenomenon known as serial dependence. The precise mechanisms and factors involved in serial dependence are still unclear. Here, we demonstrated that working memory resources are a crucial component. Specifically, when we are currently experiencing a heavy memory load, the influence of prior stimuli becomes stronger. Conversely, when prior stimuli were shown under a high memory load, their influence was reduced. These findings highlight the importance of working memory resources in shaping our interpretation of the present based on the recent past.

Decoding load or selection in visuospatial working memory?

Flexible updating of information in Visual Working Memory (VWM) is crucial to deal with its limited capacity. Previous research has shown that the removal of no longer relevant information takes some time to complete. Here, we sought to study the time course of such removal by tracking the accompanying drop in load through behavioral and neurophysiological measures. In the first experimental session, participants completed a visuospatial retro-cue task in which the Cue-Target Interval (CTI) was manipulated. The performance revealed that it takes about half a second to make full use of the retro-cue. In a second session, we sought to study the dynamics of load-related electroencephalographic (EEG) signals to track the removal of information. We applied Multivariate Pattern Analysis (MVPA) to EEG data from the same task. Right after encoding, results replicated previous research using MVPA to decode load. However, especially after the retro-cue, results suggested that classifiers were mainly sensitive to a selection component, and not so much to load per se. Additionally, visual cue variations, as well as eye movements that accompany load manipulations can also contribute to decoding. These findings advise caution when using MVPA to decode VWM load, as classifiers may be sensitive to confounding operations.

Just-in-Time Encoding Into Visual Working Memory Is Contingent Upon Constant Availability of External Information.

Humans maintain an intricate balance between storing information in visual working memory (VWM) and just-in-time sampling of the external world, rooted in a trade-off between the cost of maintaining items in VWM versus retrieving information as it is needed. Previous studies have consistently shown that one prerequisite of just-in-time sampling is a high degree of availability of external information, and that introducing a delay before being able to access information led participants to rely less on the external world and more on VWM. However, these studies manipulated availability in such a manner that the cost of sampling was stable and predictable. It is yet unclear whether participants become less reliant on external information when it is more difficult to factor in the cost of sampling that information. In two experiments, participants copied an example layout from the left to the right side of the screen. In Experiment 1, intermittent occlusion of the example layout led participants to attempt to encode more items per inspection than when the layout was constantly available, but this did not consistently result in more correct placements. However, these findings could potentially be explained by inherent differences in how long the example layout could be viewed. Therefore in Experiment 2, the example layout only became available after a gaze-contingent delay, which could be constant or variable. Here, the introduction of any delay led to increased VWM load compared to no delay, although the degree of variability in the delay did not alter behaviour. These results reaffirm that the nature of when we engage VWM is dynamical, and suggest that any disruption to the continuous availability of external information is the main driver of increased VWM usage relative to whether availability is predictable or not.

TDCS over PPC or DLPFC does not improve visual working memory capacity

Non-invasive brain stimulation has been highlighted as a possible intervention to induce cognitive benefits, including on visual working memory (VWM). However, findings are inconsistent, possibly due to methodological issues. A recent high-profile study by Wang et al.1 reported that anodal transcranial direct current stimulation (tDCS) over posterior parietal cortex (PPC), but not over dorsolateral prefrontal cortex (DLPFC), selectively improved VWM capacity but not precision, especially at a high VWM load. Thus, in the current pre-registered conceptual replication study, we accounted for the key potential methodological issues in the original study and tested an adequate number of participants required to demonstrate the previously reported effects (n = 48 compared to n = 20). Participants underwent counterbalanced PPC, DLPFC and sham stimulation before completing 360 trials of a continuous orientation-reproduction task with a slight variation of task stimuli and setup. We found no evidence for the selective effect of PPC stimulation. Instead, our results showed that tDCS effects were absent regardless of stimulation region and VWM load, which was largely supported by substantial to strong Bayesian evidence. Therefore, our results challenge previously reported benefits of single-session anodal PPC-tDCS on VWM.

A negative emotional state impairs individuals' ability to filter distractors from working memory: an ERP study.

Capacity-limited visual working memory (VWM) requires that individuals have sufficient memory space and the ability to filter distractors. Negative emotional states are known to impact VWM storage, yet their influence on distractor filtering within VWM remains underexplored. We conducted direct neural measurement of participants (n = 56) who conducted a lateralized change detection task with distractors, while manipulating the emotional state by presenting neutral or negative images before each trial. We found a detrimental effect of distractors on memory accuracy under both neutral and negative emotional states. Usingtheevent-related potential (ERP) component, contralateral delay activity (CDA; sensitive to VWM load), to observe the VWM load in each condition, we found that in the neutral state, the participants showed significantly higher late CDA amplitudes when remembering 4 targets compared with 2 targets and 2 targets with 2 distractors but no significant difference when remembering 2 targets compared with 2 targets with 2 distractors. In the negative state, no significant CDA amplitude differences were evident when remembering 4 targets and 2 targets, but CDA was significantly higher when remembering 2 targets with 2 distractors compared with 2 targets. These results suggest that the maximum number of items participants could store in VWM was lower under negative emotional states than under neutral emotional states. Importantly, the participants could filter out distractors when in a neutral emotional state but not in a negative emotional state, indicating that negative emotional states impair their ability to filter out distractors in VWM.

Windows into spatial cognition: Mechanisms by which gesture-based instruction improve anatomy learning.

The ability to create efficient "mental models" or representations of anatomical structures is crucial for achieving competence in most areas of anatomy. Gesture-based teaching has been recognized to lighten cognitive loads and allow superior mental model creation compared to non-gestural teaching practices. This commentary explores the cognitive basis and possible mechanisms behind this advantage such as (1) reducing visual working memory load, (2) allowing parallel and sequential development of internal representations, and (3) facilitating preferential feature extraction and improved organization of spatial information. We also highlight how information transfer limitations of the gestural medium, interestingly, unveil features and organizational motifs preserved in the "expert's" mental schemas concerning particular anatomical structures. The universal and innate use of gestures in communication, their visual nature, and the ability to break down complex spatial information through sequential steps, all add to the immense potential of this subtle yet powerful tool of hand gestures. As pedagogical practices in the anatomical sciences continue to evolve largely towards technology-enhanced teaching utilizing perceptually richer media, the unique advantages of gesture-based teaching need to be reemphasized.

The impact of caregiver inhibitory control on infant visual working memory

Visual working memory (VWM) emerges in the first year of life and has far-reaching implications for academic and later life outcomes. Given that caregivers play a significant role in shaping cognitive function in children, it is important to understand how they might impact VWM development as early as infancy. The current study investigated whether caregivers’ efficiency of regulating inhibitory control was associated with VWM function in their infants. Eighty-eight caregivers were presented with a Go-NoGo task to assess inhibitory control. An efficiency score was calculated using their behavioural responses. Eighty-six 6-to-10-month-old infants were presented with a preferential looking task to assess VWM function. VWM load was manipulated across one (low load), two (medium load) and three (high load) items. Functional near-infrared spectroscopy was used to record brain activation from caregivers and their infants. We found no direct association between caregiver efficiency and infant VWM behaviour. However, we found an indirect association - caregiver efficiency was linked to infant VWM through left-lateralized fronto-parietal engagement. Specifically, infants with low efficiency caregivers showed decreasing left-lateralized parietal engagement with increasing VWM performance at the medium and high loads compared to infants with high efficiency caregivers, who did not show any load- or performance-dependent modulation. Our findings contribute to a growing body of literature examining the role that caregivers play in early neurocognitive development.

The effect of visual working memory load on attentional bias in social anxiety

The effect of visual working memory load on attentional bias in social anxiety

The integration of ceramic art design and color visual aesthetics on hyperactivity disorder viewers

Background ADHD, also known as Attention-deficit hyperactivity disorder (ADHD), has inattention, hyperactivity, conduct disorder, and impulsive behavior as its main clinical manifestations. Visual working memory load is one of the factors that can affect the individual’s attentional performance, so the study proposes to intervene in patients with ADHD with the help of a training form that combines artistic design and the visual aesthetics of colors.Subjects and Methods Children with attention deficit hyperactivity disorder (ADHD), meeting the American Diagnostic and Statistical Manual of Mental Disorders, 4th edition criteria, were selected as the study subjects and divided into experimental and control groups using the random table method. Both groups underwent color vision training therapy, strengthening the experimental group regarding graphic design and color aesthetics. The practical test tools included Rey’s Complex Graphic Memory Task and Chinese Children’s Attention Level Scale, and the statistical analysis tool was SPSS23.0, with P<0.05 indicating statistical differences.ResultsIn the ceramic art design test experiment, the subjects in the experimental group scored better than the control group in terms of structure and detail (P<0.05), and their concentration level was greatly improved.ConclusionsThe intervention of art design and color visual aesthetics integration has obvious applicability to ADHD patients, with significant efficacy, better control of their attention and behavioral actions, and help to improve the ability of self-management.

Attentional selection is a sufficient cause for visual working memory interference.

Visual attention and visual working memory (VWM) are intertwined processes that allow navigation of the visual world. These systems can compete for highly limited cognitive resources, creating interference effects when both operate in tandem. Performing an attentional task while maintaining a VWM load often leads to a loss of memory information. These losses are seen even with very simple visual search tasks. Previous research has argued that this may be due to the attentional selection process, of choosing the target item out of surrounding nontarget items. Over two experiments, the current study disentangles the roles of search and selection in visual search and their influence on a retained VWM load. Experiment 1 revealed that, when search stimuli were relatively simple, target-absent searches (which did not require attentional selection) did not provoke memory interference, whereas target-present search did. In Experiment 2, the number of potential targets was varied in the search displays. In one condition, participants were required to select any one of the items displayed, requiring an attentional selection but no need to search for a specific item. Importantly, this condition led to memory interference to the same extent as a condition where a single target was presented among nontargets. Together, these results show that the process of attentional selection is a sufficient cause for interference with a concurrently maintained VWM load.

The linear impact of visual working memory load on visual awareness: Evidence from motion-induced blindness

Despite the close relationship between visual working memory (VWM) and visual awareness, the question of how these two constructs interact with each other is still under debate. The current study aimed to further address this issue by investigating whether and how visual awareness is influenced by VWM load. In Experiment 1, participants were asked to perform a motion-induced blindness (MIB) task while simultaneously memorizing different numbers of items in VWM. The results indicated that the latency of MIB was prolonged gradually as the VWM load increased, revealing a linear trend in the modulation effect of VWM load on visual awareness. Experiments 2 and 3 tested the other potential explanations and validated the initial finding by confirming that VWM load was indeed responsible for the observed effect on visual awareness. These findings have important implications for a better understanding of the relationship between VWM and visual awareness.

The effects of visual working memory load on detection and neural processing of task-unrelated auditory stimuli

While perceptual load has been proposed to reduce the processing of task-unrelated stimuli, theoretical arguments and empirical findings for other forms of task load are inconclusive. Here, we systematically investigated the detection and neural processing of auditory stimuli varying in stimulus intensity during a stimuli-unrelated visual working memory task alternating between low and high load. We found, depending on stimulus strength, decreased stimulus detection and reduced P3, but unaffected N1 amplitudes of the event-related potential to auditory stimuli under high as compared to low load. In contrast, load independent awareness effects were observed during both early (N1) and late (P3) time windows. Findings suggest a late neural effect of visual working memory load on auditory stimuli leading to lower probability of reported awareness of these stimuli.

How does searching for faces among similar-looking distractors affect distractor memory?

Prior research has shown that searching for multiple targets in a visual search task enhances distractor memory in a subsequent recognition test. Three non-mutually exclusive accounts have been offered to explain this phenomenon. The mental comparison hypothesis states that searching for multiple targets requires participants to make more mental comparisons between the targets and the distractors, which enhances distractor memory. The attention allocation hypothesis states that participants allocate more attention to distractors because a multiple-target search cue leads them to expect a more difficult search. Finally, the partial match hypothesis states that searching for multiple targets increases the amount of featural overlap between targets and distractors, which necessitates greater attention in order to reject each distractor. In two experiments, we examined these hypotheses by manipulating visual working memory (VWM) load and target-distractor similarity of AI-generated faces in a visual search (i.e., RSVP) task. Distractor similarity was manipulated using a multidimensional scaling model constructed from facial landmarks and other metadata of each face. In both experiments, distractors from multiple-target searches were recognized better than distractors from single-target searches. Experiment 2 additionally revealed that increased target-distractor similarity during search improved distractor recognition memory, consistent with the partial match hypothesis.

Visual-cortical enhancement by acoustic distractors: The effects of endogenous spatial attention and visual working memory load

Past work has shown that when a peripheral sound captures our attention, it activates the contralateral visual cortex as revealed by an event-related potential component labelled the auditory-evoked contralateral occipital positivity (ACOP). This cross-modal activation of the visual cortex has been observed even when the sounds were not relevant to the ongoing task (visual or auditory), suggesting that peripheral sounds automatically activate the visual cortex. However, it is unclear whether top-down factors such as visual working memory (VWM) load and endogenous attention, which modulate the impact of task-irrelevant information, may modulate this spatially-specific component. Here, we asked participants to perform a lateralized VWM task (change detection), whose performance is supported by both endogenous spatial attention and VWM storage. A peripheral sound that was unrelated to the ongoing task was delivered during the retention interval. The amplitude of sound-elicited ACOP was analyzed as a function of the spatial correspondence with the cued hemifield, and of the memory array set-size. The typical ACOP modulation was observed over parieto-occipital sites in the 280–500 ms time window after sound onset. Its amplitude was not affected by VWM load but was modulated when the location of the sound did not correspond to the hemifield (right or left) that was cued for the change detection task. Our results suggest that sound-elicited activation of visual cortices, as reflected in the ACOP modulation, is unaffected by visual working memory load. However, endogenous spatial attention affects the ACOP, challenging the hypothesis that it reflects an automatic process.

The linear impact of visual working memory load on visual awareness: Evidence from motion-induced blindness

The linear impact of visual working memory load on visual awareness: Evidence from motion-induced blindness

One turn at a time: Behavioral and ERP evidence for two types of rotations in the classical mental rotation task.

We perform mental rotations in many everyday situations, such as reading a map or following furniture assembling instructions. In a classical mental rotation task, participants are asked to judge whether a rotated stimulus is presented in its mirrored form or its canonical form. Previous results have indicated a degree effect: RT is longer as the angle of rotation increases, and this effect is traditionally explained by arguing that this judgment requires rotating the stimulus back to its upright form. Importantly, in half of the trials, the stimuli are rotated on both the page plane and mirror plane. Namely, we argue that in previous research the task actually involved two different rotation processes. To provide a clear dissociation between these two rotations, we collected EEG data and used the Contralateral Delay Activity (CDA) as an indicator of visual working memory (VWM) load. The results of Experiment 1 suggested different VWM involvement according to the degrees rotations when the item was not mirrored, such that the CDA amplitude generally increased as the degree of rotation was higher. Mirrored trials were all at ceiling in terms of CDA, regardless of their rotation degree. Experiment 2 showed increased CDA amplitude uniquely related to the flip rotation. Thus, we provided ERP evidence that the canonical mental rotation task involves two types of rotations that can be dissociated based on the load they imposed on VWM.

Working memory asymmetrically modulates auditory and linguistic processing of speech

Working memory load can modulate speech perception. However, since speech perception and working memory are both complex functions, it remains elusive how each component of the working memory system interacts with each speech processing stage. To investigate this issue, we concurrently measure how the working memory load modulates neural activity tracking three levels of linguistic units, i.e., syllables, phrases, and sentences, using a multiscale frequency-tagging approach. Participants engage in a sentence comprehension task and the working memory load is manipulated by asking them to memorize either auditory verbal sequences or visual patterns. It is found that verbal and visual working memory load modulate speech processing in similar manners: Higher working memory load attenuates neural activity tracking of phrases and sentences but enhances neural activity tracking of syllables. Since verbal and visual WM load similarly influence the neural responses to speech, such influences may derive from the domain-general component of WM system. More importantly, working memory load asymmetrically modulates lower-level auditory encoding and higher-level linguistic processing of speech, possibly reflecting reallocation of attention induced by mnemonic load.

The locus of visual search's interference on visual working memory.

Visual attention and visual working memory (VWM) are interacting systems. Most research has been directed toward how a retained VWM load can influence visual search behavior. However, the relationship between the two is bidirectional. When performing a visual search while maintaining a VWM load, decreases in change detection accuracy are often seen. Woodman and Luck (2010) argued that this interference was due to the onset of the search display leading to disruption. The current work attempts to identify the exact component of visual search that leads to interference with VWM. Potentially interference could be due to an attentional component of the task or a procedural artifact of the dual-task paradigm. Over five experiments, different attentional tasks were completed in the retention period of a difficult change detection task. Memory interference was measured as accuracy decrements in these conditions compared to trials where no attentional task was completed. Over the five experiments, one factor was highlighted as a sufficient cause for interference: the addition of nontarget items in the attentional task. Procedural artifacts were ruled out as potential sources of interference including: response bindings, eye movements, nontarget variance, spatial shifts of attention, perceptual load, and the time it took to complete the attentional task. It is proposed that interference arises from the attentional selective process of choosing the target item out of the nontargets. (PsycInfo Database Record (c) 2022 APA, all rights reserved).