Short-term Memory Representations Research Articles

Decay of internal reference information in duration discrimination: Intertrial interval modulates the Type B effect

Psychophysical evidence suggests that human perception of a stimulus is assimilated towards previous stimuli. The internal reference model (IRM) explains such assimilation through an internal reference (IR), which integrates past and present stimulus representations and thus might be conceived as a form of perceptual memory. In this study, we investigated whether the IR decays with time, as previously shown for perceptual memory representations in general. One specific prediction of IRM is higher discrimination sensitivity when a constant standard precedes rather than follows a variable comparison in a two-alternative forced-choice (2AFC) discrimination task. Furthermore, the magnitude of this so-called negative Type B effect should decrease with decreasing weighting of past stimulus information in the integration process. Therefore, decay of the IR should result in a reduced Type B effect. To examine this prediction, we carried out a 2AFC duration discrimination experiment with a short (1,600 ms) and a long (3,200 ms) intertrial interval (ITI). As expected, a reduced negative Type B effect was observed at the long compared with the short ITI, consistent with the idea that humans rely on the immediate past when evaluating current sensory input, however, less so when the IR incorporating the perceptual short-term memory representation of these past stimuli has already decayed.

Temporal Expectation Modulates the Cortical Dynamics of Short-Term Memory.

Increased memory load is often signified by enhanced neural oscillatory power in the alpha range (8-13 Hz), which is taken to reflect inhibition of task-irrelevant brain regions. The corresponding neural correlates of memory decay, however, are not yet well understood. In the current study, we investigated auditory short-term memory decay in humans using a delayed matching-to-sample task with pure-tone sequences. First, in a behavioral experiment, we modeled memory performance over six different delay-phase durations. Second, in a MEG experiment, we assessed alpha-power modulations over three different delay-phase durations. In both experiments, the temporal expectation for the to-be-remembered sound was manipulated so that it was either temporally expected or not. In both studies, memory performance declined over time, but this decline was weaker when the onset time of the to-be-remembered sound was expected. Similarly, patterns of alpha power in and alpha-tuned connectivity between sensory cortices changed parametrically with delay duration (i.e., decrease in occipitoparietal regions, increase in temporal regions). Temporal expectation not only counteracted alpha-power decline in heteromodal brain areas (i.e., supramarginal gyrus), but also had a beneficial effect on memory decay, counteracting memory performance decline. Correspondingly, temporal expectation also boosted alpha connectivity within attention networks known to play an active role during memory maintenance. The present data show how patterns of alpha power orchestrate short-term memory decay and encourage a more nuanced perspective on alpha power across brain space and time beyond its inhibitory role.SIGNIFICANCE STATEMENT Our sensory memories of the physical world fade quickly. We show here that this decay of short-term memory can be counteracted by so-called temporal expectation; that is, knowledge of when to expect a sensory event that an individual must remember. We also show that neural oscillations in the "alpha" (8-13 Hz) range index both the degree of memory decay (for brief sound patterns) and the respective memory benefit from temporal expectation. Spatially distributed cortical patterns of alpha power show opposing effects in auditory versus visual sensory cortices. Moreover, alpha-tuned connectivity changes within supramodal attention networks reflect the allocation of neural resources as short-term memory representations fade.

Testing effects in visual short-term memory: The case of an object's size.

In many daily activities, we need to form and retain temporary representations of an object's size. Typically, such visual short-term memory (VSTM) representations follow perception and are considered reliable. Here, participants were asked to hold in mind a single simple object for a short duration and to reproduce its size by adjusting the length and width of a test probe. Experiment 1 revealed two powerful findings: First, similar to a recently reported perceptual illusion, participants greatly overestimated the size of open objects - ones with missing boundaries - relative to the same-size fully closed objects. This finding confirms that object boundaries are critical for size perception and memory. Second, and in contrast to perception, even the size of the closed objects was largely overestimated. Both inflation effects were substantial and were replicated and extended in Experiments 2-5. Experiments 6-8 used a different testing procedure to examine whether the overestimation effects are due to inflation of size in VSTM representations or to biases introduced during the reproduction phase. These data showed that while the overestimation of the open objects was repeated, the overestimation of the closed objects was not. Taken together, these findings suggest that similar to perception, only the size representation of open objects is inflated in VSTM. Importantly, they demonstrate the considerable impact of the testing procedure on VSTM tasks and further question the use of reproduction procedures for measuring VSTM.

Different phonological mechanisms facilitate vocabulary learning at early and late stages of language acquisition: Evidence from Polish 9-year-olds learning English

ABSTRACTTo acquire a new word, learners need to create its representation in phonological short-term memory (STM) and then encode it in their long-term memory. Two strategies can enable word representation in STM: universal segmentation and phonological mapping. Universal segmentation is language universal and thus should predict word learning in any language, while phonological mapping is language specific. This study investigates the mechanisms of vocabulary learning through a comparison of vocabulary learning task results in multiple languages. We tested 44 Polish third graders learning English on phonological STM, phonological awareness in Polish and in English, and on three tasks, which involved learning novel word forms in Polish (first language), in English (second language), and in a language that did not resemble any language known to participants (an unknown language). Participants’ English proficiency was controlled through a vocabulary task. The results suggest that word learning engages different mechanisms for familiar and unfamiliar languages. Phonological awareness in English predicted learning second language and unknown language words, and phonological STM predicted learning words of the unknown language. We propose that universal segmentation facilitates word learning only in an unfamiliar language, while in familiar languages speakers use phonological mapping in order to learn new words.

Top-down modulation of alpha power and pattern similarity for threatening representations in visual short-term memory

Recent studies have shown that top-down attention biases task-relevant representations in visual short-term memory (VSTM). Accumulating evidence has also revealed the modulatory effects of emotional arousal on attentional processing. However, it remains unclear how top-down attention interacts with emotional memoranda in VSTM. In this study, we investigated the mechanisms of alpha oscillations and their spatiotemporal characteristics that underlie top-down attention to threatening representations during VSTM maintenance with electroencephalography. Participants were instructed to remember a threatening object and a neutral object in a cued variant delayed response task. Retrospective cues (retro-cues) were presented to direct attention to the hemifield of a threatening object (i.e., cue-to-threat trials) or a neutral object (i.e., cue-to-neutral trials) during a retention interval prior to the probe test. We found a significant retro-cue-related alpha lateralisation over posterior regions during VSTM maintenance. The novel finding was that the magnitude of alpha lateralisation was greater for cue-to-threat objects compared to cue-to-neutral ones. These results indicated that directing attention towards threatening representations compared to neutral representations could result in greater regulation of alpha activity contralateral to the cued hemifield. Importantly, we estimated the spatiotemporal pattern similarity in alpha activity and found significantly higher similarity indexes for the posterior regions relative to the anterior regions and for the cue-to-threat objects relative to cue-to-neutral objects over the posterior regions. Together, our findings provided the oscillatory evidence of greater top-down modulations of alpha lateralisation and spatiotemporal pattern similarity for attending to threatening representations in VSTM.

Dissociations of the number and precision of visual short-term memory representations in change detection.

The present study dissociated the number (i.e., quantity) and precision (i.e., quality) of visual short-term memory (STM) representations in change detection using receiver operating characteristic (ROC) and experimental manipulations. Across three experiments, participants performed both recognition and recall tests of visual STM using the change-detection task and the continuous color-wheel recall task, respectively. Experiment 1 demonstrated that the estimates of the number and precision of visual STM representations based on the ROC model of change-detection performance were robustly correlated with the corresponding estimates based on the mixture model of continuous-recall performance. Experiments 2 and 3 showed that the experimental manipulation of mnemonic precision using white-noise masking and the experimental manipulation of the number of encoded STM representations using consolidation masking produced selective effects on the corresponding measures of mnemonic precision and the number of encoded STM representations, respectively, in both change-detection and continuous-recall tasks. Altogether, using the individual-differences (Experiment 1) and experimental dissociation (Experiment 2 and 3) approaches, the present study demonstrated the some-or-none nature of visual STM representations across recall and recognition.

Poor performance on the retention of phonemes’ serial order in short-term memory reflects young children’s poor reading skills

Abstract The present study aimed to identify crucial factors that underlie phonological representations in short-term memory (STM) of third-graders with different literacy skills. For this purpose, we used the Nonword Repetition Task (NRT) to disentangle the processing of phonemes’ identity and their serial order. We found no evidence that children’s literacy skills are linked to their capacity for retaining phonemes’ identity. However, their literacy skills are linked to their capacity for retaining phonemes’ serial order. The latter link can be interpreted in terms of a domain-general STM mechanism but is also compatible with the impact of literacy on children’s knowledge of the phonotactic regularities in a language.

Discrete item-based and continuous configural representations in visual short-term memory

ABSTRACTBoth discrete item-based and global configural information can be stored in visual short-term memory (VSTM). To characterize their contribution, the present study developed a dual-trace signal detection (DTSD) model consisting of a high threshold (HT) component for discrete item information and a continuous signal detection theory (SDT) component for configural information. We used an orientation change-detection task in which observers attempted to retain several orientations over a 1-s retention interval and then reported whether a cued item in the test array had the old or new orientation on a 6-point confidence scale. The resulting Receiver Operating Characteristics (ROC) curves were fit with the DTSD model, producing estimates of the two memory representations. In a series of experiments, we found that manipulations of configural encoding selectively affected the SDT component whereas the manipulation of item information selectively affected the HT component. Together these findings indicate that VSTM maintains a few discrete representations and continuous representation of configural information.

Familiarity increases the number of remembered Pokémon in visual short-term memory.

Long-term memory (LTM) can influence many aspects of short-term memory (STM), including increased STM span. However, it is unclear whether LTM enhances the quantitative or qualitative aspect of STM. That is, do we retain a larger number of representations or more precise representations in STM for familiar stimuli than unfamiliar stimuli? This study took advantage of participants' prior rich multimedia experience with Pokémon, without investing on laboratory training to examine how prior LTM influenced visual STM. In a Pokémon visual STM change detection task, participants remembered more first-generation Pokémon characters that they were more familiar with than recent-generation Pokémon characters that they were less familiar with. No significant difference in memory quality was found when quantitative and qualitative effects of LTM were isolated using receiver operating characteristic (ROC) analyses. Critically, these effects were absent in participants who were unfamiliar with first-generation Pokémon. Furthermore, several alternative interpretations were ruled out, including general video-gaming experience, subjective Pokémon preference, and verbal encoding. Together, these results demonstrated a strong link between prior stimulus familiarity in LTM and visual STM storage capacity.

Serial position encoding of signs

Reduced short-term memory (STM) capacity has been reported for sign as compared to speech when items have to be recalled in a specific order. This difference has been attributed to a more precise and efficient serial position encoding in verbal STM (used for speech) than visuo-spatial STM (used for sign). We tested in the present investigation whether the reduced STM capacity with signs stems from a lack of positional encoding available in verbal STM. Error analyses reported in prior studies have revealed that positions are defined in verbal STM by distance from both the start and the end of the sequence (both-edges positional encoding scheme). Our analyses of the errors made by deaf participants with finger-spelled letters revealed that the both-edges positional encoding scheme underlies the STM representation of signs. These results indicate that the cause of the STM disadvantage is not the type of positional encoding but rather the difficulties in binding an item in visuo-spatial STM to its specific position in the sequence. Both-edges positional encoding scheme could be specific of sign, since it has not been found in visuo-spatial STM tasks conducted with hearing participants.

Short-term memory stores organized by information domain.

Vision and audition have complementary affinities, with vision excelling in spatial resolution and audition excelling in temporal resolution. Here, we investigated the relationships among the visual and auditory modalities and spatial and temporal short-term memory (STM) using change detection tasks. We created short sequences of visual or auditory items, such that each item within a sequence arose at a unique spatial location at a unique time. On each trial, two successive sequences were presented; subjects attended to either space (the sequence of locations) or time (the sequence of inter item intervals) and reported whether the patterns of locations or intervals were identical. Each subject completed blocks of unimodal trials (both sequences presented in the same modality) and crossmodal trials (Sequence 1 visual, Sequence 2 auditory, or vice versa) for both spatial and temporal tasks. We found a strong interaction between modality and task: Spatial performance was best on unimodal visual trials, whereas temporal performance was best on unimodal auditory trials. The order of modalities on crossmodal trials also mattered, suggesting that perceptual fidelity at encoding is critical to STM. Critically, no cost was attributable to crossmodal comparison: In both tasks, performance on crossmodal trials was as good as or better than on the weaker unimodal trials. STM representations of space and time can guide change detection in either the visual or the auditory modality, suggesting that the temporal or spatial organization of STM may supersede sensory-specific organization.

Dissociable loss of the representations in visual short-term memory

ABSTRACTThe present study investigated in what manner the information in visual short-term memory (VSTM) is lost. Participants memorized four items, one of which was given higher priority later by a retro-cue. Then participants were required to detect a possible change, which could be either a large or small change, occurred to one of the items. The results showed that the detection performance for the small change of the uncued items was poorer than the cued item, yet large change that occurred to all four memory items could be detected perfectly, indicating that the uncued representations lost some detailed information yet still had some basic features retained in VSTM. The present study suggests that after being encoded into VSTM, the information is not lost in an object-based manner; rather, features of an item are still dissociable, so that they can be lost separately.

Working Memory Models: Insights From Neuroimaging.

FIGURE 1. The Atkinson and Shiffrin Model of memory is diagramed in the gray panel. Sensory information is perceived and suppressed via selective attention processes, then briefly held in the limited-capacity modality-specific sensory register. Information enhanced by selective attention enters into short term memory (STM). The process of rehearsal (maintenance) can sustain information in STM. Information in STM is automatically encoded (stored, consolidated) into long term memory (LTM). Although flawed, this model continues to provide a simple and easy approach to understanding memory. Assumptions that proved to be inconsistent with research included that any information in STM will transfer to LTM and that STM is required

Short-Term and Working Memory Impairments in Early-Implanted, Long-Term Cochlear Implant Users Are Independent of Audibility and Speech Production.

To determine whether early-implanted, long-term cochlear implant (CI) users display delays in verbal short-term and working memory capacity when processes related to audibility and speech production are eliminated. Twenty-three long-term CI users and 23 normal-hearing controls each completed forward and backward digit span tasks under testing conditions that differed in presentation modality (auditory or visual) and response output (spoken recall or manual pointing). Normal-hearing controls reproduced more lists of digits than the CI users, even when the test items were presented visually and the responses were made manually via touchscreen response. Short-term and working memory delays observed in CI users are not due to greater demands from peripheral sensory processes such as audibility or from overt speech-motor planning and response output organization. Instead, CI users are less efficient at encoding and maintaining phonological representations in verbal short-term memory using phonological and linguistic strategies during memory tasks.

Verbal Short-Term Memory Deficits in Chinese Children with Dyslexia may not be a Problem with the Activation of Phonological Representations.

This study explored the underlying mechanism of the verbal short-term memory deficit in Chinese children with developmental dyslexia. Twenty-four children with dyslexia and 28 age-matched normal readers participated in the study. They were required to memorize a visually presented series of six Chinese characters and identify them from a list also including code-specific distracters and non-code-specific distracters. Error rates were recorded and were higher for code-specific distracters in all three conditions, revealing phonological, visual, and semantic similarity effects respectively. Group comparisons showed a stronger phonological similarity effect in dyslexic group, suggesting intact activation of phonological representations of target characters. Children with dyslexia also exhibited a greater semantic similarity effect, revealing stronger activation of semantic representations, while visual similarity effects were equivalent to controls. These results suggest that the verbal short-term memory deficit in Chinese dyslexics might not stem from insufficient activation of phonological information. Based the semantic activation of target characters in dyslexics is greater than in controls, it is possible that the memory deficit of dyslexia is related with deficient inhibition of target semantic representations in short-term memory.

Understanding the nature of visual short-term memory representation in human parietal cortex

Understanding the nature of visual short-term memory representation in human parietal cortex

Retrieval-Induced Inhibition in Short-Term Memory

We used a visual illusion called motion repulsion as a model system for investigating competition between two mental representations. Subjects were asked to remember two random-dot-motion displays presented in sequence and then to report the motion directions for each. Remembered motion directions were shifted away from the actual motion directions, an effect similar to the motion repulsion observed during perception. More important, the item retrieved second showed greater repulsion than the item retrieved first. This suggests that earlier retrieval exerted greater inhibition on the other item being held in short-term memory. This retrieval-induced motion repulsion could be explained neither by reduced cognitive resources for maintaining short-term memory nor by continued inhibition between short-term memory representations. These results indicate that retrieval of memory representations inhibits other representations in short-term memory. We discuss mechanisms of retrieval-induced inhibition and their implications for the structure of memory.

Filling gaps in visual motion for target capture.

A remarkable challenge our brain must face constantly when interacting with the environment is represented by ambiguous and, at times, even missing sensory information. This is particularly compelling for visual information, being the main sensory system we rely upon to gather cues about the external world. It is not uncommon, for example, that objects catching our attention may disappear temporarily from view, occluded by visual obstacles in the foreground. Nevertheless, we are often able to keep our gaze on them throughout the occlusion or even catch them on the fly in the face of the transient lack of visual motion information. This implies that the brain can fill the gaps of missing sensory information by extrapolating the object motion through the occlusion. In recent years, much experimental evidence has been accumulated that both perceptual and motor processes exploit visual motion extrapolation mechanisms. Moreover, neurophysiological and neuroimaging studies have identified brain regions potentially involved in the predictive representation of the occluded target motion. Within this framework, ocular pursuit and manual interceptive behavior have proven to be useful experimental models for investigating visual extrapolation mechanisms. Studies in these fields have pointed out that visual motion extrapolation processes depend on manifold information related to short-term memory representations of the target motion before the occlusion, as well as to longer term representations derived from previous experience with the environment. We will review recent oculomotor and manual interception literature to provide up-to-date views on the neurophysiological underpinnings of visual motion extrapolation.

Neural dynamics underlying attentional orienting to auditory representations in short-term memory.

Sounds are ephemeral. Thus, coherent auditory perception depends on "hearing" back in time: retrospectively attending that which was lost externally but preserved in short-term memory (STM). Current theories of auditory attention assume that sound features are integrated into a perceptual object, that multiple objects can coexist in STM, and that attention can be deployed to an object in STM. Recording electroencephalography from humans, we tested these assumptions, elucidating feature-general and feature-specific neural correlates of auditory attention to STM. Alpha/beta oscillations and frontal and posterior event-related potentials indexed feature-general top-down attentional control to one of several coexisting auditory representations in STM. Particularly, task performance during attentional orienting was correlated with alpha/low-beta desynchronization (i.e., power suppression). However, attention to one feature could occur without simultaneous processing of the second feature of the representation. Therefore, auditory attention to memory relies on both feature-specific and feature-general neural dynamics.

Common neural mechanism for maintaining representation in visual mental imagery and visual short-term memory

Common neural mechanism for maintaining representation in visual mental imagery and visual short-term memory