Encoding-retrieval Similarity Research Articles

Greater sleep variance related to decrements in memory performance and event-specific neural similarity: a racially/ethnically diverse lifespan sample

Successful memory performance depends on overlap between neural representations at encoding and retrieval. With older age, neural similarity, memory performance, and sleep quality decline. Regardless of age, racial/ethnic minorities tend to experience poor sleep, which may contribute to poor memory. Previous studies have not investigated memory performance, neural similarity, sleep quality, and age in diverse participants. Here, we recruited racially/ethnically diverse adults across the lifespan and examined night-to-night sleep quality in relation to memory performance and encoding-retrieval similarity. We employed item-specific, representational similarity analysis (not confounded by effort, word perception, or differences in electroencephalography signal amplitude) to assess neural similarity for intact and recombined paired associates. Greater sleep variance and poorer memory performance were more strongly associated with older age. Interestingly, sleep variance was positively associated with neural similarity for intact pairs. This relationship was stronger with younger age and for racial/ethnic minorities. For recombined pairs, greater sleep variance was associated with reduced neural similarity. Thus, varied sleep may induce greater reliance on familiarity, while consistent sleep may support recollection.

Age-related differences in encoding-retrieval similarity and their relationship to false memory

Typical aging is associated with increases in false memory rates among older adults. Such errors are frequently associated with differential neural activity during encoding and retrieval in older compared to younger adults within visual cortices and the hippocampus. It remains unknown how pattern similarity reductions relate to false memories in healthy aging. Using encoding-retrieval similarity (ERS) analyses in a sample of younger and older adults, we examined how the similarity of neural patterns between memory phases associated with target and lure objects was impacted by age and contributed to false memory rates. Single-item ERS for targets and lures was reduced by age throughout much of the ventral visual stream and the posterior hippocampus. Furthermore, ERS associated with perceptual lures within the visual stream maintained differential relationships with false memory. Finally, a global ERS metric accounted for age deficits in single-item ERS, but did not contribute to false memory rates. These findings highlight the contribution of age-related reductions in ERS across multiple representational levels to false memories in healthy aging.

Distinct medial-temporal lobe mechanisms of encoding and amygdala-mediated memory reinstatement for disgust and fear

Current models of episodic memory posit that retrieval involves the reenactment of encoding processes. Recent evidence has shown that this reinstatement process – indexed by subsequent encoding-retrieval similarity of brain activity patterns - is related to the activity in the hippocampus during encoding. However, we tend to re-experience emotional events in memory more richly than dull events. The role of amygdala - a critical hub of emotion processing – in reinstatement of emotional events was poorly understood. To investigate it, we leveraged a previously overlooked divergence in the role of amygdala in memory modulation by distinct emotions - disgust and fear. Here we used a novel paradigm in which participants encoded complex events (word pairs) and their memory was tested after 3 weeks, both phases during fMRI scanning. Using representational similarity analysis and univariate analyses, we show that the strength of amygdala activation during encoding was correlated with memory reinstatement of individual event representations in emotion-specific regions. Critically, amygdala modulated reinstatement more for disgust than fear. This was in line with other differences observed at the level of memory performance and neural mechanisms of encoding. Specifically, amygdala and perirhinal cortex were more involved during encoding of disgust-related events, whereas hippocampus and parahippocampal gyrus during encoding of fear-related events. Together, these findings shed a new light on the role of the amygdala and medial temporal lobe regions in encoding and reinstatement of specific emotional memories.

An engram of intentionally forgotten information

Successful forgetting of unwanted memories is crucial for goal-directed behavior and mental wellbeing. While memory retention strengthens memory traces, it is unclear what happens to memory traces of events that are actively forgotten. Using intracranial EEG recordings from lateral temporal cortex, we find that memory traces for actively forgotten information are partially preserved and exhibit unique neural signatures. Memory traces of successfully remembered items show stronger encoding-retrieval similarity in gamma frequency patterns. By contrast, encoding-retrieval similarity of item-specific memory traces of actively forgotten items depend on activity at alpha/beta frequencies commonly associated with functional inhibition. Additional analyses revealed selective modification of item-specific patterns of connectivity and top-down information flow from dorsolateral prefrontal cortex to lateral temporal cortex in memory traces of intentionally forgotten items. These results suggest that intentional forgetting relies more on inhibitory top-down connections than intentional remembering, resulting in inhibitory memory traces with unique neural signatures and representational formats.

Age-related dedifferentiation and hyperdifferentiation of perceptual and mnemonic representations

Preliminary evidence indicates that occipito-temporal activation patterns for different visual stimuli are less distinct in older (OAs) than younger (YAs) adults, suggesting a dedifferentiation of visual representations with aging. Yet, it is unclear if this deficit (1) affects only sensory or also categorical aspects of representations during visual perception (perceptual representations), and (2) affects only perceptual or also mnemonic representations. To investigate these issues, we fMRI-scanned YAs and OAs viewing and then remembering visual scenes. First, using representational similarity analyses, we distinguished sensory vs. categorical features of perceptual representations. We found that, compared to YAs, sensory features in early visual cortex were less differentiated in OAs (i.e., age-related dedifferentiation), replicating previous research, whereas categorical features in anterior temporal lobe (ATL) were more differentiated in OAs. This is, to our knowledge, the first report of an age-related hyperdifferentiation. Second, we assessed the quality of mnemonic representations by measuring encoding-retrieval similarity (ERS) in activation patterns. We found that aging impaired mnemonic representations in early visual cortex and hippocampus but enhanced mnemonic representations in ATL. Thus, both perceptual and mnemonic representations in ATL were enhanced by aging. In sum, our findings suggest that aging impairs visual and mnemonic representations in posterior brain regions but enhances them in anterior regions.

Neural pattern similarity across concept exemplars predicts memory after a long delay

The irregularities of the world ensure that each interaction we have with a concept is unique. In order to generalize across these unique encounters to form a high-level representation of a concept, we must draw on similarities between exemplars to form new conceptual knowledge that is maintained over a long time. Two neural similarity measures — pattern robustness and encoding-retrieval similarity — are particularly important for predicting memory outcomes. In this study, we used fMRI to measure activity patterns while people encoded and retrieved novel pairings between unfamiliar (Dutch) words and visually presented animal species. We address two underexplored questions: 1) whether neural similarity measures can predict memory outcomes, despite perceptual variability between presentations of a concept and 2) if pattern similarity measures can predict subsequent memory over a long delay (i.e., one month). Our findings indicate that pattern robustness during encoding in brain regions that include parietal and medial temporal areas is an important predictor of subsequent memory. In addition, we found significant encoding-retrieval similarity in the left ventrolateral prefrontal cortex after a month’s delay. These findings demonstrate that pattern similarity is an important predictor of memory for novel word-animal pairings even when the concept includes multiple exemplars. Importantly, we show that established predictive relationships between pattern similarity and subsequent memory do not require visually identical stimuli (i.e., are not simply due to low-level visual overlap between stimulus presentations) and are maintained over a month.

Individual-specific and shared representations during episodic memory encoding and retrieval

Although human memories seem unique to each individual, they are shared to a great extent across individuals. Previous studies have examined, separately, subject-specific and cross-subject shared representations during memory encoding and retrieval, but how shared memories are formed from individually encoded representations is not clearly understood. Using a unique fMRI design involving memory encoding and retrieval, and representational similarity analysis to link representations from different individuals, brain regions, and processing stages, the current study revealed that distributed brain regions showed both subject-specific and shared neural representations during both memory encoding and retrieval. Furthermore, different brain regions showed stage-specific representational strength, with the visual cortex showing greater unique and shared representations during encoding, whereas the left angular gyrus showing greater unique and shared representations during retrieval. The neural representations during encoding were transformed during retrieval, as shown by smaller cross-subject encoding-retrieval similarity (ERS) than cross-subject similarity either during encoding or during retrieval. This cross-subject and cross-stage similarity was found both within and across regions, with strong pattern similarity between the encoded representation in VVC and the retrieved representation in the angular gyrus. Simulation analysis further suggested that these patterns could be achieved by incorporating stage-specific representational strength, and cross-region reinstatement from encoding to retrieval, but not by a common transformation from encoding to retrieval across subjects. Together, our results shed light on how memory representations are encoded and transformed to maintain individual characteristics and at the same time to create shared representations to facilitate interpersonal communication.

Excitatory TMS modulates memory representations

ABSTRACTBrain stimulation technologies have seen increasing application in basic science investigations, specifically toward the goal of improving memory function. However, proposals concerning the neural mechanisms underlying cognitive enhancement often rely on simplified notions of excitation. As a result, most applications examining the effects of transcranial magnetic stimulation (TMS) on functional neuroimaging measures have been limited to univariate analyses of brain activity. We present here analyses using representational similarity analysis (RSA) and encoding-retrieval similarity (ERS) analysis to quantify the effect of TMS on memory representations. To test whether an increase in local excitability in PFC can have measurable influences on upstream representations in earlier temporal memory regions, we compared 1 and 5Hz stimulation to the left dorsolateral PFC (DLPFC). We found that 5Hz rTMS, relative to 1Hz, had multiple effects on neural representations: 1) greater representational similarity during both encoding and retrieval in ventral stream regions, 2) greater ERS in the hippocampus, and, critically, 3) increasing ERS in MTL was correlated with increasing univariate activity in DLPFC, and greater functional connectivity for hits than misses between these regions. These results provide the first evidence of rTMS modulating semantic representations and strengthen the idea that rTMS may affect the reinstatement of previously experienced events in upstream regions.

Transformed Neural Pattern Reinstatement during Episodic Memory Retrieval.

Contemporary models of episodic memory posit that remembering involves the reenactment of encoding processes. Although encoding-retrieval similarity has been consistently reported and linked to memory success, the nature of neural pattern reinstatement is poorly understood. Using high-resolution fMRI on human subjects, our results obtained clear evidence for item-specific pattern reinstatement in the frontoparietal cortex, even when the encoding-retrieval pairs shared no perceptual similarity. No item-specific pattern reinstatement was found in the ventral visual cortex. Importantly, the brain regions and voxels carrying item-specific representation differed significantly between encoding and retrieval, and the item specificity for encoding-retrieval similarity was smaller than that for encoding or retrieval, suggesting different nature of representations between encoding and retrieval. Moreover, cross-region representational similarity analysis suggests that the encoded representation in the ventral visual cortex was reinstated in the frontoparietal cortex during retrieval. Together, these results suggest that, in addition to reinstatement of the originally encoded pattern in the brain regions that perform encoding processes, retrieval may also involve the reinstatement of a transformed representation of the encoded information. These results emphasize the constructive nature of memory retrieval that helps to serve important adaptive functions.SIGNIFICANCE STATEMENT Episodic memory enables humans to vividly reexperience past events, yet how this is achieved at the neural level is barely understood. A long-standing hypothesis posits that memory retrieval involves the faithful reinstatement of encoding-related activity. We tested this hypothesis by comparing the neural representations during encoding and retrieval. We found strong pattern reinstatement in the frontoparietal cortex, but not in the ventral visual cortex, that represents visual details. Critically, even within the same brain regions, the nature of representation during retrieval was qualitatively different from that during encoding. These results suggest that memory retrieval is not a faithful replay of past event but rather involves additional constructive processes to serve adaptive functions.

Reinstatement of individual past events revealed by the similarity of distributed activation patterns during encoding and retrieval.

Neurobiological memory models assume memory traces are stored in neocortex, with pointers in the hippocampus, and are then reactivated during retrieval, yielding the experience of remembering. Whereas most prior neuroimaging studies on reactivation have focused on the reactivation of sets or categories of items, the current study sought to identify cortical patterns pertaining to memory for individual scenes. During encoding, participants viewed pictures of scenes paired with matching labels (e.g., "barn," "tunnel"), and, during retrieval, they recalled the scenes in response to the labels and rated the quality of their visual memories. Using representational similarity analyses, we interrogated the similarity between activation patterns during encoding and retrieval both at the item level (individual scenes) and the set level (all scenes). The study yielded four main findings. First, in occipitotemporal cortex, memory success increased with encoding-retrieval similarity (ERS) at the item level but not at the set level, indicating the reactivation of individual scenes. Second, in ventrolateral pFC, memory increased with ERS for both item and set levels, indicating the recapitulation of memory processes that benefit encoding and retrieval of all scenes. Third, in retrosplenial/posterior cingulate cortex, ERS was sensitive to individual scene information irrespective of memory success, suggesting automatic activation of scene contexts. Finally, consistent with neurobiological models, hippocampal activity during encoding predicted the subsequent reactivation of individual items. These findings show the promise of studying memory with greater specificity by isolating individual mnemonic representations and determining their relationship to factors like the detail with which past events are remembered.

Temporal memory is shaped by encoding stability and intervening item reactivation.

Making sense of previous experience requires remembering the order in which events unfolded in time. Prior work has implicated the hippocampus and medial temporal lobe cortex in memory for temporal information associated with individual episodes. However, the processes involved in encoding and retrieving temporal information across extended sequences is relatively poorly understood. Here we used fMRI during the encoding and retrieval of extended sequences to test specific predictions about the type of information used to resolve temporal order and the role of the hippocampus in this process. Participants studied sequences of images of celebrity faces and common objects followed by a recency discrimination test. The main conditions of interest were pairs of items that had been presented with three intervening items, half of which included an intervening category shift. During encoding, hippocampal pattern similarity across intervening items was associated with subsequent successful order memory. To test for evidence of associative retrieval, we trained a classifier to discriminate encoding patterns associated with faces versus objects and applied the classifier on fMRI patterns during recency discrimination. We found evidence that the category content of intervening items was reactivated during recency judgments, and this was related to hippocampal encoding-retrieval similarity. A follow-up behavioral priming experiment revealed additional evidence for intervening item reinstatement during temporal order judgments. Reinstatement did not differ according to whether the items occurred within a single context or across context boundaries. Thus, these data suggest that inter-item associative encoding and retrieval mediated by the hippocampus contribute to temporal order memory.

Neural Similarity Between Encoding and Retrieval is Related to Memory Via Hippocampal Interactions

A fundamental principle in memory research is that memory is a function of the similarity between encoding and retrieval operations. Consistent with this principle, many neurobiological models of declarative memory assume that memory traces are stored in cortical regions, and the hippocampus facilitates the reactivation of these traces during retrieval. The present investigation tested the novel prediction that encoding-retrieval similarity can be observed and related to memory at the level of individual items. Multivariate representational similarity analysis was applied to functional magnetic resonance imaging data collected during encoding and retrieval of emotional and neutral scenes. Memory success tracked fluctuations in encoding-retrieval similarity across frontal and posterior cortices. Importantly, memory effects in posterior regions reflected increased similarity between item-specific representations during successful recognition. Mediation analyses revealed that the hippocampus mediated the link between cortical similarity and memory success, providing crucial evidence for hippocampal-cortical interactions during retrieval. Finally, because emotional arousal is known to modulate both perceptual and memory processes, similarity effects were compared for emotional and neutral scenes. Emotional arousal was associated with enhanced similarity between encoding and retrieval patterns. These findings speak to the promise of pattern similarity measures for evaluating memory representations and hippocampal-cortical interactions.