Scene Memory Research Articles

Spatial Contextual Information Modulates Affordance Processing and Early Electrophysiological Markers of Scene Perception.

Scene perception allows humans to extract information from their environment and plan navigation efficiently. The automatic extraction of potential paths in a scene, also referred to as navigational affordances, is supported by scene-selective regions (SSRs) that enable efficient human navigation. Recent evidence suggests that the activity of these SSRs can be influenced by information from adjacent spatial memory areas. However, it remains unexplored how these contextual information could influence the extraction of bottom-up information, such as navigational affordances, from a scene and the underlying neural dynamics. Therefore, we analyzed ERPs in 26 young adults performing scene and spatial memory tasks in artificially generated rooms with varying numbers and locations of available doorways. We found that increasing the number of navigational affordances only impaired performance in the spatial memory task. ERP results showed a similar pattern of activity for both tasks, but with increased P2 amplitude in the spatial memory task compared with the scene memory. Finally, we reported no modulation of the P2 component by the number of affordances in either task. This modulation of early markers of visual processing suggests that the dynamics of SSR activity are influenced by a priori knowledge, with increased amplitude when participants have more contextual information about the perceived scene. Overall, our results suggest that prior spatial knowledge about the scene, such as the location of a goal, modulates early cortical activity associated with SSRs, and that this information may interact with bottom-up processing of scene content, such as navigational affordances.

Influence of Familiarity, Aesthetic Value, and Change Type on Visual Memory of Real-World Scenes in a Virtual Reality Change/No-Change Paradigm

Influence of Familiarity, Aesthetic Value, and Change Type on Visual Memory of Real-World Scenes in a Virtual Reality Change/No-Change Paradigm

The modulation of temporal predictability on attentional boost effect.

The attentional boost effect, characterized by better memory for background scenes coinciding with a detection target than a nontarget, is believed to stem from a temporary increase in attentional capacity at the time of an acute behavior-related event occurring. Sisk and Jiang's study found that the attentional boost effect also occurs when the target's appearance was predictable. Unfortunately, the duration of the predictive interval in Sisk and Jiang's study was fixed. Since different predictive intervals had different weakening degrees to the acuteness of the target, this fixed duration hindered further investigation into the impact of different levels of predictability on the attentional boost effect. Using the encoding-recognition paradigm and the remembering/knowing paradigm, and setting target stimuli with different predictive interval in target detection tasks, the current study aimed to explore the influence of varying the duration of the predictive interval on the attentional boost effect. The attentional boost effect was observed only in the short and medium predictive duration conditions, but not in the long predictive duration condition. Moreover, as the duration of the predictive interval increased, participants' memory performance on target-paired words gradually declined, while their memory performance on distractor-paired and baseline-paired words gradually improved. Predictability may alter the task demands, allowing participants to more effectively allocate attentional resources to the two tasks at hand.

A ventromedial visual cortical ‘Where’ stream to the human hippocampus for spatial scenes revealed with magnetoencephalography

The primate including the human hippocampus implicated in episodic memory and navigation represents a spatial view, very different from the place representations in rodents. To understand this system in humans, and the computations performed, the pathway for this spatial view information to reach the hippocampus was analysed in humans. Whole-brain effective connectivity was measured with magnetoencephalography between 30 visual cortical regions and 150 other cortical regions using the HCP-MMP1 atlas in 21 participants while performing a 0-back scene memory task. In a ventromedial visual stream, V1–V4 connect to the ProStriate region where the retrosplenial scene area is located. The ProStriate region has connectivity to ventromedial visual regions VMV1–3 and VVC. These ventromedial regions connect to the medial parahippocampal region PHA1–3, which, with the VMV regions, include the parahippocampal scene area. The medial parahippocampal regions have effective connectivity to the entorhinal cortex, perirhinal cortex, and hippocampus. In contrast, when viewing faces, the effective connectivity was more through a ventrolateral visual cortical stream via the fusiform face cortex to the inferior temporal visual cortex regions TE2p and TE2a. A ventromedial visual cortical ‘Where’ stream to the hippocampus for spatial scenes was supported by diffusion topography in 171 HCP participants at 7 T.

Visual working memory for natural scenes: challenges and opportunities.

Visual working memory is a fundamental cognitive process that people use thousands of times each day as they engage in visually guided behavior. Thus, it is important to understand how the natural visual input-which consists of complex, spatially organized, continuously varying features-is represented in visual working memory. However, most research has used arrays of discrete, artificial objects defined by simple features, and existing formal models of visual working memory cannot be applied to natural scenes. In this paper, we identify 3 key aspects of natural scenes that are not captured by existing formal models of visual working memory, along with 2 distinct types of attention that must be considered. The goal is to clearly define the challenges and opportunities for moving models of visual working memory from arrays of artificial objects to natural scenes.

Complexity Matters: Normalization to Prototypical Viewpoint Induces Memory Distortion along the Vertical Axis of Scenes.

Scene memory is prone to systematic distortions potentially arising from experience with the external world. Boundary transformation, a well-known memory distortion effect along the near-far axis of the three-dimensional space, represents the observer's erroneous recall of scenes' viewing distance. Researchers argued that normalization to the prototypical viewpoint with the high-probability viewing distance influenced this phenomenon. Herein, we hypothesized that the prototypical viewpoint also exists in the vertical angle of view (AOV) dimension and could cause memory distortion along scenes' vertical axis. Human subjects of both sexes were recruited to test this hypothesis, and two behavioral experiments were conducted, revealing a systematic memory distortion in the vertical AOV in both the forced choice (n = 79) and free adjustment (n = 30) tasks. Furthermore, the regression analysis implied that the complexity information asymmetry in scenes' vertical axis and the independent subjective AOV ratings from a large set of online participants (n = 1,208) could jointly predict AOV biases. Furthermore, in a functional magnetic resonance imaging experiment (n = 24), we demonstrated the involvement of areas in the ventral visual pathway (V3/V4, PPA, and OPA) in AOV bias judgment. Additionally, in a magnetoencephalography experiment (n = 20), we could significantly decode the subjects' AOV bias judgments ∼140 ms after scene onset and the low-level visual complexity information around the similar temporal interval. These findings suggest that AOV bias is driven by the normalization process and associated with the neural activities in the early stage of scene processing.

Investigating visual navigation using spiking neural network models of the insect mushroom bodies.

Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN-a library for building GPU accelerated spiking neural networks-we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

Visual Recognition Memory of Scenes Is Driven by Categorical, Not Sensory, Visual Representations.

When we perceive a scene, our brain processes various types of visual information simultaneously, ranging from sensory features, such as line orientations and colors, to categorical features, such as objects and their arrangements. Whereas the role of sensory and categorical visual representations in predicting subsequent memory has been studied using isolated objects, their impact on memory for complex scenes remains largely unknown. To address this gap, we conducted an fMRI study in which female and male participants encoded pictures of familiar scenes (e.g., an airport picture) and later recalled them, while rating the vividness of their visual recall. Outside the scanner, participants had to distinguish each seen scene from three similar lures (e.g., three airport pictures). We modeled the sensory and categorical visual features of multiple scenes using both early and late layers of a deep convolutional neural network. Then, we applied representational similarity analysis to determine which brain regions represented stimuli in accordance with the sensory and categorical models. We found that categorical, but not sensory, representations predicted subsequent memory. In line with the previous result, only for the categorical model, the average recognition performance of each scene exhibited a positive correlation with the average visual dissimilarity between the item in question and its respective lures. These results strongly suggest that even in memory tests that ostensibly rely solely on visual cues (such as forced-choice visual recognition with similar distractors), memory decisions for scenes may be primarily influenced by categorical rather than sensory representations.

Can neutral episodic memories become emotional? Evidence from facial expressions and subjective feelings

Maladaptive emotional memories are a transdiagnostic feature of mental health problems. Therefore, understanding whether and how emotional memories can change might help to prevent and treat mental disorders. We tested whether neutral memories of naturalistic events can retroactively acquire positive or negative affect, in a preregistered three-day Modification of Valence in Episodes (MOVIE) paradigm. On Day 1, participants (N = 41) encoded memories of neutral movie scenes, representing lifelike naturalistic experiences. On Day 2, they retrieved each episode before viewing a happy, sad, or neutral scene from the same movie (yielding a within-subjects design with a neutral-negative, neutral-positive, and neutral-neutral condition). On Day 3, participants again retrieved each memory from Day 1. We assessed the affective tone of episodes through facial expressions of positive and negative affect (using facial electromyography, fEMG) and through self-reported feelings. Positive updating of neutral episodes led to increased expressions of positive affect, whereas negative updating led to increased self-reported negative feelings. These results suggest that complex neutral episodic memories can retroactively acquire an affective tone, but the effects were modest and inconsistent across affect readouts. Future research should investigate alternative approaches to updating emotional memories that produce more profound changes in the valence of memories.

The Accuracy and Precision of Memory for Natural Scenes: A Walk in the Park.

It is challenging to quantify the accuracy and precision of scene memory because it is unclear what 'space' scenes occupy (how can we quantify error when misremembering a natural scene?). To address this, we exploited the ecologically valid, metric space in which scenes occur and are represented: routes. In a delayed estimation task, participants briefly saw a target scene drawn from a video of an outdoor 'route loop', then used a continuous report wheel of the route to pinpoint the scene. Accuracy was high and unbiased, indicating there was no net boundary extension/contraction. Interestingly, precision was higher for routes that were more self-similar (as characterized by the half-life, in meters, of a route's Multiscale Structural Similarity index), consistent with previous work finding a 'similarity advantage' where memory precision is regulated according to task demands. Overall, scenes were remembered to within a few meters of their actual location.

Children develop adult-like visual sensitivity to image memorability by the age of 4.

Adults have been shown to consistently remember and forget certain images despite large individual differences, suggesting a population-wide sensitivity to an image's intrinsic memorability-a measure of how successfully an image is remembered. While a decade of research has focused on image memorability among adults, the developmental trajectory of these consistencies in memory is understudied. Here, we investigate by what age children gain adult-like sensitivity to the image memorability effect. We utilized data from Saragosa-Harris et al. (2021), where 137 children aged between 3 and 5 years old encoded animal-scene image pairs and then after a 5-min, 24-hr, or 1-week delay performed a cued recognition task for each scene target given its animal cue. We tested adults' memory of the same scene images using ResMem (Needell & Bainbridge, 2022), a pretrained deep neural network that predicts adult image memorability scores, and using an online behavioral continuous recognition task (N = 116). Results showed that ResMem predictions, as a proxy of adults' memory, predicted scene memory of children by the age of 4 and were the most predictive of children's memory across ages after a long, 1-week delay. Children at age 3 show nonadult-like consistent memory patterns, implying that the nonadult-like memory patterns were not due to poor memory performance. Instead, 3-year-olds may have consistently used certain visual memory strategies that become less optimal as they age. Our results suggest that adult-like sensitivity to image memorability emerges by the age of 4 through experience. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

From vision to memory: How scene-sensitive regions support episodic memory formation during child development

Previous brain imaging studies have identified three brain regions that selectively respond to visual scenes, the parahippocampal place area (PPA), the occipital place area (OPA), and the retrosplenial cortex (RSC). There is growing evidence that these visual scene-sensitive regions process different types of scene information and may have different developmental timelines in supporting scene perception. How these scene-sensitive regions support memory functions during child development is largely unknown. We investigated PPA, OPA and RSC activations associated with episodic memory formation in childhood (5–7 years of age) and young adulthood, using a subsequent scene memory paradigm and a functional localizer for scenes. PPA, OPA, and RSC subsequent memory activation and functional connectivity differed between children and adults. Subsequent memory effects were found in activations of all three scene regions in adults. In children, however, robust subsequent memory effects were only found in the PPA. Functional connectivity during successful encoding was significant among the three regions in adults, but not in children. PPA subsequently memory activations and PPA-RSC subsequent memory functional connectivity correlated with accuracy in adults, but not children. These age-related differences add new evidence linking protracted development of the scene-sensitive regions to the protracted development of episodic memory.

Eye tracking evidence for the reinstatement of emotionally negative and neutral memories.

Recent eye tracking studies have linked gaze reinstatement-when eye movements from encoding are reinstated during retrieval-with memory performance. In this study, we investigated whether gaze reinstatement is influenced by the affective salience of information stored in memory, using an adaptation of the emotion-induced memory trade-off paradigm. Participants learned word-scene pairs, where scenes were composed of negative or neutral objects located on the left or right side of neutral backgrounds. This allowed us to measure gaze reinstatement during scene memory tests based on whether people looked at the side of the screen where the object had been located. Across two experiments, we behaviorally replicated the emotion-induced memory trade-off effect, in that negative object memory was better than neutral object memory at the expense of background memory. Furthermore, we found evidence that gaze reinstatement was related to recognition memory for the object and background scene components. This effect was generally comparable for negative and neutral memories, although the effects of valence varied somewhat between the two experiments. Together, these findings suggest that gaze reinstatement occurs independently of the processes contributing to the emotion-induced memory trade-off effect.

The anterior medial hippocampus contributes to both recall and familiarity-based memory for scenes

The hippocampus is usually associated with recall memory, whereas its contribution to familiarity-based memory is debated. Growing evidence support the idea that this structure participates to any cognitive process performed on scene representations. In parallel, differences in functional specialisation and cortical connectivity were found across the longitudinal and transverse axes of the hippocampus. Here we reanalysed functional MRI data from 51 participants showing stronger engagement of the hippocampus in recall, familiarity-based recognition and rejection, and visual discrimination, of scenes compared to single objects. A conjunction analysis between these four tasks revealed a set of occipital, medial temporal, posterior cingulate, and parietal regions, matching the scene construction network described in the literature. Crucially, we found that the anterior medial part of the hippocampus was consistently involved in all tasks investigated for scene stimuli. These findings support that the hippocampus can contribute to both recall and familiarity-based memory, depending on stimulus type. More generally, this bolsters the recent proposal that circumscribed regions within the hippocampus may underpin specific cognitive mechanisms.

Research on the learning experience of virtual simulation class experimental teaching and learning based on the perspective of nursing students

BackgroundThe enrichment of information technology has impacted traditional teaching modes. The emergence of virtual simulation class experimental teaching software has effectively improved the quality of nursing experiment teaching. The learning experience of virtual simulation class experiment teaching and learning based on the perspective of nursing students is explored to provide a basis for improving related learning effects in the future.MethodsFourteen undergraduate nursing students were selected using the purposive sampling method for semi-structured interviews. The Colaizzi seven-step analysis method was used to collate and analyse the interview data.ResultsTwo themes and six sub-themes were considered during the data analysis. The two themes were positive experiences and negative experiences. In the positive learning experience, undergraduate nursing students showed a deep memory of authentic and diverse scenes, which presented knowledge in a clearly logical, visualised and stereoscopic manner. Negative experiences are manifested as significantly different learning efficiencies in different grades and subjects, and timing the delivery of teaching feedback is difficult.ConclusionVirtual simulation experimental teaching can promote the subjective initiative of nursing students’ learning and promote better coordination and unity in their image and theoretical thinking. Some advantages can be augmented by following the national educational policy, strengthening the information construction, combining the construction of virtual simulation experiments with the discipline’s characteristics and optimising the resources. This paper provides a reference for the future exploration of nursing education and further improving the construction of virtual simulation experimental teaching tools and resources.

Stories in the Mind? The Role of Story-Based Categorizations in Motion Classification.

Categorization is fundamental for spatial and motion representation in both the domain of artificial intelligence and human cognition. In this paper, we investigated whether motion categorizations designed in artificial intelligence can inform human cognition. More concretely, we investigated if such categorizations (also known as qualitative representations) can inform the psychological understanding of human perception and memory of motion scenes. To this end, we took two motion categorizations in artificial intelligence, Motion-RCC and Motion-OPRA1 , and conducted four experiments on human perception and memory. Participants viewed simple motion scenes and judged the similarity of transformed scenes with this reference scene. Those transformed scenes differed in none, one, or both Motion-RCC and Motion-OPRA1 categories. Importantly, we applied an equal absolute metric change to those transformed scenes, so that differences in the similarity judgments should be due only to differing categories. In Experiments 1a and 1b, where the reference stimulus and transformed stimuli were visible at the same time (perception), both Motion-OPRA1 and Motion-RCC influenced the similarity judgments, with a stronger influence of Motion-OPRA1 . In Experiments 2a and 2b, where participants first memorized the reference stimulus and viewed the transformed stimuli after a short blank (memory), only Motion-OPRA1 had marked influences on the similarity judgments. Our findings demonstrate a link between human cognition and these motion categorizations developed in artificial intelligence. We argue for a continued and close multidisciplinary approach to investigating the representation of motion scenes.

Exosomal miR-let-7c-5p is involved in the cognitive function of type 2 diabetes mellitus patients by interleukin 10: A cross-sectional study.

Interleukin (IL)-10 plays a notable role in the inflammatory-associated mild cognitive impairment (MCI). We aimed to investigate whether IL-10 and its upstream factors exert an impact on MCI in type 2 diabetes mellitus (T2DM) patients. A total of 117 T2DM patients were recruited and divided into Control group and MCI group based on the presence or absence of MCI. Clinical parameters were collected. The Montreal Cognitive Assessment (MoCA) was conducted for global cognitive function. Digit Span Test (DST), Verbal Fluency Test (VFT), and Trail Making Test-B (TMTB) were used to evaluate the executive functions of the diabetic patients. Trail Making Test-A (TMTA) was performed to examine the information processing speed function. Patients' scene memory was examined by Logical Memory Test (LMT). After the baseline data were compared, correlation and regression analyses were performed to explore the relationship amongIL-10, miR-let-7c-5p and cognitive function. Compared to 80 patients in the control group, 37 patients in the MCI group exhibited lower IL-10 in plasma and higher miR-let-7c-5p levels in exosomes from plasma. The IL-10 level was negatively associated with MoCA. Likewise, miR-let-7c-5p levels were negatively correlated with IL-10 levels and MoCA. Elevated miR-let-7c-5p levels and decreased IL-10 levels are risk factors for MCI in T2DM patients. Increased miR-let-7c-5p and downregulated IL-10 may influence VFT and TMTB, respectively, associated with executive function. We demonstrated that IL-10 is correlated to the executive function of T2DM patients. Decreased IL-10 may result from the regulation of miR-let-7c-5p in exosomes.

Scene memory for intrinsic and extrinsic boundaries

Scene memory for intrinsic and extrinsic boundaries

Spatial Scene Memories Are Biased Towards a Fixed Amount of Semantic Information.

Scene memory has known spatial biases. Boundary extension is a well-known bias whereby observers remember visual information beyond an image's boundaries. While recent studies demonstrate that boundary contraction also reliably occurs based on intrinsic image properties, the specific properties that drive the effect are unknown. This study assesses the extent to which scene memory might have a fixed capacity for information. We assessed both visual and semantic information in a scene database using techniques from image processing and natural language processing, respectively. We then assessed how both types of information predicted memory errors for scene boundaries using a standard rapid serial visual presentation (RSVP) forced error paradigm. A linear regression model indicated that memories for scene boundaries were significantly predicted by semantic, but not visual, information and that this effect persisted when scene depth was considered. Boundary extension was observed for images with low semantic information, and contraction was observed for images with high semantic information. This suggests a cognitive process that normalizes the amount of semantic information held in memory.

The theatre of the confused: Tokyo

This article focuses on a production in July 2021 entitled Waiting for Will, written and directed by Shoichiro Kawai. This play, in Japanese, is presented in the spirit of Samuel Beckett's Waiting for Godot and features two aging Shakespearean actors trying to recover their memory of Shakespearean lines and scenes they once acted, while they wait for ‘Will’, a pun on William Shakespeare as well as on one's last will and testament. Waiting for Will is part of a genealogy of alternative theatre in Japan. Though the production echoes Western forms, it is still distinctly Japanese in nature.