Intact Scene Research Articles

The role of scenic context on upright face preference in infancy.

Scenic information plays an important role in face processing, whereas it has received limited attention in the field of developmental research. In the current study, we investigated whether infants, like adults, utilize scenic information for face processing by the preferential-looking method. In Experiment 1, we examined 4-5 and 6-7-month-olds' visual preferences for upright faces compared to inverted faces in two surrounding scene conditions: intact (in which a face occurs in an intact scene) and scrambled (in which a face occurs in a jumbled scene). We found that 6- to 7-month-olds preferred the upright face in the intact scene, but not in the scrambled scene. Meanwhile, 4- to 5-month-olds showed significant upright face preference in both scenes. The results of Experiment 2 ruled out the possibility that the lack of preference for upright faces in the scrambled scene in 6- to 7-month-olds resulted from more distraction by the scrambledness of the image than occurs with 4- to 5-month-olds, by showing no developmental changes in preference either for the scrambled images or the intact images when faces did not appear. Our results suggest that infants aged 6 months or more utilize scenic information for face processing.

Compromised future thinking: another cognitive cost of temporal lobe epilepsy.

The ability to mentally travel forward through time allows humans to envisage a diverse array of possible events taking place in the future, helping us to choose which pathway to take in life. In epilepsy, we assume that patients use this cognitive ability when deciding between various treatment options, but this assumption has not been robustly tested. The temporal lobes are key contributors to this ‘future thinking’ and its building blocks include cognitive functions commonly impaired in temporal lobe epilepsy such as memory and language, giving rise to a hypothesis that ‘future thinking’ is impaired in this patient cohort. Participants were 68 adults: 37 with neurosurgically-naïve, unilateral temporal lobe epilepsy (51% right lateralized) and 31 healthy controls of similar age, sex and intellectual ability to the participants with epilepsy. Future thinking was measured using an imagined experiences task validated in other neurological populations. Tools well-established in temporal lobe epilepsy were used to measure potential cognitive correlates of future thinking. Analysis of variance revealed significantly impoverished future thinking in both left and right temporal lobe epilepsy relative to controls (P = 0.001, ηp2=0.206), with no difference between temporal lobe epilepsy groups (P > 0.05). Future thinking deficits in left temporal lobe epilepsy were paralleled by deficits in scene construction, whereas impoverished future thinking in right temporal lobe epilepsy occurred in the setting of intact scene construction. Deficits in future thinking were associated with reductions in lexical access and episodic autobiographic memory in both epilepsy groups. In sum, future thinking is compromised in both left and right temporal lobe epilepsy. The deficit in left temporal lobe epilepsy is largely explainable by dysfunction in verbal cognitive processes including scene construction. While the basis of the deficits observed with right temporal foci shares features with that of left temporal lobe epilepsy, their intact scene construction raises questions about the role of the left and right temporal lobes in future thinking and scene construction and the relationship between these two constructs, including whether right temporal lobe might play a specific role in future thinking in terms of creative processing. Clinicians should take impaired future thinking into account when counselling temporal lobe epilepsy patients about various treatment options, as they may struggle to vividly imagine what different outcomes might mean for their future selves.

Coherent natural scene structure facilitates the extraction of task-relevant object information in visual cortex

Looking for objects within complex natural environments is a task everybody performs multiple times each day. In this study, we explore how the brain uses the typical composition of real-world environments to efficiently solve this task. We recorded fMRI activity while participants performed two different categorization tasks on natural scenes. In the object task, they indicated whether the scene contained a person or a car, while in the scene task, they indicated whether the scene depicted an urban or a rural environment. Critically, each scene was presented in an “intact” way, preserving its coherent structure, or in a “jumbled” way, with information swapped across quadrants. In both tasks, participants’ categorization was more accurate and faster for intact scenes. These behavioral benefits were accompanied by stronger responses to intact than to jumbled scenes across high-level visual cortex. To track the amount of object information in visual cortex, we correlated multi-voxel response patterns during the two categorization tasks with response patterns evoked by people and cars in isolation. We found that object information in object- and body-selective cortex was enhanced when the object was embedded in an intact, rather than a jumbled scene. However, this enhancement was only found in the object task: When participants instead categorized the scenes, object information did not differ between intact and jumbled scenes. Together, these results indicate that coherent scene structure facilitates the extraction of object information in a task-dependent way, suggesting that interactions between the object and scene processing pathways adaptively support behavioral goals.

Does rehearsal matter? Left anterior temporal alpha and theta band changes correlate with the beneficial effects of rehearsal on working memory

Rehearsal during working memory (WM) maintenance is assumed to facilitate retrieval. Less is known about how rehearsal modulates WM delay activity. In the present study, 44 participants completed a Sternberg Task with either intact novel scenes or phase-scrambled scenes, which had similar color and spatial frequency but lacked semantic content. During the rehearsal condition participants generated a descriptive label during encoding and covertly rehearsed during the delay period. During the suppression condition participants did not generate a label during encoding and suppressed (repeated “the”) during the delay period. This was easy in the former (novel scenes) but more difficult in the later condition (phase-scrambled scenes) where scenes lacked semantic content. Behavioral performance and EEG delay activity was analyzed as a function of maintenance strategy. Performance during WM revealed a benefit of rehearsal for phase-scrambled but not intact scenes. Examination of the absolute amplitude revealed three underlying sources of activity for rehearsal, including the left anterior temporal (ATL) and left and midline parietal regions. Increases in alpha and theta activity in ATL were correlated with improvement in performance on WM with rehearsal only when labeling was not automatic (e.g., phase-scrambled scenes), which may reflect differences in labeling and rehearsal (i.e., semantic associations vs. shallow labels). We conclude that rehearsal only benefits memory for visual stimuli that lack semantic information, and that this is correlated with changes in alpha and theta rhythms.

Investigating the Impact of the Missing Significant Objects in Scene Recognition Using Multivariate Pattern Analysis.

Significant objects in a scene can make a great contribution to scene recognition. Besides the three scene-selective regions: parahippocampal place area (PPA), retrosplenial complex (RSC), and occipital place area (OPA), some neuroimaging studies have shown that the lateral occipital complex (LOC) is also engaged in scene recognition processing. In this study, the multivariate pattern analysis was adopted to explore the object-scene association in scene recognition when different amounts of significant objects were masked. The scene classification only succeeded in the intact scene in the ROIs. In addition, the average signal intensity in LOC [including the lateral occipital cortex (LO) and the posterior fusiform area (pF)] decreased when there were masked objects, but such a decrease was not observed in scene-selective regions. These results suggested that LOC was sensitive to the loss of significant objects and mainly involved in scene recognition by the object-scene semantic association. The performance of the scene-selective areas may be mainly due to the fact that they responded to the change of the scene's entire attribute, such as the spatial information, when they were employed in the scene recognition processing. These findings further enrich our knowledge of the significant objects' influence on the activation pattern during the process of scene recognition.

Emotional mimicry signals pain empathy as evidenced by facial electromyography.

Facial mimicry has been suggested to be a behavioral index for emotional empathy. The present study is the first to investigate the link between facial muscle activity and empathy for pain by facial electromyographic (EMG) recording while observers watched videos depicting real-life painful events. Three types of visual stimulus were used: an intact painful scene and arm-only (needle injection) and face only (painful expression) scenes. Enhanced EMG activity of the corrugator supercilii (CS) and zygomaticus major (ZM) muscles was found when observers viewed others in pain, supporting a unique pain expression that is distinct from the expression of basic emotions. In the intact video stimulus condition, CS activity was correlated positively with the empathic concern score and ZM activity, suggesting facial mimicry mediated empathy for pain. Cluster analysis of facial EMG responses revealed markedly different patterns among stimulus types, including response category, ratio, and temporal dynamics, indicating greater ecological validity of the intact scene in eliciting pain empathy as compared with partial scenes. This study is the first to quantitatively describe pain empathy in terms of facial EMG data. It may provide important evidence for facial mimicry as a behavioral indicator of pain empathy.

Scene Construction in Amnesia: An fMRI Study

In recent years, there has been substantial interest in how the human hippocampus not only supports recollection of past experiences, but also the construction of fictitious and future events, and the leverage this might offer for understanding the operating mechanisms of the hippocampus. Evidence that patients with bilateral hippocampal damage and amnesia cannot construct novel or future scenes/events has been influential in driving this line of research forward. There are, however, some patients with hippocampal damage and amnesia who retain the ability to construct novel scenes. This dissociation may indicate that the hippocampus is not required for scene construction, or alternatively, there could be residual function in remnant hippocampal tissue sufficient to support the basic construction of scenes. Resolving this controversy is central to current theoretical debates about the hippocampus. To investigate, we used fMRI and a scene construction task to test patient P01, who has dense amnesia, ∼50% bilateral hippocampal volume loss, and intact scene construction. We found that scene construction in P01 was associated with increased activity in a set of brain areas, including medial temporal, retrosplenial, and posterior parietal cortices, that overlapped considerably with the regions engaged in control participants performing the same task. Most notably, the remnant of P01's right hippocampus exhibited increased activity during scene construction. This suggests that the intact scene construction observed in some hippocampal-damaged amnesic patients may be supported by residual function in their lesioned hippocampus, in accordance with theoretical frameworks that ascribe a vital role to the hippocampus in scene construction.

The mask-onset delay paradigm and the availability of central and peripheral visual information during scene viewing

We employed a variant of the mask-onset delay paradigm in order to limit the availability of visual information in central and peripheral vision within individual fixations during scene viewing. Subjects viewed full-color scene photos with instructions to search for a target object (Experiment 1) or to study them for a later memory test (Experiment 2). After a fixed interval following the onset of each eye fixation (50-100 ms), the scene was scrambled either in the central visual field or over the entire display. The intact scene was presented when the subject made an eye movement. Our results reconcile different sets of findings from prior research regarding the masking of central and peripheral visual information at different intervals following fixation onset. In particular, we found that when the entire display was scrambled, both search and memory performance were impaired even at relatively long mask-onset intervals. In contrast, when central vision was scrambled, there were subtle impairments that depended on the viewing task. In the 50-ms mask-onset interval, subjects were selectively impaired at identifying, but not in locating, the search target (Experiment 1), while memory performance (Experiment 2) was unaffected in this condition, and hence, the reliance on central and peripheral visual information depends partly on the viewing task.

Categorization of natural scenes

Categorization of scenes is a fundamental process of human vision that allows us to efficiently and rapidly analyze our surroundings. Several studies have explored the processes underlying human scene categorization, but they have focused on processing global image information. In this study, we present both psychophysical and computational experiments that investigate the role of local versus global image information in scene categorization. In a first set of human experiments, categorization performance is tested when only local or only global image information is present. Our results suggest that humans rely on local, region-based information as much as on global, configural information. In addition, humans seem to integrate both types of information for intact scene categorization. In a set of computational experiments, human performance is compared to two state-of-the-art computer vision approaches that have been shown to be psychophysically plausible and that model either local or global information. In addition to the influence of local versus global information, in a second series of experiments, we investigated the effect of color on the categorization performance of both the human observers and the computational model. Analysis of the human data suggests that color is an additional channel of perceptual information that leads to higher categorization results at the expense of increased reaction times in the intact condition. However, it does not affect reaction times when only local information is present. When color is removed, the employed computational model follows the relative performance decrease of human observers for each scene category and can thus be seen as a perceptually plausible model for human scene categorization based on local image information.

Why people see things that are not there: A novel Perception and Attention Deficit model for recurrent complex visual hallucinations

As many as two million people in the United Kingdom repeatedly see people, animals, and objects that have no objective reality. Hallucinations on the border of sleep, dementing illnesses, delirium, eye disease, and schizophrenia account for 90% of these. The remainder have rarer disorders. We review existing models of recurrent complex visual hallucinations (RCVH) in the awake person, including cortical irritation, cortical hyperexcitability and cortical release, top-down activation, misperception, dream intrusion, and interactive models. We provide evidence that these can neither fully account for the phenomenology of RCVH, nor for variations in the frequency of RCVH in different disorders. We propose a novel Perception and Attention Deficit (PAD) model for RCVH. A combination of impaired attentional binding and poor sensory activation of a correct proto-object, in conjunction with a relatively intact scene representation, bias perception to allow the intrusion of a hallucinatory proto-object into a scene perception. Incorporation of this image into a context-specific hallucinatory scene representation accounts for repetitive hallucinations. We suggest that these impairments are underpinned by disturbances in a lateral frontal cortex-ventral visual stream system. We show how the frequency of RCVH in different diseases is related to the coexistence of attentional and visual perceptual impairments; how attentional and perceptual processes can account for their phenomenology; and that diseases and other states with high rates of RCVH have cholinergic dysfunction in both frontal cortex and the ventral visual stream. Several tests of the model are indicated, together with a number of treatment options that it generates.