Scene Inversion Research Articles

Flipping the world upside down: Using eye tracking in virtual reality to study visual search in inverted scenes.

Image inversion is a powerful tool for investigating cognitive mechanisms of visual perception. However, studies have mainly used inversion in paradigms presented on twodimensional computer screens. It remains open whether disruptive effects of inversion also hold true in more naturalistic scenarios. In our study, we used scene inversion in virtual reality in combination with eye tracking to investigate the mechanisms of repeated visual search through three-dimensional immersive indoor scenes. Scene inversion affected all gaze and head measures except fixation durations and saccade amplitudes. Our behavioral results, surprisingly, did not entirely follow as hypothesized: While search efficiency dropped significantly in inverted scenes, participants did not utilize more memory as measured by search time slopes. This indicates that despite the disruption, participants did not try to compensate the increased difficulty by using more memory. Our study highlights the importance of investigating classical experimental paradigms in more naturalistic scenarios to advance research on daily human behavior.

Effects of Natural Scene Inversion on Visual-evoked Brain Potentials and Pupillary Responses: A Matter of Effortful Processing of Unfamiliar Configurations

The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort.

Scene inversion reveals distinct patterns of attention to semantically interpreted and uninterpreted features

Semantic guidance theories propose that attention in real-world scenes is strongly associated with semantically informative scene regions. That is, we look where there are recognizable and informative objects that help us make sense of our visual environment. In contrast, image guidance theories propose that local differences in semantically uninterpreted image features such as luminance, color, and edge orientation primarily determine where we look in scenes. While it is clear that both semantic guidance and image guidance play a role in where we look in scenes, the degree of their relative contributions and how they interact with each other remains poorly understood. In the current study, we presented real-world scenes in upright and inverted orientations and used general linear mixed effects models to understand how semantic guidance, image guidance, and observer center bias were associated with fixation location and fixation duration. We observed distinct patterns of change under inversion. Semantic guidance was severely disrupted by scene inversion, while image guidance was mildly impaired and observer center bias was enhanced. In addition, we found that fixation durations for semantically rich regions decreased when viewing inverted scenes relative to upright scene viewing, while fixation durations for image salience and center bias were unaffected by inversion. Together these results provide important new constraints on theories and computational models of attention in real-world scenes.

Scene Inversion Interferes with Meaning-based Guidance in Real-world Scenes

Scene Inversion Interferes with Meaning-based Guidance in Real-world Scenes

Elevation Spatial Variation Error Compensation in Complex Scene and Elevation Inversion by Autofocus Method in GEO SAR

Due to the high altitude of geosynchronous synthetic aperture radar (GEO SAR), its synthetic aperture time can reach up to several hundred seconds, and its revisit cycle is very short, which makes it of great application worth in the remote sensing field, such as in disaster monitoring and vegetation measurements. However, because of the elevation of the target, elevation spatial variation error is caused in the GEO SAR imaging. In this paper, we focus on the compensation of the elevation space-variant error in the fast variant part with the autofocus method and utilize the error to carry out elevation inversing in complex scenes. For a complex scene, it can be broken down into a slow variant slope and the remaining fast variant part. First, the phase error caused by the elevation spatial variation is analyzed. Second, the spatial variant error caused by the slowly variant slope is compensated with the improved imaging algorithm. The error caused by the remaining fast variable part is the focus of this paper. We propose a block map-drift phase gradient autofocus (block-MD-PGA) algorithm to compensate for the random phase error part. By dividing sub-blocks reasonably, the elevation spatial variant error is compensated for by an autofocus algorithm in each sub-block. Because the errors of different elevations are diverse, the proposed algorithm is suitable for the scene where the target elevations are almost the same after the sub-blocks are divided. Third, the phase error obtained by the autofocus method is used to inverse the target elevation. Finally, simulations with dot-matrix targets and targets based on the high-resolution TerraSAR-X image verify the excellent effect of the proposed method and the accuracy of the elevation inversion.

Faces in Context: Does Face Perception Depend on the Orientation of the Visual Scene?

The mechanisms held responsible for familiar face recognition are thought to be orientation dependent; inverted faces are more difficult to recognize than their upright counterparts. Although this effect of inversion has been investigated extensively, researchers have typically sliced faces from photographs and presented them in isolation. As such, it is not known whether the perceived orientation of a face is inherited from the visual scene in which it appears. Here, we address this question by measuring performance in a simultaneous same-different task while manipulating both the orientation of the faces and the scene. We found that the face inversion effect survived scene inversion. Nonetheless, an improvement in performance when the scene was upside down suggests that sensitivity to identity increased when the faces were more easily segmented from the scene. Thus, while these data identify congruency with the visual environment as a contributing factor in recognition performance, they imply different mechanisms operate on upright and inverted faces.

Scene Integration Without Awareness

A recent study showed that scenes with an object-background relationship that is semantically incongruent break interocular suppression faster than scenes with a semantically congruent relationship. These results implied that semantic relations between the objects and the background of a scene could be extracted in the absence of visual awareness of the stimulus. In the current study, we assessed the replicability of this finding and tried to rule out an alternative explanation dependent on low-level differences between the stimuli. Furthermore, we used a Bayesian analysis to quantify the evidence in favor of the presence or absence of a scene-congruency effect. Across three experiments, we found no convincing evidence for a scene-congruency effect or a modulation of scene congruency by scene inversion. These findings question the generalizability of previous observations and cast doubt on whether genuine semantic processing of object-background relationships in scenes can manifest during interocular suppression.

Does inversion affect boundary extension for briefly-presented views?

ABSTRACTInverting scenes interferes with visual perception and memory on many tasks. Might scene inversion eliminate boundary extension (BE) for briefly-presented photographs? In Experiment 1, an upright or inverted photograph (133, 258, or 383 ms) was followed by a 258 ms masked interval and a test photograph showing the identical view. Test photographs were rated as “same”, “closer”, or “farther away” (5-point scale). BE was just as great for inverted as upright views at the 133 and 383 ms durations, but surprisingly was greater for inverted views at the 258 ms duration. In Experiment 2, 258-ms views yielded greater BE when the study photographs were always tested in the opposite orientation, indicating that the difference in BE was related to encoding. Results suggest that scene construction beyond the view boundaries occurs rapidly and is not impeded by scene inversion, but that changes in the relative quality of visual details available for upright and inverted views may sometimes yield increased BE for inverted scenes.

Effects of scene inversion on boundary extension

Effects of scene inversion on boundary extension

If Visual Saliency Predicts Search, Then Why? Evidence from Normal and Gaze-Contingent Search Tasks in Natural Scenes

The Itti and Koch (Vision Research 40: 1489–1506, 2000) saliency map model has inspired a wealth of research testing the claim that bottom-up saliency determines the placement of eye fixations in natural scenes. Although saliency seems to correlate with (although not necessarily cause) fixation in free-viewing or encoding tasks, it has been suggested that visual saliency can be overridden in a search task, with saccades being planned on the basis of target features, rather than being captured by saliency. Here, we find that target regions of a scene that are salient according to this model are found quicker than control regions (Experiment 1). However, this does not seem to be altered by filtering features in the periphery using a gaze-contingent display (Experiment 2), and a deeper analysis of the eye movements made suggests that the saliency effect is instead due to the meaning of the scene regions. Experiment 3 supports this interpretation, showing that scene inversion reduces the saliency effect. These results suggest that saliency effects on search may have nothing to do with bottom-up saccade guidance.

The contribution of scene context on change detection performance

The gist of a visual scene is perceived in a fraction of a second but in change detection tasks subjects typically need several seconds to find the changing object in a visual scene. Here, we report influences of scene context on change detection performance. Scene context manipulations consisted of scene inversion, scene jumbling, where the images were cut into 24 pieces and randomly recombined, and scene configuration scrambling, where the arrangement of the objects in the scene was randomized. Reaction times, where significantly lower in images with normal scene context. We conclude that scene context structures scene perception.

The effects of scene inversion and negation on change detection

The effects of scene inversion and negation on change detection

Cortical correlates of face and scene inversion: A comparison

Face recognition is more strongly impaired by stimulus inversion than nonface object recognition. This phenomenon, known as the face inversion effect (FIE), suggests that the visual system contains specialized processing mechanisms that are more engaged by upright faces than by inverted faces or nonface objects. Neuroimaging and neuropsychological studies indicate that environmental scenes may also recruit specialized-purpose processing machinery but a comparable inversion effect for scenes has not been established. Here we demonstrate that both face and scene inversion lead to behavioral penalties during performance of a continuous visual matching task; however, the scene inversion effect was less robust and declined in magnitude over the course of the experiment. Scene inversion led to greater neural response in the functionally defined lateral occipital (LO) object area for inverted versus upright scenes and reduced response in the parahippocampal place area (PPA), while face inversion lead to greater response in LO and the right middle fusiform (MF) object area for inverted versus upright faces but no change in the fusiform face area (FFA). A whole-brain analysis revealed several regions that responded more strongly to either upright versus inverted faces or upright versus inverted scenes, some of which may be involved in post-recognition processing. These results demonstrate that both face and scene inversion cause a shift from specialized processing streams towards generic object-processing mechanisms; however, this shift only leads to a reliable behavioral penalty in the case of face inversion.

Effects of scene inversion on change detection of targets matched for visual salience.

This work examines how context may influence the detection of changes in flickering scenes. Each scene contained two changes that were matched for low-level visual salience. One of the changes was of high interest to the meaning of the scene, and the other was of lower interest. High-interest changes were more readily detected. To further examine the effects of contextual significance, we inverted the scene orientation to disrupt top-down effects of global context while controlling for contributions of visual salience. In other studies, inverting scene orientation has had inconsistent effects on detection of high-interest changes. However, this experiment demonstrated that inverting scene orientation significantly reduced the advantage for high-interest changes in comparison to lower-interest changes. Thus, scene context influences the deployment of attention and change-detection performance, and this top-down influence may be disrupted by scene inversion.

The Effects of Scene Inversion on Change Blindness

In two experiments, participants searched for a difference between two views of a scene. In Experiment 1, the authors extended the change-blindness findings from previous work by R. A. Rensink, J. K. O'Regan, and J. J. Clark (1997), which used an experimenter-induced global transient, to a less artificial situation in which participants searched for a difference in a pair of photographic images presented simultaneously. To examine the idea that meaning-driven endogenous orienting was responsible for the previously observed advantage for changes in center-of-interest items, the authors inverted half of the image pairs. The advantage for center-of-interest items was replicated with upright displays, but it was completely eliminated by inversion, strongly supporting the role of meaning-driven endogenous orienting in this task. With flickering displays (Experiment 2), the center-of-interest effect was completely unaffected by inversion. The authors suggest that when change blindness is induced via flicker, scene modifications are typically found by stimulus-driven rather than by meaning-driven processes.