Figure-ground Segregation Research Articles

Figure and Ground in the Visual Cortex: V2 Combines Stereoscopic Cues with Gestalt Rules

Figure-ground organization is a process by which the visual system identifies some image regions as foreground and others as background, inferring 3D layout from 2D displays. A recent study reported that edge responses of neurons in area V2 are selective for side-of-figure, suggesting that figure-ground organization is encoded in the contour signals (border ownership coding). Here, we show that area V2 combines two strategies of computation, one that exploits binocular stereoscopic information for the definition of local depth order, and another that exploits the global configuration of contours (Gestalt factors). These are combined in single neurons so that the "near" side of the preferred 3D edge generally coincides with the preferred side-of-figure in 2D displays. Thus, area V2 represents the borders of 2D figures as edges of surfaces, as if the figures were objects in 3D space. Even in 3D displays, Gestalt factors influence the responses and can enhance or null the stereoscopic depth information.

Temporal properties in masking biological motion

The perception of biological motion using point light animation techniques was investigated in several experiments. Animations simulating walking were presented with additional masking dots. The temporal properties of the walking motion or the temporal relationship between the walking and masking motions were systematically manipulated. Results showed that (1) perception of biological motion was sensitive to even small temporal perturbation within the walker, (2) the effectiveness of a mask depended upon the temporal phase difference between the mask and point light walker, (3) relatively small temporal differences between the mask and point light walker decreased the effectiveness of the mask, and (4) these effects were not due simply to observers detecting the phase offsets in the display. Temporal properties of the motion are important in perceiving the human form in action, just as in other types of figure-ground segregation. This information may be processed by both motion and form pathways for processing biological motion.

Stochastic correlative firing for figure-ground segregation

Segregation of sensory inputs into separate objects is a central aspect of perception and arises in all sensory modalities. The figure-ground segregation problem requires identifying an object of interest in a complex scene, in many cases given binaural auditory or binocular visual observations. The computations required for visual and auditory figure-ground segregation share many common features and can be cast within a unified framework. Sensory perception can be viewed as a problem of optimizing information transmission. Here we suggest a stochastic correlative firing mechanism and an associative learning rule for figure-ground segregation in several classic sensory perception tasks, including the cocktail party problem in binaural hearing, binocular fusion of stereo images, and Gestalt grouping in motion perception.

Lateral interactions in the visual cortex of patients with schizophrenia and bipolar disorder

Schizophrenia is associated with perceptual organization deficits and abnormal neuronal connectivity has been described in early visual areas. The purpose of this study was to investigate the functional integrity of lateral connections in early visual areas of patients with schizophrenia and type I bipolar disorder with a history of psychosis. Twenty-four out-patients with schizophrenia, 22 out-patients with bipolar disorder, and 20 healthy control subjects participated in the study. Using a computer-assisted psychophysical test, contrast thresholds were measured for centrally presented target stimuli (Gabor patches), which were surrounded by two collinear flankers. Target-to-flanker distances were 0, 1, 2, 3, 4, 6, 9 and 122. Psychophysical measures were contrast threshold changes at each target-to-flanker distance compared with baseline thresholds determined for isolated targets with no flankers. Clinical measures included IQ, positive, negative, and depressive symptoms. Results. In patients with schizophrenia, flankers did not facilitate contrast detection for target stimuli at 2-6 lambda distances compared to controls [effect size (Cohen's d): 1.25-1.42]. The inhibitory effect of flankers (0 and 1lambda) and contrast thresholds in the absence of flankers were spared. Patients with bipolar disorder did not differ from the controls. Medicated and non-medicated patients displayed similar performances. Positive and negative symptoms and depression did not correlate with contrast threshold values. Excitatory lateral connections in early visual cortex are specifically impaired in patients with schizophrenia, which may contribute to perceptual disorders such as unclear seeing, partial or skewed sight, disrupted rectilinearity, and abnormal figure-ground segregation.

Perceptual Continuity and the Emergence of Perceptual Persistence in the Ventral Visual Pathway

Perceptual continuity is an important aspect of our experience of the visual world. In this study, we focus on an example of perceptual continuity involving the maintenance of figure-ground segregation despite the removal of binding cues that initiated the segregation. Fragmented line drawings of objects were superimposed on a background of randomly oriented lines. Global forms could be discriminated from the background based on differences in motion or differences in color/brightness. Furthermore, perception of a global form persisted after the binding cue had been removed. A comparison between the persistence of forms constructed from motion or color demonstrated that both forms produced persistence after the object defining cues were removed. Functional imaging showed a gradual increase in the persistence of brain activity in the lower visual areas (V1, V2, VP), which reached significance in V4v and peaked in the lateral occipital area. There was no difference in the location of persistence for color- or motion-defined forms. These results suggest that the retention of a global percept is an emerging property of the ventral visual processing stream and the maintenance of grouped visual elements is independent of cue type. We postulated that perceptual persistence depends on a system of perceptual memory reflecting the state of perceptual organization.

The role of the Gestalt principle of similarity in the watercolor illusion

The watercolor illusion presents two main effects: a long-range assimilative color spreading (coloration effect), and properties imparting a strong figure status (figural effect) to a region delimited by a dark (e.g. purple) contour flanked by a lighter chromatic contour (e.g. orange). In four experiments, the strength of the watercolor illusion to determine figure-ground organization is directly compared (combined or pitted against) with the Gestalt principle of similarity both of color and line width. The results demonstrated that (i) the watercolor illusion and, particularly, its figural effect won over the classical Gestalt factors of similarity; (ii) the watercolor illusion cannot be due to the coloration effect as suggested by the similarity principle; (iii) coloration and figural effects may be independent in the watercolor illusion, and (iv) the watercolor illusion can be considered as a principle of figure-ground segregation on its own. Two parallel and independent processes as proposed within the FACADE model (Grossberg, 1994, 1997) are suggested to account for the two effects of coloration and figural enhancement in the watercolor illusion.

Auditory M50 and M100 responses to broadband noise: functional implications

The functional significance of the M50 and M100 auditory evoked fields remains unclear. Here we report auditory evoked field data from three different studies employing wide-band noise stimuli. We find that, for the same stimuli, the strength of the M100, as well as its lateralization, are task-modulated. The M50, in contrast, shows three properties: It is dramatically more pronounced for noise stimuli than for pure tones, does not seem to be task dependent, and, is significantly stronger in the left hemisphere in all task conditions. These contrasting patterns of activation shed light on the properties of the response-generating mechanisms and suggest roles in the process of auditory figure-ground segregation.

Single-unit responses to kinetic stimuli in New World monkey area V2: Physiological characteristics of cue-invariant neurones

In order to investigate the neural processes underlying figure-ground segregation on the basis of motion, we studied the responses of neurones in the second visual area (V2) of marmoset monkeys to stimuli that moved against dynamic textured backgrounds. The stimuli were either "solid" bars, which were uniformly darker or lighter than the background's average, or kinetic ("camouflaged") bars, formed by textural elements that matched the spatial and temporal modulation of the background. Camouflaged bars were rendered visible only by the coherent motion of their textural elements. Using solid bars, we subdivided the population of marmoset V2 neurones into motion-selective (uni- and bi-directional units, 73.3% of the sample) and weakly-biased (26.7%) subpopulations. The motion selective subpopulation was further subdivided into cue-invariant neurones (units which demonstrated a similar selectivity for the direction of motion of the solid and camouflaged bars) and non-cue-invariant neurones (units which showed selectivity to the direction of motion of solid bars, but had weak or pandirectional responses to camouflaged bars). Cells with cue-invariant responses to these stimuli were as common in V2 as in the primary visual area (V1; approximately 40% of the population). In V2, neurones with cue-invariant and non-cue-invariant motion selectivity formed distinct populations in terms of classical response properties: cue-invariant neurones were characterized by a sharp axis of motion selectivity and extensive length summation, while the majority of non-cue-invariant neurones had broader motion selectivity and were end-stopped. In the light of previous studies, these different constellations of classical response properties suggest a correlation with more traditionally recognized categories of V2 units and modular compartments. The responses of V2 cells to kinetic stimuli were slightly delayed relative to their responses to luminance-defined stimuli.

Figure–ground segregation can rely on differences in motion direction

If the elements within a figure move synchronously while those in the surround move at a different time, the figure is easily segregated from the surround and thus perceived. Lee and Blake (1999) [Visual form created solely from temporal structure. Science, 284, 1165–1168] demonstrated that this figure–ground separation may be based not only on time differences between motion onsets, but also on the differences between reversals of motion direction. However, Farid and Adelson (2001) [Synchrony does not promote grouping in temporally structured displays. Nature Neuroscience, 4, 875–876] argued that figure–ground segregation in the motion-reversal experiment might have been based on a contrast artefact and concluded that (a)synchrony as such was ‘not responsible for the perception of form in these or earlier displays’. Here, we present experiments that avoid contrast artefacts but still produce figure–ground segregation based on purely temporal cues. Our results show that subjects can segregate figure from ground even though being unable to use motion reversals as such. Subjects detect the figure when either (i) motion stops (leading to contrast artefacts), or (ii) motion directions differ between figure and ground. Segregation requires minimum delays of about 15 ms. We argue that whatever the underlying cues and mechanisms, a second stage beyond motion detection is required to globally compare the outputs of local motion detectors and to segregate figure from ground. Since analogous changes take place in both figure and ground in rapid succession, this second stage has to detect the asynchrony with high temporal precision.

Different types of signal coupling in the visual cortex related to neural mechanisms of associative processing and perception.

The hypothesis of object representation by synchronization in the visual cortex has been supported by our recent experiments in monkeys. They demonstrated local synchrony among gamma activities (30-90 Hz) and their perceptual modulation, according to the rules of figure-ground segregation. However, gamma-synchrony in primary visual cortex is restricted to few mm, challenging the synchronization hypothesis for larger cortical object representations. The restriction is due to randomly changing phase relations among locally synchronized patches which, however, form continuous waves of gamma-activity, traveling across object representations. The phase continuity of these waves may support coding of object continuity. Interactions across still larger distances, measured among cortical areas in human data, involve amplitude envelopes of gamma signals. Based on models with spiking neurons we discuss potentially underlying mechanisms. Most important for gamma synchronization are local facilitatory connections with distance-dependent delays. They also explain the occurrence of gamma waves and the restriction of gamma-synchrony. Fast local feedback inhibition generates gamma oscillations and supports local synchrony, while slow shunting inhibitory feedback supports figure-ground segregation. Finally, dispersion in inter-areal far projections destroys coherence of gamma signals, but preserves their amplitude modulations. In conclusion, we propose that the hypothesis of associative processing by gamma synchronization be extended to more general forms of signal coupling.

Investigation of the Figure Superiority Effect in Sustained Attention

This study examined whether enhanced perceptual discrimination for targets presented on figural than on ground elements, namely the figure superiority effect, extends to performance on vigilance or sustained attention tasks. In the experimental condition, targets requiring discriminations of line orientation were presented on figure-ground displays that could be organized as a face, a seahorse, and a pineapple, respectively, against a uniform black or white background. A control condition was also employed in which the same targets were presented on a bipartite black/white field. Figure-ground organization did not differentially effect signal detection in the experimental condition. However, perceptual sensitivity was significantly greater for signals appearing in the meaningful figure-ground display than in the control display, which lacked a meaningful figure-ground segregation. Consequently, meaningful figure-ground organization can be a critical psychophysical factor in controlling sustained attention.

Segregation and persistence of form in the lateral occipital complex

While the lateral occipital complex (LOC) has been shown to be implicated in object recognition, it is unclear whether this brain area is responsive to low-level stimulus-driven features or high-level representational processes. We used scrambled shape-from-motion displays to disambiguate the presence of contours from figure-ground segregation and to measure the strength of the binding process for shapes without contours. We found persisting brain activation in the LOC for scrambled displays after the motion stopped indicating that this brain area subserves and maintains figure-ground segregation processes, a low-level function in the object processing hierarchy. In our second experiment, we found that the figure-ground segregation process has some form of spatial constancy indicating top–down influences. The persisting activation after the motion stops suggests an intermediate role in object recognition processes for this brain area and might provide further evidence for the idea that the lateral occipital complex subserves mnemonic functions mediating between iconic and short-term memory.

Visual-spatial processing and dimensions of schizophrenia: a preliminary study on 62 schizophrenic subjects

The aim of the study was to explore the relationships between the performance in figure-ground segregation and the clinical dimensions in schizophrenia. Sixty-two schizophrenic subjects filled out the embedded figures test (EFT) and the schizophrenic symptomatology was rated using the brief psychiatric rating scale (BPRS). The BPRS items were grouped into four categories: positive, negative, general and disorganization. The results showed in male schizophrenics negative and significant correlations between EFT scores and negative or disorganization subscales. Taken into account that in schizotypic subjects EFT scores was negatively correlated with negative dimension of schizotypy we suggested that those relationship could constitute a trait of the disease.

Figure-ground segregation by center-surround motion mechanisms

Figure-ground segregation by center-surround motion mechanisms

Figure-ground and figure-figure segregation in curve tracing

Figure-ground and figure-figure segregation in curve tracing

Keeping it together: The maintenance of figure-ground segregation in the lateral occipital sulcus

Keeping it together: The maintenance of figure-ground segregation in the lateral occipital sulcus

Neural mechanisms of visual associative processing

This is a review of our work on multiple microelectrode recordings from the visual cortex of monkeys and subdural recordings from humans - related to the potential underlying neural mechanisms. The former hypothesis of object representation by synchronization in visual cortex (or more generally: of flexible associative processing) has been supported by our recent experiments in monkeys. They demonstrated local synchrony among rhythmic or stochastic γ-activities (30-90 Hz) and perceptual modulation, according to the rules of figure-ground segregation. However, γ-synchrony in primary visual cortex is restricted to few millimeters, challenging the synchronization hypothesis for larger cortical object representations. We found that the spatial restriction is due to γ-waves, traveling in random directions across the object representations. It will be argued that phase continuity of these waves can support the coding of object continuity. Based on models with spiking neurons, potentially underlying neural mechanisms are proposed: (i) Fast inhibitory feedback loops can generate locally synchronized γ-activities; (ii) Hebbian learning of lateral and feed forward connections with distance-dependent delays can explain the stabilization of cortical retinotopy, the limited size of synchronization, the occurrence of γ-waves, and the larger receptive fields at successive levels; (iii) slow inhibitory feedback can support figure-ground segregation; (iv) temporal dispersion in far projections destroys coherence of fast signals but preserves slow amplitude modulations. In conclusion, it is proposed that the hypothesis of flexible associative processing by γ-synchronization, including coherent representations of visual objects, has to be extended to more general forms of signal coupling.

The role of figure-ground segregation in change blindness.

Partial report methods have shown that a large-capacity representation exists for a few hundred milliseconds after a picture has disappeared. However, change blindness studies indicate that very limited information remains available when a changed version of the image is presented subsequently. What happens to the large-capacity representation? New input after the first image may interfere, but this is likely to depend on the characteristics of the new input. In our first experiment, we show that a display containing homogeneous image elements between changing images does not render the large-capacity representation unavailable. Interference occurs when these new elements define objects. On that basis we introduce a new method to produce change blindness: The second experiment shows that change blindness can be induced by redefining figure and background, without an interval between the displays. The local features (line segments) that defined figures and background were swapped, while the contours of the figures remained where they were. Normally, changes are easily detected when there is no interval. However, our paradigm results in massive change blindness. We propose that in a change blindness experiment, there is a large-capacity representation of the original image when it is followed by a homogeneous interval display, but that change blindness occurs whenever the changed image forces resegregation of figures from the background.

Contextual modulation in V1: the Rossi-Zipser controversy.

A recent study (Rossi et al. 2001) implied the absence of figure-ground based contextual modulation in macaque V1, in contrast to the study on which it was modelled (Zipser et al. 1996). We suggest that Rossi et al. may have underestimated the extent of modulation by considering only positive and not also negative modulation and that their data may have shown figure-ground based contextual modulation. We then suggest a paradigm to assess whether it reflects figure-ground segregation, boundaries, or both.

The effect of figure-ground segregation on visual search and implicit learning

The effect of figure-ground segregation on visual search and implicit learning