Different Levels Of Visual Processing Research Articles

Chapter 10 - Visual objects and their colors

The ventral temporal cortex hosts key regions for the high-level visual processing of object shape and color. These areas represent nodes of large-scale neural circuits dedicated to object recognition. In the language-dominant hemisphere, some of these regions communicate with the language systems; by assigning verbal labels to percepts, these circuits speedup stimulus categorization, and permit fast and accurate interindividual communication. By impairing the functioning of these circuits, neurological damage may provoke disabling disorders of the processing of visual objects and of their colors. Brain damage of vascular, degenerative, toxic, or traumatic origin can induce deficits at different levels of visual processing, from the building of shape- or wavelength-invariant percepts, to their connections with semantic knowledge and with the appropriate lexical entry. After an overview of the neuroimaging of domain-preferring regions for object shape and color in the ventral temporal cortex, this chapter reviews evidence from historical and recent cases of acquired visual agnosia and color processing deficits. A recurrent motif emerging from patients' patterns of performance and lesion locations is the existence of caudo-rostral gradients in the ventral occipito-temporal cortex, spanning from more perceptual to more cognitive stages of processing.

The time-course of prediction formation and revision in human visual motion processing

Establishing the real-time position of a moving object poses a challenge to the visual system due to neural processing delays. While sensory information is travelling through the visual hierarchy, the object continues moving and information about its position becomes outdated. By extrapolating the position of a moving object along its trajectory, predictive mechanisms might effectively decrease the processing time associated with these objects. Here, we use time-resolved decoding of electroencephalographic (EEG) data from an apparent motion paradigm to demonstrate the interaction of two separate predictive mechanisms. First, we reveal predictive latency advantages for position representations as soon as the second object in an apparent motion sequence – even before the stimulus contains any physical motion energy. This is consistent with the existence of omni-directional, within-layer waves of sub-threshold activity that bring neurons coding for adjacent positions closer to their firing threshold, thereby reducing the processing time of the second stimulus in one of those positions. Second, we show that an additional direction-specific latency advantage emerges from the third sequence position onward, once the direction of the apparent motion stimulus is uniquely determined. Because the receptive fields of early visual areas are too small to encompass sequential apparent motion positions (as evidenced by the lack of latency modulation for the second stimulus position), this latency advantage most likely arises from descending predictions from higher to lower visual areas through feedback connections. Finally, we reveal that the same predictive activation that facilitates the processing of the object in its expected position needs to be overcome when the object's trajectory unexpectedly reverses, causing an additional latency disadvantage for stimuli that violate predictions. Altogether, our results suggest that two complementary mechanisms interact to form and revise predictions in visual motion processing, modulating the latencies of neural position representations at different levels of visual processing.

Idiosyncratic perception: a link between acuity, perceived position and apparent size.

Perceiving the positions of objects is a prerequisite for most other visual and visuomotor functions, but human perception of object position varies from one individual to the next. The source of these individual differences in perceived position and their perceptual consequences are unknown. Here, we tested whether idiosyncratic biases in the underlying representation of visual space propagate across different levels of visual processing. In Experiment 1, using a position matching task, we found stable, observer-specific compressions and expansions within local regions throughout the visual field. We then measured Vernier acuity (Experiment 2) and perceived size of objects (Experiment 3) across the visual field and found that individualized spatial distortions were closely associated with variations in both visual acuity and apparent object size. Our results reveal idiosyncratic biases in perceived position and size, originating from a heterogeneous spatial resolution that carries across the visual hierarchy.

Differential aging effects in motion perception tasks for central and peripheral vision.

The perception of motion is considered critical for performing everyday tasks, such as locomotion and driving, and relies on different levels of visual processing. However, it is unclear whether healthy aging differentially affects motion processing at specific levels of processing, or whether performance at central and peripheral spatial eccentricities is altered to the same extent. The aim of this study was to explore the effects of aging on hierarchically different components of motion processing: the minimum displacement of dots to perceive motion (Dmin), the minimum contrast and speed to determine the direction of motion, spatial surround suppression of motion, global motion coherence (translational and radial), and biological motion. We measured motion perception in both central vision and at 15° eccentricity, comparing performance in 20 older (60–79 years) and 20 younger (19–34 years) adults. Older adults had significantly elevated thresholds, relative to younger adults, for motion contrast, speed, Dmin, and biological motion. The differences between younger and older participants were of similar magnitude in central and peripheral vision, except for surround suppression of motion, which was weaker in central vision for the older group, but stronger in the periphery. Our findings demonstrate that the effects of aging are not uniform across all motion tasks. Whereas the performance of some tasks in the periphery can be predicted from the results in central vision, the effects of age on surround suppression of motion shows markedly different characteristics between central and peripheral vision.

Masking procedures can influence priming effects besides their effects on conscious perception.

Masked priming has been employed to study the role of consciousness for different levels of visual processing. However, masking procedures differ systematically between studies. To examine these procedural differences we contrasted priming effects with metacontrast masking, which is often applied in the context of perceptual priming, and priming effects with sandwich pattern masking, frequently used in studies on semantic priming. Results indicate that the amount of masking neither affects perceptual nor semantic priming effects in a semantic categorization task when a metacontrast masking paradigm was used. However, perceptual and semantic priming effects increased with increasing prime visibility when a sandwich pattern masking paradigm was used. Findings suggest that different types of masking procedures affect the processing of the masked stimuli in substantially different ways even if the masking effect on conscious perception of these stimuli is comparable.

Distinct neural processes for the perception of familiar versus unfamiliar faces along the visual hierarchy revealed by EEG

Humans recognize faces with ease, despite the complexity of the task and of the visual system which underlies it. Different spatial regions, including both the core and extended face processing networks, and distinct temporal stages of processing have been implicated in face recognition, but there is ongoing controversy regarding the extent to which the mechanisms for recognizing a familiar face differ from those for an unfamiliar face. Here, we used electroencephalogram (EEG) and flicker SSVEP, a high signal-to-noise approach, and searchlight decoding methods to elucidate the mechanisms mediating the processing of familiar and unfamiliar faces in the time domain. Familiar and unfamiliar faces were presented periodically at 15 Hz, 6 Hz and 3.75 Hz either upright or inverted in separate blocks, with the rationale that faster frequencies require shorter processing times per image and tap into fundamentally different levels of visual processing. The 15 Hz trials, likely to reflect early visual processing, exhibited enhanced neural responses for familiar over unfamiliar face trials, but only when the faces were upright. In contrast, decoding methods revealed similar classification accuracies for upright and inverted faces for both familiar and unfamiliar faces. For the 6 Hz frequency, familiar faces had lower amplitude responses than unfamiliar faces, and decoding familiarity was more accurate for upright compared with inverted faces. Finally, the 3.75 Hz frequency revealed no main effects of familiarity, but decoding showed significant correlations with behavioral ratings of face familiarity, suggesting that activity evoked by this slow presentation frequency reflected higher-level, cognitive aspects of familiarity processing. This three-way dissociation between frequencies reveals that fundamentally different stages of the visual hierarchy are modulated by face familiarity. The combination of experimental and analytical approaches used here represent a novel method for elucidating spatio-temporal characteristics within the visual system.

Chromatic induction from surrounding stimuli under perceptual suppression.

The appearance of colors can be affected by their spatiotemporal context. The shift in color appearance according to the surrounding colors is called color induction or chromatic induction; in particular, the shift in opponent color of the surround is called chromatic contrast. To investigate whether chromatic induction occurs even when the chromatic surround is imperceptible, we measured chromatic induction during interocular suppression. A multicolor or uniform color field was presented as the surround stimulus, and a colored continuous flash suppression (CFS) stimulus was presented to the dominant eye of each subject. The subjects were asked to report the appearance of the test field only when the stationary surround stimulus is invisible by interocular suppression with CFS. The resulting shifts in color appearance due to chromatic induction were significant even under the conditions of interocular suppression for all surround stimuli. The magnitude of chromatic induction differed with the surround conditions, and this difference was preserved regardless of the viewing conditions. The chromatic induction effect was reduced by CFS, in proportion to the magnitude of chromatic induction under natural (i.e., no-CFS) viewing conditions. According to an analysis with linear model fitting, we revealed the presence of at least two kinds of subprocesses for chromatic induction that reside at higher and lower levels than the site of interocular suppression. One mechanism yields different degrees of chromatic induction based on the complexity of the surround, which is unaffected by interocular suppression, while the other mechanism changes its output with interocular suppression acting as a gain control. Our results imply that the total chromatic induction effect is achieved via a linear summation of outputs from mechanisms that reside at different levels of visual processing.

Electrophysiological evidence for colour effects on the naming of colour diagnostic and noncolour diagnostic objects

In this study, we investigated the level of visual processing at which surface colour information improves the naming of colour diagnostic and noncolour diagnostic objects. Continuous electroencephalograms were recorded while participants performed a visual object naming task in which coloured and black-and-white versions of both types of objects were presented. The black-and-white and the colour presentations were compared in two groups of event-related potentials (ERPs): (1) The P1 and N1 components, indexing early visual processing; and (2) the N300 and N400 components, which index late visual processing. A colour effect was observed in the P1 and N1 components, for both colour and noncolour diagnostic objects. In addition, for colour diagnostic objects, a colour effect was observed in the N400 component. These results suggest that colour information is important for the naming of colour and noncolour diagnostic objects at different levels of visual processing. It thus appears that the visual system uses colour information, during naming of both object types, at early visual stages; however, for the colour diagnostic objects naming, colour information is also recruited during the late visual processing stages.

Crowding in a detection task: External noise triggers change in processing strategy

External noise paradigms have been widely used to probe different levels of visual processing ( Pelli & Farell, 1999). A basic assumption of this paradigm is that the processing strategy is noise-invariant, remaining the same in low and high external noise. We tested this assumption by examining crowding in a detection task where traditionally crowding has no effect. In the first experiment, we measured detection thresholds for a vertically oriented sine wave grating (target) surrounded by four sine wave gratings (flankers) that were either vertically or horizontally oriented. At low noise levels, the detection threshold for the target was unaffected by the orientation of the flankers – there was no crowding. Surprisingly, however, there was crowding for detection at high noise levels: the threshold increased for the similarly-oriented flankers. This suggests that high noise triggered a change in processing strategy, increasing the range of space or features over which the visual signal was sampled. In a second experiment, we evaluated the impact of the spatial and temporal window of the noise on this crowding effect. Although crowding was observed for detection when the spatial and/or temporal window of the noise was localized (i.e. identical to the signal window), no crowding was observed when the noise was spatially and temporally extended (i.e. continuously displayed, full screen dynamic noise). Our results show that certain spatiotemporal distributions of external noise can elicit a change in processing strategy, invalidating the noise-invariant assumption that underlies external noise paradigms. In contrast, spatiotemporally extended noise maintains the required noise-indifference, perhaps because it matches the characteristics of the internal noise that determines the contrast threshold in low noise.

Asymmetry of visual sensory mechanisms: Electrophysiological, structural, and psychophysical evidences

Psychophysical visual field asymmetries are widely documented and have been attributed to anatomical anisotropies both at the retinal and cortical levels. This debate on whether such differences originate within the retina itself or are due to higher visual processing may be illuminated if concomitant anatomical, physiological, and psychophysical measures are taken in the same individuals. In the current study, we have focused on the study of objective functional and structural asymmetries at the retinal level and examined their putative correlation with visual performance asymmetries. Forty healthy participants (80 eyes; 13 male and 27 female subjects) were included in this study. Objective functional/structural asymmetries were probed using the multifocal electroretinogram (mfERG) technique and optical coherence tomography (OCT), respectively. A nasal/temporal pattern of asymmetry (nasal visual hemifield disadvantage) was found for all methods (retinal thickness, contrast sensitivity, and mfERG P1 amplitude). Furthermore, superior/inferior asymmetries could be documented only with psychophysics and structural measures. These patterns likely arise at different levels of the retina as inferred by partly independent correlation patterns. We conclude that patterns of structural/functional asymmetries arise at different levels of visual processing with a strong retinal contribution.

Legibility of Chinese characters in peripheral vision and the top-down influences on crowding

Written Chinese is distinct from alphabetic languages because of its enormous number of characters with a great range of spatial complexities (stroke numbers). In this study we investigated the impact of spatial complexity on legibility of Chinese characters as well as associated crowding in peripheral vision. Our results showed that for isolated characters, threshold sizes of complex characters increased faster with retinal eccentricity than did those of simple characters, suggesting possible “within-character” crowding among parts of complex Chinese characters. However, such “within-character” crowding was rendered negligible by strong “between-character” crowding introduced by flankers. When the target and flankers belonged to different complexity groups, the intensity and extent of crowding were greatly reduced, which could be explained by top-down influences as well as lower-level mechanisms. We suggest that crowding can be attributed to multiple mechanisms at different levels of visual processing.

Specific visuomotor deficits due to alcohol intoxication: Evidence from the pro- and antisaccade paradigms

Alcohol affects a variety of human behaviors, including visual perception and motor control. Although recent research has begun to explore mechanisms that mediate these changes, their exact nature is still not well understood. The present study used two basic oculomotor tasks to examine the effect of alcohol on different levels of visual processing within the same individuals. A theoretical framework is offered to integrate findings across multiple levels of oculomotor control. Twenty-four healthy participants were asked to perform eye movements in reflexive (pro-) and voluntary (anti-) saccade tasks. In one of two counterbalanced sessions, performance was measured after alcohol administration (mean BrAC=69 mg%); the other served as a within-subjects no-alcohol comparison condition. Error rates were not influenced by alcohol intoxication in either task. However, there were significant effects of alcohol on saccade latency and peak velocity in both tasks. Critically, a specific alcohol-induced impairment (hypermetria) in saccade amplitudes was observed exclusively in the anti-saccade task. The saccade latency data strongly suggest that alcohol intoxication impairs temporal aspects of saccade generation, irrespective of the level of processing triggering the saccade. The absence of effects on anti-saccade errors calls for further research into the notion of alcohol-induced impairment of the ability to inhibit prepotent responses. Furthermore, the specific impairment of saccade amplitude in the anti-saccade task under alcohol suggests that higher level processes involved in the spatial remapping of target location in the absence of a visually specified saccade goal are specifically affected by alcohol intoxication.

Importance of attentional mechanisms in audiovisual links.

The effect of auditory cues at different levels of visual processing was examined by using a visual "conjunction of features" discrimination task (experiment 1) and a "feature" discrimination task (experiment 2). In both experiments the visual target, appearing either on the left or the right of Ss' midline, was preceded by a brief tone either spatially proximal or distal to the target. In the "conjunction" task, subjects had to discriminate the orientation of a T flanked with T distractors of different orientations. In this task, assumed to require focused attention, discrimination accuracy was increased when the sound cue occurred at the subsequent visual target location and was decreased when it occurred at its alternative location. In the "feature" experiment, subjects had to discriminate the orientation of a line segment (+/-45 degrees) presented among line segment distractors. Accuracy was not affected, either when the sound was proximal or when it was distal to the location of the visual target. Results suggest that the early processing of sensory information is modality specific and that interference of auditory stimulation with visual stimuli is more pronounced as the processing of visual stimuli requires focused attention.

The formation of cooperative cell assemblies in the visual cortex

ABSTRACT During a critical period of postnatal development of the mammalian visual cortex, synaptic connections are susceptible to use-dependent modifications. Synaptic connections strengthen if pre- and postsynaptic elements are active simultaneously and postsynaptic depolarization is sufficient to allow for the activation of N-methyl-D-aspartate (NMDA)-receptor-gated conductances. By contrast, synaptic gain decreases if postsynaptic activation exceeds a critical threshold and presynaptic afferents are not capable of activating NMDA- receptor-dependent conductances. These processes lead to selective stabilization of connections between neuronal elements which often exhibit correlated activity and thus modify connectivity according to functional criteria, it is suggested that such experience-dependent selection of circuits serves different purposes at different levels of visual processing. At the input stage to the striate cortex it contributes to optimize the match between the representations of the two eyes. At a later stage of processing it participates in the development of selective connections between cortical columns and thereby serves to establish neuronal representations for frequently occurring constellations of features. Use-dependent changes of synaptic gain can also be induced in the mature visual cortex. These modifications follow the same rules as those occurring during early development and appear to depend on similar molecular mechanisms. However, in the adult the changes of synaptic gain do not seem to be followed by major rearrangements of connectivity. This suggests developmental alterations in mechanisms responsible for growth, removal and stabilization of synaptic connections. Actually, many of the cellular mechanisms thought to be involved in use-dependent synaptic plasticity change during development but it is still unclear which of them are responsible for the definitive stabilization of functionally confirmed pathways.