Object Recognition Pathway Research Articles

Moving and Static Faces, Bodies, Objects, and Scenes Are Differentially Represented across the Three Visual Pathways.

Models of human cortex propose the existence of neuroanatomical pathways specialized for different behavioral functions. These pathways include a ventral pathway for object recognition, a dorsal pathway for performing visually guided physical actions, and a recently proposed third pathway for social perception. In the current study, we tested the hypothesis that different categories of moving stimuli are differentially processed across the dorsal and third pathways according to their behavioral implications. Human participants (n = 30) were scanned with fMRI while viewing moving and static stimuli from four categories (faces, bodies, scenes, and objects). A whole-brain group analysis showed that moving bodies and moving objects increased neural responses in the bilateral posterior parietal cortex, parts of the dorsal pathway. By contrast, moving faces and moving bodies increased neural responses, the superior temporal sulcus, part of the third pathway. This pattern of results was also supported by a separate ROI analysis showing that moving stimuli produced more robust neural responses for all visual object categories, particularly in lateral and dorsal brain areas. Our results suggest that dynamic naturalistic stimuli from different categories are routed in specific visual pathways that process dissociable behavioral functions.

Beyond the Visual Word Form Area - a cognitive characterization of the left ventral occipitotemporal cortex.

The left ventral occipitotemporal cortex has been traditionally viewed as a pathway for visual object recognition including written letters and words. Its crucial role in reading was strengthened by the studies on the functionally localized "Visual Word Form Area" responsible for processing word-like information. However, in the past 20 years, empirical studies have challenged the assumptions of this brain region as processing exclusively visual or even orthographic stimuli. In this review, we aimed to present the development of understanding of the left ventral occipitotemporal cortex from the visually based letter area to the modality-independent symbolic language related region. We discuss theoretical and empirical research that includes orthographic, phonological, and semantic properties of language. Existing results showed that involvement of the left ventral occipitotemporal cortex is not limited to unimodal activity but also includes multimodal processes. The idea of the integrative nature of this region is supported by the broad functional and structural connectivity with language-related and attentional brain networks. We conclude that although the function of the area is not yet fully understood in human cognition, its role goes beyond visual word form processing. The left ventral occipitotemporal cortex seems to be crucial for combining higher-level language information with abstract forms that convey meaning independently of modality.

Perceptual Visual Inversion Secondary to Inhalation of Fumes of Sulfuryl Chloride (P4-12.003)

<h3>Objective:</h3> To describe a case of alteration of visual perception of objects and faces following Inhalation of Sulfuryl Chloride. <h3>Background:</h3> The neural pathways for object perception and recognition include two information-processing streams originating in occipital cortex. Dorsal stream extends to parietal lobe, and Ventral stream extends to inferior temporal lobe. Damage to each pathway can affect elements of visual perception affecting object recognition (what) and spatial perception (where and how). <h3>Design/Methods:</h3> Case report/literature review. <h3>Results:</h3> Fifty-three-year-old woman presented following inhalation of toxic fumes. Over the following hours and days, she lost the ability to speak her native tongue and could only communicate in her second language. She complained that most objects in her visual field were inverted, but not the whole scene. There are few reports of subjective visual field inversion without robust testing. We formulated novel experiments to probe deficits unique to her. On shape from shading (eggs vs. cavities) test, the light on top looked like cavities, unlike neurotypicals - implying that for her, the sun shines from below. She recognized upside-down faces faster than the correct way up and could easily read upside down. Prosopagnosics identify inverted faces more accurately than neurotypicals. We suggest there is a selective injury to the ventral stream,” What Pathway,” in the inferior temporal lobe (associated with object recognition). The insult relatively spared the dorsal stream “How and Where” in the posterior parietal cortex. This may explain why she exhibited mild Balint syndrome (optic ataxia, simultagnosia, oculomotor apraxia). Alternatively, the initial Balint may have been progressively corrected via visual feedback during reaching. Such correction does not occur for the ventral stream because we do not usually palpate people’s faces. <h3>Conclusions:</h3> Inversion of vision is rare but using stimuli designed to probe specific symptoms, we gain insight into cascade of neural signals that culminate in perception. <b>Disclosure:</b> Dr. Ramachandran has nothing to disclose. Dr. Kakawand has nothing to disclose. Dr. McGeoch has nothing to disclose. Mr. Ahern has nothing to disclose. Dr. Tobias has nothing to disclose.

Temporal asymmetries and interactions between dorsal and ventral visual pathways during object recognition.

Despite their anatomical and functional distinctions, there is growing evidence that the dorsal and ventral visual pathways interact to support object recognition. However, the exact nature of these interactions remains poorly understood. Is the presence of identity-relevant object information in the dorsal pathway simply a byproduct of ventral input? Or, might the dorsal pathway be a source of input to the ventral pathway for object recognition? In the current study, we used high-density EEG-a technique with high temporal precision and spatial resolution sufficient to distinguish parietal and temporal lobes-to characterise the dynamics of dorsal and ventral pathways during object viewing. Using multivariate analyses, we found that category decoding in the dorsal pathway preceded that in the ventral pathway. Importantly, the dorsal pathway predicted the multivariate responses of the ventral pathway in a time-dependent manner, rather than the other way around. Together, these findings suggest that the dorsal pathway is a critical source of input to the ventral pathway for object recognition.

Two 'what' pathways for action and object recognition.

The ventral visual stream is conceived as a pathway for object recognition. However, we also recognize the actions an object can be involved in. Here, we show that action recognition critically depends on a pathway in lateral occipitotemporal cortex, partially overlapping and topographically aligned with object representations that are precursors for action recognition. By contrast, object features that are more relevant for object recognition, such as color and texture, are typically found in ventral occipitotemporal cortex. We argue that occipitotemporal cortex contains similarly organized lateral and ventral 'what' pathways for action and object recognition, respectively. This account explains a number of observed phenomena, such as the duplication of object domains and the specific representational profiles in lateral and ventral cortex.

Spatial frequency tuning of motor responses reveals differential contribution of dorsal and ventral systems to action comprehension

Understanding object-directed actions performed by others is central to everyday life. This ability is thought to rely on the interaction between the dorsal action observation network (AON) and a ventral object recognition pathway. On this view, the AON would encode action kinematics, and the ventral pathway, the most likely intention afforded by the objects. However, experimental evidence supporting this model is still scarce. Here, we aimed to disentangle the contribution of dorsal vs. ventral pathways to action comprehension by exploiting their differential tuning to low-spatial frequencies (LSFs) and high-spatial frequencies (HSFs). We filtered naturalistic action images to contain only LSF or HSF and measured behavioral performance and corticospinal excitability (CSE) using transcranial magnetic stimulation (TMS). Actions were embedded in congruent or incongruent scenarios as defined by the compatibility between grips and intentions afforded by the contextual objects. Behaviorally, participants were better at discriminating congruent actions in intact than LSF images. This effect was reversed for incongruent actions, with better performance for LSF than intact and HSF. These modulations were mirrored at the neurophysiological level, with greater CSE facilitation for congruent than incongruent actions for HSF and the opposite pattern for LSF images. Finally, only for LSF did we observe CSE modulations according to grip kinematics. While results point to differential dorsal (LSF) and ventral (HSF) contributions to action comprehension for grip and context encoding, respectively, the negative congruency effect for LSF images suggests that object processing may influence action perception not only through ventral-to-dorsal connections, but also through a dorsal-to-dorsal route involved in predictive processing.

Mobile Universal Lexicon Evaluation System (MULES) in MS: Evaluation of a new visual test of rapid picture naming

ObjectiveThe Mobile Universal Lexicon Evaluation System (MULES) is a test of rapid picture naming that is under investigation for concussion. MULES captures an extensive visual network, including pathways for eye movements, color perception, memory and object recognition. The purpose of this study was to introduce the MULES to visual assessment of patients with MS, and to examine associations with other tests of afferent and efferent visual function. MethodsWe administered the MULES in addition to binocular measures of low-contrast letter acuity (LCLA), high-contrast visual acuity (VA) and the King-Devick (K-D) test of rapid number naming in an MS cohort and in a group of disease-free controls. ResultsAmong 24 patients with MS (median age 36 years, range 20–72, 64% female) and 22 disease-free controls (median age 34 years, range 19–59, 57% female), MULES test times were greater (worse) among the patients (60.0 vs. 40.0 s). Accounting for age, MS vs. control status was a predictor of MULES test times (P = .01, logistic regression). Faster testing times were noted among patients with MS who had greater (better) performance on binocular LCLA at 2.5% contrast (P < .001, linear regression, accounting for age), binocular high-contrast VA (P < .001), and K-D testing (P < .001). Both groups demonstrated approximately 10-s improvements in MULES test times between trials 1 and 2 (P < .0001, paired t-tests). ConclusionThe MULES test, a complex task of rapid picture naming involves an extensive visual network that captures eye movements, color perception and the characterization of objects. Color recognition, a key component of this novel assessment, is early in object processing and requires area V4 and the inferior temporal projections. MULES scores reflect performance of LCLA, a widely-used measure of visual function in MS clinical trials. These results provide evidence that the MULES test can add efficient visual screening to the assessment of patients with MS.

Objective analysis of the topological organization of the human cortical visual connectome suggests three visual pathways

The cortical visual system is composed of many areas serving various visual functions. In non-human primates, these are broadly organised into two distinct processing pathways: a ventral pathway for object recognition, and a dorsal pathway for action. In humans, recent theoretical proposals suggest the possible existence of additional pathways, but direct empirical evidence has yet to be presented. Here, we estimated the connectivity patterns between 22 human visual areas using resting-state functional MRI data of 470 individuals, leveraging the unprecedented data quantity and quality of the Human Connectome Project and a novel probabilistic atlas. An objective, data-driven analysis into the topological organisation of connectivity and subsequent quantitative confirmation revealed a highly significant triple dissociation between the retinotopic areas on the dorsal, ventral and lateral surfaces of the human occipital lobe. This suggests that the functional organisation of the human visual system involves not two but three cortical pathways.

Are face representations depth cue invariant?

The visual system can process three-dimensional depth cues defining surfaces of objects, but it is unclear whether such information contributes to complex object recognition, including face recognition. The processing of different depth cues involves both dorsal and ventral visual pathways. We investigated whether facial surfaces defined by individual depth cues resulted in meaningful face representations-representations that maintain the relationship between the population of faces as defined in a multidimensional face space. We measured face identity aftereffects for facial surfaces defined by individual depth cues (Experiments 1 and 2) and tested whether the aftereffect transfers across depth cues (Experiments 3 and 4). Facial surfaces and their morphs to the average face were defined purely by one of shading, texture, motion, or binocular disparity. We obtained identification thresholds for matched (matched identity between adapting and test stimuli), non-matched (non-matched identity between adapting and test stimuli), and no-adaptation (showing only the test stimuli) conditions for each cue and across different depth cues. We found robust face identity aftereffect in both experiments. Our results suggest that depth cues do contribute to forming meaningful face representations that are depth cue invariant. Depth cue invariance would require integration of information across different areas and different pathways for object recognition, and this in turn has important implications for cortical models of visual object recognition.

The role of the lateral occipital cortex in aesthetic appreciation of representational and abstract paintings: A TMS study

Neuroimaging studies of aesthetic appreciation have shown that activity in the lateral occipital area (LO)—a key node in the object recognition pathway—is modulated by the extent to which visual artworks are liked or found beautiful. However, the available evidence is only correlational. Here we used transcranial magnetic stimulation (TMS) to investigate the putative causal role of LO in the aesthetic appreciation of paintings. In our first experiment, we found that interfering with LO activity during aesthetic appreciation selectively reduced evaluation of representational paintings, leaving appreciation of abstract paintings unaffected. A second experiment demonstrated that, although the perceived clearness of the images overall positively correlated with liking, the detrimental effect of LO TMS on aesthetic appreciation does not owe to TMS reducing perceived clearness. Taken together, our findings suggest that object-recognition mechanisms mediated by LO play a causal role in aesthetic appreciation of representational art.

Early recurrent feedback facilitates visual object recognition under challenging conditions.

Standard models of the visual object recognition pathway hold that a largely feedforward process from the retina through inferotemporal cortex leads to object identification. A subsequent feedback process originating in frontoparietal areas through reciprocal connections to striate cortex provides attentional support to salient or behaviorally-relevant features. Here, we review mounting evidence that feedback signals also originate within extrastriate regions and begin during the initial feedforward process. This feedback process is temporally dissociable from attention and provides important functions such as grouping, associational reinforcement, and filling-in of features. Local feedback signals operating concurrently with feedforward processing are important for object identification in noisy real-world situations, particularly when objects are partially occluded, unclear, or otherwise ambiguous. Altogether, the dissociation of early and late feedback processes presented here expands on current models of object identification, and suggests a dual role for descending feedback projections.

Key Pathways for Visual Naming and Object Recognition Revealed by Diffusion Tensor Imaging Probabilistic Tractography in Epilepsy Surgery Patients (S43.008)

Key Pathways for Visual Naming and Object Recognition Revealed by Diffusion Tensor Imaging Probabilistic Tractography in Epilepsy Surgery Patients (S43.008)

The Neural Selection and Integration of Actions and Objects: An fMRI Study

There is considerable evidence that there are anatomically and functionally distinct pathways for action and object recognition. However, little is known about how information about action and objects is integrated. This study provides fMRI evidence for task-based selection of brain regions associated with action and object processing, and on how the congruency between the action and the object modulates neural response. Participants viewed videos of objects used in congruent or incongruent actions and attended either to the action or the object in a one-back procedure. Attending to the action led to increased responses in a fronto-parietal action-associated network. Attending to the object activated regions within a fronto-inferior temporal network. Stronger responses for congruent action-object clips occurred in bilateral parietal, inferior temporal, and putamen. Distinct cortical and thalamic regions were modulated by congruency in the different tasks. The results suggest that (i) selective attention to action and object information is mediated through separate networks, (ii) object-action congruency evokes responses in action planning regions, and (iii) the selective activation of nuclei within the thalamus provides a mechanism to integrate task goals in relation to the congruency of the perceptual information presented to the observer.

The time course of shape discrimination in the human brain

The lateral occipital cortex (LOC) activates selectively to images of intact objects versus scrambled controls, is selective for the figure-ground relationship of a scene, and exhibits at least some degree of invariance for size and position. Because of these attributes, it is considered to be a crucial part of the object recognition pathway. Here we show that human LOC is critically involved in perceptual decisions about object shape. High-density EEG was recorded while subjects performed a threshold-level shape discrimination task on texture-defined figures segmented by either phase or orientation cues. The appearance or disappearance of a figure region from a uniform background generated robust visual evoked potentials throughout retinotopic cortex as determined by inverse modeling of the scalp voltage distribution. Contrasting responses from trials containing shape changes that were correctly detected (hits) with trials in which no change occurred (correct rejects) revealed stimulus-locked, target-selective activity in the occipital visual areas LOC and V4 preceding the subject's response. Activity that was locked to the subjects' reaction time was present in the LOC. Response-locked activity in the LOC was determined to be related to shape discrimination for several reasons: shape-selective responses were silenced when subjects viewed identical stimuli but their attention was directed away from the shapes to a demanding letter discrimination task; shape-selectivity was present across four different stimulus configurations used to define the figure; LOC responses correlated with participants' reaction times. These results indicate that decision-related activity is present in the LOC when subjects are engaged in threshold-level shape discriminations.

“What” and “Where” in Auditory Sensory Processing: A High-Density Electrical Mapping Study of Distinct Neural Processes Underlying Sound Object Recognition and Sound Localization

Functionally distinct dorsal and ventral auditory pathways for sound localization (WHERE) and sound object recognition (WHAT) have been described in non-human primates. A handful of studies have explored differential processing within these streams in humans, with highly inconsistent findings. Stimuli employed have included simple tones, noise bursts, and speech sounds, with simulated left–right spatial manipulations, and in some cases participants were not required to actively discriminate the stimuli. Our contention is that these paradigms were not well suited to dissociating processing within the two streams. Our aim here was to determine how early in processing we could find evidence for dissociable pathways using better titrated WHAT and WHERE task conditions. The use of more compelling tasks should allow us to amplify differential processing within the dorsal and ventral pathways. We employed high-density electrical mapping using a relatively large and environmentally realistic stimulus set (seven animal calls) delivered from seven free-field spatial locations; with stimulus configuration identical across the “WHERE” and “WHAT” tasks. Topographic analysis revealed distinct dorsal and ventral auditory processing networks during the WHERE and WHAT tasks with the earliest point of divergence seen during the N1 component of the auditory evoked response, beginning at approximately 100 ms. While this difference occurred during the N1 timeframe, it was not a simple modulation of N1 amplitude as it displayed a wholly different topographic distribution to that of the N1. Global dissimilarity measures using topographic modulation analysis confirmed that this difference between tasks was driven by a shift in the underlying generator configuration. Minimum-norm source reconstruction revealed distinct activations that corresponded well with activity within putative dorsal and ventral auditory structures.

Neural basis of visual selective attention.

Attentional modulation along the object-recognition pathway of the cortical visual system of primates has been shown to consist of enhanced representation of the retinal input at a specific location in space, or of objects located anywhere in the visual field which possess a critical object feature. Moreover, selective attention mechanisms allow the visual system to resolve competition among multiple objects in a crowded scene in favor of the object that is relevant for the current behavior. Finally, selective attention affects the spontaneous activity of neurons as well as their visually driven responses, and it does so not only by modulating the spiking activity of individual neurons, but also by modulating the degree of coherent firing within the critical neuronal populations. WIREs Cogni Sci 2011 2 392-407 DOI: 10.1002/wcs.117 For further resources related to this article, please visit the WIREs website.

Learning to represent visual input

One of the central problems in computational neuroscience is to understand how the object-recognition pathway of the cortex learns a deep hierarchy of nonlinear feature detectors. Recent progress in machine learning shows that it is possible to learn deep hierarchies without requiring any labelled data. The feature detectors are learned one layer at a time and the goal of the learning procedure is to form a good generative model of images, not to predict the class of each image. The learning procedure only requires the pairwise correlations between the activations of neuron-like processing units in adjacent layers. The original version of the learning procedure is derived from a quadratic ‘energy’ function but it can be extended to allow third-order, multiplicative interactions in which neurons gate the pairwise interactions between other neurons. A technique for factoring the third-order interactions leads to a learning module that again has a simple learning rule based on pairwise correlations. This module looks remarkably like modules that have been proposed by both biologists trying to explain the responses of neurons and engineers trying to create systems that can recognize objects.

Using Biologically Inspired Features for Face Processing

In this paper, we show that a new set of visual features, derived from a feed-forward model of the primate visual object recognition pathway proposed by Riesenhuber and Poggio (R&P Model) (Nature Neurosci. 2(11):1019---1025, 1999) is capable of matching the performance of some of the best current representations for face identification and facial expression recognition. Previous work has shown that the Riesenhuber and Poggio Model features can achieve a high level of performance on object recognition tasks (Serre, T., et al. in IEEE Comput. Vis. Pattern Recognit. 2:994---1000, 2005). Here we modify the R&P model in order to create a new set of features useful for face identification and expression recognition. Results from tests on the FERET, ORL and AR datasets show that these features are capable of matching and sometimes outperforming other top visual features such as local binary patterns (Ahonen, T., et al. in 8th European Conference on Computer Vision, pp. 469---481, 2004) and histogram of gradient features (Dalal, N., Triggs, B. in International Conference on Computer Vision & Pattern Recognition, pp. 886---893, 2005). Having a model based on shared lower level features, and face and object recognition specific higher level features, is consistent with findings from electrophysiology and functional magnetic resonance imaging experiments. Thus, our model begins to address the complete recognition problem in a biologically plausible way.

Progression of neuronal processing of visual objects

We studied, with functional MRI, how neuronal processing for visual objects progresses in the human brain by measuring suppressive responses to stimulus pairs. Two concentric rectangular frames of slightly different sizes were presented such that the smaller frame was shown first, followed by the larger dominant frame, with interstimulus intervals of 0, 50 and 240-ms. The functional MRI response at 50-ms decreased along the ventral visual pathway. The response at 240-ms interstimulus interval was suppressed after a fusiform area at which the response at 50-ms interstimulus interval was highly suppressed already and the responses at 0, 50 and 240-ms interstimulus intervals showed a V-shaped dependence on those interstimulus intervals. These observations show a way of progression of the information processing along visual object recognition pathway.

Object identification and lexical/semantic access in children: A functional magnetic resonance imaging study of word‐picture matching

Theoretical models for lexical access to visual objects have been based mainly on adult data. To investigate the developmental aspects of object recognition and lexical access in children, a large-scale functional MRI (fMRI) study was performed in 283 normal children ages 5-18 using a word-picture matching paradigm in which children would match an aurally presented noun to one of two pictures (line drawings). Using group Independent Component Analysis (ICA), six task-related components were detected, including (a) the posterior superior temporal gyrus bilaterally; (b) the fusiform, inferior temporal, and middle occipital gyri bilaterally; (c) the dorsal aspect of the inferior frontal gyrus bilaterally, the left precuneus, the left superior/middle temporal gyrus, and the anterior cingulate; (d) the right medial fusiform gyrus; (e) a left-lateralized component including the inferior/middle frontal, middle temporal, medial frontal, and angular gyri, as well as the thalamus and the posterior cingulate; and (f) the ventral/anterior aspect of the inferior frontal gyrus bilaterally. Increased activation associated with age was seen in the components (b) and (d) (ventral visual pathway) for object recognition, and (c) and (f) likely associated with semantic maintenance and response selection. Increased activation associated with task performance was seen in components (b) and (d) (ventral visual pathway) while decreased activation associated with task performance was seen in component (f) (ventral/anterior inferior frontal gyrus). The results corroborate the continued development of the ventral visual pathway throughout the developmental period.