Neurons In Inferotemporal Cortex Research Articles

Repetition Suppression in Monkey Inferotemporal Cortex: Relation to Behavioral Priming

In tasks requiring judgments about visual stimuli, humans exhibit repetition priming, responding with increased speed when a stimulus is repeated. Repetition priming might depend on repetition suppression, a phenomenon first observed in monkey inferotemporal cortex (IT) whereby, when a stimulus is repeated, the strength of the neuronal visual response is reduced. If the reduction resulted in sharpening of the cortical representation of the stimulus, and did not just scale it down, then speeded processing might result. To explore the relation between repetition priming and repetition suppression, we monitored neuronal activity in IT while monkeys performed a symmetry decision task. We found 1) that monkeys exhibit repetition priming, 2) that IT neurons simultaneously exhibit repetition suppression, 3) that repetition priming and repetition suppression do not vary in a significantly correlated fashion across trials, and 4) that repetition suppression scales down the representation of the stimulus without sharpening it. We conclude that repetition suppression accompanies repetition priming but is unlikely to be its cause.

Norm-based face encoding by single neurons in the monkey inferotemporal cortex

The rich and immediate perception of a familiar face, including its identity, expression and even intent, is one of the most impressive shared faculties of human and non-human primate brains. Many visually responsive neurons in the inferotemporal cortex of macaque monkeys respond selectively to faces, sometimes to only one or a few individuals, while showing little sensitivity to scale and other details of the retinal image. Here we show that face-responsive neurons in the macaque monkey anterior inferotemporal cortex are tuned to a fundamental dimension of face perception. Using a norm-based caricaturization framework previously developed for human psychophysics, we varied the identity information present in photo-realistic human faces, and found that neurons of the anterior inferotemporal cortex were most often tuned around the average, identity-ambiguous face. These observations are consistent with face-selective responses in this area being shaped by a figural comparison, reflecting structural differences between an incoming face and an internal reference or norm. As such, these findings link the tuning of neurons in the inferotemporal cortex to psychological models of face identity perception.

Learning to Attend: Modeling the Shaping of Selectivity in Infero-temporal Cortex in a Categorization Task

Recent experiments on behaving monkeys have shown that learning a visual categorization task makes the neurons in infero-temporal cortex (ITC) more selective to the task-relevant features of the stimuli (Sigala and Logothetis in Nature 415 318-320, 2002). We hypothesize that such a selectivity modulation emerges from the interaction between ITC and other cortical area, presumably the prefrontal cortex (PFC), where the previously learned stimulus categories are encoded. We propose a biologically inspired model of excitatory and inhibitory spiking neurons with plastic synapses, modified according to a reward based Hebbian learning rule, to explain the experimental results and test the validity of our hypothesis. We assume that the ITC neurons, receiving feature selective inputs, form stronger connections with the category specific neurons to which they are consistently associated in rewarded trials. After learning, the top-down influence of PFC neurons enhances the selectivity of the ITC neurons encoding the behaviorally relevant features of the stimuli, as observed in the experiments. We conclude that the perceptual representation in visual areas like ITC can be strongly affected by the interaction with other areas which are devoted to higher cognitive functions.

Multiple Object Response Normalization in Monkey Inferotemporal Cortex

The highest stages of the visual ventral pathway are commonly assumed to provide robust representation of object identity by disregarding confounding factors such as object position, size, illumination, and the presence of other objects (clutter). However, whereas neuronal responses in monkey inferotemporal cortex (IT) can show robust tolerance to position and size changes, previous work shows that responses to preferred objects are usually reduced by the presence of nonpreferred objects. More broadly, we do not yet understand multiple object representation in IT. In this study, we systematically examined IT responses to pairs and triplets of objects in three passively viewing monkeys across a broad range of object effectiveness. We found that, at least under these limited clutter conditions, a large fraction of the response of each IT neuron to multiple objects is reliably predicted as the average of its responses to the constituent objects in isolation. That is, multiple object responses depend primarily on the relative effectiveness of the constituent objects, regardless of object identity. This average effect becomes virtually perfect when populations of IT neurons are pooled. Furthermore, the average effect cannot simply be explained by attentional shifts but behaves as a primarily feedforward response property. Together, our observations are most consistent with mechanistic models in which IT neuronal outputs are normalized by summed synaptic drive into IT or spiking activity within IT and suggest that normalization mechanisms previously revealed at earlier visual areas are operating throughout the ventral visual stream.

Underlying principles of visual shape selectivity in posterior inferotemporal cortex.

Object perception depends on shape processing in the ventral visual pathway, which in monkeys culminates in inferotemporal cortex (IT). Here we provide a description of fundamental quantitative principles governing neural selectivity for complex shape in IT. By measuring responses to large, parametric sets of two-dimensional (2D) silhouette shapes, we found that neurons in posterior IT (Brodmann's areas TEO and posterior TE) integrate information about multiple contour elements (straight and curved edge fragments of the type represented in lower-level areas) using both linear and nonlinear mechanisms. This results in complex, distributed response patterns that cannot be characterized solely in terms of example stimuli. We explained these response patterns with tuning functions in multidimensional shape space and accurately predicted neural responses to the widely varying shapes in our stimulus set. Integration of contour element information in earlier stages of IT represents an important step in the transformation from low-level shape signals to complex object representation.

Unilateral deficits in visual perception and learning after unilateral inferotemporal cortex lesions in macaques.

This study adapted the method of partial lesions, combined with controlled fixation, to study the perceptual role of macaque inferotemporal (IT) cortex. Unilateral lesions were made in IT cortex of three monkeys, without section of the corpus callosum, and visual function was tested ipsilateral and contralateral to the lesion. The observed changes were compared to the effects of bilateral lesions of IT cortex in one monkey, the approach used in most previous studies. Unilateral lesions produced far less profound, although more selective, loss on the tested visual abilities than did bilateral lesions. All three monkeys with unilateral lesions showed decreased chromatic sensitivity, but sparing of achromatic sensitivity, and severely disrupted learning and performance of visual matching to sample, and in all cases, the visual loss was contralateral to the site of the lesion. Unexpectedly, the magnitude of the contralateral loss was not increased by later section of the corpus callosum and anterior commissure in one of the monkeys, a lesion that removes interhemispheric input to contralateral from ipsilateral temporal cortex neurons. These results support physiological findings that show that the response of IT cortex neurons is dominated by the contralateral visual field, despite the bilateral activation many IT neurons receive. Comparison to earlier studies of lesions of area V4, which provides input to IT cortex, shows that V4 and IT lesions produce qualitatively different effects.

Are cortical models really bound by the "binding problem"?

Are cortical models really bound by the "binding problem"?

Sensory modality specificity of neural activity related to memory in visual cortex.

Previous studies have shown that when monkeys perform a delayed match-to-sample (DMS) task, some neurons in inferotemporal visual cortex are activated selectively during the delay period when the animal must remember particular visual stimuli. This selective delay activity may be involved in short-term memory. It does not depend on visual stimulation: both auditory and tactile stimuli can trigger selective delay activity in inferotemporal cortex when animals expect to respond to visual stimuli in a DMS task. We have examined the overall modality specificity of delay period activity using a variety of auditory/visual cross-modal and unimodal DMS tasks. The cross-modal DMS tasks involved making specific long-term memory associations between visual and auditory stimuli, whereas the unimodal DMS tasks were standard identity matching tasks. Delay activity existed in auditory/visual cross-modal DMS tasks whether the animal anticipated responding to visual or auditory stimuli. No evidence of selective delay period activation was seen in a purely auditory DMS task. Delay-selective cells were relatively common in one animal where they constituted up to 53% neurons tested with a given task. This was only the case for up to 9% of cells in a second animal. In the first animal, a specific long-term memory representation for learned cross-modal associations was observed in delay activity, indicating that this type of representation need not be purely visual. Furthermore, in this same animal, delay activity in one cross-modal task, an auditory-to-visual task, predicted correct and incorrect responses. These results suggest that neurons in inferotemporal cortex contribute to abstract memory representations that can be activated by input from other sensory modalities, but these representations are specific to visual behaviors.

Anatomical and physiological correlates of visual computation from striate to infero-temporal cortex

The calculus of two-dimensional mappings is reviewed. Currently available data suggests that a conformal (isotropic) mapping is sufficient to model the global topography of primate striate cortex. The addition of a shear component to this mapping is outlined. A similar analysis is applied to the local map structure of striate cortex. Models based on a local reiteration of the complex logarithm and on Radon (and backprojection) mappings are presented. A variety of computational functions associated with the novel architectures for image processing suggested by striate cortex neuroanatomy are discussed. Applications to segmentation, perceptual invariances, shape analysis, and visual data compression are included. Finally, recent experimental results on shape analysis by neurons of infero-temporal cortex are presented.

Inferotemporal neuron activities and color discrimination with delay

Neuron activity was recorded from the inferotemporal cortex (IT)of rhesus monkeys while they were performing a visual color discrimination task, in which a light (green or red) was illuminated twice with a delay period of 1–5 sec. Two kinds of task were employed. The first was a visual short-term memory task, originally described by Konorski (task I), and the second was its slightly modified version (task II). If the first stimulus (sample) and the second (matching) were the same in color, the monkey pressed one of two levers and if two stimuli were different, the monkey pressed the other. In task I, the matching stimulus signaled ‘GO’ for lever press. In task II, after visual stimuli, another delay period and then auditory stimulus, indicating ‘GO’ for lever press, were added. Out of 101 task related neurons, 57 were recorded during task I and 44 were during task II. Most of these were activated by visual stimuli and these were divided into two classes: ones responding non-differentially to different colors (45 neurons) and the other responding differentially to different colors (37 neurons). In task I, 8 neurons showed increases only after matching stimuli and one increased only after sample stimuli. Out of 33 neurons activated by both stimuli, 20 showed stronger responses to matching stimuli and others showed increase or decrease of equal degree. Out of task II-related neurons, 40 were activated visually during sample and matching periods and 20 showed stronger responses to matching stimuli. It is said that in these task visually activated neurons tended to show stronger responses to matching than to sample stimuli. Activity related to the lever press was not found. It was suggested from these results that the IT neurons were related to a process of visual discrimination, so that a physically identical stimulus which had a different meaning in the behavioral context would be differentiated.

Visual activation of neurons in inferotemporal cortex depends on striate cortex and forebrain commissures.

Neurons in inferotemporal cortex respond only to visual stimuli and a majority have receptive fields that extend well into both visual half-fields. After bilateral removal of striate cortex, no inferotemporal neurons responded to visual stimuli. After unilateral removal of striate cortex, inferotemporal neurons in both hemispheres responded only to stimuli in the hemifield contralateral to the intact striate cortex. After section of the corpus callosum and anterior commissure, inferotemporal neurons in both hemispheres responded only to stimuli in the hemifield contralateral to the recording site. These results indicate that inferotemporal cortex visual information from striate cortex and that the pathway from striate cortex to the contralateral inferotemporal cortex includes the forebrain commissures. This same striate-temporal pathway is also necessary for normal discrimination learning. We suggest that the converging input onto single inferotemporal neurons from widely separated retinal areas may provide a mechanism for stimulus equivalence over different parts of the visual field, and it may be the absence of such a mechanism that contributes to the visual discrimination deficit that follows inferotemporal lesions.

Visual receptive fields of neurons in inferotemporal cortex of the monkey.

Neurons in inferotemporal cortex (area TE) of the monkey had visual receptive fields which were very large (greater than 10 by 10 degrees) and almost always included the fovea. Some extended well into both halves of the visual field, while others were confined to the ipsilateral or contralateral side. These neurons were differentially sensitive to several of the following dimensions of the stimulus: size and shape, color, orientation, and direction of movement.