P1-24: Neural Representation of Gloss in the Macaque Inferior Temporal Cortex

Abstract

The variation of the appearance such as gloss provides one of the most important information for object recognition. However, little is known about the neural mechanisms related to the perception of gloss. We examined whether the neurons in the inferior temporal (IT) cortex of the monkeys are coding gloss of objects. We made visual stimuli which have various surface reflectance properties, and tested responses of IT neurons to these stimuli while a monkey was performing a visual fixation task. We found that there exist neurons in the lower bank of the superior temporal sulcus that selectively responded to specific stimuli. The selectivity was largely maintained when the object shape or illumination condition was changed. In contrast, neural selectivity was lost when the pixels of objects were randomly rearranged. In the former manipulation of the stimuli, gloss perceptions were maintained, whereas in the latter manipulation, gloss perception was dramatically changed. These results indicate that these IT neurons selectively responded to gloss, not to the irrelevant local image features or average luminance or color. Next, to understand how the responses of gloss selective neurons are related to perceived gloss, responses of gloss selective neurons were mapped in perceptual gloss space in which glossiness changes uniformly. I found that responses of most gloss selective neurons can be explained by linear combinations of two parameters that are shown to be important for gloss perception. This result suggests that the responses of gloss selective neurons of IT cortex are closely related to gloss perception.