Visual Object Representations Research Articles

Trapped particle makes 3D images.

A technique in which a small particle is trapped and moved by laser light has been used to produce visual representations of objects in three dimensions, offering key advantages over currently used approaches. A technique in which a small particle is trapped and moved by laser light has been used to produce visual representations of objects in three dimensions, offering key advantages over currently used approaches.

Task-context-dependent Linear Representation of Multiple Visual Objects in Human Parietal Cortex.

A host of recent studies have reported robust representations of visual object information in the human parietal cortex, similar to those found in ventral visual cortex. In ventral visual cortex, both monkey neurophysiology and human fMRI studies showed that the neural representation of a pair of unrelated objects can be approximated by the averaged neural representation of the constituent objects shown in isolation. In this study, we examined whether such a linear relationship between objects exists for object representations in the human parietal cortex. Using fMRI and multivoxel pattern analysis, we examined object representations in human inferior and superior intraparietal sulcus, two parietal regions previously implicated in visual object selection and encoding, respectively. We also examined responses from the lateral occipital region, a ventral object processing area. We obtained fMRI response patterns to object pairs and their constituent objects shown in isolation while participants viewed these objects and performed a 1-back repetition detection task. By measuring fMRI response pattern correlations, we found that all three brain regions contained representations for both single object and object pairs. In the lateral occipital region, the representation for a pair of objects could be reliably approximated by the average representation of its constituent objects shown in isolation, replicating previous findings in ventral visual cortex. Such a simple linear relationship, however, was not observed in either parietal region examined. Nevertheless, when we equated the amount of task information present by examining responses from two pairs of objects, we found that representations for the average of two object pairs were indistinguishable in both parietal regions from the average of another two object pairs containing the same four component objects but with a different pairing of the objects (i.e., the average of AB and CD vs. that of AD and CB). Thus, when task information was held consistent, the same linear relationship may govern how multiple independent objects are represented in the human parietal cortex as it does in ventral visual cortex. These findings show that object and task representations coexist in the human parietal cortex and characterize one significant difference of how visual information may be represented in ventral visual and parietal regions.

The case of the missing visual details: Occlusion and long-term visual memory.

To investigate the critical information in long-term visual memory representations of objects, we used occlusion to emphasize 1 type of information or another. By occluding 1 solid side of the object (e.g., top 50%) or by occluding 50% of the object with stripes (like a picket fence), we emphasized visible information about the object, processing the visible details in the former and the object's overall form in the latter. On a token discrimination test, surprisingly, memory for solid or stripe occluded objects at either encoding (Experiment 1) or test (Experiment 2) was the same. In contrast, when occluded objects matched at encoding and test (Experiment 3) or when the occlusion shifted, revealing the entire object piecemeal (Experiment 4), memory was better for solid compared with stripe occluded objects, indicating that objects are represented differently in long-term visual memory. Critically, we also found that when the task emphasized remembering exactly what was shown, memory performance in the more detailed solid occlusion condition exceeded that in the stripe condition (Experiment 5). However, when the task emphasized the whole object form, memory was better in the stripe condition (Experiment 6) than in the solid condition. We argue that long-term visual memory can represent objects flexibly, and task demands can interact with visual information, allowing the viewer to cope with changing real-world visual environments. (PsycINFO Database Record

Visual long-term memory is not unitary: Flexible storage of visual information as features or objects as a function of affect.

Research has shown that observers store surprisingly highly detailed long-term memory representations of visual objects after only a single viewing. However, the nature of these representations is currently not well understood. In particular, it may be that the nature of such memory representations is not unitary but reflects the flexible operating of two separate memory subsystems: a feature-based subsystem that stores visual experiences in the form of independent features, and an object-based subsystem that stores visual experiences in the form of coherent objects. Such an assumption is usually difficult to test, because overt memory responses reflect the joint output of both systems. Therefore, to disentangle the two systems, we (1) manipulated the affective state of observers (negative vs. positive) during initial object perception, to introduce systematic variance in the way that visual experiences are stored, and (2) measured both the electrophysiological activity at encoding (via electroencephalography) and later feature memory performance for the objects. The results showed that the nature of stored memory representations varied qualitatively as a function of affective state. Negative affect promoted the independent storage of object features, driven by preattentive brain activities (feature-based memory representations), whereas positive affect promoted the dependent storage of object features, driven by attention-related brain activities (object-based memory representations). Taken together, these findings suggest that visual long-term memory is not a unitary phenomenon. Instead, incoming information can be stored flexibly by means of two qualitatively different long-term memory subsystems, based on the requirements of the current situation.

Visuo-haptic integration in object identification using novel objects.

Although some studies have shown that haptic and visual identification seem to rely on similar processes, few studies have directly compared the two. We investigated haptic and visual object identification by asking participants to learn to recognize (Experiments 1, and 3), or to match (Experiment 2) novel objects that varied only in shape. Participants explored objects haptically, visually, or bimodally, and were then asked to identify objects haptically and/or visually. We demonstrated that patterns of identification errors were similar across identification modality, independently of learning and testing condition, suggesting that the haptic and visual representations in memory were similar. We also demonstrated that identification performance depended on both learning and testing conditions: visual identification surpassed haptic identification only when participants explored the objects visually or bimodally. When participants explored the objects haptically, haptic and visual identification were equivalent. Interestingly, when participants were simultaneously presented with two objects (one was presented haptically, and one was presented visually), object similarity only influenced performance when participants were asked to indicate whether the two objects were the same, or when participants had learned about the objects visually-without any haptic input. The results suggest that haptic and visual object representations rely on similar processes, that they may be shared, and that visual processing may not always lead to the best performance.

Mental imagery of face enhances face-sensitive event-related potentials to ambiguous visual stimuli

Visual mental imagery forms mental representations of visual objects when correspondent stimuli are absent and shares some characters with visual perception. Both the vertex-positive-potential (VPP) and N170 components of event-related potentials (ERPs) to visual stimuli have a remarkable preference to faces. This study investigated whether visual mental imagery modulates the face-sensitive VPP and/or N170 components. The results showed that with significantly larger amplitudes under the face-imagery condition than the house-imagery condition, the VPP and P2 responses, but not the N170 component, were elicited by phase-randomized ambiguous stimuli. Thus, the brain substrates underlying VPP are not completely identical to those underlying N170, and the VPP/P2 manifestation of the category selectivity in imagery probably reflects an integration of top-down mental imagery signals (from the prefrontal cortex) and bottom-up perception signals (from the early visual cortex) in the occipito-temporal cortex where VPP and P2 originate.

Interpreting the dimensions of neural feature representations revealed by dimensionality reduction

Recent progress in understanding the structure of neural representations in the cerebral cortex has centred around the application of multivariate classification analyses to measurements of brain activity. These analyses have proved a sensitive test of whether given brain regions provide information about specific perceptual or cognitive processes. An exciting extension of this approach is to infer the structure of this information, thereby drawing conclusions about the underlying neural representational space. These approaches rely on exploratory data-driven dimensionality reduction to extract the natural dimensions of neural spaces, including natural visual object and scene representations, semantic and conceptual knowledge, and working memory. However, the efficacy of these exploratory methods is unknown, because they have only been applied to representations in brain areas for which we have little or no secondary knowledge. One of the best-understood areas of the cerebral cortex is area MT of primate visual cortex, which is known to be important in motion analysis. To assess the effectiveness of dimensionality reduction for recovering neural representational space we applied several dimensionality reduction methods to multielectrode measurements of spiking activity obtained from area MT of marmoset monkeys, made while systematically varying the motion direction and speed of moving stimuli. Despite robust tuning at individual electrodes, and high classifier performance, dimensionality reduction rarely revealed dimensions for direction and speed. We use this example to illustrate important limitations of these analyses, and suggest a framework for how to best apply such methods to data where the structure of the neural representation is unknown.

Low dimensional representation of face space by face-selective inferior temporal neurons.

The representation of visual objects in primate brain is distributed and multiple neurons are involved in encoding each object. One way to understand the neural basis of object representation is to estimate the number of neural dimensions that are needed for veridical representation of object categories. In this study, the characteristics of the match between physical-shape and neural representational spaces in monkey inferior temporal (IT) cortex were evaluated. Specifically, we examined how the number of neural dimensions, stimulus behavioral saliency and stimulus category selectivity of neurons affected the correlation between shape and neural representational spaces in IT cortex. Single-unit recordings from monkey IT cortex revealed that there was a significant match between face space and its neural representation at lower neural dimensions, whereas the optimal match for the non-face objects was observed at higher neural dimensions. There was a statistically significant match between the face and neural spaces only in the face-selective neurons, whereas a significant match was observed for non-face objects in all neurons regardless of their category selectivity. Interestingly, the face neurons showed a higher match for the non-face objects than for the faces at higher neural dimensions. The optimal representation of face space in the responses of the face neurons was a low dimensional map that emerged early (~150ms post-stimulus onset) and was followed by a high dimensional and relatively late (~300ms) map for the non-face stimuli. These results support a multiplexing function for the face neurons in the representation of very similar shape spaces, but with different dimensionality and timing scales.

Challenging Cognitive Control by Mirrored Stimuli in Working Memory Matching.

Cognitive conflict has often been investigated by placing automatic processing originating from learned associations in competition with instructed task demands. Here we explore whether mirror generalization as a congenital mechanism can be employed to create cognitive conflict. Past research suggests that the visual system automatically generates an invariant representation of visual objects and their mirrored counterparts (i.e., mirror generalization), and especially so for lateral reversals (e.g., a cup seen from the left side vs. right side). Prior work suggests that mirror generalization can be reduced or even overcome by learning (i.e., for those visual objects for which it is not appropriate, such as letters d and b). We, therefore, minimized prior practice on resolving conflicts involving mirror generalization by using kanji stimuli as non-verbal and unfamiliar material. In a 1-back task, participants had to check a stream of kanji stimuli for identical repetitions and avoid miss-categorizing mirror reversed stimuli as exact repetitions. Consistent with previous work, lateral reversals led to profound slowing of reaction times and lower accuracy in Experiment 1. Yet, different from previous reports suggesting that lateral reversals lead to stronger conflict, similar slowing for vertical and horizontal mirror transformations was observed in Experiment 2. Taken together, the results suggest that transformations of visual stimuli can be employed to challenge cognitive control in the 1-back task.

Emergence of transformation-tolerant representations of visual objects in rat lateral extrastriate cortex.

Rodents are emerging as increasingly popular models of visual functions. Yet, evidence that rodent visual cortex is capable of advanced visual processing, such as object recognition, is limited. Here we investigate how neurons located along the progression of extrastriate areas that, in the rat brain, run laterally to primary visual cortex, encode object information. We found a progressive functional specialization of neural responses along these areas, with: (1) a sharp reduction of the amount of low-level, energy-related visual information encoded by neuronal firing; and (2) a substantial increase in the ability of both single neurons and neuronal populations to support discrimination of visual objects under identity-preserving transformations (e.g., position and size changes). These findings strongly argue for the existence of a rat object-processing pathway, and point to the rodents as promising models to dissect the neuronal circuitry underlying transformation-tolerant recognition of visual objects.

Neuropsychological evidence for the temporal dynamics of category-specific naming

ABSTRACTMultiple accounts have been proposed to explain category-specific recognition impairments. Some suggest that category-specific deficits may be caused by a deficit in recurrent processing between the levels of a hierarchically organized visual object recognition system. Here, we tested predictions of interactive processing theories on the emergence of category-selective naming deficits in neurologically intact observers and in patient GA, a single case showing a category-specific impairment for natural objects after a herpes simplex encephalitis infection. Fragmented object outlines were repeatedly presented until correct naming occurred (maximum 10 times), and the fragments increased in length with every repetition. We studied how shape complexity, object category, and fragment curvature influence the timing of correct object identification. The results of a survival analysis are consistent with the idea that deficits in recurrent processing between low- and high-level visual object representations can cause category-selective impairments.

Feature-selective Attention in Frontoparietal Cortex: Multivoxel Codes Adjust to Prioritize Task-relevant Information.

Human cognition is characterized by astounding flexibility, enabling us to select appropriate information according to the objectives of our current task. A circuit of frontal and parietal brain regions, often referred to as the frontoparietal attention network or multiple-demand (MD) regions, are believed to play a fundamental role in this flexibility. There is evidence that these regions dynamically adjust their responses to selectively process information that is currently relevant for behavior, as proposed by the "adaptive coding hypothesis" [Duncan, J. An adaptive coding model of neural function in prefrontal cortex. Nature Reviews Neuroscience, 2, 820-829, 2001]. Could this provide a neural mechanism for feature-selective attention, the process by which we preferentially process one feature of a stimulus over another? We used multivariate pattern analysis of fMRI data during a perceptually challenging categorization task to investigate whether the representation of visual object features in the MD regions flexibly adjusts according to task relevance. Participants were trained to categorize visually similar novel objects along two orthogonal stimulus dimensions (length/orientation) and performed short alternating blocks in which only one of these dimensions was relevant. We found that multivoxel patterns of activation in the MD regions encoded the task-relevant distinctions more strongly than the task-irrelevant distinctions: The MD regions discriminated between stimuli of different lengths when length was relevant and between the same objects according to orientation when orientation was relevant. The data suggest a flexible neural system that adjusts its representation of visual objects to preferentially encode stimulus features that are currently relevant for behavior, providing a neural mechanism for feature-selective attention.

Attentive Visual Reference

AbstractMany have held that when a person visually attends to an object, her visual system deploys a representation that designates the object. Call the referential link between such representations and the objects they designate attentive visual reference. In this article I offer an account of attentive visual reference. I argue that the object representations deployed in visual attention—which I call attentive visual object representations (AVORs)—refer directly, and are akin to indexicals. Then I turn to the issue of how the reference of an AVOR is determined relative to a context. After raising problems for existing accounts, I propose a mechanism of reference determination that is both causal and descriptive: For an AVOR to refer to a particular object, the object must appropriately cause the deployment of the AVOR, and the AVOR must be associated with descriptive information about some of the object's geometrical and mereological properties.

Connectivity-based constraints on category-specificity in the ventral object processing pathway

Recent efforts to characterize visual object representations in the ventral object processing pathway in the human brain have led to contrasting proposals about the causes of neural specificity for different categories. Here we use multivariate techniques in a novel way to relate patterns of functional connectivity to patterns of stimulus preferences. Stimulus preferences were measured throughout the ventral stream to tools, animals, faces and places; separately, we measured the strength of functional connectivity of each voxel in the ventral stream to category-preferring regions outside the ventral stream. Multivariate analyses were then performed over ventral stream voxels, relating ‘category-preferences’ to ‘functional connectivity preferences’. We show that the relation of those two measures doubly dissociates ‘tools’ and ‘places’, within what is ostensibly ‘place’ selective cortex (parahippocampal gyrus). Specifically, in the parahippocampal gyrus, functional connectivity to the left inferior parietal lobule is selectively related to stimulus preferences for tools (and not places), while functional connectivity to retrosplenial cortex is selectively related to place preferences (and not tools preferences). These findings indicate that functional connectivity can be used to index representational content rather than just provide an understanding of ‘which regions are talking to which regions’. We suggest that the connectivity of the brain is what drives category-specificity in the ventral stream, and that if this is correct, then understanding the connectivity of the ventral stream will be key to understanding the causes and function of category-specific neural organization.

Efficient physics based simulation of spatial audio for virtual and augmented reality

Many applications in spatial hearing are being enabled by the virtual and augmented reality revolution. Because of these there has been a tremendous improvement in the quality of head mounted displays, and the availability of tracking (3 DOF and 6 DOF) in an integrated environment with headphones suitable for binaural rendering. While these devices were initially focused on creating visual representations of the 3D world (in the case of VR) or a visual representation of artificial 3D objects overlaid on the real world (in the case of augmented reality), it was soon realized that unless the audio provided a degree of spatial realism that complemented the visual and was consistent with it, the sense of immersion crucial to maintaining the illusion was lost. In this talk, I will describe the engine for creating virtual simulations in real time that incorporates head motion, environmental reverberation, room materials, as well as generic or individual HRTFs. Trade-offs that allow the engine to work on archite...

Learning Warps Object Representations in the Ventral Temporal Cortex.

The human ventral temporal cortex (VTC) plays a critical role in object recognition. Although it is well established that visual experience shapes VTC object representations, the impact of semantic and contextual learning is unclear. In this study, we tracked changes in representations of novel visual objects that emerged after learning meaningful information about each object. Over multiple training sessions, participants learned to associate semantic features (e.g., "made of wood," "floats") and spatial contextual associations (e.g., "found in gardens") with novel objects. fMRI was used to examine VTC activity for objects before and after learning. Multivariate pattern similarity analyses revealed that, after learning, VTC activity patterns carried information about the learned contextual associations of the objects, such that objects with contextual associations exhibited higher pattern similarity after learning. Furthermore, these learning-induced increases in pattern information about contextual associations were correlated with reductions in pattern information about the object's visual features. In a second experiment, we validated that these contextual effects translated to real-life objects. Our findings demonstrate that visual object representations in VTC are shaped by the knowledge we have about objects and show that object representations can flexibly adapt as a consequence of learning with the changes related to the specific kind of newly acquired information.

The spatiotopic representation of visual objects across time

Each eye movement introduces changes in the retinal location of objects. How a stable spatiotopic representation emerges from such variable input is an important question for the study of vision. Researchers have classically probed human observers' performance in a task requiring a location judgment about an object presented at different locations across a saccade. Correct performance on this task requires realigning or remapping retinal locations to compensate for the saccade. A recent study showed that performance improved with longer presaccadic viewing time, suggesting that accurate spatiotopic representations take time to build up. The first goal of the study was to replicate that finding. Two experiments, one an exact replication and the second a modified version, failed to replicate improved performance with longer presaccadic viewing time. The second goal of this study was to examine the role of attention in constructing spatiotopic representations, as theoretical and neurophysiological accounts of remapping have proposed that only attended targets are remapped. A third experiment thus manipulated attention with a spatial cueing paradigm and compared transsaccadic location performance of attended versus unattended targets. No difference in spatiotopic performance was found between attended and unattended targets. Although only negative results are reported, they might nevertheless suggest that spatiotopic representations are relatively stable over time.

The Desirable Things of Ogoniok: The Material Face of a Soviet Illustrated Magazine from Stalin to Brezhnev

This article examines the popular Soviet illustrated magazine Ogoniok as a site that provoked, negotiated, and exposed consumer desire in post-World War II USSR. It argues that Ogoniok was an important medium that produced and reflected cultural fantasies of material possessions in Soviet society. The article identifies and describes changes in the principles of visual representation of material objects in the magazine, and interprets them as an evidence of changes in the social form of the Soviet commodity. Finally, it analyzes the visual form of Soviet commodity and aims to understand the social relations that encapsulated Soviet commodity-value.

Mental Files: an Introduction

In the first part of this editorial, we introduce to the topic of the special issue from the perspective of the three main disciplines that have appealed to the mental file construct: psychology, philosophy, and linguistics. In the second part we present the individual contributions to the issue, in connection with the various themes mentioned in the first part. 1. Mental files in psychology, philosophy, and linguistics 1.1. Object files The notion of an object file is used in psychology to characterize visual representations of objects at an intermediate level between low level processing of sensory features and high-level placement of objects in conceptual categories or kinds. The object filing system supports the individuation and tracking of particulars, while allowing information about their features to be stored, updated, and retrieved. It has to decide when visually encountered elements should be counted as different stages of the same persisting object, and so should be assigned the same file, and when not. A signature trait of the object filing system is that the features that matter to its operations are primarily spatiotemporal, rather than qualitative. Flombaum, Scholl, Santos (2009) dub the principle according to which, for object files, spatiotemporal factors take priority over featural similarity the 'principle of spatiotemporal priority'. They argue that it constitutes a 'fundamental principle of object persistence' in human vision. A simple demonstration is the well-known 'tunnel effect' (Burke 1952). If the time it takes an object to disappear then reappear from behind an occluder is roughly the same as the time it would take an object to travel behind the occluder, and if the object's way of moving is appropriate, viewers irresistibly experience a single persisting object, which is temporarily hidden behind the occluder. This is the case even when the reappearing object has very different surface qualities from the disappearing one-for example, a yellow ball can be perceived to 'morph' into a red cup. This experience as of one single persisting object is characteristically encapsulated, or resistant to influence from higher-level judgments of identity, which suggests that it is a perceptual effect. * Authors listed in alphabetical order.

Anatomical Connections of the Functionally Defined “Face Patches” in the Macaque Monkey

The neural circuits underlying face recognition provide a model for understanding visual object representation, social cognition, and hierarchical information processing. A fundamental piece of information lacking to date is the detailed anatomical connections of the face patches. Here, we injected retrograde tracers into four different face patches (PL, ML, AL, AM) to characterize their anatomical connectivity. We found that the patches are strongly andspecifically connected to each other, and individual patches receive inputs from extrastriate cortex, themedial temporal lobe, and three subcortical structures (the pulvinar, claustrum, and amygdala). Inputs from prefrontal cortex were surprisingly weak. Patches were densely interconnected to one another in both feedforward and feedback directions, inconsistent with a serial hierarchy. These results provide the first direct anatomical evidence that the face patches constitute a highly specialized system and suggest that subcortical regions may play a vital role in routing face-related information to subsequent processing stages.