Visual Hierarchy Research Articles

Explicit information for category-orthogonal object properties increases along the ventral stream.

Extensive research has revealed that the ventral visual stream hierarchically builds a robust representation for supporting visual object categorization tasks. We systematically explored the ability of multiple ventral visual areas to support a variety of 'category-orthogonal' object properties such as position, size and pose. For complex naturalistic stimuli, we found that the inferior temporal (IT) population encodes all measured category-orthogonal object properties, including those properties often considered to be low-level features (for example, position), more explicitly than earlier ventral stream areas. We also found that the IT population better predicts human performance patterns across properties. A hierarchical neural network model based on simple computational principles generates these same cross-area patterns of information. Taken together, our empirical results support the hypothesis that all behaviorally relevant object properties are extracted in concert up the ventral visual hierarchy, and our computational model explains how that hierarchy might be built.

Limits on perceptual encoding can be predicted from known receptive field properties of human visual cortex.

Human cognition has a limited capacity that is often attributed to the brain having finite cognitive resources, but the nature of these resources is usually not specified. Here, we show evidence that perceptual interference between items can be predicted by known receptive field properties of the visual cortex, suggesting that competition within representational maps is an important source of the capacity limitations of visual processing. Across the visual hierarchy, receptive fields get larger and represent more complex, high-level features. Thus, when presented simultaneously, high-level items (e.g., faces) will often land within the same receptive fields, while low-level items (e.g., color patches) will often not. Using a perceptual task, we found long-range interference between high-level items, but only short-range interference for low-level items, with both types of interference being weaker across hemifields. Finally, we show that long-range interference between items appears to occur primarily during perceptual encoding and not during working memory maintenance. These results are naturally explained by the distribution of receptive fields and establish a link between perceptual capacity limits and the underlying neural architecture.

Unconsciously elicited perceptual prior.

Increasing evidence over the past decade suggests that vision is not simply a passive, feed-forward process in which cortical areas relay progressively more abstract information to those higher up in the visual hierarchy, but rather an inferential process with top-down processes actively guiding and shaping perception. However, one major question that persists is whether such processes can be influenced by unconsciously perceived stimuli. Recent psychophysics and neuroimaging studies have revealed that while consciously perceived stimuli elicit stronger responses in higher visual and frontoparietal areas than those that fail to reach conscious awareness, the latter can still drive high-level brain and behavioral responses. We investigated whether unconscious processing of a masked natural image could facilitate subsequent conscious recognition of its degraded counterpart (a black-and-white "Mooney" image) presented many seconds later. We found that this is indeed the case, suggesting that conscious vision may be influenced by priors established by unconscious processing of a fleeting image.

Confidence-based integrated reweighting model of task-difficulty explains location-based specificity in perceptual learning.

Perceptual learning is classically thought to be highly specific to the trained stimuli's retinal locations. However, recent research using a novel double-training paradigm has found dramatic transfer of perceptual learning to untrained locations. These results challenged existing models of perceptual learning and provoked intense debate in the field. Recently, Hung and Seitz (2014) showed that previously reported results could be reconciled by considering the details of the training procedure, in particular, whether it involves prolonged training at threshold using a single staircase procedure or multiple staircases. Here, we examine a hierarchical neural network model of the visual pathway, built upon previously proposed integrated reweighting models of perceptual learning, to understand how retinotopic transfer depends on the training procedure adopted. We propose that the transfer and specificity of learning between retinal locations can be explained by considering the task-difficulty and confidence during training. In our model, difficult tasks lead to higher learning of weights from early visual cortex to the decision unit, and thus to specificity, while easy tasks lead to higher learning of weights from later stages of the visual hierarchy and thus to more transfer. To model interindividual difference in task-difficulty, we relate task-difficulty to the confidence of subjects. We show that our confidence-based reweighting model can account for the results of Hung and Seitz (2014) and makes testable predictions.

Visual motion transforms visual space representations similarly throughout the human visual hierarchy

Several studies demonstrate that visual stimulus motion affects neural receptive fields and fMRI response amplitudes. Here we unite results of these two approaches and extend them by examining the effects of visual motion on neural position preferences throughout the hierarchy of human visual field maps. We measured population receptive field (pRF) properties using high-field fMRI (7T), characterizing position preferences simultaneously over large regions of the visual cortex. We measured pRFs properties using sine wave gratings in stationary apertures, moving at various speeds in either the direction of pRF measurement or the orthogonal direction. We find direction- and speed-dependent changes in pRF preferred position and size in all visual field maps examined, including V1, V3A, and the MT+ map TO1. These effects on pRF properties increase up the hierarchy of visual field maps. However, both within and between visual field maps the extent of pRF changes was approximately proportional to pRF size. This suggests that visual motion transforms the representation of visual space similarly throughout the visual hierarchy. Visual motion can also produce an illusory displacement of perceived stimulus position. We demonstrate perceptual displacements using the same stimulus configuration. In contrast to effects on pRF properties, perceptual displacements show only weak effects of motion speed, with far larger speed-independent effects. We describe a model where low-level mechanisms could underlie the observed effects on neural position preferences. We conclude that visual motion induces similar transformations of visuo-spatial representations throughout the visual hierarchy, which may arise through low-level mechanisms.

Deep Neural Networks: A New Framework for Modeling Biological Vision and Brain Information Processing.

Recent advances in neural network modeling have enabled major strides in computer vision and other artificial intelligence applications. Human-level visual recognition abilities are coming within reach of artificial systems. Artificial neural networks are inspired by the brain, and their computations could be implemented in biological neurons. Convolutional feedforward networks, which now dominate computer vision, take further inspiration from the architecture of the primate visual hierarchy. However, the current models are designed with engineering goals, not to model brain computations. Nevertheless, initial studies comparing internal representations between these models and primate brains find surprisingly similar representational spaces. With human-level performance no longer out of reach, we are entering an exciting new era, in which we will be able to build biologically faithful feedforward and recurrent computational models of how biological brains perform high-level feats of intelligence, including vision.

The selectivity of responses to red-green colour and achromatic contrast in the human visual cortex: an fMRI adaptation study.

There is controversy as to how responses to colour in the human brain are organized within the visual pathways. A key issue is whether there are modular pathways that respond selectively to colour or whether there are common neural substrates for both colour and achromatic (Ach) contrast. We used functional magnetic resonance imaging (fMRI) adaptation to investigate the responses of early and extrastriate visual areas to colour and Ach contrast. High‐contrast red–green (RG) and Ach sinewave rings (0.5 cycles/degree, 2 Hz) were used as both adapting stimuli and test stimuli in a block design. We found robust adaptation to RG or Ach contrast in all visual areas. Cross‐adaptation between RG and Ach contrast occurred in all areas indicating the presence of integrated, colour and Ach responses. Notably, we revealed contrasting trends for the two test stimuli. For the RG test, unselective processing (robust adaptation to both RG and Ach contrast) was most evident in the early visual areas (V1 and V2), but selective responses, revealed as greater adaptation between the same stimuli than cross‐adaptation between different stimuli, emerged in the ventral cortex, in V4 and VO in particular. For the Ach test, unselective responses were again most evident in early visual areas but Ach selectivity emerged in the dorsal cortex (V3a and hMT+). Our findings support a strong presence of integrated mechanisms for colour and Ach contrast across the visual hierarchy, with a progression towards selective processing in extrastriate visual areas.

Data Presentation Structures in Specialised Dictionaries: Law Dictionaries with Communicative Functions / Datenpräsentationsstrukturen in Fachwörterbüchern: Rechtswörterbücher mit einer kommunikativen Funktion / La structure de la présentation des données dans les dictionnaires spécialisés

Abstract Theoretical lexicographers have developed a range of elaborate structures to describe the arrangement of data inside dictionaries, in particular in dictionary articles. However, most of these structures have been developed on the basis of detailed analyses of print dictionaries and relatively little has been said about the arrangement of data in e-dictionaries. The relevant data types are lexicographical data providing help concerning the function(s) and use of dictionaries on search results pages. In order to create a visual hierarchy on screen that makes the most important search result data stand out, lexicographers should prioritize functional data that are directly related to and support the function(s) of dictionaries on a need-to-have/niceto- have basis, because data presentation structures with functional focus may better help users achieve their intended goals, i.e. finding answers to problems in communicative situations. One result is that lexicographers can analyse and describe the visual hierarchy in terms of data presentation fields and search zones, even though some search results may be described as non-articles.

Visual Awareness Is Limited by the Representational Architecture of the Visual System.

Visual perception and awareness have strict limitations. We suggest that one source of these limitations is the representational architecture of the visual system. Under this view, the extent to which items activate the same neural channels constrains the amount of information that can be processed by the visual system and ultimately reach awareness. Here, we measured how well stimuli from different categories (e.g., faces and cars) blocked one another from reaching awareness using two distinct paradigms that render stimuli invisible: visual masking and continuous flash suppression. Next, we used fMRI to measure the similarity of the neural responses elicited by these categories across the entire visual hierarchy. Overall, we found strong brain-behavior correlations within the ventral pathway, weaker correlations in the dorsal pathway, and no correlations in early visual cortex (V1-V3). These results suggest that the organization of higher level visual cortex constrains visual awareness and the overall processing capacity of visual cognition.

Decoding the direction of imagined visual motion using 7 T ultra-high field fMRI

There is a long-standing debate about the neurocognitive implementation of mental imagery. One form of mental imagery is the imagery of visual motion, which is of interest due to its naturalistic and dynamic character. However, so far only the mere occurrence rather than the specific content of motion imagery was shown to be detectable. In the current study, the application of multi-voxel pattern analysis to high-resolution functional data of 12 subjects acquired with ultra-high field 7T functional magnetic resonance imaging allowed us to show that imagery of visual motion can indeed activate the earliest levels of the visual hierarchy, but the extent thereof varies highly between subjects. Our approach enabled classification not only of complex imagery, but also of its actual contents, in that the direction of imagined motion out of four options was successfully identified in two thirds of the subjects and with accuracies of up to 91.3% in individual subjects. A searchlight analysis confirmed the local origin of decodable information in striate and extra-striate cortex. These high-accuracy findings not only shed new light on a central question in vision science on the constituents of mental imagery, but also show for the first time that the specific sub-categorical content of visual motion imagery is reliably decodable from brain imaging data on a single-subject level.

Modernism, gender and consumer spectacle in 1920s’ Tokyo

A lot has been written about how, in the first decades of the twentieth century, cinema validated new perceptual structures and how these affected literary narrative. But the department store was also a vital part of the mobile spectacle of modernity. Ginza and its department stores provided experiences of urban flâneuring and visual consumption that would have important effects on gender and subjectivity. This essay focuses on three short stories published between 1922 and 1931, all set in department stores or on the Ginza: Tanizaki Jun'ichirō’s ‘Aoi hana’ (The Blue Flower, 1922), Itō Sei's ‘M hyakkaten’ (The M Department Store, 1931) and Yokomitsu Riichi's ‘Nanakai no undō’ (Seven Floors of Exercise, 1927). The stories share a radically experimental modernist form: fragmented interior monologues, montage-like juxtapositions, abrupt shifts of narrative perspective. They are also connected in their preoccupation with looking, with the drama of seeing and being seen. My analysis traces how the domain of vision becomes a place of struggle over subjectivity, how gendered visual hierarchies are undermined and at least temporarily reversed.

The neural representation of Arabic digits in visual cortex.

In this study, we investigated how Arabic digits are represented in the visual cortex, and how their representation changes throughout the ventral visual processing stream, compared to the representation of letters. We probed these questions with two functional magnetic resonance imaging (fMRI) experiments. In Experiment 1, we explored whether we could find brain regions that were more activated for digits than for number words in a subtraction task. One such region was detected in lateral occipital cortex. However, the activity in this region might have been confounded by string length—number words contain more characters than digits. We therefore conducted a second experiment in which string length was systematically controlled. Experiment 2 revealed that the findings of the first experiment were task dependent (as it was only observed in a task in which numerosity was relevant) or stimulus dependent (as it was only observed when the number of characters of a stimulus was not controlled). We further explored the characteristics of the activation patterns for digit and letter strings across the ventral visual processing stream through multi-voxel pattern analyses. We found an alteration in representations throughout the ventral processing stream from clustering based on amount of visual information in primary visual cortex (V1) towards clustering based on symbolic stimulus category higher in the visual hierarchy. The present findings converge to the conclusion that in the ventral visual system, as far as can be detected with fMRI, the distinction between Arabic digits and letter strings is represented in terms of distributed patterns rather than separate regions.

Behavioral evidence for a functional link between low- and mid-level visual perception in the autism spectrum

BackgroundMost investigations of visuo-perceptual abilities in the Autism Spectrum (AS) are level-specific, using tasks that selectively solicit either lower- (i.e., spatial frequency sensitivity), mid- (i.e., pattern discrimination) or higher-level processes (i.e., face identification) along the visual hierarchy. Less is known about how alterations at one level of processing (i.e., low-level) interact with that of another (i.e., mid-level). The aim of this study was to assess whether manipulating the physical properties (luminance vs texture) of local contour elements of a mid-level, visual pattern interferes with the discrimination of that pattern in a differential manner for individuals with AS. MethodsTwenty-nine AS individuals and thirty control participants (range 14–27 years) were asked to discriminate between perfect circles and Radial Frequency Patterns (RFP) of two, three, five, and 10 radial frequencies (RF), or deformations along the pattern’s contour. When RFP have few deformations (<five RF), a global, pattern analysis is needed for shape discrimination. Conversely, when RFP contain many deformations (≥10 RF), discrimination is dependent on the analysis of local deformations along the RFP contour. The effect of manipulating RF on RFP discrimination was assessed for RFP whose local contour elements were defined by either luminance or texture information, the latter previously found less efficiently processed in AS individuals. ResultsTwo separate mixed factorial ANOVAs [2 (Group)×4 (RF)] were conducted on mean deformation thresholds for luminance- and texture-defined conditions. A significant Group×RF interaction was found for the luminance-defined condition where thresholds were higher in the AS group for the two and three RF conditions; no between-group differences were found for the five and 10 RF conditions. A significant main effect of group was identified for the texture-defined condition, where mean thresholds were higher for the AS group across all RF conditions assessed (two, three, five and 10); a Group×RF interaction effect was not found. Performance for each RFP condition was not affected across group by either chronological age or intelligence, as measured by either Weschler scales or Raven Progressive Matrices. ConclusionsThe ability of AS individuals to discriminate a circular pattern is differentially affected by the availability (number of deformations along the RFP contour) and type (luminance vs texture) of local, low-level elements defining its contour. Performance is unaffected in AS when RFP discrimination is dependent on the analysis of local deformations of luminance-defined contour elements, but decreased across all RF conditions when local contour elements are texture-defined. These results suggest that efficient pattern perception in AS is functionally related to the efficacy with which its local elements are processed, indicative of an early origin for altered mid-level, pattern perception in AS.

Temporal Processing Capacity in High-Level Visual Cortex Is Domain Specific.

Prevailing hierarchical models propose that temporal processing capacity--the amount of information that a brain region processes in a unit time--decreases at higher stages in the ventral stream regardless of domain. However, it is unknown if temporal processing capacities are domain general or domain specific in human high-level visual cortex. Using a novel fMRI paradigm, we measured temporal capacities of functional regions in high-level visual cortex. Contrary to hierarchical models, our data reveal domain-specific processing capacities as follows: (1) regions processing information from different domains have differential temporal capacities within each stage of the visual hierarchy and (2) domain-specific regions display the same temporal capacity regardless of their position in the processing hierarchy. In general, character-selective regions have the lowest capacity, face- and place-selective regions have an intermediate capacity, and body-selective regions have the highest capacity. Notably, domain-specific temporal processing capacities are not apparent in V1 and have perceptual implications. Behavioral testing revealed that the encoding capacity of body images is higher than that of characters, faces, and places, and there is a correspondence between peak encoding rates and cortical capacities for characters and bodies. The present evidence supports a model in which the natural statistics of temporal information in the visual world may affect domain-specific temporal processing and encoding capacities. These findings suggest that the functional organization of high-level visual cortex may be constrained by temporal characteristics of stimuli in the natural world, and this temporal capacity is a characteristic of domain-specific networks in high-level visual cortex. Significance statement: Visual stimuli bombard us at different rates every day. For example, words and scenes are typically stationary and vary at slow rates. In contrast, bodies are dynamic and typically change at faster rates. Using a novel fMRI paradigm, we measured temporal processing capacities of functional regions in human high-level visual cortex. Contrary to prevailing theories, we find that different regions have different processing capacities, which have behavioral implications. In general, character-selective regions have the lowest capacity, face- and place-selective regions have an intermediate capacity, and body-selective regions have the highest capacity. These results suggest that temporal processing capacity is a characteristic of domain-specific networks in high-level visual cortex and contributes to the segregation of cortical regions.

Dissociations and associations between shape and category representations in the two visual pathways.

The dorsal and ventral visual pathways represent both visual and conceptual object properties. Yet the relative contribution of these two factors in the representational content of visual areas is unclear. Indeed, research investigating brain category representations rarely dissociate visual and semantic properties of objects. We present a human event-related fMRI study with a two-factorial stimulus set with 54 images that explicitly dissociates shape from category to investigate their independent contribution as well as their interactions through representational similarity analyses. Results reveal a contribution from each dimension in both streams, with a transition from shape to category along the posterior-to-anterior anatomical axis. The nature of category representations differs in the two pathways: ventral areas represent object animacy and dorsal areas represent object action properties. Furthermore, information about shape evolved from low-level pixel-based to high-level perceived shape following a posterior-to-anterior gradient similar to the shape-to-category emergence. To conclude, results show that representations of shape and category independently coexist, but at the same time they are closely related throughout the visual hierarchy. SIGNIFICANCE STATEMENT Research investigating visual cortex conceptual category representations rarely takes into account visual properties of objects. In this report, we explicitly dissociate shape from category and investigate independent contributions and interactions of these two highly correlated dimensions.

Creating shortcuts in the visual hierarchy: improving saccadic reaction time and accuracy with RSVP training

Creating shortcuts in the visual hierarchy: improving saccadic reaction time and accuracy with RSVP training

Functional Connectivity Patterns of Visual Cortex Reflect its Anatomical Organization.

The brain is continuously active, even without external input or task demands. This so-called resting-state activity exhibits a highly specific spatio-temporal organization. However, how exactly these activity patterns map onto the anatomical and functional architecture of the brain is still unclear. We addressed this question in the human visual cortex. We determined the representation of the visual field in visual cortical areas of 44 subjects using fMRI and examined resting-state correlations between these areas along the visual hierarchy, their dorsal and ventral segments, and between subregions representing foveal versus peripheral parts of the visual field. We found that retinotopically corresponding regions, particularly those representing peripheral visual fields, exhibit strong correlations. V1 displayed strong internal correlations between its dorsal and ventral segments and the highest correlation with LGN compared with other visual areas. In contrast, V2 and V3 showed weaker correlations with LGN and stronger between-area correlations, as well as with V4 and hMT+. Interhemispheric correlations between homologous areas were especially strong. These correlation patterns were robust over time and only marginally altered under task conditions. These results indicate that resting-state fMRI activity closely reflects the anatomical organization of the visual cortex both with respect to retinotopy and hierarchy.

The representation and perception of 3D space: Interactions between 2D location and depth

ABSTRACTWe live in a 3D world, and yet the majority of vision research is restricted to 2D phenomena, with depth research typically treated as a separate field. Here we ask whether 2D spatial information and depth information interact to form neural representations of 3D space, and if so, what are the perceptual implications? Using fMRI and behavioural methods, we reveal that human visual cortex gradually transitions from 2D to 3D spatial representations, with depth information emerging later along the visual hierarchy, and demonstrate that 2D location holds a fundamentally special place in early visual processing.

Functional MRI of visual responses in the awake, behaving marmoset

The visual brain is composed of interconnected subcortical and cortical structures that receive and process image information originating in the retina. The visual system of nonhuman primates, in particular macaques, has been studied in great detail in order to elucidate principles of human sensation and perception. The common marmoset (Callithrix jacchus) is a small New World monkey of growing interest as a primate model for neuroscience. Marmosets have advantages over macaques because of their small size, lissencephalic cortex, and growing potential for viral and genetic manipulations. Previous anatomical studies and electrophysiological recordings in anesthetized marmosets have shown that this species’ cortical visual hierarchy closely resembles that of other primates, including humans. Until now, however, there have been no attempts to systematically study visual responses throughout the marmoset brain using fMRI. Here we show that awake marmosets readily learn to carry out a simple visual task inside the bore of an MRI scanner during functional mapping experiments. Functional scanning at 500μm in-plane resolution in a 30cm horizontal bore at 7T revealed robust positive blood oxygenation level-dependent (BOLD) fMRI responses to visual stimuli throughout visual cortex and associated subcortical areas. Nonvisual sensory areas showed negative contrasts to visual stimuli compared to the fixation dot only baseline. Structured images of objects and faces led to stronger responses than scrambled control images at stages beyond early visual cortex. Our study establishes fMRI mapping of visual responses in awake, behaving marmosets as a straightforward and valuable tool for assessing the functional organization of the primate brain at high resolution.

Basic level category structure emerges gradually across human ventral visual cortex.

Objects can be simultaneously categorized at multiple levels of specificity ranging from very broad ("natural object") to very distinct ("Mr. Woof"), with a mid-level of generality (basic level: "dog") often providing the most cognitively useful distinction between categories. It is unknown, however, how this hierarchical representation is achieved in the brain. Using multivoxel pattern analyses, we examined how well each taxonomic level (superordinate, basic, and subordinate) of real-world object categories is represented across occipitotemporal cortex. We found that, although in early visual cortex objects are best represented at the subordinate level (an effect mostly driven by low-level feature overlap between objects in the same category), this advantage diminishes compared to the basic level as we move up the visual hierarchy, disappearing in object-selective regions of occipitotemporal cortex. This pattern stems from a combined increase in within-category similarity (category cohesion) and between-category dissimilarity (category distinctiveness) of neural activity patterns at the basic level, relative to both subordinate and superordinate levels, suggesting that successive visual areas may be optimizing basic level representations.