Higher-order Visual Areas Research Articles

Spatial orienting in complex audiovisual environments

Previous studies on crossmodal spatial orienting typically used simple and stereotyped stimuli in the absence of any meaningful context. This study combined computational models, behavioural measures and functional magnetic resonance imaging to investigate audiovisual spatial interactions in naturalistic settings. We created short videos portraying everyday life situations that included a lateralised visual event and a co-occurring sound, either on the same or on the opposite side of space. Subjects viewed the videos with or without eye-movements allowed (overt or covert orienting). For each video, visual and auditory saliency maps were used to index the strength of stimulus-driven signals, and eye-movements were used as a measure of the efficacy of the audiovisual events for spatial orienting. Results showed that visual salience modulated activity in higher-order visual areas, whereas auditory salience modulated activity in the superior temporal cortex. Auditory salience modulated activity also in the posterior parietal cortex, but only when audiovisual stimuli occurred on the same side of space (multisensory spatial congruence). Orienting efficacy affected activity in the visual cortex, within the same regions modulated by visual salience. These patterns of activation were comparable in overt and covert orienting conditions. Our results demonstrate that, during viewing of complex multisensory stimuli, activity in sensory areas reflects both stimulus-driven signals and their efficacy for spatial orienting; and that the posterior parietal cortex combines spatial information about the visual and the auditory modality.

Cortico-cortical evoked potentials and stimulation-elicited gamma activity preferentially propagate from lower- to higher-order visual areas

ObjectiveThe lower-order visual cortex in the medial–occipital region is suggested to send feed-forward signals to the higher-order visual cortex including ventral–occipital–temporal and dorsal–occipital regions. We determined how stimulation-elicited cortical-signals propagate between lower- and higher-order visual cortices, and whether the magnitudes of stimulation-elicited cortical-signals recorded in the higher-order visual cortex differed from those recorded in the lower-order one. MethodsWe studied 10 patients with focal epilepsy who underwent extraoperative electrocorticography recording. Trains of 1-Hz stimuli with an intensity of 3mA were delivered to an electrode pair within the medial–occipital region; then, cortico-cortical evoked-potential (CCEP) and stimulation-elicited gamma-activity at 80–150Hz were measured in the ventral–occipital–temporal and dorsal–occipital regions. Likewise, CCEP and stimulation-elicited gamma-activity, driven by stimuli within the higher-order visual cortex, were measured in the lower-order visual cortex. ResultsCCEPs generated, via feed-forward propagations, in the higher-order visual cortex were significantly larger than those generated, via feed-back propagations, in the lower-order visual cortex. Stimulation of the lower-order visual cortex elicited augmentation of gamma-activity in the higher-order visual cortex after the preceding CCEP subsided. ConclusionThe propagation manners of stimulation-elicited cortical-signals differ between feed-forward and feed-back directions in the human occipital lobe. Significance:Such difference may need to be taken into consideration for future clinical application of CCEPs and stimulation-elicited gamma-augmentation in presurgical evaluation for epilepsy surgery.

Spatial and Object-Based Attention Modulates Broadband High-Frequency Responses across the Human Visual Cortical Hierarchy

One of the puzzling aspects in the visual attention literature is the discrepancy between electrophysiological and fMRI findings: whereas fMRI studies reveal strong attentional modulation in the earliest visual areas, single-unit and local field potential studies yielded mixed results. In addition, it is not clear to what extent spatial attention effects extend from early to high-order visual areas. Here we addressed these issues using electrocorticography recordings in epileptic patients. The patients performed a task that allowed simultaneous manipulation of both spatial and object-based attention. They were presented with composite stimuli, consisting of a small object (face or house) superimposed on a large one, and in separate blocks, were instructed to attend one of the objects. We found a consistent increase in broadband high-frequency (30-90 Hz) power, but not in visual evoked potentials, associated with spatial attention starting with V1/V2 and continuing throughout the visual hierarchy. The magnitude of the attentional modulation was correlated with the spatial selectivity of each electrode and its distance from the occipital pole. Interestingly, the latency of the attentional modulation showed a significant decrease along the visual hierarchy. In addition, electrodes placed over high-order visual areas (e.g., fusiform gyrus) showed both effects of spatial and object-based attention. Overall, our results help to reconcile previous observations of discrepancy between fMRI and electrophysiology. They also imply that spatial attention effects can be found both in early and high-order visual cortical areas, in parallel with their stimulus tuning properties.

A comparison of neural mechanisms in mirror therapy and movement observation therapy

To compare lateralized cerebral activations elicited during self-initiated movement mirroring and observation of movements. A total of 15 right-handed healthy subjects, age range 22-56 years. Functional imaging study comparing movement mirroring with movement observation, in both hands, in an otherwise identical setting. Imaging data were analysed using statistical parametric mapping software, with significance threshold set at p < 0.01 (false discovery rate) and a minimum cluster size of 20 voxels. Movement mirroring induced additional activation in primary and higher-order visual areas strictly contralateral to the limb seen by the subject. There was no significant difference of brain activity when comparing movement observation of somebody else's right hand with left hand. Lateralized cerebral activations are elicited by inversion of visual feedback (movement mirroring), but not by movement observation.

Untangling Perceptual Memory: Hysteresis and Adaptation Map into Separate Cortical Networks

Perception is an active inferential process in which prior knowledge is combined with sensory input, the result of which determines the contents of awareness. Accordingly, previous experience is known to help the brain “decide” what to perceive. However, a critical aspect that has not been addressed is that previous experience can exert 2 opposing effects on perception: An attractive effect, sensitizing the brain to perceive the same again (hysteresis), or a repulsive effect, making it more likely to perceive something else (adaptation). We used functional magnetic resonance imaging and modeling to elucidate how the brain entertains these 2 opposing processes, and what determines the direction of such experience-dependent perceptual effects. We found that although affecting our perception concurrently, hysteresis and adaptation map into distinct cortical networks: a widespread network of higher-order visual and fronto-parietal areas was involved in perceptual stabilization, while adaptation was confined to early visual areas. This areal and hierarchical segregation may explain how the brain maintains the balance between exploiting redundancies and staying sensitive to new information. We provide a Bayesian model that accounts for the coexistence of hysteresis and adaptation by separating their causes into 2 distinct terms: Hysteresis alters the prior, whereas adaptation changes the sensory evidence (the likelihood function).

Disambiguating the roles of area V1 and the lateral occipital complex (LOC) in contour integration

Contour integration, the linking of collinear but disconnected visual elements across space, is an essential facet of object and scene perception. Here, we set out to arbitrate between two previously advanced mechanisms of contour integration: serial facilitative interactions between collinear cells in the primary visual cortex (V1) versus pooling of inputs in higher-order visual areas. To this end, we used high-density electrophysiological recordings to assess the spatio-temporal dynamics of brain activity in response to Gabor contours embedded in Gabor noise (so-called "pathfinder displays") versus control stimuli. Special care was taken to elicit and detect early activity stemming from the primary visual cortex, as indexed by the C1 component of the visual evoked potential. Arguing against a purely early V1 account, there was no evidence for contour-related modulations within the C1 timeframe (50-100 ms). Rather, the earliest effects were observed within the timeframe of the N1 component (160-200 ms) and inverse source analysis pointed to principle generators in the lateral occipital complex (LOC) within the ventral visual stream. Source anlaysis also suggested that it was only during this relatively late processing period that contextual effects emerged in hierarchically early visual regions (i.e. V1/V2), consistent with a more distributed process involving recurrent feedback/feedforward interactions between LOC and early visual sensory regions. The distribution of effects uncovered here is consistent with pooling of information in higher order cortical areas as the initial step in contour integration, and that this pooling occurs relatively late in processing rather than during the initial sensory-processing period.

Functional Biases in Visual Cortex Neurons with Identified Projections to Higher Cortical Targets

Visual perception involves information flow from lower- to higher-order cortical areas, which are known to process different kinds of information. How does this functional specialization arise? As a step toward addressing this question, we combined fluorescent retrograde tracing with in vivo two-photon calcium imaging to simultaneously compare the tuning properties of neighboring neurons in areas 17 and 18 of ferret visual cortex that have different higher cortical projection targets. Neurons projecting to the posterior suprasylvian sulcus (PSS) were more direction selective and preferred shorter stimuli, higher spatial frequencies, and higher temporal frequencies than neurons projecting to area 21, anticipating key differences between the functional properties of the target areas themselves. These differences could not be explained by a correspondence between anatomical and functional clustering within early visual cortex, and the largest differences were in properties generated within early visual cortex (direction selectivity and length preference) rather than in properties present in its retinogeniculate inputs. These projection cell groups, and hence the higher-order visual areas to which they project, likely obtain their functional properties not from biased retinogeniculate inputs but from highly specific circuitry within the cortex.

Letters persistence after physical offset: Visual word form area and left planum temporale. An fMRI study

Iconic memory is a high-capacity low-duration visual memory store that allows the persistence of a visual stimulus after its offset. The categorical nature of this store has been extensively debated. This study provides functional magnetic resonance imaging evidence for brain regions underlying the persistence of postcategorical representations of visual stimuli. In a partial report paradigm, subjects matched a cued row of a 3 × 3 array of letters (postcategorical stimuli) or false fonts (precategorical stimuli) with a subsequent triplet of stimuli. The cued row was indicated by two visual flankers presented at the onset (physical stimulus readout) or after the offset of the array (iconic memory readout). The left planum temporale showed a greater modulation of the source of readout (iconic memory vs. physical stimulus) when letters were presented compared to false fonts. This is a multimodal brain region responsible for matching incoming acoustic and visual patterns with acoustic pattern templates. These findings suggest that letters persist after their physical offset in an abstract postcategorical representation. A targeted region of interest analysis revealed a similar pattern of activation in the Visual Word Form Area. These results suggest that multiple higher-order visual areas mediate iconic memory for postcategorical stimuli.

Arousal Modulates Activity in the Medial Temporal Lobe during a Short-Term Relational Memory Task

This study investigated the effect of arousal on short-term relational memory and its underlying cortical network. Seventeen healthy participants performed a picture by location, short-term relational memory task using emotional pictures. Functional magnetic resonance imaging was used to measure the blood-oxygenation-level dependent signal relative to task. Subjects’ own ratings of the pictures were used to obtain subjective arousal ratings. Subjective arousal was found to have a dose-dependent effect on activations in the prefrontal cortex, amygdala, hippocampus, and in higher order visual areas. Serial position analyses showed that high arousal trials produced a stronger primacy and recency effect than low arousal trials. The results indicate that short-term relational memory may be facilitated by arousal and that this may be modulated by a dose–response function in arousal-driven neuronal regions.

The influence of spontaneous activity on stimulus processing in primary visual cortex

Spontaneous activity in the resting human brain has been studied extensively; however, how such activity affects the local processing of a sensory stimulus is relatively unknown. Here, we examined the impact of spontaneous activity in primary visual cortex on neuronal and behavioural responses to a simple visual stimulus, using functional MRI. Stimulus-evoked responses remained essentially unchanged by spontaneous fluctuations, combining with them in a largely linear fashion (i.e., with little evidence for an interaction). However, interactions between spontaneous fluctuations and stimulus-evoked responses were evident behaviourally; high levels of spontaneous activity tended to be associated with increased stimulus detection at perceptual threshold. Our results extend those found in studies of spontaneous fluctuations in motor cortex and higher order visual areas, and suggest a fundamental role for spontaneous activity in stimulus processing.

Differential BOLD Activity Associated with Subjective and Objective Reports during “Blindsight” in Normal Observers

The study of conscious visual perception invariably necessitates some means of report. Report can be either subjective, i.e., an introspective evaluation of conscious experience, or objective, i.e., a forced-choice discrimination regarding different stimulus states. However, the link between report type and fMRI-BOLD signals has remained unknown. Here we used continuous flash suppression to render target images invisible, and observed a long-lasting dissociation between subjective report of visibility and human subjects' forced-choice localization of targets ("blindsight"). Our results show a robust dissociation between brain regions and type of report. We find subjective visibility effects in high-order visual areas even under equal objective performance. No significant BOLD difference was found between correct and incorrect trials in these areas when subjective report was constant. On the other hand, objective performance was linked to the accuracy of multivariate pattern classification mainly in early visual areas. Together, our data support the notion that subjective and objective reports tap cortical signals of different location and amplitude within the visual cortex.

Combining Visual Rehabilitative Training and Noninvasive Brain Stimulation to Enhance Visual Function in Patients With Hemianopia: A Comparative Case Study

To standardize a protocol for promoting visual rehabilitative outcomes in post-stroke hemianopia by combining occipital cortical transcranial direct current stimulation (tDCS) with Vision Restoration Therapy (VRT). A comparative case study assessing feasibility and safety. A controlled laboratory setting. Two patients, both with right hemianopia after occipital stroke damage. METHODS AND OUTCOME MEASUREMENTS: Both patients underwent an identical VRT protocol that lasted 3 months (30 minutes, twice a day, 3 days per week). In patient 1, anodal tDCS was delivered to the occipital cortex during VRT training, whereas in patient 2 sham tDCS with VRT was performed. The primary outcome, visual field border, was defined objectively by using high-resolution perimetry. Secondary outcomes included subjective characterization of visual deficit and functional surveys that assessed performance on activities of daily living. For patient 1, the neural correlates of visual recovery were also investigated, by using functional magnetic resonance imaging. Delivery of combined tDCS with VRT was feasible and safe. High-resolution perimetry revealed a greater shift in visual field border for patient 1 versus patient 2. Patient 1 also showed greater recovery of function in activities of daily living. Contrary to the expectation, patient 2 perceived greater subjective improvement in visual field despite objective high-resolution perimetry results that indicated otherwise. In patient 1, visual function recovery was associated with functional magnetic resonance imaging activity in surviving peri-lesional and bilateral higher-order visual areas. Results of preliminary case comparisons suggest that occipital cortical tDCS may enhance recovery of visual function associated with concurrent VRT through visual cortical reorganization. Future studies may benefit from incorporating protocol refinements such as those described here, which include global capture of function, control for potential confounds, and investigation of underlying neural substrates of recovery.

Transformation from image-based to perceptual representation of materials along the human ventral visual pathway

Every object in the world has its own surface quality that is a reflection of the material from which the object is made. We can easily identify and categorize materials (wood, metal, fabric etc.) at a glance, and this ability enables us to decide how to interact appropriately with these objects. Little is known, however, about how materials are represented in the brain, or how that representation is related to material perception or the physical properties of material surface. By combining multivoxel pattern analysis of functional magnetic resonance imaging data with perceptual and image-based physical measures of material properties, we found that the way visual information about materials is coded gradually changes from an image-based representation in early visual areas to a perceptual representation in the ventral higher-order visual areas. We suggest that meaningful information about multimodal aspects of real-world materials reside in the ventral cortex around the fusiform gyrus, where it can be utilized for categorization of materials.

Dissociation of Sensitivity to Spatial Frequency in Word and Face Preferential Areas of the Fusiform Gyrus

Different cortical regions within the ventral occipitotemporal junction have been reported to show preferential responses to particular objects. Thus, it is argued that there is evidence for a left-lateralized visual word form area and a right-lateralized fusiform face area, but the unique specialization of these areas remains controversial. Words are characterized by greater power in the high spatial frequency (SF) range, whereas faces comprise a broader range of high and low frequencies. We investigated how these high-order visual association areas respond to simple sine-wave gratings that varied in SF. Using functional magnetic resonance imaging, we demonstrated lateralization of activity that was concordant with the low-level visual property of words and faces; left occipitotemporal cortex is more strongly activated by high than by low SF gratings, whereas the right occipitotemporal cortex responded more to low than high spatial frequencies. Therefore, the SF of a visual stimulus may bias the lateralization of processing irrespective of its higher order properties.

View-Based Encoding of Actions in Mirror Neurons of Area F5 in Macaque Premotor Cortex

Converging experimental evidence indicates that mirror neurons in the monkey premotor area F5 encode the goals of observed motor acts [1-3]. However, it is unknown whether they also contribute to encoding the perspective from which the motor acts of others are seen. In order to address this issue, we recorded the visual responses of mirror neurons of monkey area F5 by using a novel experimental paradigm based on the presentation of movies showing grasping motor acts from different visual perspectives. We found that the majority of the tested mirror neurons(74%) exhibited view-dependent activity with responses tuned to specific points of view. A minority of the tested mirror neurons (26%) exhibited view-independent responses. We conclude that view-independent mirror neurons encode action goals irrespective of the details of the observed motor acts, whereas the view-dependent ones might either form an intermediate step in the formation of view independence or contribute to a modulation of view-dependent representations in higher-level visual areas, potentially linking the goals of observed motor acts with their pictorial aspects.

The neural facebook": exemplar selectivity in human face-selective areas revealed through intracranial EEG recordings

Event Abstract Back to Event The neural facebook": exemplar selectivity in human face-selective areas revealed through intracranial EEG recordings Ido Davidesco1*, Stephan Bickel2, Elana Zion-Golumbic3, Michal Harel4, Charles E. Schroeder3, Ashesh D. Mehta2 and Rafael Malach4 1 Hebrew University of Jerusalem, Israel 2 Long Island Jewish Medical Center, New Hyde Park, United States 3 Columbia University College of Physicians and Surgeons & Nathan Kline Institute, United States 4 Weizmann Institute of Science, Israel Humans have a remarkable ability to distinguish between different faces, familiar and unfamiliar alike. However, fMRI studies of high-order visual cortex generally show only category selectivity (e.g. preference for faces), not selectivity for individual exemplars from the same category. Exemplar selectivity has been inferred so far only indirectly from adaptation effects. Here, we examined this issue directly, using intracranial EEG recordings (iEEG) in epilepsy patients monitored for presurgical evaluation. The patients were presented with images of faces, houses, objects and patterns. Each individual image was repeated 6 times throughout the experiment. Our results show that in addition to category selectivity, high-order visual regions, especially face-related areas (e.g. Fusiform face area, FFA), exhibit exemplar selectivity. Comparing the Gamma band responses to optimal and non-optimal stimuli from the same category showed a highly significant decline to about 30%. This effect was highly reproducible within each patient and across patients. Interestingly, the optimal face exemplars, which yielded the strongest response, were different in each electrode, even when the electrodes were adjacent. Control experiments were performed in order to verify that this effect can not be explained by low level differences between the exemplars. These results demonstrate clear exemplar selectivity in human high-order visual areas. Furthermore, the high selectivity evident in the mass local field potentials - likely reflecting activity in thousands of neurons - points to the clustering of these neurons in exemplar-selective cortical patches or columns. Such exemplar selectivity provides the neuronal substrate for individual identification in human observers. Funding: Supported by ISF, Bikura, and Mark Scher’s estate grants to RM. Keywords: EEG, Intra-cranial Electrophysiology Conference: XI International Conference on Cognitive Neuroscience (ICON XI), Palma, Mallorca, Spain, 25 Sep - 29 Sep, 2011. Presentation Type: Poster Presentation Topic: Abstracts Citation: Davidesco I, Bickel S, Zion-Golumbic E, Harel M, Schroeder CE, Mehta AD and Malach R (2011). The neural facebook": exemplar selectivity in human face-selective areas revealed through intracranial EEG recordings. Conference Abstract: XI International Conference on Cognitive Neuroscience (ICON XI). doi: 10.3389/conf.fnhum.2011.207.00071 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 16 Nov 2011; Published Online: 25 Nov 2011. * Correspondence: Dr. Ido Davidesco, Hebrew University of Jerusalem, Jerusalem, Israel, idd@netvision.net.il Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Ido Davidesco Stephan Bickel Elana Zion-Golumbic Michal Harel Charles E Schroeder Ashesh D Mehta Rafael Malach Google Ido Davidesco Stephan Bickel Elana Zion-Golumbic Michal Harel Charles E Schroeder Ashesh D Mehta Rafael Malach Google Scholar Ido Davidesco Stephan Bickel Elana Zion-Golumbic Michal Harel Charles E Schroeder Ashesh D Mehta Rafael Malach PubMed Ido Davidesco Stephan Bickel Elana Zion-Golumbic Michal Harel Charles E Schroeder Ashesh D Mehta Rafael Malach Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

Advances in Color Science: From Retina to Behavior

Color has become a premier model system for understanding how information is processed by neural circuits, and for investigating the relationships among genes, neural circuits, and perception. Both the physical stimulus for color and the perceptual output experienced as color are quite well characterized, but the neural mechanisms that underlie the transformation from stimulus to perception are incompletely understood. The past several years have seen important scientific and technical advances that are changing our understanding of these mechanisms. Here, and in the accompanying minisymposium, we review the latest findings and hypotheses regarding color computations in the retina, primary visual cortex, and higher-order visual areas, focusing on non-human primates, a model of human color vision.

Dissociable Neural Systems Support Retrieval of How and Why Action Knowledge

In everyday discourse, people typically represent actions in one of two ways: how they are performed or why they are performed. In the present study, we determined the neural systems that support these natural modes of representing actions. Participants underwent functional magnetic resonance imaging while identifying how and why people perform various familiar actions. Identifying how actions are performed produced activity in premotor areas that support the execution of actions and in higher-order visual areas that support the perception of action-related objects; this finding supports an embodied view of action knowledge. However, identifying why actions are performed preferentially engaged areas of the brain associated with representing and reasoning about mental states; these areas were right temporoparietal junction, precuneus, dorsomedial prefrontal cortex, and posterior superior temporal sulcus. Our results suggest that why action knowledge is not sufficiently constituted by information in motor and visual systems, but requires a system for representing states of mind, which do not have reliable motor correlates or visual appearance.

Data‐driven analyses of an fMRI study of a subject experiencing phosphenes

To compare two data-driven methods of statistical image analysis, principal and independent component analysis (PCA, ICA), in identifying neural networks related to the transient occurrence of phosphenes experienced by a female patient subsequent to a brain infarct. An initial functional magnetic resonance imaging (fMRI) session consisted of two acquisitions: one of the patient experiencing phosphenes and a second responding to a well-defined visual stimulation paradigm. A second fMRI session 6 months later, when the patient no longer experienced phosphenes, consisted of an acquisition in which no stimulation was presented. Analysis of correlations between the temporal expression coefficients and models of the hemodynamic response identified salient components. Spectral analysis confirmed the identification. The phosphene model was based solely on the subjective report of the patient. Both methods revealed occipital cortical and subcortical areas known to be sites for visual information-processing during stimulation, as did SPM. In addition, higher-order visual areas such as the precuneus and the lateral parietal cortex were implicated in the PCA of the phosphenes. The analyses suggest the capability of data-driven approaches to identify the brain structures involved in these transient, spontaneous visual events.

Neural “Ignition”: Enhanced Activation Linked to Perceptual Awareness in Human Ventral Stream Visual Cortex

Human recognition performance is characterized by abrupt changes in perceptual states. Understanding the neuronal dynamics underlying such transitions could provide important insights into mechanisms of recognition and perceptual awareness. Here we examined patients monitored for clinical purposes with multiple subdural electrodes. The patients participated in a backward masking experiment in which pictures of various object categories were presented briefly followed by a mask. We recorded ECoG from 445 electrodes placed in 11 patients. We found a striking increase in gamma power (30-70 Hz) and evoked responses specifically associated with successful recognition. The enhanced activation occurred 150-200 ms after stimulus onset and consistently outlasted the stimulus presentation. We propose that the gamma and evoked potential activations reflect a rapid increase in recurrent neuronal activity that plays a critical role in the emergence of a recognizable visual percept in conscious awareness.