Ventral Visual Stream Areas Research Articles

Neural substrate for the engagement of the ventral visual stream in motor control in the macaque monkey.

The present study aimed to describe the cortical connectivity of a sector located in the ventral bank of the superior temporal sulcus in the macaque (intermediate area TEa and TEm [TEa/m]), which appears to represent the major source of output of the ventral visual stream outside the temporal lobe. The retrograde tracer wheat germ agglutinin was injected in the intermediate TEa/m in four macaque monkeys. The results showed that 58-78% of labeled cells were located within ventral visual stream areas other than the TE complex. Outside the ventral visual stream, there were connections with the memory-related medial temporal area 36 and the parahippocampal cortex, orbitofrontal areas involved in encoding subjective values of stimuli for action selection, and eye- or hand-movement related parietal (LIP, AIP, and SII), prefrontal (12r, 45A, and 45B) areas, and a hand-related dysgranular insula field. Altogether these data provide a solid substrate for the engagement of the ventral visual stream in large scale cortical networks for skeletomotor or oculomotor control. Accordingly, the role of the ventral visual stream could go beyond pure perceptual processes and could be also finalized to the neural mechanisms underlying the control of voluntary motor behavior.

Action-specific feature processing in the human cortex: An fMRI study

Sensorimotor integration involves feedforward and reentrant processing of sensory input. Grasp-related motor activity precedes and is thought to influence visual object processing. Yet, while the importance of reentrant feedback is well established in perception, the top-down modulations for action and the neural circuits involved in this process have received less attention. Do action-specific intentions influence the processing of visual information in the human cortex? Using a cue-separation fMRI paradigm, we found that action-specific instruction processing (manual alignment vs. grasp) became apparent only after the visual presentation of oriented stimuli, and occurred as early as in the primary visual cortex and extended to the dorsal visual stream, motor and premotor areas. Further, dorsal stream area aIPS, known to be involved in object manipulation, and the primary visual cortex showed task-related functional connectivity with frontal, parietal and temporal areas, consistent with the idea that reentrant feedback from dorsal and ventral visual stream areas modifies visual inputs to prepare for action. Importantly, both the task-dependent modulations and connections were linked specifically to the object presentation phase of the task, suggesting a role in processing the action goal. Our results show that intended manual actions have an early, pervasive, and differential influence on the cortical processing of vision.

Independent spatiotemporal effects of spatial attention and background clutter on human object location representations

Spatial attention helps us to efficiently localize objects in cluttered environments. However, the processing stage at which spatial attention modulates object location representations remains unclear. Here we investigated this question identifying processing stages in time and space in an EEG and fMRI experiment respectively. As both object location representations and attentional effects have been shown to depend on the background on which objects appear, we included object background as an experimental factor. During the experiments, human participants viewed images of objects appearing in different locations on blank or cluttered backgrounds while either performing a task on fixation or on the periphery to direct their covert spatial attention away or towards the objects. We used multivariate classification to assess object location information. Consistent across the EEG and fMRI experiment, we show that spatial attention modulated location representations during late processing stages (>150 ms, in middle and high ventral visual stream areas) independent of background condition. Our results clarify the processing stage at which attention modulates object location representations in the ventral visual stream and show that attentional modulation is a cognitive process separate from recurrent processes related to the processing of objects on cluttered backgrounds.

Moving a Shape behind a Slit: Partial Shape Representations in Inferior Temporal Cortex.

Current models of object recognition are based on spatial representations build from object features that are simultaneously present in the retinal image. However, one can recognize an object when it moves behind a static occlude, and only a small fragment of its shape is visible through a slit at a given moment in time. Such anorthoscopic perception requires spatiotemporal integration of the successively presented shape parts during slit-viewing. Human fMRI studies suggested that ventral visual stream areas represent whole shapes formed through temporal integration during anorthoscopic perception. To examine the time course of shape-selective responses during slit-viewing, we recorded the responses of single inferior temporal (IT) neurons of rhesus monkeys to moving shapes that were only partially visible through a static narrow slit. The IT neurons signaled shape identity by their response when that was cumulated across the duration of the shape presentation. Their shape preference during slit-viewing equaled that for static, whole-shape presentations. However, when analyzing their responses at a finer time scale, we showed that the IT neurons responded to particular shape fragments that were revealed by the slit. We found no evidence for temporal integration of slit-views that result in a whole-shape representation, even when the monkey was matching slit-views of a shape to static whole-shape presentations. These data suggest that, although the temporally integrated response of macaque IT neurons can signal shape identity in slit-viewing conditions, the spatiotemporal integration needed for the formation of a whole-shape percept occurs in other areas, perhaps downstream to IT.SIGNIFICANCE STATEMENT One recognizes an object when it moves behind a static occluder and only a small fragment of its shape is visible through a static slit at a given moment in time. Such anorthoscopic perception requires spatiotemporal integration of the successively presented partial shape parts. Human fMRI studies suggested that ventral visual stream areas represent shapes formed through temporal integration. We recorded the responses of inferior temporal (IT) cortical neurons of macaques during slit-viewing conditions. Although the temporally summated response of macaque IT neurons could signal shape identity under slit-viewing conditions, we found no evidence for a whole-shape representation using analyses at a finer time scale. Thus, the spatiotemporal integration needed for anorthoscopic perception does not occur within IT.

Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas.

Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.

Predictive coding of action intentions in dorsal and ventral visual stream is based on visual anticipations, memory-based information and motor preparation.

Predictions of upcoming movements are based on several types of neural signals that span the visual, somatosensory, motor and cognitive system. Thus far, pre-movement signals have been investigated while participants viewed the object to be acted upon. Here, we studied the contribution of information other than vision to the classification of preparatory signals for action, even in the absence of online visual information. We used functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA) to test whether the neural signals evoked by visual, memory-based and somato-motor information can be reliably used to predict upcoming actions in areas of the dorsal and ventral visual stream during the preparatory phase preceding the action, while participants were lying still. Nineteen human participants (nine women) performed one of two actions towards an object with their eyes open or closed. Despite the well-known role of ventral stream areas in visual recognition tasks and the specialization of dorsal stream areas in somato-motor processes, we decoded action intention in areas of both streams based on visual, memory-based and somato-motor signals. Interestingly, we could reliably decode action intention in absence of visual information based on neural activity evoked when visual information was available and vice versa. Our results show a similar visual, memory and somato-motor representation of action planning in dorsal and ventral visual stream areas that allows predicting action intention across domains, regardless of the availability of visual information.

Visual processing deficits in 22q11.2 Deletion Syndrome.

Carriers of the rare 22q11.2 microdeletion present with a high percentage of positive and negative symptoms and a high genetic risk for schizophrenia. Visual processing impairments have been characterized in schizophrenia, but less so in 22q11.2 Deletion Syndrome (DS). Here, we focus on visual processing using high-density EEG and source imaging in 22q11.2DS participants (N = 25) and healthy controls (N = 26) with an illusory contour discrimination task.Significant differences between groups emerged at early and late stages of visual processing. In 22q11.2DS, we first observed reduced amplitudes over occipital channels and reduced source activations within dorsal and ventral visual stream areas during the P1 (100–125 ms) and within ventral visual cortex during the N1 (150–170 ms) visual evoked components. During a later window implicated in visual completion (240–285 ms), we observed an increase in global amplitudes in 22q11.2DS. The increased surface amplitudes for illusory contours at this window were inversely correlated with positive subscales of prodromal symptoms in 22q11.2DS.The reduced activity of ventral and dorsal visual areas during early stages points to an impairment in visual processing seen both in schizophrenia and 22q11.2DS. During intervals related to perceptual closure, the inverse correlation of high amplitudes with positive symptoms suggests that participants with 22q11.2DS who show an increased brain response to illusory contours during the relevant window for contour processing have less psychotic symptoms and might thus be at a reduced prodromal risk for schizophrenia.

Changes in connectivity of the posterior default network node during visual processing in mild cognitive impairment: staged decline between normal aging and Alzheimer's disease.

Visual processing difficulties are often present in Alzheimer's disease (AD), even in its pre-dementia phase (i.e. in mild cognitive impairment, MCI). The default mode network (DMN) modulates the brain connectivity depending on the specific cognitive demand, including visual processes. The aim of the present study was to analyze specific changes in connectivity of the posterior DMN node (i.e. the posterior cingulate cortex and precuneus, PCC/P) associated with visual processing in 17 MCI patients and 15 AD patients as compared to 18 healthy controls (HC) using functional magnetic resonance imaging. We used psychophysiological interaction (PPI) analysis to detect specific alterations in PCC connectivity associated with visual processing while controlling for brain atrophy. In the HC group, we observed physiological changes in PCC connectivity in ventral visual stream areas and with PCC/P during the visual task, reflecting the successful involvement of these regions in visual processing. In the MCI group, the PCC connectivity changes were disturbed and remained significant only with the anterior precuneus. In between-group comparison, we observed significant PPI effects in the right superior temporal gyrus in both MCI and AD as compared to HC. This change in connectivity may reflect ineffective "compensatory" mechanism present in the early pre-dementia stages of AD or abnormal modulation of brain connectivity due to the disease pathology. With the disease progression, these changes become more evident but less efficient in terms of compensation. This approach can separate the MCI from HC with 77% sensitivity and 89% specificity.

Invariant Temporal Dynamics Underlie Perceptual Stability in Human Visual Cortex

An inherent limitation of human visual system research stems from its reliance on highly controlled laboratory conditions. Visual processing in the real world differs substantially from such controlled conditions. In particular, during natural vision, we continuously sample the dynamic environment by variable eye movements that lead to inherent instability of the optical image. The neuronal mechanism by which human perception remains stable under these natural conditions remains unknown. Here, we examined a neural mechanism that may contribute to such stability, i.e., the extent to which neuronal responses remain invariant to oculomotor parameters and viewing conditions. To this end, we introduce an experimental paradigm in which intracranial brain activity, a video of the real-life visual scene, and free oculomotor behavior were simultaneously recorded in human patients. Our results reveal, in high-order visual areas, a remarkable level of neural invariance to the length of eye fixations and lack of evidence for a saccade-related neuronal signature. Thus, neuronal responses, while showing high selectivity to the category of visual images, manifested stable "iconic" dynamics. This property of invariance to fixation onset and duration emerged only in high-order visual representations. Inearly visual cortex, the fixation onset was accompanied with suppressive neural signal, and duration of neuronal responses was largely determined by the fixation times. These results uncover unique neuronal dynamics in high-order ventral stream visual areas that could play an important role in achieving perceptual stability, despite the drastic changes introduced by oculomotor behavior in real life.

The Neural Signature of Subliminal Visuomotor Priming: Brain Activity and Functional Connectivity Profiles

Unconscious visuomotor priming defined as the advantage in reaction time (RT) or accuracy for target shapes mapped to the same (congruent condition) when compared with a different (incongruent condition) motor response as a preceding subliminally presented prime shape has been shown to modulate activity within a visuomotor network comprised of parietal and frontal motor areas in previous functional magnetic resonance imaging (fMRI) studies. The present fMRI study investigated whether, in addition to changes in brain activity, unconscious visuomotor priming results in a modulation of functional connectivity profiles. Activity associated with congruent compared with incongruent trials was lower in the bilateral inferior and medial superior frontal gyri, in the inferior parietal lobules, and in the right caudate nucleus and adjacent portions of the thalamus. Functional connectivity increased under congruent relative to incongruent conditions between ventral visual stream areas (e.g., calcarine, fusiform, and lingual gyri), the precentral gyrus, the supplementary motor area, posterior parietal areas, the inferior frontal gyrus, and the caudate nucleus. Our findings suggest that an increase in coupling between visuomotor regions, reflecting higher efficiency of processing, is an important neural mechanism underlying unconscious visuomotor priming, in addition to changes in the magnitude of activation.

An ALE meta-analysis on the audiovisual integration of speech signals.

The brain improves speech processing through the integration of audiovisual (AV) signals. Situations involving AV speech integration may be crudely dichotomized into those where auditory and visual inputs contain (1) equivalent, complementary signals (validating AV speech) or (2) inconsistent, different signals (conflicting AV speech). This simple framework may allow the systematic examination of broad commonalities and differences between AV neural processes engaged by various experimental paradigms frequently used to study AV speech integration. We conducted an activation likelihood estimation metaanalysis of 22 functional imaging studies comprising 33 experiments, 311 subjects, and 347 foci examining "conflicting" versus "validating" AV speech. Experimental paradigms included content congruency, timing synchrony, and perceptual measures, such as the McGurk effect or synchrony judgments, across AV speech stimulus types (sublexical to sentence). Colocalization of conflicting AV speech experiments revealed consistency across at least two contrast types (e.g., synchrony and congruency) in a network of dorsal stream regions in the frontal, parietal, and temporal lobes. There was consistency across all contrast types (synchrony, congruency, and percept) in the bilateral posterior superior/middle temporal cortex. Although fewer studies were available, validating AV speech experiments were localized to other regions, such as ventral stream visual areas in the occipital and inferior temporal cortex. These results suggest that while equivalent, complementary AV speech signals may evoke activity in regions related to the corroboration of sensory input, conflicting AV speech signals recruit widespread dorsal stream areas likely involved in the resolution of conflicting sensory signals.

The emotion–action link? Naturalistic emotional stimuli preferentially activate the human dorsal visual stream

A large body of brain imaging research highlights a set of specific regions in the limbic, insular and prefrontal cortex as sensitive to static visual images of high emotional content. Here we report that when using more naturalistic stimuli (short audio–visual video clips) the most selective cortical loci demonstrating preferential activation to emotional content were centered on the dorsal, action related, stream of visual areas. Subjects underwent fMRI scanning while watching a set of highly emotional as well as neutral video clips. Following the scan, clips were rated by each subject for emotional arousal and valence. Surprisingly, activity in dorsal stream visual areas (such as IPS and SPL) showed the highest preference to emotional arousal compared to all other brain areas. In contrast, ventral stream visual areas showed a significantly weaker emotional preference. Control experiments ruled out low level visual or auditory cues as contributing factors to this effect. Furthermore, the specific spatial pattern of emotion-related activations was incompatible with general arousal or attentional effects. Given the established role of dorsal stream visual areas in action-related functions, these results support the long held hypothesis associating emotion with preparation for action.

What difference does a year of schooling make?

Early elementary schooling in 2nd and 3rd grades (ages 7-9) is an important period for the acquisition and mastery of basic mathematical skills. Yet, we know very little about neurodevelopmental changes that might occur over a year of schooling. Here we examine behavioral and neurodevelopmental changes underlying arithmetic problem solving in a well-matched group of 2nd (n = 45) and 3rd (n = 45) grade children. Although 2nd and 3rd graders did not differ on IQ or grade- and age-normed measures of math, reading and working memory, 3rd graders had higher raw math scores (effect sizes = 1.46-1.49) and were more accurate than 2nd graders in an fMRI task involving verification of simple and complex two-operand addition problems (effect size = 0.43). In both 2nd and 3rd graders, arithmetic complexity was associated with increased responses in right inferior frontal sulcus and anterior insula, regions implicated in domain-general cognitive control, and in left intraparietal sulcus (IPS) and superior parietal lobule (SPL) regions important for numerical and arithmetic processing. Compared to 2nd graders, 3rd graders showed greater activity in dorsal stream parietal areas right SPL, IPS and angular gyrus (AG) as well as ventral visual stream areas bilateral lingual gyrus (LG), right lateral occipital cortex (LOC) and right parahippocampal gyrus (PHG). Significant differences were also observed in the prefrontal cortex (PFC), with 3rd graders showing greater activation in left dorsal lateral PFC (dlPFC) and greater deactivation in the ventral medial PFC (vmPFC). Third graders also showed greater functional connectivity between the left dlPFC and multiple posterior brain areas, with larger differences in dorsal stream parietal areas SPL and AG, compared to ventral stream visual areas LG, LOC and PHG. No such between-grade differences were observed in functional connectivity between the vmPFC and posterior brain regions. These results suggest that even the narrow one-year interval spanning grades 2 and 3 is characterized by significant arithmetic task-related changes in brain response and connectivity, and argue that pooling data across wide age ranges and grades can miss important neurodevelopmental changes. Our findings have important implications for understanding brain mechanisms mediating early maturation of mathematical skills and, more generally, for educational neuroscience.

Motivational salience modulates hippocampal repetition suppression and functional connectivity in humans

Repetition suppression (RS) is a rapid decrease of stimulus-related neuronal responses upon repeated presentation of a stimulus. Previous studies have demonstrated that negative emotional salience of stimuli enhances RS. It is, however, unclear how motivational salience of stimuli, such as reward-predicting value, influences RS for complex visual stimuli, and which brain regions might show differences in RS for reward-predicting and neutral stimuli. Here we investigated the influence of motivational salience on RS of complex scenes using event-related functional magnetic resonance imaging. Thirty young healthy volunteers performed a monetary incentive delay task with complex scenes (indoor vs. outdoor) serving as neutral or reward-predicting cue pictures. Each cue picture was presented three times. In line with previous findings, reward anticipation was associated with activations in the ventral striatum, midbrain, and orbitofrontal cortex (OFC). Stimulus repetition was associated with pronounced RS in ventral visual stream areas like the parahippocampal place area (PPA). An interaction of reward anticipation and RS was specifically observed in the anterior hippocampus, where a response decrease across repetitions was observed for the reward-predicting scenes only. Functional connectivity analysis further revealed specific activity-dependent connectivity increases of the hippocampus and the PPA and OFC. Our results suggest that hippocampal RS is sensitive to reward-predicting properties of stimuli and might therefore reflect a rapid, adaptive neural response mechanism for motivationally salient information.

Neural signature of consciously-perceived visual events

Which brain regions are necessary for the conscious perception of a visual stimulus? We examined this question by scanning subjects with fMRI while they viewed an array of four photographs which flickered on and off several times a second. Every few seconds, one of the four photographs was replaced by a new photograph. Subjects were required to attend to two of the four array locations whilst ignoring the other two. We compared the event-related fMRI response to the appearance of new stimuli in the attended locations to response to stimuli in the unattended locations. The presence of a constant stream of visual transients ensured that subjects rarely noticed the appearance of a new photograph in the unattended locations. A surprise memory test given at the completion of the scan verified that stimuli in the unattended locations were rarely encoded into memory. Greater response to attended events was observed in ventral stream visual areas such as fusiform gyrus, but not in frontal-parietal regions that have previously been implicated in conscious perception. We suggest that occipitotemporal regions are involved in conscious perception per se, while frontal-parietal regions may be involved in redirecting attention towards novel stimuli, storing them in working memory, and arranging responses to them.

A Color Hierarchy for Automatic Target Selection

Visual processing of color starts at the cones in the retina and continues through ventral stream visual areas, called the parvocellular pathway. Motion processing also starts in the retina but continues through dorsal stream visual areas, called the magnocellular system. Color and motion processing are functionally and anatomically discrete. Previously, motion processing areas MT and MST have been shown to have no color selectivity to a moving stimulus; the neurons were colorblind whenever color was presented along with motion. This occurs when the stimuli are luminance-defined versus the background and is considered achromatic motion processing. Is motion processing independent of color processing? We find that motion processing is intrinsically modulated by color. Color modulated smooth pursuit eye movements produced upon saccading to an aperture containing a surface of coherently moving dots upon a black background. Furthermore, when two surfaces that differed in color were present, one surface was automatically selected based upon a color hierarchy. The strength of that selection depended upon the distance between the two colors in color space. A quantifiable color hierarchy for automatic target selection has wide-ranging implications from sports to advertising to human-computer interfaces.

Neural “Ignition”: Enhanced Activation Linked to Perceptual Awareness in Human Ventral Stream Visual Cortex

Human recognition performance is characterized by abrupt changes in perceptual states. Understanding the neuronal dynamics underlying such transitions could provide important insights into mechanisms of recognition and perceptual awareness. Here we examined patients monitored for clinical purposes with multiple subdural electrodes. The patients participated in a backward masking experiment in which pictures of various object categories were presented briefly followed by a mask. We recorded ECoG from 445 electrodes placed in 11 patients. We found a striking increase in gamma power (30-70 Hz) and evoked responses specifically associated with successful recognition. The enhanced activation occurred 150-200 ms after stimulus onset and consistently outlasted the stimulus presentation. We propose that the gamma and evoked potential activations reflect a rapid increase in recurrent neuronal activity that plays a critical role in the emergence of a recognizable visual percept in conscious awareness.

Cortical Connections of the Macaque Anterior Intraparietal (AIP) Area

We traced the cortical connections of the anterior intraparietal (AIP) area, which is known to play a crucial role in visuomotor transformations for grasping. AIP displayed major connections with 1) areas of the inferior parietal lobule convexity, the rostral part of the lateral intraparietal area and the SII region; 2) ventral visual stream areas of the lower bank of the superior temporal sulcus and the middle temporal gyrus; and 3) the premotor area F5 and prefrontal areas 46 and 12. Additional connections were observed with the caudal intraparietal area and the ventral part of the frontal eye field. This study suggests that visuomotor transformations for object-oriented actions, processed in AIP, rely not only on dorsal visual stream information related to the object's physical properties but also on ventral visual stream information related to object identity. The identification of direct anatomical connections with the inferotemporal cortex suggests that AIP also has a unique role in linking the parietofrontal network of areas involved in sensorimotor transformations for grasping with areas involved in object recognition. Thus, AIP could represent a crucial node in a cortical circuit in which hand-related sensory and motor signals gain access to representations of object identity for tactile object recognition.

Distinct Patterns of Viewpoint-Dependent BOLD Activity during Common-Object Recognition and Mental Rotation

A fundamental but unanswered question about the human visual system concerns the way in which misoriented objects are recognized. One hypothesis maintains that representations of incoming stimuli are transformed via parietally based spatial normalization mechanisms (eg mental rotation) to match view-specific representations in long-term memory. Using fMRI, we tested this hypothesis by directly comparing patterns of brain activity evoked during classic mental rotation and misoriented object recognition involving everyday objects. BOLD activity increased systematically with stimulus rotation within the ventral visual stream during object recognition and within the dorsal visual stream during mental rotation. More specifically, viewpoint-dependent activity was significantly greater in the right superior parietal lobule during mental rotation than during object recognition. In contrast, viewpoint-dependent activity was significantly greater in the right fusiform gyrus during object recognition than during mental rotation. In addition to these differences in viewpoint-dependent activity, object recognition and mental rotation produced distinct patterns of brain activity, independent of stimulus rotation: object recognition resulted in greater overall activity within ventral stream visual areas and mental rotation resulted in greater overall activity within dorsal stream visual areas. The present results are inconsistent with the hypothesis that misoriented object recognition is mediated by structures within the parietal lobe that are known to be involved in mental rotation.

Biasing the brain’s attentional set: II. Effects of selective intersensory attentional deployments on subsequent sensory processing

This study used high-density mapping of human event-related potentials to examine the brain activity associated with selective information processing when subjects were cued on a trial-by-trial basis to perform a discrimination in either the visual or auditory modality. On each trial, word-cues (S1) instructed subjects to attend to features within one sensory-modality of an impending compound auditory-visual stimulus (S2) that arrived approximately 1-second following the cue. Subjects made a discrimination within the cued modality of the S2 stimulus. The spatio-temporal patterns of activity in response to the compound S2 stimulus were examined as a function of the sensory modality being attended. The earliest effects of intersensory attention on visual processing were seen subsequent to the initial activation of visual cortex, beginning at 80 ms and continuing into the P1 and N1 components of the visual ERP. The scalp-topography of this earliest modulation was consistent with modulation of activity in ventral visual stream areas. Thus, the locus of effects on visual S2 processing differed from the anticipatory parieto-occipital biasing activity that preceded S2 presentation. This pattern of effects strongly suggests that the anticipatory activity (following the cue) associated with sustaining the focus of attention during intersensory attention, at least in the context of this paradigm, does not operate as a simple gain mechanism in early visual sensory areas. Rather, attentional biasing can operate through a higher-order process whereby parieto-occipital cortices influence the subsequent flow of visual processing in the ventral stream.