Opposite Hemifield Research Articles

Reduced interhemispheric transfer in older adults: Evidence from a divided visual field one-back task.

One of the pivotal structural changes observed in the ageing brain pertains to the corpus callosum, the largest neural pathway interconnecting the two cerebral hemispheres. Studies have highlighted the degeneration of the corpus callosum, particularly in its anterior segments, as individuals age. This prompts an essential question regarding the potential functional repercussions of these structural changes on interhemispheric communication among older adults. Two experiments were conducted to explore potential compromises in the interhemispheric transfer of visual working memory (VWM) in older adults. Both young individuals (aged 18-28 years) and healthy older adults (aged 65-85 years) engaged in modified versions of the one-back paradigm. In this task, stimuli were sequentially presented in either the left or right hemifield, and participants indicated whether each stimulus matched the preceding one. Notably, when two stimuli are matched, they could appear either in the same hemifield or in opposite hemifields. The results revealed that, in comparison to young adults, older adults demonstrated a significant increase in matching errors when the two stimuli were presented in opposite hemifields rather than the same hemifield. This new finding strongly suggests a reduced interhemispheric transfer of VWM in older adults, potentially attributed to age-related atrophy in the anterior part of the corpus callosum. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Dorsal pulvinar inactivation leads to spatial selection bias without perceptual deficit

The dorsal pulvinar has been implicated in visuospatial attentional and perceptual confidence processing. Pulvinar lesions in humans and monkeys lead to spatial neglect symptoms, including an overt spatial saccade bias during free choices. However, it remains unclear whether disrupting the dorsal pulvinar during target selection that relies on a perceptual decision leads to a perceptual impairment or a more general spatial orienting and choice deficit. To address this question, we reversibly inactivated the unilateral dorsal pulvinar by injecting GABA-A agonist THIP while two macaque monkeys performed a color discrimination saccade task with varying perceptual difficulty. We used Signal Detection Theory and simulations to dissociate perceptual sensitivity (d-prime) and spatial selection bias (response criterion) effects. We expected a decrease in d-prime if dorsal pulvinar affects perceptual discrimination and a shift in response criterion if dorsal pulvinar is mainly involved in spatial orienting. After the inactivation, we observed response criterion shifts away from contralesional stimuli, especially when two competing stimuli in opposite hemifields were present. Notably, the d-prime and overall accuracy remained largely unaffected. Our results underline the critical contribution of the dorsal pulvinar to spatial orienting and action selection while showing it to be less important for visual perceptual discrimination.

BOLD Contrast Response Characteristics of Aberrant Voxels with Bilateral Visual Population Receptive Fields in Human Albinism.

Albinism is an inherited disorder characterized by disrupted melanin production in the eye, and often in the skin and hair. This retinal hypopigmentation is accompanied by pathological decussation of many temporal retinal afferents at the optic chiasm during development, ultimately resulting in partially superimposed representations of opposite visual hemifields in each cortical hemisphere. Within these aberrant regions of hemifield overlap, individual voxels have been shown to have bilateral, dual population receptive fields (pRFs) responding to roughly mirror-image locations across the vertical meridian. Nonetheless, how these two conflicting inputs combine to determine a voxel's response to image contrast is still unknown. To address this, we stimulated the right and left hemifields with separately controlled sinusoidal gratings, each having a variety of contrasts (0, 8, 20, 45, 100%), and extracted voxel-wise BOLD response amplitudes to each contrast combination in visual areas V1-V3. We then compared voxels' responses to each hemifield stimulated individually with conditions when both hemifields were stimulated simultaneously. We hypothesized that simultaneous stimulation of the two pRF components will result in either a suppressive or facilitative interaction. However, we found that BOLD responses to simultaneous stimulation appeared to reflect simple summation of the neural activity from the individual hemifield conditions. This suggests that the superimposed opposite hemifield representations do not interact. Thus, dual pRFs in albinism likely reflect two co-localized, but functionally independent populations of neurons each of which respond to a single hemifield. This finding is commensurate with psychophysical studies which have shown no clear perceptual interaction between opposite visual hemifields in human albinism.

Contralateral delay activity and alpha lateralization reflect retinotopic and screen-centered reference frames in visual memory

The visual system represents objects in a lateralized manner, with contralateral cortical hemispheres responsible for left and right visual hemifields. This organization extends to visual short-term memory (VSTM), as evidenced by electrophysiological indices of VSTM maintenance: contralateral delay activity (CDA) and alpha-band lateralization. However, it remains unclear if VSTM represents object locations in gaze-centered (retinotopic) or screen-centered (spatiotopic) coordinates, especially after eye movements. In two experiments, participants encoded the colors of target objects and made a lateral saccade during the maintenance interval, thereby shifting the object’s location on the retina. A non-lateralized probe stimulus was then presented at the new fixation for a change detection task. The CDA maintained lateralization towards the target’s original retinotopic location, unaffected by subsequent saccades, and did not invert polarity even when a saccade brought that location into the opposite hemifield. We also found conventional alpha lateralization towards the target’s location before a saccade. After a saccade, however, alpha was lateralized towards the screen center regardless of the target’s original location, even in a control condition without any memory requirements. This suggests that post-saccadic alpha-band lateralization reflects attentional processes unrelated to memory, while pre- and post-saccade CDA reflect VSTM maintenance in a retinotopic reference frame.

The dynamics of statistical learning in visual search and its interaction with salience processing: An EEG study

Visual attention can be guided by statistical regularities in the environment, that people implicitly learn from past experiences (statistical learning, SL). Moreover, a perceptually salient element can automatically capture attention, gaining processing priority through a bottom-up attentional control mechanism. The aim of our study was to investigate the dynamics of SL and if it shapes attentional target selection additively with salience processing, or whether these mechanisms interact, e.g. one gates the other. In a visual search task, we therefore manipulated target frequency (high vs. low) across locations while, in some trials, the target was salient in terms of colour. Additionally, halfway through the experiment, the high-frequency location changed to the opposite hemifield. EEG activity was simultaneously recorded, with a specific interest in two markers related to target selection and post-selection processing, respectively: N2pc and SPCN. Our results revealed that both SL and saliency significantly enhanced behavioural performance, but also interacted with each other, with an attenuated saliency effect at the high-frequency target location, and a smaller SL effect for salient targets. Concerning processing dynamics, the benefit of salience processing was more evident during the early stage of target selection and processing, as indexed by a larger N2pc and early-SPCN, whereas SL modulated the underlying neural activity particularly later on, as revealed by larger late-SPCN. Furthermore, we showed that SL was rapidly acquired and adjusted when the spatial imbalance changed. Overall, our findings suggest that SL is flexible to changes and, combined with salience processing, jointly contributes to establishing attentional priority.

Visual integration across fixation: automatic processes are split but conscious processes remain unified in the split-brain.

The classic view holds that when "split-brain" patients are presented with an object in the right visual field, they will correctly identify it verbally and with the right hand. However, when the object is presented in the left visual field, the patient verbally states that he saw nothing but nevertheless identifies it accurately with the left hand. This interaction suggests that perception, recognition and responding are separated in the two isolated hemispheres. However, there is now accumulating evidence that this interaction is not absolute; for instance, split-brain patients are able to detect and localise stimuli anywhere in the visual field verbally and with either hand. In this study we set out to explore this cross-hemifield interaction in more detail with the split-brain patient DDC and carried out two experiments. The aim of these experiments is to unveil the unity of deliberate and automatic processing in the context of visual integration across hemispheres. Experiment 1 suggests that automatic processing is split in this context. In contrast, when the patient is forced to adopt a conscious, deliberate, approach, processing seemed to be unified across visual fields (and thus across hemispheres). First, we looked at the confidence that DDC has in his responses. The experiment involved a simultaneous "same" versus "different" matching task with two shapes presented either within one hemifield or across fixation. The results showed that we replicated the observation that split brain patients cannot match across fixation, but more interesting, that DDC was very confident in the across-fixation condition while performing at chance-level. On the basis of this result, we hypothesised a two-route explanation. In healthy subjects, the visual information from the two hemifields is integrated in an automatic, unconscious fashion via the intact splenium, and this route has been severed in DDC. However, we know from previous experiments that some transfer of information remains possible. We proposed that this second route (perhaps less visual; more symbolic) may become apparent when he is forced to use a deliberate, consciously controlled approach. In an experiment where he is informed, by a second stimulus presented in one hemifield, what to do with the first stimulus that was presented in the same or the opposite hemifield, we showed that there was indeed interhemispheric transfer of information. We suggest that this two-route model may help in clarifying some of the controversial issues in split-brain research.

Perceptual learning across saccades: Feature but not location specific

Perceptual learning is the ability to enhance perception through practice. The hallmark of perceptual learning is its specificity for the trained location and stimulus features, such as orientation. For example, training in discriminating a grating's orientation improves performance only at the trained location but not in other untrained locations. Perceptual learning has mostly been studied using stimuli presented briefly while observers maintained gaze at one location. However, in everyday life, stimuli are actively explored through eye movements, which results in successive projections of the same stimulus at different retinal locations. Here, we studied perceptual learning of orientation discrimination across saccades. Observers were trained to saccade to a peripheral grating and to discriminate its orientation change that occurred during the saccade. The results showed that training led to transsaccadic perceptual learning (TPL) and performance improvements which did not generalize to an untrained orientation. Remarkably, however, for the trained orientation, we found a complete transfer of TPL to the untrained location in the opposite hemifield suggesting high flexibility of reference frame encoding in TPL. Three control experiments in which participants were trained without saccades did not show such transfer, confirming that the location transfer was contingent upon eye movements. Moreover, performance at the trained location, but not at the untrained location, was also improved in an untrained fixation task. Our results suggest that TPL has both, a location-specific component that occurs before the eye movement and a saccade-related component that involves location generalization.

Contralateral delay activity, but not alpha lateralization, indexes prioritization of information for working memory storage

Working memory is inherently limited, which makes it important to select and maintain only task-relevant information and to protect it from distraction. Previous research has suggested the contralateral delay activity (CDA) and lateralized alpha oscillations as neural candidates for such a prioritization process. While most of this work focused on distraction during encoding, we examined the effect of external distraction presented during memory maintenance. Participants memorized the orientations of three lateralized objects. After an initial distraction-free maintenance interval, distractors appeared in the same location as the targets or in the opposite hemifield. This distraction was followed by another distraction-free interval. Our results show that CDA amplitudes were stronger in the interval before compared with the interval after the distraction (i.e., CDA amplitudes were stronger in response to targets compared with distractors). This amplitude reduction in response to distractors was more pronounced in participants with higher memory accuracy, indicating prioritization and maintenance of relevant over irrelevant information. In contrast, alpha lateralization did not change from the interval before distraction compared with the interval after distraction, and we found no correlation between alpha lateralization and memory accuracy. These results suggest that alpha lateralization plays no direct role in either selective maintenance of task-relevant information or inhibition of distractors. Instead, alpha lateralization reflects the current allocation of spatial attention to the most salient information regardless of task-relevance. In contrast, CDA indicates flexible allocation of working memory resources depending on task-relevance.

Structural and vascular changes in glaucoma with single-hemifield defect: predictors of opposite hemifield visual field progression.

To investigate longitudinal changes in optic nerve head (ONH) superficial vessel density (VD), macular VD, circumpapillary retinal nerve fiber layer (RNFL) thickness, and macular ganglion cell-inner plexiform layer (GCIPL) thickness, and their associations with future VF defects in unaffected hemifields of primary open angle glaucoma (POAG) eyes with baseline VF defect confined to a single hemifield. This retrospective observational study included 61 POAG eyes with VF defect confined to a single hemifield monitored over a mean follow-up time of 2.7years. Development of VF defect in opposite hemifield was defined based the Early Manifest Glaucoma Trail criteria. Each eye was classified into either "conversion" or "no conversion" groups according to development of VF defect in the unaffected hemifield. The rates of longitudinal changes in VD and structure parameters in each hemiretina were compared between the two groups. A Cox proportional hazard model was used to identify potential risk factors for VF conversion in the unaffected hemifield. Among 61 eyes, 17 eyes (27.9%) were classified as "conversion" and 44 eyes (72.1%) were classified as "non-conversion" groups. The conversion group exhibited significantly greater rates of both VD and structural changes in both hemiretinas. In Cox proportional hazard model, greater rate of change in GCIPL thickness, ONH superficial VD, and macular VD of both hemiretinas and greater rate of change in RNFL thickness of the unaffected hemiretina were identified as risk factors for VF conversion in the unaffected hemifield. Monitoring progressive changes in VD and structural parameters effectively predict future VF defect in the opposite hemifields of POAG eyes with single-hemifield defects.

Fovea and Attentional Noise Bias the Perception of Object Feature Locations

Attention is required for integrating object features, like color and spatial location. In a recent binding illusion coined foveal gravity, we found that color-location bindings were consistently misbound to locations closer to fovea in the absence of focal attention. Here we show that both higher weightings in fovea and noise generated from attentional allocation to the periphery appear to bias this incorrect perception of object features’ locations. Participants were cued with a shape at fixation and another in the periphery (either vertically or horizontally) before seeing a horizontal array of gray and colored diamonds (a pair of diamonds in each hemifield) either in line with or placed above fixation. Participants reported whether the two cues were the same or different shapes, and which two colors appeared at which of the four diamond locations. On average, participants reported the location of at least one colored diamond incorrectly on ~20% of all trials. When the peripheral cue was presented vertically (to remove potential attentional noise effects from modulating foveal gravity as this cue straddles the hemifield boundary affecting both hemifields equally), nearly all mislocalized trials had colors reported closer to fixation. When the peripheral cue was presented horizontally in only one hemifield and the diamonds were now above fixation (to remove potential foveal effects as colors shouldn’t be attracted to fovea because they are now presented in the periphery away from fovea), colors presented in the same hemifield as the cue were more likely to be mislocalized than in the opposite hemifield, and these mislocalizations were overwhelmingly towards fovea. Therefore, under instances of uncertainty, foveal locations will beat out peripheral locations for ownership of a feature; but noise from attending to a peripheral cue works in conjunction to actively increase uncertainty of that item’s location, with its location often defaulting towards fovea.

Spatial selectivity in adaptation to gaze direction.

A person's focus of attention is conveyed by the direction of their eyes and face, providing a simple visual cue fundamental to social interaction. A growing body of research examines the visual mechanisms that encode the direction of another person's gaze as we observe them. Here we investigate the spatial receptive field properties of these mechanisms, by testing the spatial selectivity of sensory adaptation to gaze direction. Human observers were adapted to faces with averted gaze presented in one visual hemifield, then tested in their perception of gaze direction for faces presented in the same or opposite hemifield. Adaptation caused strong, repulsive perceptual aftereffects, but only for faces presented in the same hemifield as the adapter. This occurred even though adapting and test stimuli were in the same external location across saccades. Hence, there was clear evidence for retinotopic adaptation and a relative lack of either spatiotopic or spatially invariant adaptation. These results indicate that adaptable representations of gaze direction in the human visual system have retinotopic spatial receptive fields. This strategy of coding others' direction of gaze with positional specificity relative to one's own eye position may facilitate key functions of gaze perception, such as socially cued shifts in visual attention.

Cat-astrophic effects of sudden interruptions on spatial auditory attention.

Salient interruptions draw attention involuntarily. Here, we explored whether this effect depends on the spatial and temporal relationships between a target stream and interrupter. In a series of online experiments, listeners focused spatial attention on a target stream of spoken syllables in the presence of an otherwise identical distractor stream from the opposite hemifield. On some random trials, an interrupter (a cat "MEOW") occurred. Experiment 1 established that the interrupter, which occurred randomly in 25% of the trials in the hemifield opposite the target, degraded target recall. Moreover, a majority of participants exhibited this degradation for the first target syllable, which finished before the interrupter began. Experiment 2 showed that the effect of an interrupter was similar whether it occurred in the opposite or the same hemifield as the target. Experiment 3 found that the interrupter degraded performance slightly if it occurred before the target stream began but had no effect if it began after the target stream ended. Experiment 4 showed decreased interruption effects when the interruption frequency increased (50% of the trials). These results demonstrate that a salient interrupter disrupts recall of a target stream, regardless of its direction, especially if it occurs during a target stream.

Suppression of alpha-band power underlies exogenous attention to emotional distractors.

Alpha‐band oscillations (8–14 Hz) are essential for attention and perception processes by facilitating the selection of relevant information. Directing visuospatial endogenous (voluntary) attention to a given location consistently results in a power suppression of alpha activity over occipito‐parietal areas contralateral to the attended visual field. In contrast, the neural oscillatory dynamics underlying the involuntary capture of attention, or exogenous attention, are currently under debate. By exploiting the inherent capacity of emotionally salient visual stimuli to capture attention, we aimed to investigate whether exogenous attention is characterized by either a reduction or an increase in alpha‐band activity. Electroencephalographic activity was recorded while participants completed a Posner visuospatial cueing task, in which a lateralized image with either positive, negative, or neutral emotional content competed with a target stimulus presented in the opposite hemifield. Compared with trials with no distractors, alpha power was reduced over occipital regions contralateral to distracting images. This reduction of alpha activity turned out to be functionally relevant, as it correlated with impaired behavioral performance on the ongoing task and was enhanced for distractors with negative valence. Taken together, our results demonstrate that visuospatial exogenous attention is characterized by a suppression of alpha‐band activity contralateral to distractor location, similar to the oscillatory underpinnings of endogenous attention. Further, these results highlight the key role of exogenous attention as an adaptive mechanism for the efficient detection of biologically salient stimuli.

Cortical Thickness Related to Compensatory Viewing Strategies in Patients With Macular Degeneration.

Retinal diseases like age-related macular degeneration (AMD) or hereditary juvenile macular dystrophies (JMD) lead to a loss of central vision. Many patients compensate for this loss with a pseudo fovea in the intact peripheral retina, the so-called “preferred retinal locus” (PRL). How extensive eccentric viewing associated with central vision loss (CVL) affects brain structures responsible for visual perception and visually guided eye movements remains unknown. CVL results in a reduction of cortical gray matter in the “lesion projection zone” (LPZ) in early visual cortex, but the thickness of primary visual cortex appears to be largely preserved for eccentric-field representations. Here we explore how eccentric viewing strategies are related to cortical thickness (CT) measures in early visual cortex and in brain areas involved in the control of eye movements (frontal eye fields, FEF, supplementary eye fields, SEF, and premotor eye fields, PEF). We determined the projection zones (regions of interest, ROIs) of the PRL and of an equally peripheral area in the opposite hemifield (OppPRL) in early visual cortex (V1 and V2) in 32 patients with MD and 32 age-matched controls (19–84 years) by functional magnetic resonance imaging. Subsequently, we calculated the CT in these ROIs and compared it between PRL and OppPRL as well as between groups. Additionally, we examined the CT of FEF, SEF, and PEF and correlated it with behavioral measures like reading speed and eccentric fixation stability at the PRL. We found a significant difference between PRL and OppPRL projection zones in V1 with increased CT at the PRL, that was more pronounced in the patients, but also visible in the controls. Although the mean CT of the eye fields did not differ significantly between patients and controls, we found a trend to a positive correlation between CT in the right FEF and SEF and fixation stability in the whole patient group and between CT in the right PEF and reading speed in the JMD subgroup. The results indicate a possible association between the compensatory strategies used by patients with CVL and structural brain properties in early visual cortex and cortical eye fields.

Transsaccadic integration operates independently in different feature dimensions.

Our knowledge about objects in our environment reflects an integration of current visual input with information from preceding gaze fixations. Such a mechanism may reduce uncertainty but requires the visual system to determine which information obtained in different fixations should be combined or kept separate. To investigate the basis of this decision, we conducted three experiments. Participants viewed a stimulus in their peripheral vision and then made a saccade that shifted the object into the opposite hemifield. During the saccade, the object underwent changes of varying magnitude in two feature dimensions (Experiment 1, color and location; Experiments 2 and 3, color and orientation). Participants reported whether they detected any change and estimated one of the postsaccadic features. Integration of presaccadic with postsaccadic input was observed as a bias in estimates toward the presaccadic feature value. In all experiments, presaccadic bias weakened as the magnitude of the transsaccadic change in the estimated feature increased. Changes in the other feature, despite having a similar probability of detection, had no effect on integration. Results were quantitatively captured by an observer model where the decision whether to integrate information from sequential fixations is made independently for each feature and coupled to awareness of a feature change.

Aberrant visual population receptive fields in human albinism.

Retinotopic organization is a fundamental feature of visual cortex thought to play a vital role in encoding spatial information. One important aspect of normal retinotopy is the representation of the right and left hemifields in contralateral visual cortex. However, in human albinism, many temporal retinal afferents decussate aberrantly at the optic chiasm resulting in partially superimposed representations of opposite hemifields in each hemisphere of visual cortex. Previous functional magnetic resonance imaging (fMRI) studies in human albinism suggest that the right and left hemifield representations are superimposed in a mirror-symmetric manner. This should produce imaging voxels which respond to two separate locations mirrored across the vertical meridian. However, it is not yet clear how retino-cortical miswiring in albinism manifests at the level of single voxel population receptive fields (pRFs). Here, we used pRF modeling to fit both single and dual pRF models to the visual responses of voxels in visual areas V1 to V3 of five subjects with albinism. We found that subjects with albinism (but not controls) have sizable clusters of voxels with unequivocal dual pRFs consistently corresponding to, but not fully coextensive with, regions of hemifield overlap. These dual pRFs were typically positioned at locations roughly mirrored across the vertical meridian and were uniquely clustered within a portion of the visual field for each subject.

Automatic Guidance (and Misguidance) of Visuospatial Attention by Acquired Scene Memory: Evidence From an N1pc Polarity Reversal

Visual search is facilitated when the target is repeatedly encountered at a fixed position within an invariant (vs. randomly variable) distractor layout—that is, when the layout is learned and guides attention to the target, a phenomenon known as contextual cuing. Subsequently changing the target location within a learned layout abolishes contextual cuing, which is difficult to relearn. Here, we used lateralized event-related electroencephalogram (EEG) potentials to explore memory-based attentional guidance (N = 16). The results revealed reliable contextual cuing during initial learning and an associated EEG-amplitude increase for repeated layouts in attention-related components, starting with an early posterior negativity (N1pc, 80–180 ms). When the target was relocated to the opposite hemifield following learning, contextual cuing was effectively abolished, and the N1pc was reversed in polarity (indicative of persistent misguidance of attention to the original target location). Thus, once learned, repeated layouts trigger attentional-priority signals from memory that proactively interfere with contextual relearning after target relocation.

Extinguishing Exogenous Attention via Transcranial Magnetic Stimulation

Orienting covert exogenous (involuntary) attention to a target location improves performance in many visual tasks [1, 2]. It is unknown whether early visual cortical areas are necessary for this improvement. To establish a causal link between these areas and attentional modulations, we used transcranial magnetic stimulation (TMS) to briefly alter cortical excitability and determine whether early visual areas mediate the effect of exogenous attention on performance. Observers performed an orientation discrimination task. After a peripheral valid, neutral, or invalid cue, two cortically magnified gratings were presented, one in the stimulated region and the other in the symmetric region in the opposite hemifield. Observers received two successive TMS pulses around their occipital pole while the stimuli were presented. Shortly after, a response cue indicated the grating whose orientation observers had to discriminate. The response cue either matched-target stimulated-or did not match-distractor stimulated-the stimulated side. Grating contrast was varied to measure contrast response functions (CRF) for all combinations of attention and TMS conditions. When the distractor was stimulated, exogenous attention yielded response gain-performance benefits in the valid-cue condition and costs in the invalid-cue condition compared with the neutral condition at the high contrast levels. Crucially, when the target was stimulated, this response gain was eliminated. Therefore, TMS extinguished the effect of exogenous attention. These results establish a causal link between early visual areas and the modulatory effect of exogenous attention on performance.

Urgency Promotes Affective Disengagement: Effects From Bivalent Cues on Preference Formation for Abstract Images

Although previous research has characterized the important role for spatial and affective pre-cues in the control of visual attention, less is known about the impact of pre-cues on preference formation. In preference formation, the gaze cascade phenomenon suggests that the gaze serves both to enhance and express “liking” during value-based decision-making. This phenomenon has been interpreted as a type of Pavlovian approach toward preferred objects. Decision-making here reflects a process of gradual commitment in which the gaze functions as a precursor to choice; by this account, overt attention produces a necessarily positive, additive effect on the value of the attended object. The implication is that drawing attention to an object should initiate, and therefore promote, preference formation for that object. Alternatively, information-integration models of attention propose that attention produces a multiplicative effect on the value of the attended object, implying that negative information can impede preference formation. To pitch the gradual-commitment hypothesis against the information-integration hypothesis, we conducted four experiments that combined the spatial-cueing paradigm with a value-based choice paradigm. In each trial in all experiments, subjects were presented with an irrelevant, peripheral pre-cue for a duration of 500 ms, followed by a 500 ms blank, and then a pair of abstract images (one at the pre-cued position; one in the opposite hemifield). The subjects were asked to choose their preferred abstract image by pressing the corresponding button. We manipulated the type of pre-cues (images of faces versus foods; with varying affective associations) and the time constraints (a deadline of 1,500 ms versus self-paced). Overall, the choice data showed a clear pattern of influence from the pre-cues, such that, given a deadline, abstract images were chosen less often if they had been preceded by a pre-cue with a negative affective association (both for face and food images). Analyses of the gaze data showed the emergence of significant gaze biases in line with the subjects’ choices. Taken together, the data pattern provided support for the information-integration hypothesis, particularly under urgency. When tasked with a speeded preference choice, subjects showed affective disengagement following pre-cues that carried a negative association.

Audio-visual spatial alignment improves integration in the presence of a competing audio-visual stimulus

In order to parse the world around us, we must constantly determine which sensory inputs arise from the same physical source and should therefore be perceptually integrated. Temporal coherence between auditory and visual stimuli drives audio-visual (AV) integration, but the role played by AV spatial alignment is less well understood. Here, we manipulated AV spatial alignment and collected electroencephalography (EEG) data while human subjects performed a free-field variant of the “pip and pop” AV search task. In this paradigm, visual search is aided by a spatially uninformative auditory tone, the onsets of which are synchronized to changes in the visual target. In Experiment 1, tones were either spatially aligned or spatially misaligned with the visual display. Regardless of AV spatial alignment, we replicated the key pip and pop result of improved AV search times. Mirroring the behavioral results, we found an enhancement of early event-related potentials (ERPs), particularly the auditory N1 component, in both AV conditions. We demonstrate that both top-down and bottom-up attention contribute to these N1 enhancements. In Experiment 2, we tested whether spatial alignment influences AV integration in a more challenging context with competing multisensory stimuli. An AV foil was added that visually resembled the target and was synchronized to its own stream of synchronous tones. The visual components of the AV target and AV foil occurred in opposite hemifields; the two auditory components were also in opposite hemifields and were either spatially aligned or spatially misaligned with the visual components to which they were synchronized. Search was fastest when the auditory and visual components of the AV target (and the foil) were spatially aligned. Attention modulated ERPs in both spatial conditions, but importantly, the scalp topography of early evoked responses shifted only when stimulus components were spatially aligned, signaling the recruitment of different neural generators likely related to multisensory integration. These results suggest that AV integration depends on AV spatial alignment when stimuli in both modalities compete for selective integration, a common scenario in real-world perception.