Unrelated Visual Task Research Articles

Effects of training on sensitivities to spatial changes in auditory scenes

Previous work has shown that change deafness can occur with changes in the spatial location of objects within auditory scenes. Whether performance can be improved with training has yet to be directly tested. In the present study, the impact of training was examined in a “flicker”-like paradigm, where an initial scene comprising environmental sounds presented on the horizontal plane alternated with the presentation of a comparison scene, which was either the same or contained a change in the location of one or more sounds. Trained participants were trained on a set of sounds on day 1, while control subjects completed an unrelated visual task. On day 2, participants were tested using the same paradigm, with trained subjects hearing either the sounds they were trained on or new sounds, and controls being exposed to the paradigm for the first time. Overall, trained participants performed better (93% accuracy) than untrained participants (79%). Both groups had lower reaction times on correct-response change trials than on correct-response no-change trials. Trained subjects performed no better on trained sounds than new sounds. These data indicate that training can improve task performance, but improvements may be not be limited to sounds experienced during training.Previous work has shown that change deafness can occur with changes in the spatial location of objects within auditory scenes. Whether performance can be improved with training has yet to be directly tested. In the present study, the impact of training was examined in a “flicker”-like paradigm, where an initial scene comprising environmental sounds presented on the horizontal plane alternated with the presentation of a comparison scene, which was either the same or contained a change in the location of one or more sounds. Trained participants were trained on a set of sounds on day 1, while control subjects completed an unrelated visual task. On day 2, participants were tested using the same paradigm, with trained subjects hearing either the sounds they were trained on or new sounds, and controls being exposed to the paradigm for the first time. Overall, trained participants performed better (93% accuracy) than untrained participants (79%). Both groups had lower reaction times on correct-response change tr...

Food words distract the hungry: Evidence of involuntary semantic processing of task-irrelevant but biologically-relevant unexpected auditory words.

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task by triggering shifts of attention to and from the deviant sound (deviance distraction). Evidence indicates that the involuntary orientation of attention to unexpected sounds is followed by their semantic processing. However, past demonstrations relied on tasks in which the meaning of the deviant sounds overlapped with features of the primary task. Here we examine whether such processing is observed when no such overlap is present but sounds carry some relevance to the participants’ biological need to eat when hungry. We report the results of an experiment in which hungry and satiated participants partook in a cross-modal oddball task in which they categorized visual digits (odd/even) while ignoring task-irrelevant sounds. On most trials the irrelevant sound was a sinewave tone (standard sound). On the remaining trials, deviant sounds consisted of spoken words related to food (food deviants) or control words (control deviants). Questionnaire data confirmed state (but not trait) differences between the two groups with respect to food craving, as well as a greater desire to eat the food corresponding to the food-related words in the hungry relative to the satiated participants. The results of the oddball task revealed that food deviants produced greater distraction (longer response times) than control deviants in hungry participants while the reverse effect was observed in satiated participants. This effect was observed in the first block of trials but disappeared thereafter, reflecting semantic saturation. Our results suggest that (1) the semantic content of deviant sounds is involuntarily processed even when sharing no feature with the primary task; and that (2) distraction by deviant sounds can be modulated by the participants’ biological needs.

Auditory event-related responses to diphthongs in different attention conditions

The modulation of auditory event-related potentials (ERP) by attention generally results in larger amplitudes when stimuli are attended. We measured the P1-N1-P2 acoustic change complex elicited with synthetic overt (second formant, F2Δ=1000Hz) and subtle (F2Δ=100Hz) diphthongs, while subjects (i) attended to the auditory stimuli, (ii) ignored the auditory stimuli and watched a film, and (iii) diverted their attention to a visual discrimination task. Responses elicited by diphthongs where F2 values rose and fell were found to be different and this precluded their combined analysis. Multivariate analysis of ERP components from the rising F2 changes showed main effects of attention on P2 amplitude and latency, and N1-P2 amplitude. P2 amplitude decreased by 40% between the attend and ignore conditions, and by 60% between the attend and divert conditions. The effect of diphthong magnitude was significant for components from a broader temporal window which included P1 latency and N1 amplitude. N1 latency did not vary between attention conditions, a finding that may be related to stimulation with a continuous vowel. These data show that a discernible P1-N1-P2 response can be observed to subtle vowel quality transitions, even when the attention of a subject is diverted to an unrelated visual task.

Re-examining overlap between tactile and visual motion responses within hMT + and STS

Here, we examine overlap between tactile and visual motion BOLD responses within the human MT+ complex. Although several studies have reported tactile responses overlapping with hMT+, many used group average analyses, leaving it unclear whether these responses were restricted to subregions of hMT+. Moreover, previous studies either employed a tactile task or passive stimulation, leaving it unclear whether or not tactile responses in hMT+ are simply the consequence of visual imagery. Here, we carried out a replication of one of the classic papers finding tactile responses in hMT+. We mapped MT and MST in individual subjects using visual field localizers. We then examined responses to tactile motion on the arm, either presented passively or in the presence of a visual task performed at fixation designed to minimize visualization of the concurrent tactile stimulation. To our surprise, without a visual task, we found only weak tactile motion responses in MT (6% of voxels showing tactile responses) and MST (2% of voxels). With an unrelated visual task designed to withdraw attention from the tactile modality, responses in MST were reduced to almost nothing (<1% regions). Consistent with previous results, we did observe tactile responses in STS regions superior and anterior to hMT+. Despite the lack of individual overlap, group-averaged responses produced strong spurious overlap between tactile and visual motion responses within hMT+ that resembled those observed in previous studies. The weak nature of tactile responses in hMT+ (and their abolition by withdrawal of attention) suggests that hMT+ may not serve as a supramodal motion processing module.

The semantic aftermath of distraction by deviant sounds: Crosstalk interference is mediated by the predictability of semantic congruency

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task. This deviance distraction effect emerges because deviant sounds violate the cognitive system’s predictions. In this study we sought to examine whether predictability also mediate the so-called semantic effect whereby behavioral performance suffers from the clash between the involuntary semantic evaluation of irrelevant sounds and the voluntary processing of visual targets (e.g., when participants must categorize a right visual arrow following the presentation of the deviant sound “left”). By manipulating the conditional probabilities of the congruent and incongruent deviant sounds in a left/right arrow categorization task, we elicited implicit predictions about the upcoming target and related response. We observed a linear increase of the semantic effect with the proportion of congruent deviant trials (i.e., as deviant sounds increasingly predicted congruent targets). We conclude that deviant sounds affect response times based on a combination of crosstalk interference and two types of prediction violations: stimulus violations (violations of predictions regarding the identity of upcoming irrelevant sounds) and semantic violations (violations of predictions regarding the target afforded by deviant sounds). We report a three-parameter model that captures all key features of the observed RTs. Overall, our results fit with the view that the brain builds forward models of the environment in order to optimize cognitive processing and that control of one’s attention and actions is called upon when predictions are violated.This article is part of a Special Issue entitled SI: Prediction and Attention.

A dual contribution to the involuntary semantic processing of unexpected spoken words.

Sounds are a major cause of distraction. Unexpected to-be-ignored auditory stimuli presented in the context of an otherwise repetitive acoustic background ineluctably break through selective attention and distract people from an unrelated visual task (deviance distraction). This involuntary capture of attention by deviant sounds has been hypothesized to trigger their semantic appraisal and, in some circumstances, interfere with ongoing performance, but it remains unclear how such processing compares with the automatic processing of distractors in classic interference tasks (e.g., Stroop, flanker, Simon tasks). Using a cross-modal oddball task, we assessed the involuntary semantic processing of deviant sounds in the presence and absence of deviance distraction. The results revealed that some involuntary semantic analysis of spoken distractors occurs in the absence of deviance distraction but that this processing is significantly greater in its presence. We conclude that the automatic processing of spoken distractors reflects 2 contributions, one that is contingent upon deviance distraction and one that is independent from it.

Persistent affective biases in human amygdala response following implicit priming with negative emotion concepts

To what extent do past experiences shape our behaviors, perceptions, and thoughts even without explicit knowledge of these influences? Behavioral research has demonstrated that various cognitive processes can be influenced by conceptual representations implicitly primed during a preceding and unrelated task. Here we investigated whether emotion processing might also be influenced by prior incidental exposure to negative semantic material and which neural substrates would mediate these effects. During a first (priming) task, participants performed a variant of the hangman game with either negative or neutral emotion-laden words. Subsequently, they performed a second, unrelated visual task with fearful and neutral faces presented at attended or unattended locations. Participants were generally not aware of any relationships between the two tasks. We found that priming with emotional words enhanced amygdala sensitivity to faces in the subsequent visual task, while decreasing discriminative responses to threat. Furthermore, the magnitude of the induced bias in behavior and amygdala activation was predicted by the effectiveness of semantic access observed in the priming task. This demonstrates that emotional processing can be modulated by implicit influence of environmental information processed at an earlier time, independently of volitional control.

Distraction by Auditory Novelty

The unexpected occurrence of an oddball auditory stimulus (novel) among an otherwise repeated stream of sounds (standards) is known to impact negatively on participants’ performance in an unrelated visual task. The present study sought to test new predictions emerging from Parmentier’s (2008) model of distraction by auditory novelty. Participants categorized the direction of visual arrows preceded by a task-irrelevant sound. Two time intervals between distractor and target were tested in separate blocks of trials. Rare auditory novels consisted of the words “left” or “right”, which were either congruent or incongruent with the upcoming target. The data confirmed the slowing of response in the face of a novel (novelty distraction) as well as, on incongruent trials, a further delay due to cross-talk interference between distractor and target (semantic effect). More importantly, and in line with our predictions, the results further showed that (1) the semantic effect, but not novelty distraction, increased with the time interval between distractor and target; and that (2) the production of a response on the first standard trial following a novel trial was slowed if that response required the activation of a recently inhibited network (post-novelty semantic effect). Overall, the data lend support to the view that behavioral distraction by auditory novelty reflects a mosaic of contributors, the effects of which can ripple across trials.

Hearing Without Listening: Functional Connectivity Reveals the Engagement of Multiple Nonauditory Networks During Basic Sound Processing

The present functional magnetic resonance imaging (fMRI) study presents data challenging the traditional view that sound is processed almost exclusively in the classical auditory pathway unless imbued with behavioral significance. In a first experiment, subjects were presented with broadband noise in on/off fashion as they performed an unrelated visual task. A conventional analysis assuming predictable sound-evoked responses demonstrated a typical activation pattern that was confined to classical auditory centers. In contrast, spatial independent component analysis (sICA) disclosed multiple networks of acoustically responsive brain centers. One network comprised classical auditory centers, but four others included nominally "nonauditory" areas: cingulo-insular cortex, mediotemporal limbic lobe, basal ganglia, and posterior orbitofrontal cortex, respectively. Functional connectivity analyses confirmed the sICA results by demonstrating coordinated activity between the involved brain structures. In a second experiment, fMRI data obtained from unstimulated (i.e., resting) subjects revealed largely similar networks. Together, these two experiments suggest the existence of a coordinated system of multiple acoustically responsive intrinsic brain networks, comprising classical auditory centers but also other brain areas. Our results suggest that nonauditory centers play a role in sound processing at a very basic level, even when the sound is not intertwined with behaviors requiring the well-known functionality of these regions.

The Involuntary Capture of Attention by Sound

The presentation of auditory oddball stimuli (novels) among otherwise repeated sounds (standards) triggers a well-identified chain of electrophysiological responses: The detection of acoustic change (mismatch negativity), the involuntary orientation of attention to (P3a) and its reorientation from the novel. Behaviorally, novels reduce performance in an unrelated visual task (novelty distraction). Past studies of the cross-modal capture of attention by acoustic novelty have typically discarded from their analysis the data from the standard trials immediately following a novel, despite some evidence in mono-modal oddball tasks of distraction extending beyond the presentation of deviants/novels (postnovelty distraction). The present study measured novelty and postnovelty distraction and examined the hypothesis that both types of distraction may be underpinned by common frontally-related processes by comparing young and older adults. Our data establish that novels delayed responses not only on the current trial and but also on the subsequent standard trial. Both of these effects increased with age. We argue that both types of distraction relate to the reconfiguration of task-sets and discuss this contention in relation to recent electrophysiological studies.

Towards a cognitive model of distraction by auditory novelty: The role of involuntary attention capture and semantic processing

Unexpected auditory stimuli are potent distractors, able to break through selective attention and disrupt performance in an unrelated visual task. This study examined the processing fate of novel sounds by examining the extent to which their semantic content is analyzed and whether the outcome of this processing can impact on subsequent behavior. This issue was investigated across five laboratory experiments in which participants categorized visual left and right arrows while instructed to ignore irrelevant sounds. The results showed that auditory novels that were incongruent with the visual target (e.g., word “left” presented before a right arrow) disrupted performance over and above congruent novels (semantic effect) while both types of novels delayed responses in the visual task compared to a standard sound (novelty effect). No semantic effect was observed for congruent and incongruent standards, suggesting that novelty detection is necessary for involuntary semantic processing to unravel. While the novelty effect augmented as the difference between novels and the standard increased, the semantic effect was immune to this variation. Furthermore, the novelty effect decreased across the task while the semantic effect did not. A general cognitive framework is proposed encompassing these new findings and previous work in an attempt to account for the behavioral impact of irrelevant auditory novels on primary task performance.