Covert Visuospatial Attention Research Articles

Navigation of a Telepresence Robot via Covert Visuospatial Attention and Real-Time fMRI

Brain–computer interfaces (BCIs) allow people with severe neurological impairment and without ability to control their muscles to regain some control over their environment. The BCI user performs a mental task to regulate brain activity, which is measured and translated into commands controlling some external device. We here show that healthy participants are capable of navigating a robot by covertly shifting their visuospatial attention. Covert Visuospatial Attention (COVISA) constitutes a very intuitive brain function for spatial navigation and does not depend on presented stimuli or on eye movements. Our robot is equipped with motors and a camera that sends visual feedback to the user who can navigate it from a remote location. We used an ultrahigh field MRI scanner (7 Tesla) to obtain fMRI signals that were decoded in real time using a support vector machine. Four healthy subjects with virtually no training succeeded in navigating the robot to at least three of four target locations. Our results thus show that with COVISA BCI, realtime robot navigation can be achieved. Since the magnitude of the fMRI signal has been shown to correlate well with the magnitude of spectral power changes in the gamma frequency band in signals measured by intracranial electrodes, the COVISA concept may in future translate to intracranial application in severely paralyzed people.Electronic supplementary materialThe online version of this article (doi:10.1007/s10548-012-0252-z) contains supplementary material, which is available to authorized users.

Time-dependent approach for single trial classification of covert visuospatial attention

Recently, several studies have started to explore covert visuospatial attention as a control signal for brain–computer interfaces (BCIs). Covert visuospatial attention represents the ability to change the focus of attention from one point in the space without overt eye movements. Nevertheless, the full potential and possible applications of this paradigm remain relatively unexplored. Voluntary covert visuospatial attention might allow a more natural and intuitive interaction with real environments as neither stimulation nor gazing is required. In order to identify brain correlates of covert visuospatial attention, classical approaches usually rely on the whole α-band over long time intervals. In this work, we propose a more detailed analysis in the frequency and time domains to enhance classification performance. In particular, we investigate the contribution of α sub-bands and the role of time intervals in carrying information about visual attention. Previous neurophysiological studies have already highlighted the role of temporal dynamics in attention mechanisms. However, these important aspects are not yet exploited in BCI. In this work, we studied different methods that explicitly cope with the natural brain dynamics during visuospatial attention tasks in order to enhance BCI robustness and classification performances. Results with ten healthy subjects demonstrate that our approach identifies spectro-temporal patterns that outperform the state-of-the-art classification method. On average, our time-dependent classification reaches 0.74 ± 0.03 of the area under the ROC (receiver operating characteristic) curve (AUC) value with an increase of 12.3% with respect to standard methods (0.65 ± 0.4). In addition, the proposed approach allows faster classification (<1 instead of 3 s), without compromising performances. Finally, our analysis highlights the fact that discriminant patterns are not stable for the whole trial period but are changing over short time intervals. These results support the hypothesis that visual attention information is actually indexed by subject-specific α sub-bands and is time dependent.

Real-time decoding of the direction of covert visuospatial attention

Brain–computer interfaces (BCIs) make it possible to translate a person’s intentions into actions without depending on the muscular system. Brain activity is measured and classified into commands, thereby creating a direct link between the mind and the environment, enabling, e.g., cursor control or navigation of a wheelchair or robot. Most BCI research is conducted with scalp EEG but recent developments move toward intracranial electrodes for paralyzed people. The vast majority of BCI studies focus on the motor system as the appropriate target for recording and decoding movement intentions. However, properties of the visual system may make the visual system an attractive and intuitive alternative. We report on a study investigating feasibility of decoding covert visuospatial attention in real time, exploiting the full potential of a 7 T MRI scanner to obtain the necessary signal quality, capitalizing on earlier fMRI studies indicating that covert visuospatial attention changes activity in the visual areas that respond to stimuli presented in the attended area of the visual field. Healthy volunteers were instructed to shift their attention from the center of the screen to one of four static targets in the periphery, without moving their eyes from the center. During the first part of the fMRI-run, the relevant brain regions were located using incremental statistical analysis. During the second part, the activity in these regions was extracted and classified, and the subject was given visual feedback of the result. Performance was assessed as the number of trials where the real-time classifier correctly identified the direction of attention. On average, 80% of trials were correctly classified (chance level <25%) based on a single image volume, indicating very high decoding performance. While we restricted the experiment to five attention target regions (four peripheral and one central), the number of directions can be higher provided the brain activity patterns can be distinguished. In summary, the visual system promises to be an effective target for BCI control.

Concurrent TMS-fMRI reveals dynamic interhemispheric influences of the right parietal cortex during exogenously cued visuospatial attention

We used concurrent transcranial magnetic stimulation and functional MRI (TMS-fMRI) during a visuospatial cueing paradigm in humans, to study the causal role of the right angular gyrus (AG) as a source of attentional control. Our findings show that TMS over the right AG (high vs. low intensity) modulates neural responses interhemispherically, in a manner that varies dynamically with the current attentional condition. The behavioural impact of such TMS depended not only on the target hemifield but also on exogenous cue validity, facilitating spatial reorienting to invalidly cued right visual targets. On a neural level, right AG TMS had corresponding interhemispheric effects in the left AG and left retinotopic cortex, including area V1. We conclude that the direction of covert visuospatial attention can involve dynamic interplay between the right AG and remote interconnected regions of the opposite left hemisphere, whereas our findings also suggest that the right AG can influence responses in the retinotopic visual cortex.

Studying the Role of Human Parietal Cortex in Visuospatial Attention with Concurrent TMS-fMRI

Combining transcranial magnetic stimulation (TMS) with concurrent functional magnetic resonance imaging (fMRI) allows study of how local brain stimulation may causally affect activity in remote brain regions. Here, we applied bursts of high- or low-intensity TMS over right posterior parietal cortex, during a task requiring sustained covert visuospatial attention to either the left or right hemifield, or in a neutral control condition, while recording blood oxygenation-level–dependent signal with a posterior MR surface coil. As expected, the active attention conditions activated components of the well-described “attention network,” as compared with the neutral baseline. Also as expected, when comparing left minus right attention, or vice versa, contralateral occipital visual cortex was activated. The critical new finding was that the impact of high- minus low-intensity parietal TMS upon these visual regions depended on the currently attended side. High- minus low-intensity parietal TMS increased the difference between contralateral versus ipsilateral attention in right extrastriate visual cortex. A related albeit less pronounced pattern was found for left extrastriate visual cortex. Our results confirm that right human parietal cortex can exert attention-dependent influences on occipital visual cortex and provide a proof of concept for the use of concurrent TMS–fMRI in studying how remote influences can vary in a purely top–down manner with attentional demands.

α-Band Electroencephalographic Activity over Occipital Cortex Indexes Visuospatial Attention Bias and Predicts Visual Target Detection

Covertly directing visual attention toward a spatial location in the absence of visual stimulation enhances future visual processing at the attended position. The neuronal correlates of these attention shifts involve modulation of neuronal "baseline" activity in early visual areas, presumably through top-down control from higher-order attentional systems. We used electroencephalography to study the largely unknown relationship between these neuronal modulations and behavioral outcome in an attention orienting paradigm. Covert visuospatial attention shifts to either a left or right peripheral position in the absence of visual stimulation resulted in differential modulations of oscillatory alpha-band (8-14 Hz) activity over left versus right posterior sites. These changes were driven by varying degrees of alpha-decreases being maximal contralateral to the attended position. When expressed as a lateralization index, these alpha-changes differed significantly between attention conditions, with negative values (alpha_right < alpha_left) indexing leftward and more positive values (alpha_left < or = alpha_right) indexing rightward attention. Moreover, this index appeared deterministic for processing of forthcoming visual targets. Collapsed over trials, there was an advantage for left target processing in accordance with an overall negative bias in alpha-index values. Across trials, left targets were detected most rapidly when preceded by negative index values. Detection of right targets was fastest in trials with most positive values. Our data indicate that collateral modulations of posterior alpha-activity, the momentary bias of visuospatial attention, and imminent visual processing are linked. They suggest that the momentary direction of attention, predicting spatial biases in imminent visual processing, can be estimated from a lateralization index of posterior alpha-activity.

Searching for the attention deficit in attention deficit hyperactivity disorder: The case of visuospatial orienting

We review all 14 extant studies of covert visuospatial attention in attention deficit hyperactivity disorder (ADHD) (total N=248). Metaanalysis showed that intriguing but isolated findings of alerting or posterior disengage deficits were too small to reliably detect with the sample sizes typically employed. Posterior move and engage operations and the vigilance sustained attention process were normal in ADHD. For exogenous cues, effect sizes for group differences were homogeneously small across all repeated-measures conditions, as were calculations of cost, benefit, and validity effects. For endogenous cues, effect sizes were heterogeneous; however, calculations of cost, benefit, and validity effects were small and homogenous. The most parsimonious conclusion may be that ADHD is not characterized by significant visual orienting dysfunction, but questions remain about the extent of anterior lateralized effects in the combined subtype and about attentional functioning in the inattentive subtype.

ILAB: a program for postexperimental eye movement analysis.

The recording and analysis of eye movements are fundamental to a diverse set of research applications, including studies in which reading, visual search, and both overt and covert visuospatial attention are examined. Software tools supplied with commonly available eye-tracking equipment have generally been limited in functionality and nonextensible. Because of this dearth of available software, ELAB was created to provide an extensible framework for analyzing various aspects of eye movements. The program consists of a series of open-source MATLAB functions. The program's data structures keep raw data, analysis preferences, and analyzed data separate, thus maintaining data fidelity and promoting extensibility.

Deficits in the endogenous control of covert visuospatial attention in children with developmental coordination disorder

Deficits in the covert orienting of visuospatial attention have been reported in children with Developmental Coordination Disorder (DCD). Using two new versions of the covert orienting of visuospatial attention task (COVAT), the study presented here sought to investigate how generalised deficits are in this domain by using longer time intervals between cue and imperative stimulus. Twenty children with DCD and 20 controls were tested on two different COVATs with the interval between cue and peripheral imperative stimulus (or stimulus onset asynchrony, SOA) of 150 and 850 ms presented in a random sequence: the first used peripheral cues and no probability information (exogenous mode) and the second used central cues and an 80% probability that imperative stimuli would appear at the cued location (endogenous mode). Results showed that the time course of covert orienting to peripheral cues was normal in both groups. For central cues, however, children with DCD were more disadvantaged by invalid cues compared with controls, regardless of SOA; this finding was consistent with a deficit in the disengage operation of directing covert attention. These results confirm and extend our earlier finding that impairments in the endogenous control of covert visuospatial attention exist in children with DCD. PsycINFO classification: 2820; 2330; 2346; 3250

Covert Orienting of Visual Spatial Attention in Attention Deficit Hyperactivity Disorder: Does Comorbidity Make a Difference?

Attentional performance in children with attention deficit hyperactivity disorder (ADHD) with and without comorbid disorders was examined using the Covert Orienting of Visuospatial Attention Task (COVAT) and the Continuous Performance Task (CPT). The relationship between these two tasks was also examined. The results showed no overall differences on the attention tasks between children with ADHD alone and those with ADHD plus other disorders. Compared to non-ADHD control children, children with ADHD showed a deficit in the disengage operation of covert visuospatial attention, suggesting a difficulty in the endogenous mode of orienting. The ADHD children also showed a general performance deficit on the CPT. Although there was a general slowing on both attention tasks in the ADHD group, there was no relationship between invalid cue effect sizes on the COVAT and the CPT measures. These results indicate that these two attention tasks may be tapping both similar and independent underlying cognitive processes in ADHD.

Covert Orienting of Visual Spatial Attention in Attention Deficit Hyperactivity Disorder: Does Comorbidity Make a Difference?

Attentional performance in children with attention deficit hyperactivity disorder (ADHD) with and without comorbid disorders was examined using the Covert Orienting of Visuospatial Attention Task (COVAT) and the Continuous Performance Task (CPT). The relationship between these two tasks was also examined. The results showed no overall differences on the attention tasks between children with ADHD alone and those with ADHD plus other disorders. Compared to non-ADHD control children, children with ADHD showed a deficit in the disengage operation of covert visuospatial attention, suggesting a difficulty in the endogenous mode of orienting. The ADHD children also showed a general performance deficit on the CPT. Although there was a general slowing on both attention tasks in the ADHD group, there was no relationship between invalid cue effect sizes on the COVAT and the CPT measures. These results indicate that these two attention tasks may be tapping both similar and independent underlying cognitive processes in ADHD.

Dissociation of covert and overt spatial attention during prehension movements: selective interference effects.

In four experiments, the influence of distractor objects on the temporal evolution of the reach-to-grasp movement toward a target object (an apple) was examined. In the first experiment, the distractor was another apple, which moved laterally behind the target and occasionally changed direction toward the target, thus becoming the to-be-grasped object. In the second and third experiments, the distractor was a stationary piece of fruit, which sometimes became the to-be-grasped object because of a change in illumination. The fourth experiment was a combination of the first two experiments. In all cases, selective interference effects on the transport and manipulation components were observed only when attention to the distractor was covert rather than overt. It is proposed that covert visuospatial attention selects information about distracting but potentially important stimuli, such that a registration of significance is accomplished without the need to process all available information.

Visual information-processing impairments in deficit and nondeficit schizophrenia.

Previous studies of covert visuospatial attention in schizophrenia suggest a subtle form of right hemispatial neglect in acutely ill patients but not in chronic, stable patients. Because of previous work documenting various visual information-processing abnormalities in deficit schizophrenia, the authors investigated whether the deficit/nondeficit categorization would help clarify the presence of visual attentional asymmetries in schizophrenia. Performance on a covert visuospatial attention task was examined in clinically stable outpatients with schizophrenia (17 in a deficit subgroup and 28 in a nondeficit subgroup) and 25 normal subjects. Peripheral cue and central cue versions of the covert visuospatial attention task, at 100-, 200-, and 800-msec intervals between cue and target, were administered a week apart. The nondeficit patients exhibited a significant and abnormal asymmetry, with slower reaction time to targets presented in the right visual field than in the left visual field. This right visual field disadvantage was found with both versions of the task, but only at the 100-msec cue-target interval. The deficit patients were slowest in overall reaction time but, similar to the normal subjects, showed no asymmetry. The results are consistent with slower visual information processing in the left compared to the right cerebral hemisphere in nondeficit schizophrenia. This finding cannot be accounted for by differences between the deficit and nondeficit subgroups in demographic characteristics, chronicity, or medication effects, nor is it secondary to generalized cognitive impairment.

Electrophysiologic correlates of visuo-spatial attention shift

We investigated neurophysiologic correlates of shifting visual attention across the visual field. Event-related potentials (ERPs) were recorded in 12 normal subjects during a visual discrimination task in which target stimuli were presented at a predictable or unpredictable location in the eccentric visual field. Subjects were obliged to shift their attention from the expected site to the unpredictable site immediately after the presentation of shifted stimuli in order to detect the change of stimulus attributes. Shifted stimuli modulated the NI component (130–200 msec), producing a larger amplitude at the posterior temporal site contralateral to the stimulus field and a smaller amplitude over the ipsilateral hemisphere. Furthermore, shifted stimuli uniquely evoked a positive ERP component with a latency of 200–300 msec, which distributed broadly over the skull maximally at the frontal and central electrode sites. Both the negative and positive components changed in amplitude as a function of shift distance and direction. These results suggest that modulations of the negative and positive deflections reflect the shift of covert visuo-spatial attention and that right hemispheric dominance does not exist at least in the early stage of shifting spatial attention.