Memory Saccade Task Research Articles

Eye position signals in the dorsal pulvinar during fixation and goal-directed saccades.

Sensorimotor cortical areas contain eye position information thought to ensure perceptual stability across saccades and underlie spatial transformations supporting goal-directed actions. One pathway by which eye position signals could be relayed to and across cortical areas is via the dorsal pulvinar. Several studies have demonstrated saccade-related activity in the dorsal pulvinar, and we have recently shown that many neurons exhibit postsaccadic spatial preference. In addition, dorsal pulvinar lesions lead to gaze-holding deficits expressed as nystagmus or ipsilesional gaze bias, prompting us to investigate the effects of eye position. We tested three starting eye positions (-15°, 0°, 15°) in monkeys performing a visually cued memory saccade task. We found two main types of gaze dependence. First, ~50% of neurons showed dependence on static gaze direction during initial and postsaccadic fixation, and might be signaling the position of the eyes in the orbit or coding foveal targets in a head/body/world-centered reference frame. The population-derived eye position signal lagged behind the saccade. Second, many neurons showed a combination of eye-centered and gaze-dependent modulation of visual, memory, and saccadic responses to a peripheral target. A small subset showed effects consistent with eye position-dependent gain modulation. Analysis of reference frames across task epochs from visual cue to postsaccadic fixation indicated a transition from predominantly eye-centered encoding to representation of final gaze or foveated locations in nonretinocentric coordinates. These results show that dorsal pulvinar neurons carry information about eye position, which could contribute to steady gaze during postural changes and to reference frame transformations for visually guided eye and limb movements.NEW & NOTEWORTHY Work on the pulvinar focused on eye-centered visuospatial representations, but position of the eyes in the orbit is also an important factor that needs to be taken into account during spatial orienting and goal-directed reaching. We show that dorsal pulvinar neurons are influenced by eye position. Gaze direction modulated ongoing firing during stable fixation, as well as visual and saccade responses to peripheral targets, suggesting involvement of the dorsal pulvinar in spatial coordinate transformations.

Two subdivisions of macaque LIP process visual-oculomotor information differently

Although the cerebral cortex is thought to be composed of functionally distinct areas, the actual parcellation of area and assignment of function are still highly controversial. An example is the much-studied lateral intraparietal cortex (LIP). Despite the general agreement that LIP plays an important role in visual-oculomotor transformation, it remains unclear whether the area is primary sensory- or motor-related (the attention-intention debate). Although LIP has been considered as a functionally unitary area, its dorsal (LIPd) and ventral (LIPv) parts differ in local morphology and long-distance connectivity. In particular, LIPv has much stronger connections with two oculomotor centers, the frontal eye field and the deep layers of the superior colliculus, than does LIPd. Such anatomical distinctions imply that compared with LIPd, LIPv might be more involved in oculomotor processing. We tested this hypothesis physiologically with a memory saccade task and a gap saccade task. We found that LIP neurons with persistent memory activities in memory saccade are primarily provoked either by visual stimulation (vision-related) or by both visual and saccadic events (vision-saccade-related) in gap saccade. The distribution changes from predominantly vision-related to predominantly vision-saccade-related as the recording depth increases along the dorsal-ventral dimension. Consistently, the simultaneously recorded local field potential also changes from visual evoked to saccade evoked. Finally, local injection of muscimol (GABA agonist) in LIPv, but not in LIPd, dramatically decreases the proportion of express saccades. With these results, we conclude that LIPd and LIPv are more involved in visual and visual-saccadic processing, respectively.

Effects of Pulvinar Inactivation on Spatial Decision-making between Equal and Asymmetric Reward Options

The ability to selectively process visual inputs and to decide between multiple movement options in an adaptive manner is critical for survival. Such decisions are known to be influenced by factors such as reward expectation and visual saliency. The dorsal pulvinar connects to a multitude of cortical areas that are involved in visuospatial memory and integrate information about upcoming eye movements with expected reward values. However, it is unclear whether the dorsal pulvinar is critically involved in spatial memory and reward-based oculomotor decision behavior. To examine this, we reversibly inactivated the dorsal portion of the pulvinar while monkeys performed a delayed memory saccade task that included choices between equally or unequally rewarded options. Pulvinar inactivation resulted in a delay of saccade initiation toward memorized contralesional targets but did not affect spatial memory. Furthermore, pulvinar inactivation caused a pronounced choice bias toward the ipsilesional hemifield when the reward value in the two hemifields was equal. However, this choice bias could be alleviated by placing a high reward target into the contralesional hemifield. The bias was less affected by the manipulation of relative visual saliency between the two competing targets. These results suggest that the dorsal pulvinar is involved in determining the behavioral desirability of movement goals while being less critical for spatial memory and reward processing.

Distinct neural mechanisms of distractor suppression in the frontal and parietal lobe

The posterior parietal cortex and the prefrontal cortex are associated with eye movements and visual attention, but their specific contributions are poorly understood. We compared the dorsolateral prefrontal cortex (dlPFC) and the lateral intraparietal area (LIP) in monkeys using a memory saccade task in which a salient distractor flashed at a variable timing and location during the memory delay. We found that the two areas had similar responses to target selection, but made distinct contributions to distractor suppression. Distractor responses were more strongly suppressed and more closely correlated with performance in the dlPFC relative to LIP. Moreover, reversible inactivation of the dlPFC produced much larger increases in distractibility than inactivation of LIP. These findings suggest that LIP and dlPFC mediate different aspects of selective attention. Although both areas can contribute to the perceptual selection of salient information, the dlPFC has a decisive influence on whether and how attended stimulus is linked with actions.

Vector subtraction and eye position gainfields in macaque frontal eye field

Spatially accurate saccade planning and perceptual localization require the integration of retinal and extraretinal signals. The way that retinal and extraretinal signals are combined determines the specific computation that is performed. For vector addition, retinal and extraretinal signals are spatially correlated, while for vector subtraction, the signals are anti-correlated. To characterize the interaction of retinal and extraretinal signals, we trained 3 macaque monkeys to perform a delayed visually guided saccade task in which both target eccentricity and initial eye position were varied. We recorded from 70 neurons in frontal eye field. We first tested cells with a delayed memory saccade task to determine the receptive/movement field. Then, using the visually-guided saccade task, we determined the eye position sensitivity and retinal sensitivity for neuronal responses during the visual and pre-saccadic task epochs. These sensitivities give an estimate of the gain field and the retinal receptive field of the neurons respectively. We found that the initial response to the saccade target was modulated by initial eye position in 51/70 (73%) neurons. In 47/70 (67%), the retinal and eye position signals were spatially anti-correlated and thus satisfied the constraint appropriate for vector subtraction, while 4/70 (6%) satisfied the vector addition constraint. Presaccadic activity was modulated by initial eye position in 42/70 (60%) neurons. Spatially anti-correlated retinal and extraretinal signals were found in 30/70 (43%) neurons, while correlated signals were found in 12/70 (17%) neurons. Across the population, the manner in which retinal and extraretinal signals are combined in FEF strongly favors vector subtraction rather than addition. The results are consistent with a model in which vector subtraction is computed from the responses of a network of cells with retinal receptive fields that are modulated by eye position in a gainfield-like manner.

Human sound localization: measurements in untrained, head-unrestrained subjects using gaze as a pointer

Studies of sound localization in humans have used various behavioral measures to quantify the observers' perceptions; a non-comprehensive list includes verbal reports, head pointing, gun pointing, stylus pointing, and laser aiming. Comparison of localization performance reveals that in humans, just as in animals, different results are obtained with different experimental tasks. Accordingly, to circumvent problems associated with task selection and training, this study used gaze, an ethologically valid behavior for spatial pointing in species with a specialized area of the fovea, to measure sound localization perception of human subjects. Orienting using gaze as a pointer does not require training, preserves the natural link between perception and action, and allows for direct behavioral comparisons across species. The results revealed, unexpectedly, a large degree of variability across subjects in both accuracy and precision. The magnitude of the average angular localization errors for the most eccentric horizontal targets, however, were very similar to those documented in studies that used head pointing, whereas the magnitude of the localization errors for the frontal targets were considerably larger. In addition, an overall improvement in sound localization in the context of the memory-saccade task, as well as a lack of effect of initial eye and head position on perceived sound location were documented.

Cognitive Signals in the Primate Motor Thalamus Predict Saccade Timing

We often generate movements without any external event that immediately triggers them. How the brain decides the timing of self-initiated movements remains unclear. Previous studies suggest that the basal ganglia-thalamocortical pathways play this role, but the subcortical signals that determine movement timing have not been identified. The present study reports that a subset of thalamic neurons predicts the timing of self-initiated saccadic eye movements. When monkeys made a saccade in response to the fixation point (FP) offset in the traditional memory saccade task, neurons in the ventrolateral and the ventroanterior nuclei of the thalamus exhibited a gradual buildup of activity that peaked around the most probable time of the FP offset; however, neither the timing nor the magnitude of neuronal activity correlated with saccade latencies, suggesting that the brain is unlikely to have used this information to decide the times of saccades in the traditional memory saccade task. In contrast, when monkeys were required to make a self-timed saccade within a fixed time interval after an external cue, the same neurons again exhibited a strong buildup of activity that preceded saccades by several hundred milliseconds, showing a close correlation between the times of neuronal activity and the times of self-initiated saccades. The results suggest that neurons in the motor thalamus carry subjective time information, which is used by cortical networks to determine the timing of self-initiated saccades.

A Method for Detection and Classification of Events in Neural Activity

We present a method for the real time prediction of punctuate events in neural activity, based on the time-frequency spectrum of the signal, applicable both to continuous processes like local field potentials (LFPs) as well as to spike trains. We test it on recordings of LFP and spiking activity acquired previously from the lateral intraparietal area (LIP) of macaque monkeys performing a memory-saccade task. In contrast to earlier work, where trials with known start times were classified, our method detects and classifies trials directly from the data. It provides a means to quantitatively compare and contrast the content of LFP signals and spike trains: we find that the detector performance based on the LFP matches the performance based on spike rates. The method should find application in the development of neural prosthetics based on the LFP signal. Our approach uses a new feature vector, which we call the 2d cepstrum.

Deficits and Recovery in Visuospatial Memory During Head Motion After Bilateral Labyrinthine Lesion

To keep a stable internal representation of the environment as we move, extraretinal sensory or motor cues are critical for updating neural maps of visual space. Using a memory-saccade task, we studied whether visuospatial updating uses vestibular information. Specifically, we tested whether trained rhesus monkeys maintain the ability to update the conjugate and vergence components of memory-guided eye movements in response to passive translational or rotational head and body movements after bilateral labyrinthine lesion. We found that lesioned animals were acutely compromised in generating the appropriate horizontal versional responses necessary to update the directional goal of memory-guided eye movements after leftward or rightward rotation/translation. This compromised function recovered in the long term, likely using extravestibular (e.g., somatosensory) signals, such that nearly normal performance was observed 4 mo after the lesion. Animals also lost their ability to adjust memory vergence to account for relative distance changes after motion in depth. Not only were these depth deficits larger than the respective effects on version, but they also showed little recovery. We conclude that intact labyrinthine signals are functionally useful for proper visuospatial memory updating during passive head and body movements.

Radial motion bias in macaque frontal eye field

The visual responsiveness and spatial tuning of frontal eye field (FEF) neurons were determined using a delayed memory saccade task. Neurons with visual responses were then tested for direction selectivity using moving random dot patterns centered in the visual receptive field. The preferred axis of motion showed a significant tendency to be aligned with the receptive-field location so as to favor motion toward or away from the center of gaze. Centrifugal (outward) motion was preferred over centripetal motion. Motion-sensitive neurons in FEF thus appear to have a direction bias at the population level. This bias may facilitate the detection or discrimination of expanding optic flow patterns. The direction bias is similar to that seen in visual area MT and in posterior parietal cortex, from which FEF receives afferent projections. The outward motion bias may explain asymmetries in saccades made to moving targets. A representation of optic flow in FEF might be useful for planning eye movements during navigation.

Effects of electrical microstimulation in monkey frontal eye field on saccades to remembered targets

Spatially selective delay activity in the frontal eye field (FEF) is hypothesized to be part of a mechanism for the transformation of visual signals into instructions for voluntary movements. To understand the linkage between FEF activity and eye movement planning, we recorded neuronal responses of FEF neurons while monkeys performed a memory-saccade task. We then electrically stimulated the same sites during the memory-delay epoch of the task. The stimulation currents used were subthreshold for evoking saccades during a gap-fixation task. Microstimulation resulted in changes in the spatial and temporal components of saccade parameters: an increase in latency, and a shift in amplitude and direction. We performed a vector analysis to determine the relative influence of the visual cue and electrical stimulus on the memory-saccade. In general, the memory-saccade was strongly weighted toward the visual cue direction, yet the electrical stimulus introduced a consistent bias away from the receptive/movement field of the stimulation site. The effects of sub-threshold stimulation were consistent with a combination of vector subtraction and averaging, but not with vector summation. Vector subtraction may play a role in spatial updating of movement plans for memory-guided saccades when eye position changes during the memory period.

Visuospatial Memory Computations During Whole-Body Rotations in Roll

We used a memory-saccade task to test whether the location of a target, briefly presented before a whole-body rotation in roll, is stored in egocentric or in allocentric coordinates. To make this distinction, we exploited the fact that subjects, when tilted sideways in darkness, make systematic errors when indicating the direction of gravity (an allocentric task) even though they have a veridical percept of their self-orientation in space. We hypothesized that if spatial memory is coded allocentrically, these distortions affect the coding of remembered targets and their readout after a body rotation. Alternatively, if coding is egocentric, updating for body rotation becomes essential and errors in performance should be related to the amount of intervening rotation. Subjects (n = 6) were tested making saccades to remembered world-fixed targets after passive body tilts. Initial and final tilt angle ranged between -120 degrees CCW and 120 degrees CW. The results showed that subjects made large systematic directional errors in their saccades (up to 90 degrees ). These errors did not occur in the absence of intervening body rotation, ruling out a memory degradation effect. Regression analysis showed that the errors were closely related to the amount of subjective allocentric distortion at both the initial and final tilt angle, rather than to the amount of intervening rotation. We conclude that the brain uses an allocentric reference frame, possibly gravity-based, to code visuospatial memories during whole-body tilts. This supports the notion that the brain can define information in multiple frames of reference, depending on sensory inputs and task demands.

Primate Memory Saccade Amplitude After Intervened Motion Depends on Target Distance

To keep a stable internal representation of the visual world as our eyes, head, and body move around, humans and monkeys must continuously adjust neural maps of visual space using extraretinal sensory or motor cues. When such movements include translation, the amount of body displacement must be weighted differently in the updating of far versus near targets. Using a memory-saccade task, we have investigated whether nonhuman primates can benefit from this geometry when passively moved sideways. We report that monkeys made appropriate memory saccades, taking into account not only the amplitude and nature (rotation vs. translation) of the movement, but also the distance of the memorized target: i.e., the amplitude of memory saccades was larger for near versus far targets. The scaling by viewing distance, however, was less than geometrically required, such that memory saccades consistently undershot near targets. Such a less-than-ideal scaling of memory saccades is reminiscent of the viewing distance-dependent properties of the vestibuloocular reflex. We propose that a similar viewing distance-dependent vestibular signal is used as an extraretinal compensation for the visuomotor consequences of the geometry of motion parallax by scaling both memory saccades and reflexive eye movements during motion through space.

A Model for Intracortical Visual Prosthesis Research

In the field of visual prosthesis research, it has generally been held that animal models are limited to testing the safety of implantable hardware due to the inability of the animal to provide a linguistic report of perceptions. In contrast, vision scientists make extensive use of trained animal models to investigate the links between visual stimuli, neural activities, and perception. We describe an animal model for cortical visual prosthesis research in which novel animal psychophysical testing has been employed to compensate for the lack of a linguistic report. One hundred and fifty-two intracortical microelectrodes were chronically implanted in area V1 of a male macaque. Receptive field mapping was combined with eye-tracking to develop a reward-based training procedure. The animal was trained to use electrically induced point-flash percepts, called phosphenes, in performing a memory saccade task. It is our long-term goal to use this animal model to investigate stimulation strategies in developing a multichannel sensory cortical interface.

Parietal representation of object-based saccades.

When monkeys make saccadic eye movements to simple visual targets, neurons in the lateral intraparietal area (LIP) display a retinotopic, or eye-centered, coding of the target location. However natural saccadic eye movements are often directed at objects or parts of objects in the visual scene. In this paper we investigate whether LIP represents saccadic eye movements differently when the target is specified as part of a visually displayed object. Monkeys were trained to perform an object-based saccade task that required them to make saccades to previously cued parts of an abstract object after the object reappeared in a new orientation. We recorded single neurons in area LIP of two macaque monkeys and analyzed their activity in the object-based saccade task, as well as two control tasks: a standard memory saccade task and a fixation task with passive object viewing. The majority of LIP neurons that were tuned in the memory saccade task were also tuned in the object-based saccade task. Using a hierarchical generalized linear model analysis, we compared the effects of three different spatial variables on the firing rate: the retinotopic location of the target, the object-fixed location of the target, and the orientation of the object in space. There was no evidence of an explicit object-fixed representation in the activity in LIP during either of the object-based tasks. In other words, no cells had receptive fields that rotated with the object. While some cells showed a modulation of activity due to the location of the target on the object, these variations were small compared to the retinotopic effects. For most cells, firing rates were best accounted for by either the retinotopic direction of the movement, the orientation of the object, or both spatial variables. The preferred direction of these retinotopic and object orientation effects were found to be invariant across tasks. On average, the object orientation effects were consistent with the retinotopic coding of potential target locations on the object. This interpretation is supported by the fact that the magnitude of these two effects were roughly equal in the early portions of the trial, but around the time of the motor response, the retinotopic effects dominated. We conclude that LIP uses the same retinotopic coding of saccade target whether the target is specified as an absolute point in space or as a location on a moving object.

Temporal structure in neuronal activity during working memory in macaque parietal cortex.

Many cortical structures have elevated firing rates during working memory, but it is not known how the activity is maintained. To investigate whether reverberating activity is important, we studied the temporal structure of local field potential (LFP) activity and spiking from area LIP in two awake macaques during a memory-saccade task. Using spectral analysis, we found spatially tuned elevated power in the gamma band (25-90 Hz) in LFP and spiking activity during the memory period. Spiking and LFP activity were also coherent in the gamma band but not at lower frequencies. Finally, we decoded LFP activity on a single-trial basis and found that LFP activity in parietal cortex discriminated between preferred and anti-preferred direction with approximately the same accuracy as the spike rate and predicted the time of a planned movement with better accuracy than the spike rate. This finding could accelerate the development of a cortical neural prosthesis.

Spike train coherence in macaque parietal cortex during a memory saccade task

The dynamics of cell-to-cell interactions as measured by the coherence between spike trains can help elucidate local circuitry and phases of operation for networks of neurons. We compute the coherence between pairs of spike trains collected from macaque area LIP during a memory saccade task. Significant coherence is found for frequencies below 50Hz, and time lags less than ±10ms. The mean coherence, as examined in both the time and frequency domains for a sliding window, undergoes changes which correspond to behavioral events, but are not necessarily linked to the mean firing rates of the recorded cells. Our results suggest that the maintenance of memory activity is done through a different mechanism than sensory response and saccade generation.

Responses to auditory stimuli in macaque lateral intraparietal area. II. Behavioral modulation.

The lateral intraparietal area (LIP), a region of posterior parietal cortex, was once thought to be unresponsive to auditory stimulation. However, recent reports have indicated that neurons in area LIP respond to auditory stimuli during an auditory-saccade task. To what extent are auditory responses in area LIP dependent on the performance of an auditory-saccade task? To address this question, recordings were made from 160 LIP neurons in two monkeys while the animals performed auditory and visual memory-saccade and fixation tasks. Responses to auditory stimuli were significantly stronger during the memory-saccade task than during the fixation task, whereas responses to visual stimuli were not. Moreover, neurons responsive to auditory stimuli tended also to be visually responsive and to exhibit delay or saccade activity in the memory-saccade task. These results indicate that, in general, auditory responses in area LIP are modulated by behavioral context, are associated with visual responses, and are predictive of delay or saccade activity. Responses to auditory stimuli in area LIP may therefore be best interpreted as supramodal responses, and similar in nature to the delay activity, rather than as modality-specific sensory responses. The apparent link between auditory activity and oculomotor behavior suggests that the behavioral modulation of responses to auditory stimuli in area LIP reflects the selection of auditory stimuli as targets for eye movements.

Response-locked changes in auto- and cross-covariations in parietal cortex

Action potentials from small groups of physically adjacent neurons were recorded from the parietal cortex of two rhesus macaques performing a memory saccade task. Recordings were made using tetrodes and sorted into spike trains from individual cells. Auto- and crosscovariograms of spike times for individual cells and simultaneously recorded pairs of cells, respectively, show modulations synchronized with behavioral events consistent with visual, memory, and perisaccadic activity.

Motor intention activity in the macaque's lateral intraparietal area. I. Dissociation of motor plan from sensory memory.

1. The lateral intraparietal area (area LIP) of the monkey's posterior parietal cortex (PPC) contains neurons that are active during saccadic eye movements. These neurons' activity includes visual and saccade-related components. These responses are spatially tuned and the location of a neuron's visual receptive field (RF) relative to the fovea generally overlaps its preferred saccade amplitude and direction (i.e., its motor field, MF). When a delay is imposed between the presentation of a visual stimulus and a saccade made to its location (memory saccade task), many LIP neurons maintain elevated activity during the delay (memory activity, M), which appears to encode the metrics of the next intended saccadic eye movements. Recent studies have alternatively suggested that LIP neurons encode the locations of visual stimuli regardless of where the animal intends to look. We examined whether the M activity of LIP neurons specifically encodes movement intention or the locations of recent visual stimuli, or a combination of both. In the accompanying study, we investigated whether the intended-movement activity reflects changes in motor plan. 2. We trained monkeys (Macaca mulatta) to memorize the locations of two visual stimuli and plan a sequence of two saccades, one to each remembered target, as we recorded the activity of single LIP neurons. Two targets were flashed briefly while the monkey maintained fixation; after a delay the fixation point was extinguished, and the monkey made two saccades in sequence to each target's remembered location, in the order in which the targets were presented. This "delayed double saccade" (DDS) paradigm allowed us to dissociate the location of visual stimulation from the direction of the planned saccade and thus distinguish neuronal activity related to the target's location from activity related to the saccade plan. By imposing a delay, we eliminated the confounding effect of any phasic responses coincident with the appearance of the stimulus and with the saccade. 3. We arranged the two visual stimuli so that in one set of conditions at least the first one was in the neuron's visual RF, and thus the first saccade was in the neuron's motor field (MF). M activity should be high in these conditions according to both the sensory memory and motor plan hypotheses. In another set of conditions, the second stimulus appeared in the RF but the first one was presented outside the RF, instructing the monkey to plan the first saccade away from the neuron's MF. If the M activity encodes the motor plan, it should be low in these conditions, reflecting the plan for the first saccade (away from the MF). If it is a sensory trace of the stimulus' location, it should be high, reflecting stimulation of the RF by the second target. 4. We tested 49 LIP neurons (in 3 hemispheres of 2 monkeys) with M activity on the DDS task. Of these, 38 (77%) had M activity related to the next intended saccade. They were active in the delay period, as expected, if the first saccade was in their preferred direction. They were less active or silent if the next saccade was not in their preferred direction, even when the second stimulus appeared in their RF. 5. The M activity of 8 (16%) of the remaining neurons specifically encoded the location of the most recent visual stimulus. Their firing rate during the delay reflected stimulation of the RF independently of the saccade being planned. The remaining 3 neurons had M activity that did not consistently encode either the next saccade or the stimulus' location. 6. We also recorded the activity of a subset of neurons (n = 38) in a condition in which no stimulus appeared in a neuron's RF, but the second saccade was in the neuron's MF. In this case the majority of neurons tested (23/38, 60%) became active in the period between the first and second saccade, even if neither stimulus had appeared in their RF. Moreover, this activity appeared only after the first saccade had started in all but two of