Saccade Target Research Articles

An integrated model of word processing and eye-movement control during Chinese reading.

In the Chinese writing system, there are no interword spaces to mark word boundaries. To understand how Chinese readers conquer this challenge, we constructed an integrated model of word processing and eye-movement control during Chinese reading (CRM). The model contains a word-processing module and an eye-movement control module. The word-processing module perceives new information within the perceptual span around a fixation. The model uses the interactive activation framework (McClelland & Rumelhart, 1981) to simulate word processing, but some new assumptions were made to address the word segmentation problem in Chinese reading. All the words supported by characters in the perceptual span are activated and they compete for a winner. When one word wins the competition, it is identified and it is simultaneously segmented from text. The eye-movement control module makes the decision regarding when and where to move the eyes using the activation information of word units and character units provided by the word-processing module. The model estimates how many characters can be processed during a fixation, and then makes a saccade to somewhere beyond this point. The model successfully simulated important findings on the relation between word processing and eye-movement control, how Chinese readers choose saccade targets, how Chinese readers segment words with ambiguous boundaries, and how Chinese readers process information with parafoveal vision during Chinese sentence reading. The current model thus provides insights on how Chinese readers address some important challenges, such as word segmentation and saccade-target selection. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Rapid spatial oculomotor updating across saccades is malleable

The oculomotor system uses a sophisticated updating mechanism to adjust for large retinal displacements which occur with every saccade. Previous studies have shown that updating operates rapidly and starts before saccade is initiated. Here we used saccade adaptation to alter life-long expectations about how a saccade changes the location of an object on the retina. Participants made a sequence of one horizontal and one vertical saccade and ignored an irrelevant distractor. The time-course of oculomotor updating was estimated using saccade curvature of the vertical saccade, relative to the distractor. During the first saccade both saccade targets were shifted on 80% of trials, which induced saccade adaptation (Experiment 1). Critically, since the distractor was left stationary, successful saccade adaptation (e.g., saccade becoming shorter) meant that after the first saccade the distractor appeared in a different hemifield than without adaptation. After adaptation, second saccades curved away only from the newly learned distractor location starting at 80 ms after the first saccade. When on the minority of trials (20%) the targets were not shifted, saccades again first curved away from the newly learned (now empty) location, but then quickly switched to curving away from the life-long learned, visible location. When on some trials the distractor was removed during the first saccade, saccades curved away only from the newly learned (but empty) location (Experiment 2). The results show that updating of locations across saccades is not only fast, but is highly malleable, relying on recently learned sensorimotor contingencies.

Initial landing position effects on Chinese word learning in children and adults

We adopted a word learning paradigm to examine whether children and adults differ in their saccade targeting strategies when learning novel words in Chinese reading. Adopting a developmental perspective, we extrapolated hypotheses pertaining to saccadic targeting and its development from the Chinese Reading Model (Li & Pollatsek, 2020). In our experiment, we embedded novel words into eight sentences, each of which provided a context for readers to form a new lexical representation. A group of children and a group of adults were required to read these sentences as their eye movements were recorded. At a basic level, we showed that decisions of initial saccadic targeting, and mechanisms responsible for computation of initial landing sites relative to launch sites are in place early in children, however, such targeting was less optimal in children than adults. Furthermore, for adults as lexical familiarity increased saccadic targeting behavior became more optimized, however, no such effects occurred in children. Mechanisms controlling initial saccadic targeting in relation to launch sites and in respect of lexical familiarity appear to operate with functional efficacy that is developmentally delayed. At a broad theoretical level, we consider our results in relation to issues associated with visually and linguistically, mediated saccadic control. More specifically, our novel findings fit neatly with our theoretical extrapolations from the CRM and suggest that its framework may be valuable for future investigations of the development of eye movement control in Chinese reading.

Visual attention and eye movement control during oculomotor competition.

Saccadic eye movements are typically preceded by selective shifts of visual attention. Recent evidence, however, suggests that oculomotor selection can occur in the absence of attentional selection when saccades erroneously land in between nearby competing objects (saccade averaging). This study combined a saccade task with a visual discrimination task to investigate saccade target selection during episodes of competition between a saccade target and a nearby distractor. We manipulated the spatial predictability of target and distractor locations and asked participants to execute saccades upon variably delayed go-signals. This allowed us to systematically investigate the capacity to exert top-down eye movement control (as reflected in saccade endpoints) based on the spatiotemporal dynamics of visual attention during movement preparation (measured as visual sensitivity). Our data demonstrate that the predictability of target and distractor locations, despite not affecting the deployment of visual attention prior to movement preparation, largely improved the accuracy of short-latency saccades. Under spatial uncertainty, a short go-signal delay likewise enhanced saccade accuracy substantially, which was associated with a more selective deployment of attentional resources to the saccade target. Moreover, we observed a systematic relationship between the deployment of visual attention and saccade accuracy, with visual discrimination performance being significantly enhanced at the saccade target relative to the distractor only before the execution of saccades accurately landing at the saccade target. Our results provide novel insights linking top-down eye movement control to the operation of selective visual attention during movement preparation.

Transsaccadic perception is affected by saccade landing point deviations after saccadic adaptation.

Whenever we move our eyes, some visual information obtained before a saccade is combined with the visual information obtained after a saccade. Interestingly, saccades rarely land exactly on the saccade target, which may pose a problem for transsaccadic perception as it could affect the quality of postsaccadic input. Recently, however, we showed that transsaccadic feature integration is actually unaffected by deviations of saccade landing points. Possibly, transsaccadic integration remains unaffected because the presaccadic shift of attention follows the intended saccade target and not the actual saccade landing point during regular saccades. Here, we investigated whether saccade landing point errors can in fact alter transsaccadic perception when the presaccadic shift of attention follows the saccade landing point deviation. Given that saccadic adaptation not only changes the saccade vector, but also the presaccadic shift of attention, we combined a feature report paradigm with saccadic adaptation. Observers reported the color of the saccade target, which occasionally changed slightly during a saccade to the target. This task was performed before and after saccadic adaptation. The results showed that, after adaptation, presaccadic color information became less precise and transsaccadic perception had a stronger reliance on the postsaccadic color estimate. Therefore, although previous studies have shown that transsaccadic perception is generally unaffected by saccade landing point deviations, our results reveal that this cannot be considered a general property of the visual system. When presaccadic shifts of attention follow altered saccade landing points, transsaccadic perception is affected, suggesting that transsaccadic feature perception might be dependent on visual spatial attention.

Spelling ability influences early letter encoding during reading: Evidence from return-sweep eye movements.

In recent years, there has been an increase in research concerning individual differences in readers’ eye movements. However, this body of work is almost exclusively concerned with the reading of single-line texts. While spelling and reading ability have been reported to influence saccade targeting and fixation times during intra-line reading, where upcoming words are available for parafoveal processing, it is unclear how these variables affect fixations adjacent to return-sweeps. We, therefore, examined the influence of spelling and reading ability on return-sweep and corrective saccade parameters for 120 participants engaged in multiline text reading. Less-skilled readers and spellers tended to launch their return-sweeps closer to the end of the line, prefer a viewing location closer to the start of the next, and made more return-sweep undershoot errors. We additionally report several skill-related differences in readers’ fixation durations across multiline texts. Reading ability influenced all fixations except those resulting from return-sweep error. In contrast, spelling ability influenced only those fixations following accurate return-sweeps—where parafoveal processing was not possible prior to fixation. This stands in contrasts to an established body of work where fixation durations are related to reading but not spelling ability. These results indicate that lexical quality shapes the rate at which readers access meaning from the text by enhancing early letter encoding, and influences saccade targeting even in the absence of parafoveal target information.

No exception from Bayes' rule: The presence and absence of the range effect for saccades explained.

In an influential theoretical model, human sensorimotor control is achieved by a Bayesian decision process, which combines noisy sensory information and learned prior knowledge. A ubiquitous signature of prior knowledge and Bayesian integration in human perception and motor behavior is the frequently observed bias toward an average stimulus magnitude (i.e., a central-tendency bias, range effect, regression-to-the-mean effect). However, in the domain of eye movements, there is a recent controversy about the fundamental existence of a range effect in the saccadic system. Here we argue that the problem of the existence of a range effect is linked to the availability of prior knowledge for saccade control. We present results from two prosaccade experiments that both employ an informative prior structure (i.e., a nonuniform Gaussian distribution of saccade target distances). Our results demonstrate the validity of Bayesian integration in saccade control, which generates a range effect in saccades. According to Bayesian integration principles, the saccadic range effect depends on the availability of prior knowledge and varies in size as a function of the reliability of the prior and the sensory likelihood.

How spatial frequencies and color drive object search in real-world scenes: A new eye-movement corpus.

When studying how people search for objects in scenes, the inhomogeneity of the visual field is often ignored. Due to physiological limitations, peripheral vision is blurred and mainly uses coarse-grained information (i.e., low spatial frequencies) for selecting saccade targets, whereas high-acuity central vision uses fine-grained information (i.e., high spatial frequencies) for analysis of details. Here we investigated how spatial frequencies and color affect object search in real-world scenes. Using gaze-contingent filters, we attenuated high or low frequencies in central or peripheral vision while viewers searched color or grayscale scenes. Results showed that peripheral filters and central high-pass filters hardly affected search accuracy, whereas accuracy dropped drastically with central low-pass filters. Peripheral filtering increased the time to localize the target by decreasing saccade amplitudes and increasing number and duration of fixations. The use of coarse-grained information in the periphery was limited to color scenes. Central filtering increased the time to verify target identity instead, especially with low-pass filters. We conclude that peripheral vision is critical for object localization and central vision is critical for object identification. Visual guidance during peripheral object localization is dominated by low-frequency color information, whereas high-frequency information, relatively independent of color, is most important for object identification in central vision.

Visual crowding in driving

Visual crowding—the deleterious influence of nearby objects on object recognition—is considered to be a major bottleneck for object recognition in cluttered environments. Although crowding has been studied for decades with static and artificial stimuli, it is still unclear how crowding operates when viewing natural dynamic scenes in real-life situations. For example, driving is a frequent and potentially fatal real-life situation where crowding may play a critical role. In order to investigate the role of crowding in this kind of situation, we presented observers with naturalistic driving videos and recorded their eye movements while they performed a simulated driving task. We found that the saccade localization on pedestrians was impacted by visual clutter, in a manner consistent with the diagnostic criteria of crowding (Bouma's rule of thumb, flanker similarity tuning, and the radial-tangential anisotropy). In order to further confirm that altered saccadic localization is a behavioral consequence of crowding, we also showed that crowding occurs in the recognition of cluttered pedestrians in a more conventional crowding paradigm. We asked participants to discriminate the gender of pedestrians in static video frames and found that the altered saccadic localization correlated with the degree of crowding of the saccade targets. Taken together, our results provide strong evidence that crowding impacts both recognition and goal-directed actions in natural driving situations.

Differences between oculomotor and perceptual artifacts for temporally limited head mounted displays

AbstractWe used perceptual and oculomotor measures to understand the negative impacts of low (phantom array) and high (motion blur) duty cycles with a high‐speed, AR‐likehead‐mounted display prototype. We observed large intersubject variability for the detection of phantom array artifacts but a highly consistent and systematic effect on saccadic eye movement targeting during low duty cycle presentations. This adverse effect on saccade endpoints was also related to an increased error rate in a perceptual discrimination task, showing a direct effect of display duty cycle on the perceptual quality. For high duty cycles, the probability of detecting motion blur increased during head movements, and this effect was elevated at lower refresh rates. We did not find an impact of the temporal display characteristics on compensatory eye movements during head motion (e.g., VOR). Together, our results allow us to quantify the tradeoff of different negative spatiotemporal impacts of user movements and make subsequent recommendations for optimized temporal HMD parameters.

Preparation of saccade sequences and eye programming affect endogenous covert attention.

Endogenous attention can be allocated in parallel to at least two saccade target locations of a planned sequence, but attentional resources are larger in the location of the first than the second saccade. The meridian effect that is observed in endogenous attention can be explained by eye programming, but it is not known how eye-movement preparation and eye programming can together affect endogenous attention during sequential saccades. We used a double-task paradigm to investigate this issue. In two experiments, we confirmed the relation between the preparation of sequential saccades and attentional selection and also showed that eye programming could eliminate deterioration of attentional resources in the second saccade location. The finding of the meridian effect in both the saccadic task and the target discrimination task additionally indicates the important role of eye programming in endogenous attention. The results were discussed in terms of the Premotor Theory of Attention.

Saliency and priority modulation in a pop-out paradigm: Pupil size and microsaccades

A salient stimulus can trigger a coordinated orienting response consisting of a saccade, pupil, and microsaccadic responses. Saliency models predict that the degree of visual conspicuity of all visual stimuli guides visual orienting. By presenting a multiple-item array that included an oddball colored item (pop-out), randomly mixed colored items (mixed-color), or single-color items (single-color), we examined the effects of saliency and priority (saliency + relevancy) on pupil size and microsaccade responses. Larger pupil responses were produced in the pop-out compared to the mixed-color or single-color conditions after stimulus presentation. However, the saliency modulation on microsaccades was not significant. Furthermore, although goal-relevancy information did not modulate pupil responses and microsaccade rate, microsaccade direction was biased toward the pop-out item when it was the subsequent saccadic target. Together, our results demonstrate saliency modulation on pupil size and priority effects on microsaccade direction during visual pop-out.

Modulations of foveal vision associated with microsaccade preparation

It is known that attention shifts prior to a saccade to start processing the saccade target before it lands in the foveola, the high-resolution region of the retina. Yet, once the target is foveated, microsaccades, tiny saccades maintaining the fixated object within the fovea, continue to occur. What is the link between these eye movements and attention? There is growing evidence that these eye movements are associated with covert shifts of attention in the visual periphery, when the attended stimuli are presented far from the center of gaze. Yet, microsaccades are primarily used to explore complex foveal stimuli and to optimize fine spatial vision in the foveola, suggesting that the influences of microsaccades on attention may predominantly impact vision at this scale. To address this question we tracked gaze position with high precision and briefly presented high-acuity stimuli at predefined foveal locations right before microsaccade execution. Our results show that visual discrimination changes prior to microsaccade onset. An enhancement occurs at the microsaccade target location. This modulation is highly selective and it is coupled with a drastic impairment at the opposite foveal location, just a few arcminutes away. This effect is strongest when stimuli are presented closer to the eye movement onset time. These findings reveal that the link between attention and microsaccades is deeper than previously thought, exerting its strongest effects within the foveola. As a result, during fixation, foveal vision is constantly being reshaped both in space and in time with the occurrence of microsaccades.

Attention updates the perceived position of moving objects.

The information used by conscious perception may differ from that which drives certain actions. A dramatic illusion caused by an object's internal texture motion has been put forward as one example. The motion causes an illusory position shift that accumulates over seconds into a large effect, but targeting of the grating for a saccade (a rapid eye movement) is not affected by this illusion. While this has been described as a dissociation between perception and action, an alternative explanation is that rather than saccade targeting having privileged access to the correct position, a shift of attention that precedes saccades resets the accumulated illusory position shift to zero. In support of this possibility, we found that the accumulation of illusory position shift can be reset by transients near the moving object, creating an impression of the object returning to near its actual position. Repetitive luminance changes of the object also resulted in reset of the accumulation, but less so when attention to the object was reduced by a concurrent digit identification task. Finally, judgments of the object's positions around the time of saccade onset reflected the veridical rather than the illusory position. These results suggest that attentional shifts, including those preceding saccades, can update the perceived position of moving objects and mediate the previously reported dissociation between conscious perception and saccades.

Interaction effects of aging, word frequency, and predictability on saccade length in Chinese reading.

BackgroundIt was well known that age has an impact on word processing (word frequency or predictability) in terms of fixating time during reading. However, little is known about whether or not age modulates these impacts on saccade behaviors in Chinese reading (i.e., length of incoming/outgoing saccades for a target word).MethodsAge groups, predictability, and frequency of target words were manipulated in the present study. A larger frequency effect on lexical accessing (i.e., gaze duration) and on context integration (i.e., go-past time, total reading time), as well as larger predictability effects on data of raw total reading time, were observed in older readers when compared with their young counterparts.ResultsEffect of predictability and frequency on word skipping and re-fixating rate did not differ across the two age groups. Notably, reliable interaction effects of age, along with word predictability and/or frequency, on the length of the first incoming/outgoing saccade for a target word were also observed.DiscussionOur findings suggest that the word processing function of older Chinese readers in terms of saccade targeting declines with age.

Ongoing Cognitive Processing Influences Precise Eye-Movement Targets in Reading

Reading is a highly complex learned skill in which humans move their eyes three to four times every second in response to visual and cognitive processing. The consensus view is that the details of these rapid eye-movement decisions—which part of a word to target with a saccade—are determined solely by low-level oculomotor heuristics. But maximally efficient saccade targeting would be sensitive to ongoing word identification, sending the eyes farther into a word the farther its identification has already progressed. Here, using a covert text-shifting paradigm, we showed just such a statistical relationship between saccade targeting in reading and trial-to-trial variability in cognitive processing. This result suggests that, rather than relying purely on heuristics, the human brain has learned to optimize eye movements in reading even at the fine-grained level of character-position targeting, reflecting efficiency-based sensitivity to ongoing cognitive processing.

Bold moves: Inevitable saccadic selection in visual short-term memory.

Selection for visual short-term memory (vstm) provides a basis for many cognitive functions. Saccadic eye movements sway this selection in favor of stimuli previously seen at locations congruent with their target. In three experiments, we provide converging evidence that this saccadic selection is implemented as a fundamental, inevitable selection process, rather than a top-down strategy. In particular, benefits for congruent over incongruent items were largely constant across set sizes ranging from two to eight items (Experiment 1), showing that saccadic selection imposes priorities on vstm irrespective of memory load and is effective even when only few representations need to be maintained. Moreover, a decrement in performance for incongruent items occurred reliably, whether the congruent location contained a task-relevant item or an irrelevant noise patch (Experiment 2). Finally, saccadic selection was immune to a strong manipulation of the observer's attentional priorities (Experiment 3). Given the prevalence of saccades in natural vision, our results demonstrate a fundamental and ecologically relevant selection mechanism for vstm: Saccades systematically eliminate information seen at non-target locations, while information at the saccade target remains available to recall. This simple heuristic is effective in the absence of informative cues and may incapacitate voluntary selection mechanisms that are incongruent with ongoing movement plans.

Intra-saccadic displacement sensitivity after a lesion to the posterior parietal cortex

Visual perception is introspectively stable and continuous across eye movements. It has been hypothesized that displacements in retinal input caused by eye movements can be dissociated from displacements in the external world using extra-retinal information, such as a corollary discharge from the oculomotor system. The extra-retinal information can inform the visual system about an upcoming eye movement and accompanying displacements in retinal input. The parietal cortex has been hypothesized to be critically involved in integrating retinal and extra-retinal information. Two tasks have been widely used to assess the quality of this integration: double-step saccades and intra-saccadic displacements. Double-step saccades performed by patients with parietal cortex lesions seemed to show hypometric second saccades. However, recently idea has been refuted by demonstrating that patients with very similar lesions were able to perform the double step saccades, albeit taking multiple saccades to reach the saccade target. So, it seems that extra-retinal information is still available for saccade execution after a lesion to the parietal lobe. Here, we investigated whether extra-retinal signals are also available for perceptual judgements in nine patients with strokes affecting the posterior parietal cortex. We assessed perceptual continuity with the intra-saccadic displacement task. We exploited the increased sensitivity when a small temporal blank is introduced after saccade offset (blank effect). The blank effect is thought to reflect the availability of extra-retinal signals for perceptual judgements. Although patients exhibited a relative difference to control subjects, they still demonstrated the blank effect. The data suggest that a lesion to the posterior parietal cortex (PPC) alters the processing of extra-retinal signals but does not abolish their influence altogether.

Visual information is required to reduce the global effect

When a distractor appears in close proximity to a saccade target, the saccadic end point is biased towards the distractor. This so-called global effect reduces with the latency of the saccade if the saccade is visually guided. We recently reported that the global effect does not reduce with the latency of a double-step memory-guided saccade. The aim of this study was to investigate why the global effect in memory-guided saccades does not show the typically observed reduction with saccadic latency. One possibility is that reduction of the global effect requires continuous access to visual information about target and distractor locations, which is lacking in the case of a memory-guided saccade. Alternatively, participants may be inclined to routinely preprogram a memory-guided saccade at the moment the visual information disappears, with the result that a memory-guided saccade is typically programmed on the basis of an earlier representation than necessary. To distinguish between these alternatives, two potential targets were presented, and participants were asked to make a saccade to one of them after a delay. In one condition, the target identity was precued, allowing preprogramming of the saccade, while in another condition, it was revealed by a retro cue after the delay. The global effect remained present in both conditions. Increasing visual exposure of target and distractor led to a reduction of the global effect, irrespective of whether participants could preprogram a saccade or not. The results suggest that continuous access to visual information is required in order to eliminate the global effect.

Undersweep fixations during reading in adults and children

Return sweeps take a reader’s fixation from the end of one line to the start of the next. Return sweeps frequently undershoot their target and are followed by a corrective saccade toward the left margin. The pauses prior to corrective saccades are typically considered to be uninvolved in linguistic processing. However, recent findings indicate that these undersweep fixations influence skilled adult readers’ subsequent reading pass across the line and provide preview of line-initial words. The current research examined these effects in children. First, a children’s reading corpus analysis revealed that words receiving an undersweep fixation were more likely skipped and received shorter gaze durations during a subsequent pass. Second, a novel eye movement experiment that directly compared adults’ and children’s eye movements indicated that, during an undersweep fixation, readers very briefly allocate their attention to the fixated word—as indicated by inhibition of return effects during a subsequent pass—prior to deploying attention toward the line-initial word. We argue that prior to the redeployment of attention, readers extract information at the point of fixation that facilitates later encoding and saccade targeting. Given similar patterns of results for adults and children, we conclude that the mechanisms controlling for oculomotor coordination and attention necessary for reading across line boundaries are established from a very early point in reading development.