Foveal Information Research Articles

Parafoveal and foveal N400 effects in natural reading: A timeline of semantic processing from fixation-related potentials.

The depth at which parafoveal words are processed during reading is an ongoing topic of debate. Recent studies using RSVP-with-flanker paradigms have shown that implausible words within sentences elicit an N400 component while they are still in parafoveal vision, suggesting that the semantics of parafoveal words can be accessed to rapidly update the sentence representation. To study this effect in natural reading, we combined the coregistration of eye movements and EEG with the deconvolution modeling of fixation-related potentials (FRPs) to test whether semantic plausibility is processed parafoveally during Chinese sentence reading. For one target word per sentence, both its parafoveal and foveal plausibility were orthogonally manipulated using the boundary paradigm. Consistent with previous eye movement studies, we observed a delayed effect of parafoveal plausibility on fixation durations that only emerged on the foveal word. Crucially, in FRPs aligned to the pretarget fixation, a clear N400 effect emerged already based on parafoveal plausibility, with more negative voltages for implausible previews. Once participants fixated the target, we again observed an N400 effect of foveal plausibility. Interestingly, this foveal N400 was absent whenever the preview had been implausible, indicating that when a word's (im)plausibility is already processed in parafoveal vision, this information is not revised anymore upon direct fixation. Implausible words also elicited a late positive component (LPC), but exclusively when in foveal vision. Our results not only provide convergent neural and behavioral evidence for the parafoveal uptake of semantic information, but also indicate different contributions of parafoveal versus foveal information toward higher level sentence processing.

Familiar objects benefit more from transsaccadic feature predictions.

The transsaccadic feature prediction mechanism associates peripheral and foveal information belonging to the same object to make predictions about how an object seen in the periphery would appear in the fovea or vice versa. It is unclear if such transsaccadic predictions require experience with the object such that only familiar objects benefit from this mechanism by virtue of having peripheral-foveal associations. In two experiments, we tested whether familiar objects have an advantage over novel objects in peripheral-foveal matching and transsaccadic change detection tasks. In both experiments, observers were unknowingly familiarized with a small set of stimuli by completing a sham orientation change detection task. In the first experiment, observers subsequently performed a peripheral-foveal matching task, where they needed to pick the foveal test object that matched a briefly presented peripheral target. In the second experiment, observers subsequently performed a transsaccadic object change detection task where a peripheral target was exchanged or not exchanged with another target after the saccade, either immediately or after a 300-ms blank period. We found an advantage of familiar objects over novel objects in both experiments. While foveal-peripheral associations explained the familiarity effect in the matching task of the first experiment, the second experiment provided evidence for the advantage of peripheral-foveal associations in transsaccadic object change detection. Introducing a postsaccadic blank improved change detection performance in general but more for familiar than for novel objects. We conclude that familiar objects benefit from additional object-specific predictions.

Are eye movements and EEG on the same page?: A coregistration study on parafoveal preview and lexical frequency.

Readers extract visual and linguistic information not only from fixated words but also upcoming parafoveal words to introduce new input efficiently into the language processing pipeline. The lexical frequency of upcoming words and similarity with subsequent foveal information both influence the amount of time people spend once they fixate the word foveally. However, it is unclear from eye movements alone the extent to which parafoveal word processing, and the integration of that word with foveally obtained information, continues after saccade plans have been initiated. To investigate the underlying neural processes involved in word recognition after saccade planning, we coregistered electroencephalogram (EEG) and eye movements during a gaze-contingent display change paradigm. We orthogonally manipulated the frequency of the parafoveal and foveal words and measured fixation related potentials (FRPs) upon foveal fixation. Eye movements showed primarily an effect of preview frequency, suggesting that saccade planning is based on the familiarity of the parafoveal input. FRPs, on the other hand, demonstrated a disruption in downstream processing when parafoveal and foveal input differed, but only when the parafoveal word was high frequency. These findings demonstrate that lexical processing continues after the eyes have moved away from a word and that eye movements and FRPs provide distinct but complementary accounts about oculomotor behavior and neural processing that cannot be obtained from either method in isolation. Furthermore, these findings put constraints on models of reading by suggesting that lexical processes that occur before an eye movement program is initiated are qualitatively different from those that occur afterward. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Transsaccadic object associations shape peripheral perception: The role of reliability.

Faced with inhomogeneous representations, the visual system has to rely on pre- and postsaccadic processing mechanisms to assure perceptual continuity across eye movements. While postsaccadically, memorized peripheral and postsaccadic foveal information are integrated according to their reliabilities, here we investigated whether this also holds true for the presaccadic combination of peripheral input and internal associated foveal images. In three experiments, participants learned associations between objects changing transsaccadically in one feature dimension (spatial frequency in Experiment 1 and color in Experiments 2 and 3). Subsequently, participants judged the respective feature of only peripherally presented objects. Importantly, the reliability of this peripheral input was manipulated by lowering the contrast (Experiment 1) or adding color noise (Experiment 3). We hypothesized that participants' presaccadic peripheral percepts would be biased toward the internal associated foveal image and that the biasing effect would be stronger the lower the peripheral reliability. In all experiments, perception was biased in the direction of the associated foveal image. However, the strength of the bias did not differ between reliability conditions. The presaccadic perceptual bias effect had previously not been tested with the feature color. By showing that yet another feature incorporates prior transsaccadic knowledge, our results highlight the scope of the effect. Furthermore, they point to important differences between pre- and postsaccadic processing mechanisms. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Predictability effects and parafoveal processing in older readers.

Normative aging is accompanied by visual and cognitive changes that impact the systems that are critical for fluent reading. The patterns of eye movements during reading displayed by older adults have been characterized as demonstrating a trade-off between longer forward saccades and more word skipping versus higher rates of regressions back to previously read text. This pattern is assumed to reflect older readers' reliance on top-down contextual information to compensate for reduced uptake of parafoveal information from yet-to-be fixated words. However, the empirical evidence for these assumptions is equivocal. This study investigated the depth of older readers' parafoveal processing as indexed by sensitivity to the contextual plausibility of parafoveal words in both neutral and highly constraining sentence contexts. The eye movements of 65 cognitively intact older adults (61-87 years) were compared with data previously collected from young adults in two sentence reading experiments in which critical target words were replaced by valid, plausible, related, or implausible previews until the reader fixated on the target word location. Older and younger adults showed equivalent plausibility preview benefits on first-pass reading measures of both predictable and unpredictable words. However, older readers did not show the benefit of preview orthographic relatedness that was observed in young adults and showed significantly attenuated preview validity effects. Taken together, the data suggest that older readers are specifically impaired in the integration of parafoveal and foveal information but do not show deficits in the depth of parafoveal processing. The implications for understanding the effects of aging on reading are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

A review of interactions between peripheral and foveal vision.

Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.

Learning to see the Ebbinghaus illusion in the periphery reveals a top-down stabilization of size perception across the visual field

Our conscious visual perception relies on predictive signals, notably in the periphery where sensory uncertainty is high. We investigated how such signals could support perceptual stability of objects’ size across the visual field. When attended carefully, the same object appears slightly smaller in the periphery compared to the fovea. Could this perceptual difference be encoded as a strong prior to predict the peripheral perceived size relative to the fovea? Recent studies emphasized the role of foveal information in defining peripheral size percepts. However, they could not disentangle bottom-up from top-down mechanisms. Here, we revealed a pure top-down contribution to the perceptual size difference between periphery and fovea. First, we discovered a novel Ebbinghaus illusion effect, inducing a typical reduction of foveal perceived size, but a reversed increase effect in the periphery. The resulting illusory size percept was similar at both locations, deviating from the classic perceptual difference. Then through an updating process of successive peripheral-foveal viewing, the unusual peripheral perceived size decreased. The classic perceptual eccentricity difference was restored and the peripheral illusion effect changed into a fovea-like reduction. Therefore, we report the existence of a prior that actively shapes peripheral size perception and stabilizes it relative to the fovea.

Microsaccade generation requires a foveal anchor.

Visual scene characteristics can affect various aspects of saccade and microsaccade dynamics. For example, blank visual scenes are known to elicit diminished saccade and microsaccade production, compared to natural scenes. Similarly, microsaccades are less frequent in the dark. Yet, the extent to which foveal versus peripheral visual information contribute to microsaccade production remains unclear: because microsaccade directions are biased towards covert attention locations, it follows that peripheral visual stimulation could suffice to produce regular microsaccade dynamics, even without foveal stimulation being present. Here we determined the characteristics of microsaccades as a function of foveal and/or peripheral visual stimulation, while human subjects conducted four types of oculomotor tasks (fixation, free viewing, guided viewing and passive viewing). Foveal information was either available, or made unavailable, by the presentation of simulated scotomas. We found foveal stimulation to be critical for microsaccade production, and peripheral stimulation, by itself, to be insufficient to yield normal microsaccades. In each oculomotor task, microsaccade production decreased when scotomas blocked foveal stimulation. Across comparable foveal stimulation conditions, the type of peripheral stimulation (static versus dynamic) moreover affected microsaccade production, with dynamic backgrounds resulting in lower microsaccadic rates than static backgrounds. These results indicate that a foveal visual anchor is necessary for normal microsaccade generation. Whereas peripheral visual stimulation, on its own, does not suffice for normal microsaccade production, it can nevertheless modulate microsaccadic characteristics. These findings extend our current understanding of the links between visual input and ocular motor control, and may therefore help improve the diagnosis and treatment of ophthalmic conditions that degrade central vision, such as age-related macular degeneration.

Do deaf individuals have better visual skills in the periphery? Evidence from processing facial attributes

ABSTRACT Studies examining visual abilities in individuals with early auditory deprivation have reached mixed conclusions, with some finding congenital auditory deprivation and/or lifelong use of a visuospatial language improves specific visual skills and others failing to find substantial differences. A more consistent finding is enhanced peripheral vision and an increased ability to efficiently distribute attention to the visual periphery following auditory deprivation. However, the extent to which this applies to visual skills in general or to certain conspicuous stimuli, such as faces, in particular is unknown. We examined the perceptual resolution of peripheral vision in the deaf, testing various facial attributes typically associated with high-resolution scrutiny of foveal information processing. We compared performance in face-identification tasks to performance using non-face control stimuli. Although we found no enhanced perceptual representations in face identification, gender categorization, or eye gaze direction recognition tasks, fearful expressions showed greater resilience than happy or neutral ones to increasing eccentricities. In the absence of an alerting sound, the visual system of auditory deprived individuals may develop greater sensitivity to specific conspicuous stimuli as a compensatory mechanism. The results also suggest neural reorganization in the deaf in their opposite advantage of the right visual field in face identification tasks.

Parafoveal previews and lexical frequency in natural reading: Evidence from eye movements and fixation-related potentials.

Participants’ eye movements and electroencephalogram (EEG) signal were recorded as they read sentences displayed according to the gaze-contingent boundary paradigm. Two target words in each sentence were manipulated for lexical frequency (high vs. low frequency) and parafoveal preview of each target word (identical vs. string of random letters vs. string of Xs). Eye movement data revealed visual parafoveal-on-foveal (PoF) effects, as well as foveal visual and orthographic preview effects and word frequency effects. Fixation-related potentials (FRPs) showed visual and orthographic PoF effects as well as foveal visual and orthographic preview effects. Our results replicated the early preview positivity effect (Dimigen, Kliegl, & Sommer, 2012) in the X-string preview condition, and revealed different neural correlates associated with a preview comprised of a string of random letters relative to a string of Xs. The former effects seem likely to reflect difficulty associated with the integration of parafoveal and foveal information, as well as feature overlap, while the latter reflect inhibition, and potentially disruption, to processing underlying reading. Interestingly, and consistent with Kretzschmar, Schlesewsky, and Staub (2015), no frequency effect was reflected in the FRP measures. The findings provide insight into the neural correlates of parafoveal processing and written word recognition in reading and demonstrate the value of utilizing ecologically valid paradigms to study well established phenomena that occur as text is read naturally.

Visual letter similarity effects during sentence reading: Evidence from the boundary technique

The study of how the cognitive system encodes letter identities from the visual input has received much attention in models of visual word recognition but it has typically been overlooked in models of eye movement control in reading. Here we examined how visual letter similarity affects early word processing during reading using Rayner's (1975) boundary change technique in which the parafoveal preview of the target word was either identical (e.g., frito-frito [fried]) or a one-letter-different nonword (e.g., frjto-frito vs. frgto-frito). Critically, the substituted letter in the nonword was visually similar (based on letter confusability norms) or visually dissimilar. Results showed shorter viewing times on the target word when the parafoveal preview was visually similar than when it was visually dissimilar. Thus, visual letter similarity modulates the integration of parafoveal and foveal information during sentence reading. Future implementations of models of eye movement control in reading should incorporate a more developed orthographic-lexical module to capture these effects.

Attention modulates trans-saccadic integration

With every saccade, humans must reconcile the low resolution peripheral information available before a saccade, with the high resolution foveal information acquired after the saccade. While research has shown that we are able to integrate peripheral and foveal vision in a near-optimal manner, it is still unclear which mechanisms may underpin this important perceptual process. One potential mechanism that may moderate this integration process is visual attention. Pre-saccadic attention is a well documented phenomenon, whereby visual attention shifts to the location of an upcoming saccade before the saccade is executed. While it plays an important role in other peri-saccadic processes such as predictive remapping, the role of attention in the integration process is as yet unknown. This study aimed to determine whether the presentation of an attentional distractor during a saccade impaired trans-saccadic integration, and to measure the time-course of this impairment. Results showed that presenting an attentional distractor impaired integration performance both before saccade onset, and during the saccade, in selected subjects who showed integration in the absence of a distractor. This suggests that visual attention may be a mechanism that facilitates trans-saccadic integration.

Numerosity estimation benefits from transsaccadic information integration.

Humans achieve a stable and homogeneous representation of their visual environment, although visual processing varies across the visual field. Here we investigated the circumstances under which peripheral and foveal information is integrated for numerosity estimation across saccades. We asked our participants to judge the number of black and white dots on a screen. Information was presented either in the periphery before a saccade, in the fovea after a saccade, or in both areas consecutively to measure transsaccadic integration. In contrast to previous findings, we found an underestimation of numerosity for foveal presentation and an overestimation for peripheral presentation. We used a maximum-likelihood model to predict accuracy and reliability in the transsaccadic condition based on peripheral and foveal values. We found near-optimal integration of peripheral and foveal information, consistently with previous findings about orientation integration. In three consecutive experiments, we disrupted object continuity between the peripheral and foveal presentations to probe the limits of transsaccadic integration. Even for global changes on our numerosity stimuli, no influence of object discontinuity was observed. Overall, our results suggest that transsaccadic integration is a robust mechanism that also works for complex visual features such as numerosity and is operative despite internal or external mismatches between foveal and peripheral information. Transsaccadic integration facilitates an accurate and reliable perception of our environment.

Foveal to peripheral extrapolation of brightness within objects.

Peripheral viewing is characterized by poor resolution and distortions as compared to central viewing; nevertheless, when we move our gaze around, the visual scene does not appear to change. One possible mechanism leading to perceptual uniformity would be that peripheral appearance is extrapolated based on foveal information. Here we investigate foveal-to-peripheral extrapolation in the case of the perceived brightness of an object's surface. While fixating a spot on the rendered object, observers were asked to adjust the brightness of a disc to match a peripherally viewed target area on the surface of the same object. Being forced to fixate a better illuminated point led to brighter matches as compared to fixating points in the shadow, indicating that foveal brightness information was extrapolated. When observers fixated additional points outside of the object on the scene's background, fixated brightness had no effect on the brightness match. Results indicate that our visual system uses the brightness of the foveally viewed surface area to estimate the brightness of areas in the periphery. However, this mechanism is selectively applied within an object's boundary.

When your mind skips what your eyes fixate: How forced fixations lead to comprehension illusions in reading.

The phenomenon of forced fixations suggests that readers sometimes fixate a word (due to oculomotor constraints) even though they intended to skip it (due to parafoveal cognitive-linguistic processing). We investigate whether this leads readers to look directly at a word but not pay attention to it. We used a gaze-contingent boundary paradigm to dissociate parafoveal and foveal information (e.g., the word phone changed to scarf once the reader's eyes moved to it) and asked questions about the sentence to determine which one the reader encoded. When the word was skipped or fixated only briefly (i.e., up to 100 ms) readers were more likely to report reading the parafoveal than the fixated word, suggesting that there are cases in which readers look directly at a word but their minds ignore it, leading to the illusion of reading something they did not fixate.

Earlier saccades to task-relevant targets irrespective of relative gain between peripheral and foveal information.

Saccades bring objects of interest onto the fovea for high-acuity processing. Saccades to rewarded targets show shorter latencies that correlate negatively with expected motivational value. Shorter latencies are also observed when the saccade target is relevant for a perceptual discrimination task. Here we tested whether saccade preparation is equally influenced by informational value as it is by motivational value. We defined informational value as the probability that information is task-relevant times the ratio between postsaccadic foveal and presaccadic peripheral discriminability. Using a gaze-contingent display, we independently manipulated peripheral and foveal discriminability of the saccade target. Latencies of saccades with perceptual task were reduced by 36 ms in general, but they were not modulated by the information saccades provide (Experiments 1 and 2). However, latencies showed a clear negative linear correlation with the probability that the target is task-relevant (Experiment 3). We replicated that the facilitation by a perceptual task is spatially specific and not due to generally heightened arousal (Experiment 4). Finally, the facilitation only emerged when the perceptual task is in the visual but not in the auditory modality (Experiment 5). Taken together, these results suggest that saccade latencies are not equally modulated by informational value as by motivational value. The facilitation by a perceptual task only arises when task-relevant visual information is foveated, irrespective of whether the foveation is useful or not.

Using a dichoptic moving window presentation technique to investigate binocular advantages during reading.

Reading comes with a clear binocular advantage, expressed in shorter fixation times and fewer regressions in binocular relative to monocular visual presentations. Little is known, however, about whether the cost associated with monocular viewing derives primarily from the encoding of foveal information or in obtaining a preview benefit from upcoming parafoveal text. In the present sentence reading eye tracking experiment, the authors used a novel dichoptic binocular gaze-contingent moving window technique to selectively manipulate the amount of text made available to the reader both binocularly and monocularly in the fovea and parafovea on a fixation-by-fixation basis. This technique allowed the authors to quantify disruption to reading caused by prevention of binocular fusion during direct fixation of words and parafoveal preprocessing of upcoming text. Sentences were presented (a) binocularly; (b) monocularly; (c) with monocular text to the left of fixation; (d) with monocular text to the right of fixation; or (e) with all words other than the fixated word presented binocularly. A robust binocular advantage occurred for average fixation duration and regressions. Also, while there was a limited cost associated with monocular foveal processing, the restriction of parafoveal processing to monocular information was particularly disruptive. The findings demonstrate the critical importance of a unified binocular input for the efficient preprocessing text to the right of fixation. (PsycINFO Database Record

A Model of the Superior Colliculus Predicts Fixation Locations during Scene Viewing and Visual Search.

Modern computational models of attention predict fixations using saliency maps and target maps, which prioritize locations for fixation based on feature contrast and target goals, respectively. But whereas many such models are biologically plausible, none have looked to the oculomotor system for design constraints or parameter specification. Conversely, although most models of saccade programming are tightly coupled to underlying neurophysiology, none have been tested using real-world stimuli and tasks. We combined the strengths of these two approaches in MASC, a model of attention in the superior colliculus (SC) that captures known neurophysiological constraints on saccade programming. We show that MASC predicted the fixation locations of humans freely viewing naturalistic scenes and performing exemplar and categorical search tasks, a breadth achieved by no other existing model. Moreover, it did this as well or better than its more specialized state-of-the-art competitors. MASC's predictive success stems from its inclusion of high-level but core principles of SC organization: an over-representation of foveal information, size-invariant population codes, cascaded population averaging over distorted visual and motor maps, and competition between motor point images for saccade programming, all of which cause further modulation of priority (attention) after projection of saliency and target maps to the SC. Only by incorporating these organizing brain principles into our models can we fully understand the transformation of complex visual information into the saccade programs underlying movements of overt attention. With MASC, a theoretical footing now exists to generate and test computationally explicit predictions of behavioral and neural responses in visually complex real-world contexts.SIGNIFICANCE STATEMENT The superior colliculus (SC) performs a visual-to-motor transformation vital to overt attention, but existing SC models cannot predict saccades to visually complex real-world stimuli. We introduce a brain-inspired SC model that outperforms state-of-the-art image-based competitors in predicting the sequences of fixations made by humans performing a range of everyday tasks (scene viewing and exemplar and categorical search), making clear the value of looking to the brain for model design. This work is significant in that it will drive new research by making computationally explicit predictions of SC neural population activity in response to naturalistic stimuli and tasks. It will also serve as a blueprint for the construction of other brain-inspired models, helping to usher in the next generation of truly intelligent autonomous systems.

The Role of Extrafoveal Vision in Source Code Comprehension.

Understanding software engineers' behaviour plays a vital role in the software development industry. It also provides helpful guidelines for teaching and learning. In this article, we conduct a study of the extrafoveal vision and its role in information processing. This is a new perspective on source code comprehension. Despite its major importance, the extrafoveal vision has been largely ignored by previous studies. The available research has been focused entirely on the foveal information processing and the gaze fixation position. In this work, we share the results of a gaze-contingent study of source code comprehension by expert ( N = 12) and novice ( N = 12) programmers in conditions of the restricted extrafoveal vision. The window-moving paradigm was employed to restrict the extrafoveal area of vision as participants comprehend two source code examples. The results indicate that the semantic preview allowed by the extrafoveal vision provides tangible benefits to expert programmers. When the experts could not use the semantic information from the extrafoveal area, their fixation duration increased to duration similar to novices. The experts' performance dropped in the restricted-view mode, and they required more time to solve the tasks.

Modulating foveal representation can influence visual discrimination in the periphery.

A previous study by Williams et al. (2008) provided evidence for a novel form of feedback in the visual system, whereby peripheral information is contained in foveal retinotopic cortex. Beyond its possible implication for peripheral object recognition, few studies have examined the effect of a direct behavioral manipulation of the foveal feedback representation. To address this question, we measured participants' peripheral visual discrimination performance while modulating their foveal representation in a series of psychophysical experiments. On each trial, participants discriminated the identities of briefly presented novel, three-dimensional objects or the orientations of gratings in a peripheral location while fixating at the center. Besides the peripheral target, another stimulus (foil) was also presented and masked at the fovea. Our results showed that for objects, when the foveal foil that was identical to the peripheral target was presented 150 ms after the onset of the peripheral target, visual discrimination of the peripheral target was improved. This congruency effect occurred even though participants did not consciously perceive the foveal stimulus. No such effect was observed when the foveal foil was presented simultaneously with the peripheral target, or when the foil was presented in a parafoveal location. The foil effect in gratings was different from that in objects in terms of its effective timing and foveal specificity, suggesting that foveal feedback may be specific to high-level objects. These results indicate that modulating foveal information can affect individuals' ability to discriminate peripheral objects, suggesting a functional role of foveal representations in peripheral visual perception.