Parafoveal Preview Research Articles

A design for neural network model of continuous reading

Cognition and learning are exceedingly modeled as an associative activity of connectionist neural networks. However, only a few such models exist for continuous reading, which involves the delicate coordination of word recognition and eye movements. Moreover, these models are limited to only orthographic level of word processing with predetermined lexicons. Here, we present a conceptual design of a developmentally plausible neural network model of reading designed to simulate word learning, parafoveal preview activation of words, their later foveal word recognition including phonological decoding, and forward saccade length as a control mechanism for intake of new textual information. We will discuss the theoretical advancements of the design and avenues for future developments.

Neural mechanism underlying preview effects and masked priming effects in visual word processing.

Two classic experimental paradigms - masked repetition priming and the boundary paradigm - have played a pivotal role in understanding the process of visual word recognition. Traditionally, these paradigms have been employed by different communities of researchers, with their own long-standing research traditions. Nevertheless, a review of the literature suggests that the brain-electric correlates of word processing established with both paradigms may show interesting similarities, in particular with regard to the location, timing, and direction of N1 and N250 effects. However, as of yet, no direct comparison has been undertaken between the two paradigms. In the current study, we used combined eye-tracking/EEG to perform such a within-subject comparison using the same materials (single Chinese characters) as stimuli. To facilitate direct comparisons, we used a simplified version of the boundary paradigm - the single word boundary paradigm. Our results show the typical early repetition effects of N1 and N250 for both paradigms. However, repetition effects in N250 (i.e., a reduced negativity following identical-word primes/previews as compared to different-word primes/previews) were larger with the single word boundary paradigm than with masked priming. For N1 effects, repetition effects were similar across the two paradigms, showing a larger N1 after repetitions as compared to alternations. Therefore, the results indicate that at the neural level, a briefly presented and masked foveal prime produces qualitatively similar facilitatory effects on visual word recognition as a parafoveal preview before a single saccade, although such effects appear to be stronger in the latter case.

An early effect of the parafoveal preview on post-saccadic processing of English words.

A key aspect of efficient visual processing is to use current and previous information to make predictions about what we will see next. In natural viewing, and when looking at words, there is typically an indication of forthcoming visual information from extrafoveal areas of the visual field before we make an eye movement to an object or word of interest. This "preview effect" has been studied for many years in the word reading literature and, more recently, in object perception. Here, we integrated methods from word recognition and object perception to investigate the timing of the preview on neural measures of word recognition. Through a combined use of EEG and eye-tracking, a group of multilingual participants took part in a gaze-contingent, single-shot saccade experiment in which words appeared in their parafoveal visual field. In valid preview trials, the same word was presented during the preview and after the saccade, while in the invalid condition, the saccade target was a number string that turned into a word during the saccade. As hypothesized, the valid preview greatly reduced the fixation-related evoked response. Interestingly, multivariate decoding analyses revealed much earlier preview effects than previously reported for words, and individual decoding performance correlated with participant reading scores. These results demonstrate that a parafoveal preview can influence relatively early aspects of post-saccadic word processing and help to resolve some discrepancies between the word and object literatures.

Parafoveal Processing of Orthography, Phonology, and Semantics during Chinese Reading: Effects of Foveal Load.

The foveal load hypothesis assumes that the ease (or difficulty) of processing the currently fixated word in a sentence can influence processing of the upcoming word(s), such that parafoveal preview is reduced when foveal load is high. Recent investigations using pseudo-character previews reported an absence of foveal load effects in Chinese reading. Substantial Chinese studies to date provide some evidence to show that parafoveal words may be processed orthographically, phonologically, or semantically. However, it has not yet been established whether parafoveal processing is equivalent in terms of the type of parafoveal information extracted (orthographic, phonological, semantic) under different foveal load conditions. Accordingly, the present study investigated this issue with two experiments. Participants' eye movements were recorded as they read sentences in which foveal load was manipulated by placing a low- or high-frequency word N preceding a critical word. The preview validity of the upcoming word N + 1 was manipulated in Experiment 1, and word N + 2 in Experiment 2. The parafoveal preview was either identical to word N + 1(or word N + 2); orthographically related; phonologically related; semantically related; or an unrelated pseudo-character. The results showed robust main effects of frequency and preview type on both N + 1 and N + 2. Crucially, however, interactions between foveal load and preview type were absent, indicating that foveal load does not modulate the types of parafoveal information processed during Chinese reading.

Bilingual parafoveal processing: Children and adults preprocess orthographic information of the upcoming word during sentence reading in their first and second language.

Readers of different ages and across different languages routinely process information of upcoming words in a sentence, before their eyes move to fixate them directly (parafoveal processing). However, there is inconsistent evidence of similar parafoveal processing in a reader's second language (L2). In this eye movement study, the gaze-contingent boundary paradigm (Rayner, 1975a) was used to test whether parafoveal processing of orthographic information is an integral part of both beginning and proficient L2 reading. The eye movements of beginning L2-learners (n = 53, aged 11-14 years) and highly proficient L2-users (n = 56, aged 19-65 years) were recorded while they read sentences in their first language (L1) German and L2 English. Sentences each contained a cognate target word (e.g., English: tunnel, German: Tunnel). The parafoveal preview of the targets either (a) preserved the spelling and meaning of the target (identity condition), (b) preserved letter identities but transposed the position of two adjacent letters (transposed-letter [TL] condition, e.g., tunenl/Tunenl), or substituted the identity of two adjacent letters (substituted-letter condition, e.g., tunocl/Tunocl). TL previews elicited longer early first-pass reading times than identity previews in both L1 and L2 reading in children and adults, suggesting that letter position was processed parafoveally. Substituted-letter previews resulted in longer reading times than TL previews in children and adults in L1 and L2, suggesting that letter identity information was processed independently of position information. These results suggest that letter position and identity information are extracted from the parafovea during L1 and L2 reading, facilitating word recognition in children and adults. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Visual similarity effects in the identification of Arabic letters: evidence with masked priming

Abstract Research using masked priming and parafoveal preview techniques has shown that visual letter similarity has an impact on word processing during the initial stages in Latin-derived scripts. However, these effects appear to be absent in Arabic. One reason for this discrepancy could be attributed to the distinctive features of the Arabic script, which includes numerous letters sharing a basic form while varying in the location or number of diacritics. To shed light on this issue, the present study employed Arabic letters rather than words in two masked priming experiments: an alphabetic decision task and a letter-matching task. Both experiments showed that visually similar letters were more effective as primes than visually dissimilar letters. These findings suggest that the processes of letter identification in Arabic and Latin scripts may be roughly alike, implying that differences in visual letter similarity across scripts may arise at later stages of processing.

Parafoveal Word Frequency Does Not Modulate the Effect of Foveal Load on Preview in Chinese Reading: Evidence from Eye Movements.

The foveal load effect is one of the most fundamental effects in reading psychology, and also one of the most controversial issues in recent years. The foveal load effect refers to the phenomenon that the difficulty of foveal processing affects parafoveal preview. In Chinese reading, whether the foveal load effect exists, as well as whether this effect is modulated by parafoveal word frequency, remains unclear. In this study, the eye-tracking technique was used to track the eye movements of 48 subjects. Utilized the boundary paradigm with single-character words as parafoveal words, the present study manipulated foveal word frequency (high and low), parafoveal word frequency (high and low), and two types of preview (identical preview and pseudocharacter preview) to investigate these questions. The results revealed that the foveal word frequency does not influence preview, suggesting the absence of the foveal load effect when using single-character words as parafoveal words. Furthermore, parafoveal word frequency does not modulate the effect of the foveal load on the preview. This empirical evidence contributes to refining the understanding of the Chinese reading model.

Processing difficulty while reading words with neighbors is not due to increased foveal load: Evidence from eye movements.

Words with high orthographic relatedness are termed "word neighbors" (angle/angel; birch/birth). Activation-based models of word recognition assume that lateral inhibition occurs between words and their activated neighbors. However, studies of eye movements during reading have not found inhibitory effects in early measures assumed to reflect lexical access (e.g., gaze duration). Instead, inhibition in eye-movement studies has been found in later measures of processing (e.g., total time, regressions in). We conducted an eye-movement boundary change study (Rayner, Cognitive Psychology, 7(1), 65-81, 1975) that manipulated the parafoveal preview of the word following the neighbor word (word N+1). In this way, we explored whether the late inhibitory effects seen with transposed letter words and words with higher-frequency neighbors result from reduced parafoveal preview due to increased foveal load and/or interference during late stages of lexical processing (the L2 stage within the E-Z Reader framework). For word N+1, while there were clear preview effects, there was not an effect of the neighborhood status of word N, nor a significant interaction. This suggests that the late inhibitory effects of earlier eye-movement studies are driven by misidentification of neighbor words rather than being due to increased foveal load.

Lexical Processing Strongly Affects Reading Times But Not Skipping During Natural Reading.

In a typical text, readers look much longer at some words than at others, even skipping many altogether. Historically, researchers explained this variation via low-level visual or oculomotor factors, but today it is primarily explained via factors determining a word's lexical processing ease, such as how well word identity can be predicted from context or discerned from parafoveal preview. While the existence of these effects is well established in controlled experiments, the relative importance of prediction, preview and low-level factors in natural reading remains unclear. Here, we address this question in three large naturalistic reading corpora (n = 104, 1.5 million words), using deep neural networks and Bayesian ideal observers to model linguistic prediction and parafoveal preview from moment to moment in natural reading. Strikingly, neither prediction nor preview was important for explaining word skipping-the vast majority of explained variation was explained by a simple oculomotor model, using just fixation position and word length. For reading times, by contrast, we found strong but independent contributions of prediction and preview, with effect sizes matching those from controlled experiments. Together, these results challenge dominant models of eye movements in reading, and instead support alternative models that describe skipping (but not reading times) as largely autonomous from word identification, and mostly determined by low-level oculomotor information.

Cross-language semantic parafoveal preview benefits in bilinguals.

The aim of this project was to identify factors contributing to cross-language semantic preview benefits. In Experiment 1, Russian-English bilinguals read English sentences with Russian words presented as parafoveal previews. The gaze-contingent boundary paradigm was used to present sentences. Critical previews were cognate translations of the target word (CTAPT-START), noncognate translations (CPOK-TERM), or interlingual homograph translations (MOPE-SEA). A semantic preview benefit (i.e., shorter fixation durations for related than unrelated previews) was observed for cognate and interlingual homograph translations, but not for noncognate translations. In Experiment 2, English-French bilinguals read English sentences with French words used as parafoveal previews. Critical previews were interlingual homograph translations of the target word (PAIN-BREAD) or interlingual homograph translations with a diacritic added (PÁIN-BREAD). A robust semantic preview benefit was found only for interlingual homographs without diacritics, although both preview types produced a semantic preview benefit in the total fixation duration. Our findings suggest that semantically related previews need to have substantial orthographic overlap with words in the target language to produce cross-language semantic preview benefits in early eye fixation measures. In terms of the Bilingual Interactive Activation+ model, the preview word may need to activate the language node for the target language before its meaning is integrated with that of the target word. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Word processing before explicit attention: Using the gaze-contingent boundary paradigm in L2 reading research

Eye-movement studies investigating second language (L2) word processing during reading are growing exponentially. However, what information L2 readers are able to process parafoveally is a less researched topic. The gaze-contingent boundary paradigm (Rayner, 1975) allows researchers to manipulate visual information in an upcoming word during reading, tapping into real-time word processing without awareness. This article provides an overview of experimental studies of parafoveal word processing in reading, followed by a methodological review of the use of the boundary paradigm in L2 and bilingual research. We synthesize key methodological details (including preview type, eye-movement measures) and findings of 15 experiments that met our search criteria, concluding that the parafoveal preview effect observed when reading in the first language is also present in L2 reading. We propose how the gaze-contingent boundary paradigm can be used to study L2 lexical knowledge and factors that affect its development. Finally, we provide advice and instructions for designing and conducting boundary paradigm experiments.

Mask-related costs in measuring preview benefit: Evidence from a distributional analysis based on target word reading times.

Skilled reading involves processing the upcoming word in parafoveal vision before it is fixated, leading to shorter fixations on that word. This phenomenon, parafoveal preview benefit, is a key component of theoretical models of reading; it is measured using the invisible boundary paradigm, in which reading times on a target word are compared for instances when preview is accurate and when the target word is masked while in the parafovea. However, parafoveal masks have been shown to induce unintentional processing costs, thereby inflating measures of preview benefit. The degraded mask has been explored as a potential solution to this problem, leading to mixed results. While previous work has analyzed the preview effect by comparing mean reading times on the target word, the present study provides a more comprehensive analysis by examining the distribution of the preview effect across target word fixation times for unrelated and degraded masks. Participants read sentences containing target words whose preview was either identical, unrelated, or degraded, and their eye movements were recorded. Analyses revealed that although there were no mean differences between reading times for the unrelated and degraded conditions, the pattern of the effects varied as a function of target word fixation times. Unrelated masks resulted in positively sloped generally linear delta plots, while degraded masks resulted in relatively flat delta plots for fixations longer than 200 ms. These differences suggest that different cognitive mechanisms are involved in the processing of the two mask types. Implications for understanding and measuring preview benefit are discussed.

Out of sight, out of mind: Foveal processing is necessary for semantic integration of words into sentence context.

Word recognition begins before a reader looks directly at a word, as demonstrated by the parafoveal preview benefit and word skipping. Both low-level form and high-level semantic features can be accessed in parafoveal vision and used to promote reading efficiency. However, words are not recognized in isolation during reading; once a semantic representation is retrieved, it must be integrated with the broader sentence context. One open question about parafoveal processing is whether it is limited to shallow stages of lexico-semantic activation or extends to semantic integration. In the present two-experiment study, we recorded event-related brain potentials in response to a sentence-final word that was presented in foveal or parafoveal vision and was either expected, unexpected, or anomalous in the sentence context. We found that word recognition, indexed by the N400, ensued regardless of perception location whereas identification of the semantic fit of a word in its sentence context, indexed by the late positive component, was only observed for foveally perceived but not parafoveally perceived words. This pattern was not sensitive to task differences that promote different levels of orthographic scrutiny, as manipulated between the two experiments. These findings demonstrate separate roles for parafoveal and foveal processing in reading. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Are eye movements and EEG on the same page?: A coregistration study on parafoveal preview and lexical frequency.

Readers extract visual and linguistic information not only from fixated words but also upcoming parafoveal words to introduce new input efficiently into the language processing pipeline. The lexical frequency of upcoming words and similarity with subsequent foveal information both influence the amount of time people spend once they fixate the word foveally. However, it is unclear from eye movements alone the extent to which parafoveal word processing, and the integration of that word with foveally obtained information, continues after saccade plans have been initiated. To investigate the underlying neural processes involved in word recognition after saccade planning, we coregistered electroencephalogram (EEG) and eye movements during a gaze-contingent display change paradigm. We orthogonally manipulated the frequency of the parafoveal and foveal words and measured fixation related potentials (FRPs) upon foveal fixation. Eye movements showed primarily an effect of preview frequency, suggesting that saccade planning is based on the familiarity of the parafoveal input. FRPs, on the other hand, demonstrated a disruption in downstream processing when parafoveal and foveal input differed, but only when the parafoveal word was high frequency. These findings demonstrate that lexical processing continues after the eyes have moved away from a word and that eye movements and FRPs provide distinct but complementary accounts about oculomotor behavior and neural processing that cannot be obtained from either method in isolation. Furthermore, these findings put constraints on models of reading by suggesting that lexical processes that occur before an eye movement program is initiated are qualitatively different from those that occur afterward. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The influence of predictability, visual contrast, and preview validity on eye movements and N400 amplitude: co-registration evidence that the N400 reflects late processes

ABSTRACT Two eye movement/EEG co-registration experiments investigated effects of predictability, visual contrast, and parafoveal preview in normal reading. Replicating previous studies, in Experiment 1 contrast and predictability additively influenced fixation durations, and in Experiment 2 invalid preview eliminated the predictability effect on early eye movement measures. In both experiments, predictability influenced the amplitude of the N400 component of the fixation-related potential. In Experiment 1, visual contrast did not influence the N400, and in Experiment 2, the effect of predictability on the N400 was larger with invalid preview, in opposition to the eye movement pattern. The N400 may reflect a late process of accessing conceptual representations while the duration of the eyes’ fixation on a word is sensitive to the difficulty of perceptual encoding and early stages of word recognition. The effects of predictability on both fixation duration and the N400 suggest an influence of this variable at two distinct processing stages.

Online Assessment of Parafoveal Morphological Processing/Awareness during Reading among Chinese and Korean Adults

ABSTRACT Purpose The present study tested parafoveal morphological processing during sentence reading with two eye-tracking experiments, making use of an implicit measurement of morphological awareness. In Chinese and Korean, each character form typically corresponds to multiple mental lexicons, leading to morphological ambiguity. Method Using the gaze-contingent boundary paradigm, we manipulated the relation between the homographic parafoveal preview morphemes and the target words in Chinese and Korean, respectively, in two experiments. We tested 57 Chinese and 45 Korean university students. Together with baseline conditions in which the previews were either identical or unrelated to the target, we had two critical conditions in which the homographs shared/did not share the same morphemic meaning (i.e., same morpheme/different morpheme) with the target morpheme. Results Across the two experiments, the differences between the same and different morpheme conditions in a number of eye movement indices were significant, consistently showing that appropriate morpho-semantic information facilitates lexical processing. The different-morpheme previews facilitated the target word processing in Chinese but not in Korean reading. Conclusion These findings suggest that morphemic meanings are activated early on during word recognition in Chinese, a logographic orthography, and Korean Hangul, a phonologically transparent writing system, before the word is fixated upon.

Parafoveal preview benefit in a conflicting sentential context: Evidence from ERPs.

In natural reading, the reader's processing of a word starts when the word is located in parafoveal vision. Relative to a situation with an invalid preview, fixations are significantly shorter after a fully valid, identical preview. Although research on the identity preview benefit has been ongoing for more than 40 years, the mechanism of this preview benefit, the level of lexical processing it occurs, and its relationship to the sentential context remain unclear. This study employed EEG brain component analysis technology to address these questions in Chinese sentence reading. We manipulated the sentential context to make the target word plausible or not plausible with the sentence and manipulated the target word present or not present in preview. EEG results showed that the identity preview benefit can affect not only the early preview positivity, reflecting the early orthographic processing of words, but also the N400 and LPC components, reflecting the late and in-depth semantic processing of words. Conflicting sentential context, in which the target word is implausible and cannot be integrated into the sentence, can interfere temporarily with these processes. These findings suggest that in the process of sentence reading, an identical preview word can promote the subsequent reading process at multiple levels, and its role is modulated by contextual information.

Parafoveal processing and transposed-letter effects in dyslexic reading.

During parafoveal processing, skilled readers encode letter identity independently of letter position (Johnson et al., 2007). In the current experiment, we examined orthographic parafoveal processing in readers with dyslexia. Specifically, the eye movements of skilled readers and adult readers with dyslexia were recorded during a boundary paradigm experiment (Rayner, 1975). Parafoveal previews were either identical to the target word (e.g., nearly), a transposed‐letter preview (e.g., enarly), or a substituted‐letter preview (e.g., acarly). Dyslexic and non‐dyslexic readers demonstrated orthographic parafoveal preview benefits during silent sentence reading and both reading groups encoded letter identity and letter position information parafoveally. However, dyslexic adults showed, that very early in lexical processing, during parafoveal preview, the positional information of a word's initial letters were encoded less flexibly compared to during skilled adult reading. We suggest that dyslexic readers are less able to benefit from correct letter identity information (i.e., in the letter transposition previews) due to the lack of direct mapping of orthography to phonology. The current findings demonstrate that dyslexic readers show consistent and dyslexic‐specific reading difficulties in foveal and parafoveal processing during silent sentence reading.

Role of Morphology in Visual Word Recognition: A Parafoveal Preview Study in Arabic Using Eye-Tracking

Words in Semitic languages such as Arabic and Hebrew are composed of two interwoven morphemes: roots and word patterns (verbal and nominal). Studies exploring the organizing principles of the mental lexicon in Hebrew reported robust priming effects by roots and verbal patterns, but not by nominal patterns. In Arabic, prior studies have produced some inconsistent results. Using the eye-tracking methodology, this study investigated whether the Arabic morphological classes (i.e., root, verbal pattern, nominal pattern) presented parafoveally would facilitate naming of foveally presented words among young native Arabic skilled readers. Results indicate that roots and both word patterns accelerated word naming latencies, suggesting that morphological knowledge contributed to word recognition processes in Arabic. The inclusion of the three morpheme classes into one study represents so far the most comprehensive study of morphological priming effects in Arabic.

The perceptual span is dynamically adjusted in response to foveal load by beginning readers.

The perceptual span describes the size of the visual field from which information is obtained during a fixation in reading. Its size depends on characteristics of writing system and reader, but-according to the foveal load hypothesis-it is also adjusted dynamically as a function of lexical processing difficulty. Using the moving window paradigm to manipulate the amount of preview, here we directly test whether the perceptual span shrinks as foveal word difficulty increases. We computed the momentary size of the span from word-based eye-movement measures as a function of foveal word frequency, allowing us to separately describe the perceptual span for information affecting spatial saccade targeting and temporal saccade execution. First fixation duration and gaze duration on the upcoming (parafoveal) word N + 1 were significantly shorter when the current (foveal) word N was more frequent. We show that the word frequency effect is modulated by window size. Fixation durations on word N + 1 decreased with high-frequency words N, but only for large windows, that is, when sufficient parafoveal preview was available. This provides strong support for the foveal load hypothesis. To investigate the development of the foveal load effect, we analyzed data from three waves of a longitudinal study on the perceptual span with German children in Grades 1 to 6. Perceptual span adjustment emerged early in development at around second grade and remained stable in later grades. We conclude that the local modulation of the perceptual span indicates a general cognitive process, perhaps an attentional gradient with rapid readjustment. (PsycInfo Database Record (c) 2022 APA, all rights reserved).