Prediction In Language Comprehension Research Articles

Prior Context and Individual Alpha Frequency Influence Predictive Processing during Language Comprehension.

The extent to which the brain predicts upcoming information during language processing remains controversial. To shed light on this debate, the present study reanalyzed Nieuwland and colleagues' (2018) [Nieuwland, M. S., Politzer-Ahles, S., Heyselaar, E., Segaert, K., Darley, E., Kazanina, N., et al. Large-scale replication study reveals a limit on probabilistic prediction in language comprehension. eLife, 7, e33468, 2018] replication of DeLong and colleagues (2015) [DeLong, K. A., Urbach, T. P., & Kutas, M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience, 8, 1117-1121, 2005]. Participants (n = 356) viewed sentences containing articles and nouns of varying predictability, while their EEG was recorded. We measured ERPs preceding the critical words (namely, the semantic prediction potential), in conjunction with postword N400 patterns and individual neural metrics. ERP activity was compared with two measures of word predictability: cloze probability and lexical surprisal. In contrast to prior literature, semantic prediction potential amplitudes did not increase as cloze probability increased, suggesting that the component may not reflect prediction during natural language processing. Initial N400 results at the article provided evidence against phonological prediction in language, in line with Nieuwland and colleagues' findings. Strikingly, however, when the surprisal of the prior words in the sentence was included in the analysis, increases in article surprisal were associated with increased N400 amplitudes, consistent with prediction accounts. This relationship between surprisal and N400 amplitude was not observed when the surprisal of the two prior words was low, suggesting that expectation violations at the article may be overlooked under highly predictable conditions. Individual alpha frequency also modulated the relationship between article surprisal and the N400, emphasizing the importance of individual neural factors for prediction. The present study extends upon existing neurocognitive models of language and prediction more generally, by illuminating the flexible and subject-specific nature of predictive processing.

Speech Prosody Serves Temporal Prediction of Language via Contextual Entrainment.

Temporal prediction assists language comprehension. In a series of recent behavioral studies, we have shown that listeners specifically employ rhythmic modulations of prosody to estimate the duration of upcoming sentences, thereby speeding up comprehension. In the current human magnetoencephalography (MEG) study on participants of either sex, we show that the human brain achieves this function through a mechanism termed entrainment. Through entrainment, electrophysiological brain activity maintains and continues contextual rhythms beyond their offset. Our experiment combined exposure to repetitive prosodic contours with the subsequent presentation of visual sentences that either matched or mismatched the duration of the preceding contour. During exposure to prosodic contours, we observed MEG coherence with the contours, which was source-localized to right-hemispheric auditory areas. During the processing of the visual targets, activity at the frequency of the preceding contour was still detectable in the MEG; yet sources shifted to the (left) frontal cortex, in line with a functional inheritance of the rhythmic acoustic context for prediction. Strikingly, when the target sentence was shorter than expected from the preceding contour, an omission response appeared in the evoked potential record. We conclude that prosodic entrainment is a functional mechanism of temporal prediction in language comprehension. In general, acoustic rhythms appear to endow language for employing the brain's electrophysiological mechanisms of temporal prediction.

Multiple predictions during language comprehension: Friends, foes, or indifferent companions?

To comprehend language, we continually use prior context to pre-activate expected upcoming information, resulting in facilitated processing of incoming words that confirm these predictions. But what are the consequences of disconfirming prior predictions? To address this question, most previous studies have examined unpredictable words appearing in contexts that constrain strongly for a single continuation. However, during natural language processing, it is far more common to encounter contexts that constrain for multiple potential continuations, each with some probability. Here, we ask whether and how pre-activating both higher and lower probability alternatives influences the processing of the lower probability incoming word. One possibility is that, similar to language production, there is continuous pressure to select the higher-probability pre-activated alternative through competitive inhibition. During comprehension, this would result in relative costs in processing the lower probability target. A second possibility is that if the two pre-activated alternatives share semantic features, they mutually enhance each other's pre-activation. This would result in greater facilitation in processing the lower probability target. To distinguish between these accounts, we recorded ERPs as participants read three-sentence scenarios that constrained either for a single word or for two potential continuations – a higher probability expected candidate and a lower probability second-best candidate. We found no evidence that competitive pre-activation between the expected and second-best candidates resulted in costs in processing the second-best target, either during lexico-semantic processing (indexed by the N400) or at later stages of processing (indexed by a later frontal positivity). Instead, we found only benefits of pre-activating multiple alternatives, with evidence of enhanced graded facilitation on lower-probability targets that were semantically related to a higher-probability pre-activated alternative. These findings are consistent with a previous eye-tracking study by Luke and Christianson (2016, Cogn Psychol) using corpus-based materials. They have significant theoretical implications for models of predictive language processing, indicating that routine graded prediction in language comprehension does not operate through the same competitive mechanisms that are engaged in language production. Instead, our results align more closely with hierarchical probabilistic accounts of language comprehension, such as predictive coding.

Structural prediction during language comprehension revealed by electrophysiology: Evidence from Italian auxiliaries.

Prediction in language comprehension has become a key mechanism in recent psycholinguistic theory, with evidence from lexical prediction as a primary source. Less work has focused on whether comprehenders also make structural predictions above the lexical level. Previous research shows that processing is facilitated for syntactic structures which are predictable based on context; however, there is so far no direct evidence that speakers formulate structural predictions ahead of encountering input. We investigated whether subject noun animacy cues comprehenders to predict different verb phrase (VP) structures, with the incompatibility between a low animacy subject and an Agent interpretation of transitives/unergative VPs predicting a derived (passive/unaccusative) VP structure, using Italian auxiliaries. Native Italian speakers read sentences with subject nouns varying from high to low animacy followed by the auxiliary avereHAVE, which is compatible with underived VPs, or essereBE, which is compatible with derived VPs. The auxiliary avereHAVE elicited greater frontal negativity when preceded by a subject noun with lower animacy. The auxiliary essereBE elicited no differential ERP given subject animacy. We propose that this frontal negativity reflects violation of a structural prediction, with amplitude reflecting the strength of initial commitment or difficulty in revising a predicted structure. Differences between auxiliaries are proposed to follow from the more specific distribution of avereHAVE. We argue that this evidence unambiguously supports a predictive mechanism for phrase-level structure. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Error-based structure prediction in language comprehension: Evidence from verb bias effects in a visual-world structural priming paradigm for Mandarin Chinese.

Structural priming studies in production have demonstrated stronger priming effects for unexpected sentence structures (inverse preference effect). This is consistent with error-based implicit learning accounts that assume learning depends on prediction error. Such prediction error can be verb-specific, leading to strong priming when a verb that is for instance biased toward the prepositional object (PO) structure occurs with an unexpected double object (DO) structure. However, it is unclear whether this mechanism also holds for language comprehension, especially for languages like Mandarin Chinese, which arguably depends strongly on semantics to predict syntax in comprehension. Experiment 1 was a norming study (N = 367) that measured the biases (DO vs. PO) of 48 Mandarin Chinese dative verbs. Experiment 2 (N = 72) crossed verb bias (DO-bias or PO-bias) and structure (DO or PO) of prime sentences in a visual-world paradigm, to examine whether Mandarin comprehenders show an inverse preference effect. The priming effect is expressed as the proportion of looks to the predicted referent (i.e., the recipient after a DO-prime, the theme after a PO-prime), for two critical time windows during target sentence processing: the verb and the first syllable of the first postverbal noun (which was identical in theme and recipient). There was priming in both time windows, even though the verb differed between prime and target. Importantly, there was an inverse preference effect (i.e., stronger priming after a DO prime with a PO-biased verb than with a DO-biased verb) in the second time window. These results provide evidence for an error-based structure prediction system in comprehension. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The fate of the unexpected: Consequences of misprediction assessed using ERP repetition effects

Amid increasing interest in the role of prediction in language comprehension, there remains a gap in our understanding of what happens when predictions are disconfirmed. Are unexpected words harder to process and encode because of interference from the original prediction? Or, because of their relevance for learning, do expectation violations strengthen the representations of unexpected words? In two experiments, we used event-related potentials to probe the downstream consequences of prediction violations. Critical words were unexpected but plausible completions of either strongly constraining sentences, wherein they constituted a prediction violation, or weakly constraining sentences that did not afford a clear prediction. Three sentences later the critical word was repeated at the end of a different, weakly constraining sentence. In Experiment 1, repeated words elicited a reduced N400 and an enhanced late positive complex (LPC) compared to words seen for the first time. Critically, there was no effect of initial sentence constraint on the size of the repetition effect in either time window. Thus, prediction violations did not accrue either costs or benefits for later processing. Experiment 2 used the same critical items and added strongly constraining filler sentences with expected endings to further promote prediction. Again, there was no effect of initial sentence constraint on either the N400 or the LPC to repeated critical words. When taken with prior findings, the results suggest that prediction is both powerful and flexible: It can facilitate processing of predictable information by reducing encoding effort without causing processing difficulties for unexpected inputs.

Are Linguistic Prediction Deficits Characteristic of Adults with Dyslexia?

Individuals with dyslexia show deficits in phonological abilities, rapid automatized naming, short-term/working memory, processing speed, and some aspects of sensory and visual processing. There is currently one report in the literature that individuals with dyslexia also show impairments in linguistic prediction. The current study sought to investigate prediction in language processing in dyslexia. Forty-one adults with dyslexia and 43 typically-developing controls participated. In the experiment, participants made speeded-acceptability judgements in sentences with word final cloze manipulations. The final word was a high-cloze probability word, a low-cloze probability word, or a semantically anomalous word. Reaction time from the onset of the final word to participants’ response was recorded. Results indicated that individuals with dyslexia showed longer reaction times, and crucially, they showed clear differences from controls in low predictability sentences, which is consistent with deficits in linguistic prediction. Conclusions focus on the mechanism supporting prediction in language comprehension and possible reasons why individuals with dyslexia show less prediction.

Commonalities in alpha and beta neural desynchronizations during prediction in language comprehension and production

The present study investigates whether predictions during language comprehension are generated by engaging the language production system. Previous studies investigating either prediction or production highlighted M/EEG desynchronization (power decrease) in the alpha (8–10 Hz) and beta (13–30 Hz) frequency bands preceding the target. However, it is unclear whether this electrophysiological modulation underlies common mechanisms. We recorded EEG from participants performing both a comprehension and a production task in two separate blocks. Participants listened to high and low constraint incomplete sentences and were asked either to name a picture to complete them (production) or to simply listen to the final word (comprehension). We found that in a silent gap before the final stimulus, predictable stimuli elicited alpha and beta desynchronization in both tasks, signaling the pre-activation of linguistic information. Source estimation highlighted the involvement of left-lateralized language areas and temporo-parietal areas in the right hemisphere. Furthermore, correlations between the desynchronizations in comprehension and production showed spatiotemporal commonalities in language-relevant areas of the left hemisphere. As proposed by prediction-by-production models, our results suggest that comprehenders engage the production system while predicting upcoming words.

Lexical prediction in language comprehension: a replication study of grammatical gender effects in Dutch

ABSTRACTAn important question in predictive language processing is the extent to which prediction effects can reliably be measured on pre-nominal material (e.g. articles before nouns). Here, we present a large sample (N = 58) close replication of a study by Otten and van Berkum (2009). They report ERP modulations in relation to the predictability of nouns in sentences, measured on gender-marked Dutch articles. We used nearly identical materials, procedures, and data analysis steps. We fail to replicate the original effect, but do observe a pattern consistent with the original data. Methodological differences between our replication and the original study that could potentially have contributed to the diverging results are discussed. In addition, we discuss the suitability of Dutch gender-marked determiners as a test-case for future studies of pre-activation of lexical items.

Large-scale replication study reveals a limit on probabilistic prediction in language comprehension.

Do people routinely pre-activate the meaning and even the phonological form of upcoming words? The most acclaimed evidence for phonological prediction comes from a 2005 Nature Neuroscience publication by DeLong, Urbach and Kutas, who observed a graded modulation of electrical brain potentials (N400) to nouns and preceding articles by the probability that people use a word to continue the sentence fragment ('cloze'). In our direct replication study spanning 9 laboratories (N=334), pre-registered replication-analyses and exploratory Bayes factor analyses successfully replicated the noun-results but, crucially, not the article-results. Pre-registered single-trial analyses also yielded a statistically significant effect for the nouns but not the articles. Exploratory Bayesian single-trial analyses showed that the article-effect may be non-zero but is likely far smaller than originally reported and too small to observe without very large sample sizes. Our results do not support the view that readers routinely pre-activate the phonological form of predictable words.

The N400 as an index of lexical preactivation and its implications for prediction in language comprehension

ABSTRACTThe N400 component's amplitude is standardly reduced for predictable words. But it is not clear whether this reduction truly reflects preactivation of the critical word or whether it just indexes the difficulty of integrating the word with the sentence. To adjudicate between these two accounts, event-related potentials were recorded while participants read short stories. In half of the stories, just before the story-final sentence, we induced an explicit prediction of a congruent or an incongruent target word, thereby preactivating this word. Inducing prediction for the incongruent target word eliminated the N400, fully supporting the preactivation theory. This implies that the N400 is a marker of prediction and that prediction is an essential aspect of sentence comprehension. In addition, an analysis of the ERPs on the words preceding the critical target word provides evidence on how the target word becomes preactivated by the context.

Semantic prediction in language comprehension: evidence from brain potentials

ABSTRACTDo people predict specific word-forms during language comprehension? In an Event-Related Potential (ERP) study participants read German sentences with predictable (The goalkeeper claims that the slick ball was easy to CATCH.) and unpredictable (The kids boasted that the young horse was easy to SADDLE.) verbs. Verbs were either consistent with the expected word-form (catch/saddle) or inconsistent and therefore led to ungrammaticality (*catches/*saddles). ERPs within the N400 time-window were modulated by predictability but not by the surface-form of the verbs, suggesting that no exact word-forms were predicted. Based on our results we will argue that predictions included semantic rather than form-information. Furthermore, ungrammatical verbs led to a strong P600, probably due to task-saliency whereas correct unpredictable verbs elicited an anterior post-N400 positivity. Because the contexts were moderately constraining, this might reflect discourse revision processes rather than inhibition of a predicted word.

Limits on lexical prediction during reading

Efficient language processing may involve generating expectations about upcoming input. To investigate the extent to which prediction might facilitate reading, a large-scale survey provided cloze scores for all 2689 words in 55 different text passages. Highly predictable words were quite rare (5% of content words), and most words had a more-expected competitor. An eye-tracking study showed sensitivity to cloze probability but no mis-prediction cost. Instead, the presence of a more-expected competitor was found to be facilitative in several measures. Further, semantic and morphosyntactic information was highly predictable even when word identity was not, and this information facilitated reading above and beyond the predictability of the full word form. The results are consistent with graded prediction but inconsistent with full lexical prediction. Implications for theories of prediction in language comprehension are discussed.

Dynamicity and dialogue

The article surveys how Functional Discourse Grammar (FDG; Hengeveld & Mackenzie 2008) has responded to Simon Dik’s call for a functional grammar to have ‘psychological adequacy’ and draws parallels to similar initiatives from other approaches. After a brief history of what has later come to be known as cognitive adequacy, the impact of psycholinguistic notions on the architecture of FDG is discussed and exemplified with emphasis on how FDG confronts the tension between the static nature of a pattern model of grammar and the dynamicity of the communicative process. The article then turns to four ways in which FDG has responded in recent years to ongoing work in psycholinguistics. The first concerns how the incrementality of language production, i.e. the gradual earlier-to-later build-up of utterances, has inspired FDG’s coverage of fragmentary discourse acts and its Depth-First Principle. The second, pertaining to the role of prediction in language comprehension, is reflected in the countdown to a clause-final position PF. The third is priming, involving the reuse of elements of structure at all levels of analysis: this interferes with the mapping of function onto form in ways that have been explored in FDG. The fourth is dialogical alignment, the manner in which participants in dialogue mutually accommodate their language use; this has led to new understandings of the respective roles of FDG’s Conceptual and Contextual Components. Taken together, these developments have moved FDG towards modelling dialoguing interactants rather than an isolated speaker.

Encouraging prediction during production facilitates subsequent comprehension: Evidence from interleaved object naming in sentence context and sentence reading.

Many studies have shown that a supportive context facilitates language comprehension. A currently influential view is that language production may support prediction in language comprehension. Experimental evidence for this, however, is relatively sparse. Here we explored whether encouraging prediction in a language production task encourages the use of predictive contexts in an interleaved comprehension task. In Experiment 1a, participants listened to the first part of a sentence and provided the final word by naming aloud a picture. The picture name was predictable or not predictable from the sentence context. Pictures were named faster when they could be predicted than when this was not the case. In Experiment 1b the same sentences, augmented by a final spill-over region, were presented in a self-paced reading task. No difference in reading times for predictive versus non-predictive sentences was found. In Experiment 2, reading and naming trials were intermixed. In the naming task, the advantage for predictable picture names was replicated. More importantly, now reading times for the spill-over region were considerable faster for predictive than for non-predictive sentences. We conjecture that these findings fit best with the notion that prediction in the service of language production encourages the use of predictive contexts in comprehension. Further research is required to identify the exact mechanisms by which production exerts its influence on comprehension.

Language prediction in aging and aphasia

Language prediction in aging and aphasia

Preface to special issue “prediction in language comprehension and production”

Humans use prediction in many cognitive domains, for example, to avoid getting hit by a bus, to putt a golf ball, or to find the right moment to interrupt a chatty interlocutor. It is experimentall...

What do we mean by prediction in language comprehension?

ABSTRACTWe consider several key aspects of prediction in language comprehension: its computational nature, the representational level(s) at which we predict, whether we use higher-level representations to predictively pre-activate lower level representations, and whether we “commit” in any way to our predictions, beyond pre-activation. We argue that the bulk of behavioural and neural evidence suggests that we predict probabilistically and at multiple levels and grains of representation. We also argue that we can, in principle, use higher-level inferences to predictively pre-activate information at multiple lower representational levels. We suggest that the degree and level of predictive pre-activation might be a function of its expected utility, which, in turn, may depend on comprehenders’ goals and their estimates of the relative reliability of their prior knowledge and the bottom-up input. Finally, we argue that all these properties of language understanding can be naturally explained and productively explored within a multi-representational hierarchical actively generative architecture whose goal is to infer the message intended by the producer, and in which predictions play a crucial role in explaining the bottom-up input.

Structural prediction in aphasia

Structural prediction in aphasia

Prediction in language comprehension beyond specific words: An ERP study on sentence comprehension in Polish

Recently, several ERP studies have shown that the human language comprehension system anticipates words that are highly likely continuations of a given text. However, it remains an open issue whether the language comprehension system can also make predictions that go beyond a specific word. Here, we address the question of whether readers predict broad semantically defined classes of words. Event-related brain potentials were recorded, while native Polish speakers read short stories for comprehension. The stories were setting up a context that was very strongly biasing towards either an animate or an inanimate direct object noun in the story-final sentence. At the same time, the context was highly predictive for a specific direct object noun or not predictive for a specific direct object noun. The noun that was actually presented either did fit the animacy bias of the context or did not fit. The noun was preceded by an adjective. Polish has four classes of grammatical gender in the singular: feminine, neuter, masculine-animate, and masculine-inanimate. The prenominal adjective agrees with the direct object noun with respect to case and, in the case of masculine-animate and masculine-inanimate nouns, with respect to the in-/animacy of the noun. This allowed us to probe, at the adjective, whether the comprehension system predicts the in-/animacy of the direct object noun. Prediction-inconsistent adjectives elicited a negativity relative to prediction-consistent adjectives. This negativity was of the same size for contexts biasing towards a specific noun and for contexts not biasing towards a specific noun. These findings show that the comprehension system can predict semantically defined classes of words.