Unpredictable Words Research Articles

Robust effects of predictability across experimental contexts: Evidence from event-related potentials

Many experiments have shown that comprehenders can generate predictions about upcoming inputs on the fly, but relatively little is known about whether and how comprehenders' sensitivity to predictability may be modulated by the experimental context. The present study used event-related potentials (ERPs) in two experiments to ask whether changing the overall predictive validity of the stimuli will affect comprehenders' brain responses to predictable as well as unpredictable words by manipulating the filler sentences, which made up 50% of the stimuli in each experiment. Contrary to the prediction that predictable words should be processed more easily and elicit a smaller N400 response in a more prediction-encouraging experimental context, we found that participants' N400 response to predictable as well as unpredictable words was smaller when the overall predictive validity of the stimuli was low (that is, when the filler items were incongruous compared to when they were predictable). Further, even though the use of different filler sentences did modulate comprehenders' ERP and behavioural responses, it did not modulate the effect of target word predictability on participants' ERP responses at all. We take the present findings to suggest that healthy young adults’ brain responses are inherently sensitive to the predictability of the incoming linguistic stimuli, and that this robust sensitivity can be observed regardless of the make-up of the experimental stimuli.

Flexible predictions during listening comprehension: Speaker reliability affects anticipatory processes

During listening comprehension, the identification of individual words can be strongly influenced by properties of the preceding context. While sentence context can facilitate both behavioral and neural responses, it is unclear whether these effects can be attributed to the pre-activation of lexico-semantic features or the facilitated integration of contextually congruent words. Moreover, little is known about how statistics of the broader language environment, or information about the current speaker, might shape these facilitation effects. In the present study, we measured neural responses to predictable and unpredictable words as participants listened to sentences for comprehension. Critically, we manipulated the reliability of each speaker's utterances, such that individual speakers either tended to complete sentences with words that were highly predictable (reliable speaker) or with words that were unpredictable but still plausible (unreliable speaker). As expected, the amplitude of the N400 was reduced for locally predictable words, but, critically, these context effects were also modulated by speaker identity. Sentences from a reliable speaker showed larger facilitation effects with an earlier onset, suggesting that listeners engaged in enhanced anticipatory processing when a speaker's behavior was more predictable. This finding suggests that listeners can implicitly track the reliability of predictive cues in their environment and use these statistics to adaptively regulate predictive processing.

Contextual predictability and phonetic attention

The interaction of contextual, high-level linguistic knowledge and the listener’s attention to low-level phonetic details has been the subject of a large body of research in speech perception for several decades. In the current paper, I investigate this interaction by considering the specific phenomenon of word predictability and its role in modulating the listener’s attention to subphonemic details of the acoustic signal. In the first experiment, subjects are presented with a discrimination task in which target words are presented in either predictable or unpredictable sentential context and then repeated in isolation, being either acoustically identical or subtly different. The subjects more accurately discriminate contextually unpredictable words, suggesting more attention to the phonetic details of words in unpredictable contexts. In the second experiment, considering the predictions of exemplar theory, I test whether this perceptual bias could result in changes in production. In this experiment, in which subjects heard and repeated sentences, I find a significant effect of word predictability on how close the subjects’ productions were to the model’s, which suggests a role of predictability on phonetic accommodation. The results of these experiments contribute to our understanding of stored exemplars and suggest the influence of contextual predictability in sound change.

Listener-oriented phonetic reduction and theory of mind

ABSTRACTPredictable words tend to be phonetically reduced relative to unpredictable words. Under “listener-oriented” accounts of this phenomenon, the talker has tacit knowledge of their interlocutor's mental state. These theories consequently predict that individual variation in theory of mind is related to magnitude of probabilistic phonetic reduction. The current study tests this prediction for three acoustic variables (word duration, vowel duration, and vowel dispersion) in two definitions of predictability (contextual predictability and discourse mention). A relationship between individual variation in theory of mind and phonetic reduction was observed only for semantic predictability, and in the direction opposite to that predicted by listener-oriented theories. Taken together, these results are not consistent with the predictions of a strong interpretation of listener-orientation in speech production.

Similar time courses for word form and meaning preactivation during sentence comprehension.

Current psycholinguistic research generally acknowledges that aspects of sentence comprehension benefit from neural preactivation of different types of information. However, despite strong support from a number of studies, routine specific word form preactivation has been challenged by Ito, Corley, Pickering, Martin, and Nieuwland (2016). They suggest that word form prediction is contingent upon having enough processing time and resources (afforded by slower input rates) to progress through unidirectional, productionlike stages of comprehension to arrive at word forms via semantic feature preactivation. This conclusion is based on findings from their ERP study, which used a related anomaly paradigm and reported form preactivation at a slow (700ms) word presentation rate but not a faster one (500ms). The present experimental design is a conceptual replication of Ito et al. (2016), testing young adults by measuring ERP amplitudes to unpredictable words related either semantically/associatively or orthographically to predictable sentence continuations, relative to unrelated continuations. Results showed that, at a visual presentation rate of two words per second, both types of related words show similarly reduced N400s, as well as varying degrees of increased posterior post-N400 positivity. These findings indicate that word form preactivation during sentence comprehension is detectable along a similar time course as semantic feature preactivation, and such processing does not necessarily require additional time beyond that afforded by near-normal reading rates.

A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension.

Emojis are ideograms that are becoming ubiquitous in digital communication. However, no research has yet investigated how humans process semantic and pragmatic content of emojis in real time. We investigated neural responses to irony-producing emojis, the question being whether emoji-generated irony is processed similarly to word-generated irony. Previous ERP studies have routinely found P600 effects to verbal irony. Our research sought to identify whether the same neural responses could also be elicited by emoji-induced irony. In three experiments, participants read sentences that ended in either a congruent, incongruent, or ironic (wink) emoji. Results across all three experiments demonstrated clear P600 effects, the amplitudes of which were correlated with participants’ tendency to treat the emoji as a marker of irony, as indicated by behavioral comprehension question responses. These ironic wink emojis also elicited a strong P200 effect, also found in studies of verbal irony processing. Moreover, unexpected emojis (both mismatch and ironic emoji) also elicited late frontal positivities, which have been implicated processing unpredicted words in context. These results are the first to identify how linguistically-relevant ideograms are processed in real-time at the neural level, and specifically draw parallels between the processing of word- and emoji-induced irony.

No prediction error cost in reading: Evidence from eye movements

Two eye movement while reading experiments address the issue of how reading of an unpredictable word is influenced by the presence of a more predictable alternative. The experiments replicate the robust effects of predictability on the probability of skipping and on early and late reading time measures. However, in both experiments, an unpredictable but plausible word was read no more slowly when another word was highly predictable (i.e., in a constraining context) than when no word was highly predictable (i.e., in a neutral context). In fact, an unpredictable word that was semantically related to the predictable alternative demonstrated facilitation in the constraining context, in relatively late eye movement measures. These results, which are consistent with Luke and Christianson’s (2016) corpus study, provide the first evidence from a controlled experimental design for the absence of a prediction error cost, and for facilitation of an unpredictable but semantically related word, during normal reading. The findings support a model of lexical predictability effects in which there is broad pre-activation of potential continuations, rather than discrete predictions of specific lexical items. Importantly, pre-activation of likely continuations does not result in processing difficulty when some other word is actually encountered.

Skipping syntactically illegal the previews: The role of predictability.

Readers tend to skip words, particularly when they are short, frequent, or predictable. Angele and Rayner (2013) recently reported that readers are often unable to detect syntactic anomalies in parafoveal vision. In the present study, we manipulated target word predictability to assess whether contextual constraint modulates the-skipping behavior. The results provide further evidence that readers frequently skip the article the when infelicitous in context. Readers skipped predictable words more often than unpredictable words, even when the, which was syntactically illegal and unpredictable from the prior context, was presented as a parafoveal preview. The results of the experiment were simulated using E-Z Reader 10 by assuming that cloze probability can be dissociated from parafoveal visual input. It appears that when a short word is predictable in context, a decision to skip it can be made even if the information available parafoveally conflicts both visually and syntactically with those predictions.

Predictability, plausibility, and two late ERP positivities during written sentence comprehension

Van Petten and Luka’s (2012, International Journal of Psychophysiology, 83(2), 176–190) literature survey of late positive ERP components elicited by more or less predictable words during sentence processing led them to propose two topographically and functionally distinct positivities: a parietal one associated with semantically incongruent words related to semantic reanalysis and a frontal one with unknown significance associated with congruent but lexically unpredicted words. With the goal of testing this hypothesis within a single set of experimental materials and participants, we report results from two ERP studies: Experiment 1, a post-hoc analysis of a dataset that varied on dimensions of both cloze probability (predictability) and plausibility, and Experiment 2, a follow-up study in which these factors were manipulated in a controlled fashion. In both studies, we observed distinct post-N400 positivities: a more anterior one to plausible, but not anomalous, low cloze probability sentence medial words, and a more posterior one to semantically anomalous sentence continuations. Taken together with an observed canonical cloze-modulated N400, these dual positivities indicate a dissociation between brain processes relating to written words׳ sentential predictability versus plausibility, clearly an important distinction for any viable neural or psycholinguistic model of written sentence processing.

Event-related brain potential study of expectancy and semantic matching in schizotypy

Priming studies have revealed semantic processing abnormalities in subjects that display high schizotypal traits. The objective of the present study was to further elucidate the contribution of predictive (expectancy) and integrative (semantic matching) context processing to the semantic deficit described in schizotypy. Thirty-six participants were assigned into high or low schizotypy groups according to their score on the Schizotypal Personality Questionnaire (SPQ), and event-related brain potentials were recorded while these individuals performed semantic judgments based on asymmetrically associated word pairs. Viewed in one direction (forward), the target was highly predictable from the prime, whereas in the backward direction, the prime-to-target association was weak. It was assumed that the forward condition would be dependent on expectancy generation, while the backward condition would rely on semantic matching. In the low-SPQ group, forward and backward related words evoked a reduced (less negative) N400 amplitude compared to unrelated words, resulting in a significant forward and backward N400 priming effect, respectively. By contrast, only forward related words were facilitated in the high-SPQ group, resulting in significant forward priming and a lack of backward priming. Furthermore, the N400 amplitude for forward related words was less negative within the high-SPQ group in comparison to the low-SPQ group, which indicated easier semantic access to predictable words for high-SPQ individuals. Therefore, schizotypy may be associated with an imbalance in the use of predictive and integrative context processing strategies, namely preserved, if not overallocated, expectancy generation along with altered integration of unpredictable words due to semantic matching deficit.

The effect of word predictability on reading time is logarithmic

It is well known that real-time human language processing is highly incremental and context-driven, and that the strength of a comprehender’s expectation for each word encountered is a key determinant of the difficulty of integrating that word into the preceding context. In reading, this differential difficulty is largely manifested in the amount of time taken to read each word. While numerous studies over the past thirty years have shown expectation-based effects on reading times driven by lexical, syntactic, semantic, pragmatic, and other information sources, there has been little progress in establishing the quantitative relationship between expectation (or prediction) and reading times. Here, by combining a state-of-the-art computational language model, two large behavioral data-sets, and non-parametric statistical techniques, we establish for the first time the quantitative form of this relationship, finding that it is logarithmic over six orders of magnitude in estimated predictability. This result is problematic for a number of established models of eye movement control in reading, but lends partial support to an optimal perceptual discrimination account of word recognition. We also present a novel model in which language processing is highly incremental well below the level of the individual word, and show that it predicts both the shape and time-course of this effect. At a more general level, this result provides challenges for both anticipatory processing and semantic integration accounts of lexical predictability effects. And finally, this result provides evidence that comprehenders are highly sensitive to relative differences in predictability – even for differences between highly unpredictable words – and thus helps bring theoretical unity to our understanding of the role of prediction at multiple levels of linguistic structure in real-time language comprehension.

Sühne: Texte unterwegs by L´szl Végel

reviews resulted in massive evacuations and downright starvation. He and Berlin do not lack for history, and as far as the city is concerned, even with all that’s been destroyed or forgotten, he is right that, if anything, an excess of history remains today. Ulf Zimmermann Kennesaw State University Araceli Tinajero. Kokoro, una mexicana en Japón. Madrid. Editorial Verbum. 2012. isbn 9788479627119 Kokoro, una mexicana en Japón is a memoir that relates various trips to Japan that Araceli Tinajero made during the 1980s. Tinajero expresses what she saw, experienced, and learned about herself, her Mexican culture, and the traditional and contemporary way of Japanese life in a bittersweet manner. Valuable for its bicultural content and flavor, the book entertains with the details of lives in the two different cultures: Mexican and Japanese . Kokoro, una mexicana en Japón shows how people are basically just people no matter where they live or from which background they come. The common denominator for all of us is our willingness to reach toward one another in camaraderie. This intriguing read covers various years during the 1980s and presents Japan as a changing and changed society from the post–World War II era into a more contemporary time. As a document of social criticism, Tinajero also details the discrimination and marginalization of ethnic groups within Japan and examines inequality in 1980s Japan. The traditional styles of dress, food varieties, idiosyncrasies of work, sports fanaticism, gang loyalties , the minutiae of sūmo, the intricate and efficient workings of the Japanese train system, and the delicacies of the social customs inherent to Japan are all described in sensitive language and in minute detail. The comparisons Tinajero makes to similar /dissimilar customs and traditions in Mexico are enlightening, as is her examination of the close relationship between Japanese and Mexican fine arts and literary endeavors, which make up two of the final chapters of the book. Although Kokoro is not a novel but rather a cultural Baedeker, it maintains the reader’s interest and attention throughout. According to Tinajero, the Japanese word kokoro translates as the heart or soul of a person , and in this book Tinajero exhibits both elements in poignant fashion, especially when she writes about the 2008 death of one of her closest friends during the 1980s, Kimiko. The reader empathizes with the author, who describes her somber return to Japan to visit Kimiko’s grave. The only discordant note in the book is the insertion of two chapters, toward the end, which offer lists of writers, artists, sculptors, and collectors of Mexican folkloric costumes, with detailed explanations that are of interest but not pertinent to the overall tone of the memoir. For a student of Japanese and/or Mexican cultural studies, these chapters could be relevant, but for the reader of Kokoro, una mexicana en Japón whose primary focus is on the memoir of a Mexican living in Japan, these two chapters seem somewhat out of place. Janet Mary Livesey University of Oklahoma László Végel. Sühne: Texte unterwegs. Lacy Kornitzer, tr. Berlin. Matthes und Seitz. 2012. isbn 9783882215991 This slender volume of personal essays is the latest multilingual contribution of the accomplished fiction writer László Végel to the intellectual discussion about the legacy of Yugoslav socialism and the lingering mutual misperceptions that span the former Iron Curtain. In these loosely connected, lyrical essays built around the author’s various stays in Berlin since 1988, we can tease out two related questions of great importance to the author: What is it about the strange life and death of the country called Yugoslavia that left no one willing to bury its corpse— that is, to defend in real time or to honor it posthumously—and why, in the postsocialist world, do so much misery, misunderstanding, and political myopia continue to exist in 78 World Literature Today Alessio Zanelli Over Misty Plains Indigo Dreams Publishing A reflective take on aging, illness, loss, and the beauty of physical landscapes, Zanelli offers a meditative approach in his latest poetry compilation. Exploring themes of mortality, love, and a sense of belonging, he also incorporates traces of humor and unpredictable word selection...

Repetition is easy: Why repeated referents have reduced prominence

The repetition and the predictability of a word in a conversation are two factors that are believed to affect whether it is emphasized: predictable, repeated words are less acoustically prominent than unpredictable, new words. However, because predictability and repetition are correlated, it is unclear whether speakers lengthen unpredictable words to facilitate comprehension or whether this lengthening is the result of difficulties in accessing a new (nonrepeated) lexical item. In this study, we investigated the relationship between acoustic prominence, repetition, and predictability in a description task. In Experiment 1, we found that repeated referents are produced with reduced prominence, even when these referents are unexpected. In Experiment 2, we found that predictability and repetition both have independent effects on duration and intensity. However, word duration was primarily determined by repetition, and intensity was primarily determined by predictability. The results are most consistent with an account in which multiple cognitive factors influence the acoustic prominence of a word.

Skill generalisation in teaching spelling to children with learning difficulties

A central focus in remedial teaching is the generalisation of responses to contexts in which a student has never been explicitly instructed. Remarkably little is known about how and when generalisation occurs. In this article we examine generalisation effects in the context of spelling. Three areas are discussed: generalisation between spelling and reading, generalisation to untrained sound-letter-correspondences and generalisation to untrained unpredictable words. The research presented indicates both that reading training often leads to spelling improvements and that spelling training leads to reading improvements. There is a tendency for spelling training to be more likely to induce changes in reading than vice versa. In addition, for unpredictable words, generalisation is more likely to occur for words of high frequency and words that are orthographically similar to many other words. We conclude that a better understanding of how generalisation occurs will enable us to improve the efficiency and effectiveness of remedial spelling programmes.

Listening to the sound of silence: disfluent silent pauses in speech have consequences for listeners

Silent pauses are a common form of disfluency in speech yet little attention has been paid to them in the psycholinguistic literature. The present paper investigates the consequences of such silences for listeners, using an Event-Related Potential (ERP) paradigm. Participants heard utterances ending in predictable or unpredictable words, some of which included a disfluent silence before the target. In common with previous findings using er disfluencies, the N400 difference between predictable and unpredictable words was attenuated for the utterances that included silent pauses, suggesting a reduction in the relative processing benefit for predictable words. An earlier relative negativity, topographically distinct from the N400 effect and identifiable as a Phonological Mismatch Negativity (PMN), was found for fluent utterances only. This suggests that only in the fluent condition did participants perceive the phonology of unpredictable words to mismatch with their expectations. By contrast, for disfluent utterances only, unpredictable words gave rise to a late left frontal positivity, an effect previously observed following ers and disfluent repetitions. We suggest that this effect reflects the engagement of working memory processes that occurs when fluent speech is resumed. Using a surprise recognition memory test, we also show that listeners were more likely to recognise words which had been encountered after silent pauses, demonstrating that silence affects not only the process of language comprehension but also its eventual outcome. We argue that, from a listener's perspective, one critical feature of disfluency is the temporal delay which it adds to the speech signal.

Not all disfluencies are are equal: The effects of disfluent repetitions on language comprehension

Disfluencies can affect language comprehension, but to date, most studies have focused on disfluent pauses such as er. We investigated whether disfluent repetitions in speech have discernible effects on listeners during language comprehension, and whether repetitions affect the linguistic processing of subsequent words in speech in ways which have been previously observed with ers. We used event-related potentials (ERPs) to measure participants’ neural responses to disfluent repetitions of words relative to acoustically identical words in fluent contexts, as well as to unpredictable and predictable words that occurred immediately post-disfluency and in fluent utterances. We additionally measured participants’ recognition memories for the predictable and unpredictable words. Repetitions elicited an early onsetting relative positivity (100–400ms post-stimulus), clearly demonstrating listeners’ sensitivity to the presence of disfluent repetitions. Unpredictable words elicited an N400 effect. Importantly, there was no evidence that this effect, thought to reflect the difficulty of semantically integrating unpredictable compared to predictable words, differed quantitatively between fluent and disfluent utterances. Furthermore there was no evidence that the memorability of words was affected by the presence of a preceding repetition. These findings contrast with previous research which demonstrated an N400 attenuation of, and an increase in memorability for, words that were preceded by an er. However, in a later (600–900ms) time window, unpredictable words following a repetition elicited a relative positivity. Reanalysis of previous data confirmed the presence of a similar effect following an er. The effect may reflect difficulties in resuming linguistic processing following any disruption to speech.

Event-Related Potentials Reveal Rapid Verification of Predicted Visual Input

Human information processing depends critically on continuous predictions about upcoming events, but the temporal convergence of expectancy-based top-down and input-driven bottom-up streams is poorly understood. We show that, during reading, event-related potentials differ between exposure to highly predictable and unpredictable words no later than 90 ms after visual input. This result suggests an extremely rapid comparison of expected and incoming visual information and gives an upper temporal bound for theories of top-down and bottom-up interactions in object recognition.

How important are linguistic factors in word skipping during reading?

The probability of skipping a word is influenced by its processing ease. For instance, a word that is predictable from the preceding context is skipped more often than an unpredictable word. A meta-analysis of studies examining this predictability effect reported effect sizes ranging from 0 to 13%, with an average of 8%. One study does not fit within this picture and reported 23% more skipping of Dutch pronouns in sentences in which the pronoun had no disambiguating value (e.g. 'Mary was envious of Helen because she never looked so good') than in sentences where it did have a disambiguating value (e.g. 'Mary was envious of Albert because she never looked so good'). We re-examined this ambiguity in Dutch using a task that more closely resembles normal reading and observed only a 9% difference in skipping of the pronoun, bringing this linguistic effect in line with the other findings.

Spelling pronunciation and visual preview both facilitate learning to spell irregular words

Spelling pronunciations are hypothesized to be helpful in building up relatively stable phonologically underpinned orthographic representations, particularly for learning words with irregular phoneme-grapheme correspondences. In a four-week computer-based training, the efficacy of spelling pronunciations and previewing the spelling patterns on learning to spell loan words in Dutch, originating from French and English, was examined in skilled and less skilled spellers with varying ages. Reading skills were taken into account. Overall, compared to normal pronunciation, spelling pronunciation facilitated the learning of the correct spelling of irregular words, but it appeared to be no more effective than previewing. Differences between training conditions appeared to fade with older spellers. Less skilled young spellers seemed to profit more from visual examination of the word as compared to practice with spelling pronunciations. The findings appear to indicate that spelling pronunciation and allowing a preview can both be effective ways to learn correct spellings of orthographically unpredictable words, irrespective of age or spelling ability.

Age of acquisition effects on spelling in surface dysgraphia

Background: It is not known whether the age of acquisition (AoA) of a word has any significant effect on the spelling performance of normal or impaired speakers. One way to explore this question is to examine the effects of AoA on surface dysgraphia. Aims: We report MK, a patient who suffered herpes simplex viral encephalitis (HSVE) resulting in semantic anomia and surface dysgraphia that we characterise as a tendency to produce a legitimate alternative spelling of a component defined as a LASC error. Methods & Procedures: We describe MK's neuropsychological profile, giving details of impaired naming, spoken and written word comprehension, written picture naming, oral reading, and spelling to dictation, but preserved repetition of whole words. We report experiments designed (1) to test the effect of AoA on spelling by controlling for word frequency as well as other correlated variables using logistic regression and ANOVA, and (2) to test the effects of AoA and sound to spelling predictability on MK's spelling. Outcomes and Results: The results show an effect of AoA but no independent effect of frequency on spelling and an interaction between AoA and predictability, i.e., an effect of AoA on unpredictable word spelling but no effect of AoA on predictable word spelling. Conclusions: We discuss these data with reference to accounts of AoA that locate the effect at the level of mappings between input (phonological) and output (orthographic) representations. We argue that the effect of AoA on spelling is not the result of lexeme activation per se but instead reflects the largely unpredictable mappings between sound and spelling that characterise the majority of English word spellings.