Upcoming Words Research Articles

Language-driven anticipatory eye movements in virtual reality

Predictive language processing is often studied by measuring eye movements as participants look at objects on a computer screen while they listen to spoken sentences. This variant of the visual-world paradigm has revealed that information encountered by a listener at a spoken verb can give rise to anticipatory eye movements to a target object, which is taken to indicate that people predict upcoming words. The ecological validity of such findings remains questionable, however, because these computer experiments used two-dimensional stimuli that were mere abstractions of real-world objects. Here we present a visual-world paradigm study in a three-dimensional (3-D) immersive virtual reality environment. Despite significant changes in the stimulus materials and the different mode of stimulus presentation, language-mediated anticipatory eye movements were still observed. These findings thus indicate that people do predict upcoming words during language comprehension in a more naturalistic setting where natural depth cues are preserved. Moreover, the results confirm the feasibility of using eyetracking in rich and multimodal 3-D virtual environments.

Getting ahead of yourself: Parafoveal word expectancy modulates the N400 during sentence reading.

An important question in the reading literature regards the nature of the semantic information readers can extract from the parafovea (i.e., the next word in a sentence). Recent eye-tracking findings have found a semantic parafoveal preview benefit under many circumstances, and findings from event-related brain potentials (ERPs) also suggest that readers can at least detect semantic anomalies parafoveally (Barber, Van der Meij, & Kutas, Psychophysiology, 50(1), 48-59, 2013). We use ERPs to ask whether fine-grained aspects of semantic expectancy can affect the N400 elicited by a word appearing in the parafovea. In an RSVP-with-flankers paradigm, sentences were presented word by word, flanked 2° bilaterally by the previous and upcoming words. Stimuli consisted of high constraint sentences that were identical up to the target word, which could be expected, unexpected but plausible, or anomalous, as well as low constraint sentences that were always completed with the most expected ending. Findings revealed an N400 effect to the target word when it appeared in the parafovea, which was graded with respect to the target's expectancy and congruency within the sentence context. Furthermore, when targets appeared at central fixation, this graded congruency effect was mitigated, suggesting that the semantic information gleaned from parafoveal vision functionally changes the semantic processing of those words when foveated.

Word-Based Grammars for PPM

The Prediction by Partial Matching (PPM) compression algorithm is considered one of the most efficient methods for compressing natural language text. Despite the advances of the PPM method for the English language to predict upcoming symbols or words, more research is required to devise better compression methods for other languages, such as Arabic due, for example, to the rich morphological nature of the Arabic text, where a word can take many different forms. In this paper, we propose a new method that achieves the best compression rates not only for Arabic text but also for other languages that use Arabic script in their writing system such as Persian. Our word-based method constructs a context-free grammar (CFG) for the text and this grammar is then encoded using PPM to achieve excellent compression rates.

How robust are prediction effects in language comprehension? Failure to replicate article-elicited N400 effects

ABSTRACTCurrent psycholinguistic theory proffers prediction as a central, explanatory mechanism in language processing. However, widely-replicated prediction effects may not mean that prediction is necessary in language processing. As a case in point, C. D. Martin et al. [2013. Bilinguals reading in their second language do not predict upcoming words as native readers do. Journal of Memory and Language, 69(4), 574–588. doi:10.1016/j.jml.2013.08.001] reported ERP evidence for prediction in native- but not in non-native speakers. Articles mismatching an expected noun elicited larger negativity in the N400 time window compared to articles matching the expected noun in native speakers only. We attempted to replicate these findings, but found no evidence for prediction irrespective of language nativeness. We argue that pre-activation of phonological form of upcoming nouns, as evidenced in article-elicited effects, may not be a robust phenomenon. A view of prediction as a necessary computation in language comprehension must be re-evaluated.

Effects of Vocabulary Size on Anticipatory Sentence Processing in Korean Learners of English

The present study investigates whether and the extent to which nonnative speakers of English exhibit anticipatory processing of English sentences in comparison to native speakers (Borovsky et al., 2012), using a looking-while-listening paradigm. We also examine the relationship between the anticipatory behavior and vocabulary knowledge of English as a second language. College students with high-intermediate English proficiency participated in an eye-tracking experiment and an offline measurement of vocabulary knowledge. The results revealed that the participants anticipate upcoming words, thereby incrementally processing English sentences as native speakers do. In doing so, they also actively make use of combinatory information of semantic cues and real-world knowledge, having advantage of a larger L2 vocabulary size.

Foreign-accented speech modulates linguistic anticipatory processes

Listeners are able to anticipate upcoming words during sentence comprehension, and, as a result, they also pre-activate semantically related words. In the present study, we aim at exploring whether these anticipatory processes are modulated by indexical properties of the speakers, such as a speaker's accent. Event-related brain potentials were obtained while native speakers of Spanish listened to native (Experiment 1) or foreign-accented speakers (Experiment 2) of Spanish producing highly constrained sentences. The sentences ended in: (1) the highest cloze probability completion, (2) a word semantically related to the expected ending, or (3) a word with no semantic overlap with the expected ending. In Experiment 1, we observed smaller N400 mean amplitudes for the semantically related words as compared to the words with no semantic overlap, replicating previous findings. In Experiment 2, we observed no difference in integrating semantically related and unrelated words when listening to accented speech. These results suggest that linguistic anticipatory processes are affected by indexical properties of the speakers, such as the speaker's accent.

World knowledge and novel information integration during L2 speech comprehension

In this study we explore whether world knowledge (WK) processing differs between individuals listening to their native (L1) or their non-native (L2) language. We recorded event-related brain potentials in L1 and L2 speakers of Spanish while they listened to sentences uttered by native speakers of Spanish. Sentences were either congruent or incongruent with participants’ WK. In addition, participants also listened to sentences in which upcoming words could not be anticipated on the basis of WK. WK violations elicited a late negativity of greater magnitude and duration in the L2 than the L1 group. However, sentences in which WK was not helpful regarding word anticipation elicited similar N400 modulations in both groups. These results suggest that WK processing requires a deeper lexical search in L2 comprehension than in L1 comprehension.

Listeners Exploit Syntactic Structure On-Line to Restrict Their Lexical Search to a Subclass of Verbs

Many experiments have shown that listeners actively build expectations about up-coming words, rather than simply waiting for information to accumulate. The online construction of a syntactic structure is one of the cues that listeners may use to construct strong expectations about the possible words they will be exposed to. For example, speakers of verb-final languages use pre-verbal arguments to predict on-line the kind of arguments that are likely to occur next (e.g., Kamide, 2008, for a review). Although in SVO languages information about a verb's arguments typically follows the verb, some languages use pre-verbal object pronouns, potentially allowing listeners to build on-line expectations about the nature of the upcoming verb. For instance, if a pre-verbal direct object pronoun is heard, then the following verb has to be able to enter a transitive structure, thus excluding intransitive verbs. To test this, we used French, in which object pronouns have to appear pre-verbally, to investigate whether listeners use this cue to predict the occurrence of a transitive verb. In a word detection task, we measured the number of false alarms to sentences that contained a transitive verb whose first syllable was homophonous to the target monosyllabic verb (e.g., target “dort” /dɔʁ/ to sleep and false alarm verb “dorlote” /dɔʁlɔt/ to cuddle). The crucial comparison involved two sentence types, one without a pre-verbal object clitic, for which an intransitive verb was temporarily a plausible option (e.g., “Il dorlote” / He cuddles) and the other with a pre-verbal object clitic, that made the appearance of an intransitive verb impossible (“Il le dorlote” / He cuddles it). Results showed a lower rate of false alarms for sentences with a pre-verbal object pronoun (3%) compared to locally ambiguous sentences (about 20%). Participants rapidly incorporate information about a verb's argument structure to constrain lexical access to verbs that match the expected subcategorization frame.

Learning to predict or predicting to learn?

ABSTRACTHumans complete complex commonplace tasks, such as understanding sentences, with striking speed and accuracy. This expertise is dependent on anticipation: predicting upcoming words gets us ahead of the game. But how do we master the game in the first place? To make accurate predictions, children must first learn their language. One possibility is that prediction serves double duty, enabling rapid language learning as well as understanding. Children could master the structures of their language by predicting how speakers will behave and, when those guesses are wrong, revising their linguistic representations. A number of prominent computational models assume that children learn in this way. But is that assumption correct? Here, we lay out the requirements for showing that children use “predictive learning”, and review the current evidence for this position. We argue that, despite widespread enthusiasm for the idea, we cannot yet conclude that children “predict to learn”.

On forward inferences of fast and slow readers. An eye movement study.

Unimpaired readers process words incredibly fast and hence it was assumed that top-down processing, such as predicting upcoming words, would be too slow to play an appreciable role in reading. This runs counter the major postulate of the predictive coding framework that our brain continually predicts probable upcoming sensory events. This means, it may generate predictions about the probable upcoming word during reading (dubbed forward inferences). Trying to asses these contradictory assumptions, we evaluated the effect of the predictability of words in sentences on eye movement control during silent reading. Participants were a group of fluent (i.e., fast) and a group of speed-impaired (i.e., slow) readers. The findings indicate that fast readers generate forward inferences, whereas speed-impaired readers do so to a reduced extent - indicating a significant role of predictive coding for fluent reading.

Automatic Answer Assessment in LMS Using Latent Semantic Analysis

Abstract E-Learning uses systems like Learning Management Systems (LMSs), to support and enhance teaching-learning process. When we compared some of the popular LMSs, a lack of efficient mechanisms to assess descriptive answers like long answers and essays, was observed. Also, it is tedious for the teachers to manually evaluate for large number of students. Hence, we propose an automatic system to assess descriptive answers of students and provide teachers with immediate feedback. This is achieved by first, comparing student's answer with teacher's ideal answer set, using latent semantic analysis (LSA). Then, estimating the order of previous and upcoming words in an answer using positional indexing, based on the keyword list added by the teacher. A final score is then generated depending on LSA, correct keyword usage and also on spell check. Cohen's kappa coefficient of human rater-tool agreement showed a good strength when the system was integrating into an existing LMS.

Registering eye movements during reading in Alzheimer’s disease: Difficulties in predicting upcoming words

Reading requires the fine integration of attention, ocular movements, word identification, and language comprehension, among other cognitive parameters. Several of the associated cognitive processes such as working memory and semantic memory are known to be impaired by Alzheimer’s disease (AD). This study analyzes eye movement behavior of 18 patients with probable AD and 40 age-matched controls during Spanish sentence reading. Controls focused mainly on word properties and considered syntactic and semantic structures. At the same time, controls’ knowledge and prediction about sentence meaning and grammatical structure are quite evident when we consider some aspects of visual exploration, such as word skipping, and forward saccades. By contrast, in the AD group, the predictability effect of the upcoming word was absent, visual exploration was less focused, fixations were much longer, and outgoing saccade amplitudes were smaller than those in controls. The altered visual exploration and the absence of a contextual predictability effect might be related to impairments in working memory and long-term memory retrieval functions. These eye movement measures demonstrate considerable sensitivity with respect to evaluating cognitive processes in Alzheimer’s disease. They could provide a user-friendly marker of early disease symptoms and of its posterior progression.

Can bilinguals see it coming? Word anticipation in L2 sentence reading.

Why is it more difficult to comprehend a 2nd (L2) than a 1st language (L1)? In the present article we investigate whether difficulties during L2 sentence comprehension come from differences in the way L1 and L2 speakers anticipate upcoming words. We recorded the brain activity (event-related potentials) of Spanish monolinguals, French-Spanish late bilinguals, and Spanish-Catalan early bilinguals while reading sentences in Spanish. We manipulated the ending of highly constrained sentences so that the critical noun was either expected or not. The expected and unexpected nouns were of different gender so that we could observe potential anticipation effects already on the article. In line with previous studies, a modulation of the N400 effect was observed on the article and the noun, followed by an anterior positivity on the noun. Importantly, this pattern was found in all 3 groups, suggesting that, at least when their 2 languages are closely related, bilinguals are able to anticipate upcoming words in a similar manner as monolinguals.

Effect of repetition proportion on language-driven anticipatory eye movements

Previous masked priming research in word recognition has demonstrated that repetition priming is influenced by experiment-wise information structure, such as proportion of target repetition. Research using naturalistic tasks and eye-tracking has shown that people use linguistic knowledge to anticipate upcoming words. We examined whether the proportion of target repetition within an experiment can have a similar effect on anticipatory eye movements. We used a word-to-picture matching task (i.e., the visual world paradigm) with target repetition proportion carefully controlled. Participants' eye movements were tracked starting when the pictures appeared, one second prior to the onset of the target word. Targets repeated from the previous trial were fixated more than other items during this preview period when target repetition proportion was high and less than other items when target repetition proportion was low. These results indicate that linguistic anticipation can be driven by short-term within-experiment trial structure, with implications for the generalization of priming effects, the bases of anticipatory eye movements, and experiment design.

Bilinguals reading in their second language do not predict upcoming words as native readers do

Abstract During reading, monolingual readers actively predict upcoming words from sentence context. Here we investigated whether bilingual readers predict sentence final words when they read in their second language. We recorded event-related potentials while English monolinguals (L1 comprehenders) and late Spanish–English bilinguals (L2 comprehenders) read sentences ending in an expected or unexpected noun. Lexical prediction was indexed by the amplitude of the N400 effect elicited by the article preceding the final noun, such that the more negative the N400, the less prediction as regards the final word. Contrary to L1 comprehenders, L2 comprehenders failed to show an N400 amplitude increase for unexpected articles. We interpret these results as evidence that L2 comprehenders do not actively predict upcoming words during sentence comprehension to the same extent as L1 comprehenders. This weaker capacity of lexical prediction in L2 might be one of the consequences of overall slower and less accurate linguistic processing stages in L2 relative to L1.

What belongs together goes together: the speaker-hearer perspective. A commentary on MacDonald's PDC account

What belongs together goes together: the speaker-hearer perspective. A commentary on MacDonald's PDC account

Structural syntactic prediction measured with ELAN: Evidence from ERPs

The current study used event-related potentials (ERPs) to investigate how and when argument structure information is used during the processing of sentences with a filler-gap dependency. We hypothesize that one specific property – animacy (living vs. non-living) – is used by the parser during the building of the syntactic structure. Participants heard sentences that were rated off-line as having an expected noun (Who did the Lion King chase the caravan with?) or an unexpected noun (Who did Lion King chase the animal with?). This prediction is based on the animacy properties relation between the wh-word and the noun in the object position. ERPs from the noun in the unexpected condition (animal) elicited a typical Early Left Anterior Negativity (ELAN)/P600 complex compared to the noun in the expected condition (caravan). Firstly, these results demonstrate that the ELAN reflects not only grammatical category violation but also animacy property expectations in filler-gap dependency. Secondly, our data suggests that the language comprehension system is able to make detailed predictions about aspects of the upcoming words to build up the syntactic structure.

Neuter is not Common in Dutch: Eye Movements Reveal Asymmetrical Gender Processing

Native speakers of languages with transparent gender systems can use gender cues to anticipate upcoming words. To examine whether this also holds true for a non-transparent two-way gender system, i.e. Dutch, eye movements were monitored as participants followed spoken instructions to click on one of four displayed items on a screen (e.g., Klik op [Formula: see text] rode appel [Formula: see text], 'Click on the[Formula: see text] red apple[Formula: see text]'). The items contained the target, a colour- and/or gender-matching competitor, and two unrelated distractors. A mixed-effects regression analysis revealed that the presence of a colour-matching and/or gender-matching competitor significantly slowed the process of finding the target. The gender effect, however, was only observed for common nouns, reflecting the fact that neuter gender-marking cannot disambiguate as all Dutch nouns become neuter when used as diminutives. The gender effect for common nouns occurred before noun onset, suggesting that gender information is, at least partially, activated automatically before encountering the noun.

Three perspectives on non-uniform linguistic attainment

D^hrowska's target article comes at a time when the study of individual diflerences is a more prominent thing than ever in both native and non-native language studies. For example, the cover of the most recent research report of the Max Planck Institute for Psycholinguistics proclaims: differences are a hallmark of our language faculty, and an upcoming issue of Language Learning is devoted to individual differences in second language learning. The variable of literacy, which D^browska considers a key element of a range of language-experiential influences on grammar development and language processing, is receiving renewed attention. For example, Huettig, Singh and Mishra (2011) find that high-literate Indian participants are faster than low-literates in directing their gaze to images of objects referenced in spoken sentences. Highliterates may be better able than low-literates to use grammatical and semantic information from sentence context to predict upcoming words. The skills that might underlie language development — and individual differences in the trainability of such skills — are actively investigated these days as well. Chandrasekaran et al. (2010), looking at the L2 acquisition of Mandarin pitch tone, found that individuals who were successful in the task attended to the direction of pitch contour change, and were also more trainable in pitch direction detection than less successful participants. Individual differences in the acquisition of L2 linguistic tones appear to be related to superior neural representation of pitch patterns in the inferior colliculus (Chandrasekaran et al., 2011). ^ Of course, inter-individual variability in language skills, academic achievement, intelligence, trainability, and literacy has not been ignored over the years. With respect to the literacy factor, for example, Fletcher (1981) showed in a picture

Skilled Deaf Readers Have an Enhanced Perceptual Span in Reading

Recent evidence suggests that, compared with hearing people, deaf people have enhanced visual attention to simple stimuli viewed in the parafovea and periphery. Although a large part of reading involves processing the fixated words in foveal vision, readers also utilize information in parafoveal vision to preprocess upcoming words and decide where to look next. In the study reported here, we investigated whether auditory deprivation affects low-level visual processing during reading by comparing the perceptual span of deaf signers who were skilled and less-skilled readers with the perceptual span of skilled hearing readers. Compared with hearing readers, the two groups of deaf readers had a larger perceptual span than would be expected given their reading ability. These results provide the first evidence that deaf readers’ enhanced attentional allocation to the parafovea is used during complex cognitive tasks, such as reading.