Sentence Context Research Articles

Diverse frontoparietal connectivity supports semantic prediction and integration in sentence comprehension

Predictive processing in parietal, temporal, frontal, and sensory cortex allows us to anticipate future meanings to maximize the efficiency of language comprehension, with the temporoparietal junction (TPJ) and inferior frontal gyrus (IFG) thought to be situated towards the top of a predictive hierarchy. Although the regions underpinning this fundamental brain function are well-documented, it remains unclear how they interact to achieve efficient comprehension. To this end we recorded functional magnetic resonance imaging (fMRI) in 22 participants (11 males) while they comprehended sentences presented part-by-part, in which we manipulated the constraint provided by sentential contexts on upcoming semantic information. Using this paradigm, we examined the connectivity patterns of bilateral TPJ and IFG during anticipatory phases (i.e., before the onset of targets) and integration phases (i.e., after the onset of targets). When upcoming semantic content was highly predictable in strong-constraint contexts, both left TPJ and bilateral IFG showed stronger visual coupling, while right TPJ showed stronger connectivity with regions within control, default mode, and visual networks, including IFG, parahippocampal gyrus, posterior cingulate, and fusiform gyrus. These connectivity patterns were weaker when predicted semantic content appeared, in line with predictive coding theory. Conversely, for less predictable content, these connectivity patterns were stronger during the integration phase. Overall, these results suggest that both top-down semantic prediction and bottom-up integration during predictive processing are supported by flexible coupling of frontoparietal regions with control, memory, and sensory systems.Significance StatementRecent work has revealed the neural basis of predictive language comprehension. However, it remains unclear how brain regions change their connectivity in a dynamic fashion to support comprehension in highly predictive and less predictive contexts. Here, we show that stronger frontoparietal connectivity with cognitive control, memory, and sensory areas supports top-down prediction generation in strong-constraint contexts; these connectivity patterns are reduced when the anticipated information appears. This pattern is reversed when upcoming sensory input is unpredictable; connectivity is stronger after word inputs have been presented, allowing semantic integration with preceding low-constraint context. Our findings suggest that both top-down semantic prediction and bottom-up semantic integration in language comprehension rely upon diverse functional coupling of higher-order frontoparietal regions with other brain systems.

The gender congruency effect in sentence context depends on gender transparency and L2 proficiency: A self-paced reading study with Polish–German bilinguals

Aims and objectives: The gender congruency effect, and so the facilitated retrieval of grammatical gender for translation equivalents of the same gender, has been documented in the recognition of isolated words in L2. Our study investigates whether this effect extends to word recognition in sentence context and whether it is modulated by gender transparency and L2 proficiency. Design/methodology/approach: Sixty late unbalanced Polish–German bilinguals completed a self-paced reading task with noun phrases manipulated for lexical gender congruency with L1 (congruent, incongruent) and noun-internal gender transparency in L2 (transparent, non-transparent). L2 proficiency was assessed through the Dialang test. Data and analysis: Reading times on the noun were analysed by means of linear mixed-effects modelling. Findings/conclusion: Results showed a gender congruency effect that was limited to transparent nouns and which was greater at lower L2 proficiency levels. Originality: The study is the first to investigate the gender congruency effect in the recognition of nouns embedded in grammatical sentences. Significance/implications: The study shows that the presence of a contextualising sentence does not eliminate the cross-language effects of grammatical gender. Furthermore, it provides first evidence that individual noun-internal gender cues modulate the gender congruency effect. The findings are discussed in terms of the relationship between gender transparency at the micro-level and the degree of activation of gender values.

Neurophysiological measures of covert semantic processing in neurotypical adolescents actively ignoring spoken sentence inputs: A high-density event-related potential (ERP) study

Language comprehension requires semantic processing of individual words and their context within a sentence. Well-characterized event-related potential (ERP) components (the N400 and late positivity component (LPC/P600)) provide neuromarkers of semantic processing, and are robustly evoked when semantic errors are introduced into sentences. These measures are useful for evaluating semantic processing in clinical populations, but it is not known whether they can be evoked in more severe neurodevelopmental disorders where explicit attention to the sentence inputs cannot be objectively assessed (i.e., when sentences are passively listened to). We evaluated whether N400 and LPC/P600 could be detected in adolescents who were explicitly ignoring sentence inputs. Specifically, it was asked whether explicit attention to spoken inputs was required for semantic processing, or if a degree of automatic processing occurs when the focus of attention is directed elsewhere? High-density ERPs were acquired from twenty-two adolescents (12–17 years), under two experimental conditions: 1. individuals actively determined whether the final word in a sentence was congruent or incongruent with sentence context, or 2. passively listened to background sentences while watching a video. When sentences were ignored, N400 and LPC/P600 were robustly evoked to semantic errors, albeit with reduced amplitudes and protracted/delayed latencies. Statistically distinct topographic distributions during passive versus active paradigms pointed to distinct generator configurations for semantic processing as a function of attention. Covert semantic processing continues in neurotypical adolescents when explicit attention is withdrawn from sentence inputs. As such, this approach could be used to objectively investigate semantic processing in populations with communication deficits.

The role of variable retrieval in effective learning

Current research on memory indicates that learning is most effective when it involves spaced retrieval practice of study materials. Here, we investigated whether the benefits of both retrieval practice and spacing can be further boosted when variability is introduced across practice sessions. Across six experiments, participants learned translations of foreign vocabulary, with foreign words embedded in contextual sentences hinting at the meaning of these words. These sentences were then either kept constant or varied from one learning cycle to another. Whenever repeated practice took the form of retrieval from long-term memory with contextual sentences serving as cues (with or without feedback after retrieval attempts), variable sentences led to better learning of the meanings of the embedded foreign words than constant sentences. The benefits of variable retrieval were observed both immediately after study and after a 24-h delay, and they were larger when retrieval practice was spaced rather than massed. However, these benefits were not appreciated by the learners who judged learning to be more effective with constant rather than variable cues. This metacognitive illusion, misaligning the effectiveness of learning and its appraisal by learners, was confirmed in the seventh experiment which focused on learning lecture content. Thus, while spaced retrieval practice employing variable cues clearly produces robust benefits for memory performance, such benefits may be severely underappreciated by the learners.

Exploring the Capabilities of ChatGPT in Ancient Chinese Translation and Person Name Recognition

Abstract This study examines the potential of ChatGPT, notable for its skill in standard modern languages, in the context of ancient Chinese. We focus on two fundamental tasks: translating ancient Chinese into modern Chinese and identifying ancient Chinese names. We conduct experiments on Shi Shuo Xin Yu, which is a collection of anecdotes, short conversations, and pithy observations on personalities who lived in China between about 150 and 420 A.D. We also include other methods, like Baidu Yiyan (ERNIE-Bot) for ancient-to-modern translation, and SIKU-RoBERTa for ancient Chinese name recognition. The results reveal that ChatGPT’s performance in ancient Chinese remains in need of enhancement, but it excels in the task of ancient-to-modern translation with the provision of a few context sentences. For the ancient Chinese name recognition, ChatGPT can outperform SIKU-RoBERTa model in terms of precision, but suffers from low recall.

Semantic inhibition impairment in college students with depressive states as evidenced by EEG and pupillometry during the hayling task

In this study we tested whether depression is associated with impaired semantic inhibition, resulting in symptoms of rumination and anhedonia. For this purpose and using the Beck Depression Inventory II (BDI-II) college students with depressive states (DEP) and matched controls (CTL) performed a Hayling’s task, while EEG and pupillometry measures were recorded. Participants were asked to complete sentential contexts with either a highly associated word (initiation) or a non-related word (inhibition), in response to randomly presented trial-by-trial cues. The DEP group, compared to the CTL group, showed lower performance, and reduced frontal negativity (N450) in inhibition trials. Source analyses revealed greater activation for inhibition trials than for initiation trials in bilateral orbitofrontal cortex for the CTL group, but the difference was reduced and more left lateralized for the DEP group. In addition, the DEP group showed more pupil size reactivity to inhibition trials than the CTL group, indicating higher cognitive effort during semantic inhibition. Finally, self-reported rumination and anhedonia correlated with N450 in inhibition trials, and rumination correlated with pupil dilation. Overall, this research contributes to understanding the neural underpinnings of impaired semantic inhibition in individuals with depression, with potential clinical applications.

Contextualised retrieval practice: the effect of context type and working memory capacity on word retention

ABSTRACT The present study on intentional retrieval practice compared the benefits of presenting words in either informative or uninformative sentence contexts. Participants first studied a list of English words with their translations. Then, they were all exposed to half of the words with informative sentences containing meaning clues in the Context Inference (CI) condition and half with uninformative sentences devoid of such clues in the Memory Retrieval (MR) condition as part of retrieval-based practising. Participants were required to type the L1 translation for each word presented using a mobile application. Data were collected by both form-recall and meaning-recall tests immediately afterwards and then a week later. In addition, this study focused on the relationship between working memory capacity (WMC) and word retention in these two conditions to explore the suggestion that individuals may benefit differently from retrieval practices. Although the results showed that both conditions contributed to word retention, the MR condition was significantly more effective than the CI condition for the participants’ long-term retention. Further, the results revealed an overall positive effect of WMC on word retention in both conditions, with high-WMC individuals achieving higher retention scores than low-WMC individuals. However, this effect was not modulated by the type of context condition.

Phonological Error Analysis in Reading Arabic Texts by Ninth Grade Students at the Wustha Level, Nurus Salam Islamic Boarding School, Mentayan, Bantan Subdistrict, Bengkalis Regency

This study attempts to identify the causes that led to the phonological mistakes of the stressing side, pauses, tones, and intonations in the Arabic text read by students at the Nurus Salam Mentayan Resident House's 9th grade Wustha level. The error analysis approach is used in this investigation to track the development of Arabic text reading abilities. In addition to recording techniques, freely engaged dialectical methods and observation are used in data collection. The study's findings demonstrated 50 errors in the stressed speech in both the speech and the sentence. The pause happened when one spoke the ma`rifat phrases in a sentence or number when one spoke the word Qaul and the phrase that came from it, and when one spoke the words and responses. 43 reading tones do not match the word's meaning; 4) 32 intonations on the intonation tune do not match the sentence or number's context. Since intonations are uttered consistently without regard to meaning, they cannot convey the structure and meaning of numbers. Several variables contribute to the incidence of mistakes, such as: 1) When it comes to suprasegmental sounds, particularly stressing, pauses, tones, and intonation, teachers pay insufficient attention to them. 2) In theory, no subjects like ashwat can accept the super-segmental sound element. 3) The mother tongue heavily impacts the use of this suprasegmental noise, as the students' reading habits of Indonesians are also flat, meaning they ignore tone, intonation, stressing, and pauses.

Defending Russell’s Theory of Definite Descriptions Against a Strawsonian Attack

Although Russell’s theory of definite descriptions is highlyappreciated in the area of philosophy of language, it has faced some objections from different angles. One of the major objections is known as the objection arising from incomplete definite descriptions. According to this objection, a speaker by his/her utterance of a sentence containing an incomplete definite description often succeeds in saying something true despite the fact that such a sentence always expresses a false proposition. This particular objection against Russell’s theory arises because of an ignorance concerning the distinction between the meaning of a sentence and the assertion made by a speaker by using that sentence in a particular context. To address this distinction between meaning and assertion Scott Soames’ theory concerning the connection between meaning and assertion has been adopted. With the help of this theory, it has been shown that the problem arising from incomplete definite descriptions does not pose a genuine threat to Russell’s theory. Philosophy and Progress, Vol#73-74; No#1-2; Jan-Dec 2023 P 317-336

Taking the Extra Listening Mile: Processing Spoken Semantic Context Is More Effortful for Older Than Young Adults.

Older adults use semantic context to generate predictions in speech processing, compensating for aging-related sensory and cognitive changes. This study aimed to gauge aging-related changes in effort exertion related to context use. The study revisited data from Harel-Arbeli et al. (2023) that used a "visual-world" eye-tracking paradigm. Data on efficiency of context use (response latency and the probability to gaze at the target before hearing it) and effort exertion (pupil dilation) were extracted from a subset of 14 young adults (21 to 27 years old) and 13 older adults (65 to 79 years old). Both age groups showed a similar pattern of context benefits for response latency and target word predictions, however only the older adults group showed overall increased pupil dilation when listening to context sentences. Older adults' efficient use of spoken semantic context appears to come at a cost of increased effort exertion.

Pendampingan Penguasaan Mufradat Melalui Ice Breaking Tebak Makna dalam Pengajaran Bahasa Arab di MDTA Madinatul Ulum Desa Margaluyu

For a student, increasing Arabic vocabulary is very important, especially for those who are involved in Arabic language education. The fewer vocabulary a student has, the slimmer his chances of mastering the context of Arabic sentences. Therefore, to make the learning process more interesting, media is needed in the learning process that is easy to understand and easy for students to master. So that the learning process can achieve the desired goals and be more dynamic, other tools or media are needed, such as audio-visual media, print projectors, films, games and so on. The opportunity to master the Arabic learning of vocabulary more easily if the learning media is better. The Arabic Language Education Study Program's Community Service uses the Participatory Action Research (PAR) method, namely a research method carried out in a participatory manner among MDTA Madinatul Ulum Margaluyu students. The service team will try to provide training and mentoring as a stimulus in an effort to improve students' abilities in mastering Arabic vocabulary through Picture Card Media.The results of the Arabic Language Education Study Program Service Team succeeded in improving the abilities of MDTA Madinatul Ulum City Margaluyu students regarding mastery of Arabic vocabulary at MDTA Madinatul Ulum Margaluyu.

Age differences in context use during reading and downstream effects on recognition memory.

It is well-known that sentential context modulates sentence processing. But does context also have effects that extend beyond the immediate moment, for example, by impacting the memory representations that people store? And are there age-related differences in this process? Here, we investigated this question. German readers who varied in age self-paced through constraining sentences that continued in a predictable or less predictable fashion. Participants' recognition memory was then tested for previously seen (i.e., "old") words and for initially predictable but not actually presented words (i.e., "lures"). The results showed that readers of all ages slowed down when reading unpredictable sentences. However, aging individuals maintained less sentence-specific information than younger adults: They not only understood sentential materials less correctly on the fly, but they also showed disproportionate rates of false remembering and less successful old-new discrimination in the recognition memory test. Of note, rates of false remembering were reduced in those aging readers who allocated more time toward reading unpredictable sentence continuations. Together, our results show that aging increases reliance on gist or schema-congruent processing but that more attentive encoding of text can buffer against some of the resulting memory distortions. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Declarative and Automatized Phonological Vocabulary Knowledge: Recognition, Recall, Lexicosemantic Judgment, and Listening‐Focused Employability of Second Language Words

AbstractThis study revisits the roles of different aspects of phonological vocabulary knowledge in second language (L2) listening. Japanese learners of English (n = 114) completed the TOEIC Listening test and three phonological vocabulary tests assessing (a) ability to recognize the meanings of aural forms (meaning recognition), (b) ability to recall the meanings of aural forms (meaning recall), and (c) ability to spontaneously judge the appropriate use of word meanings in sentential contexts (lexicosemantic judgment task [LJT]). Among the three measures, the LJT best predicted the participants’ ability to access the target words during real‐life L2 listening comprehension of monologues and conversations (measured via TOEIC). Structural equation modeling demonstrated that the LJT was distinct from both meaning recognition and recall and revealed their different associations with listening comprehension scores. In line with the skill acquisition theory, we propose that the LJT reflects automatized knowledge, whereas meaning recognition and recall represent declarative knowledge.

Higher reading spans mitigate context effects on lexical processing by low-proficiency L2 learners: a self-paced reading study

AbstractThis study examines context effects on lexical processing by low-proficiency Japanese learners of English during sentence comprehension, and the role of individual differences in verbal working memory (WM). Thirty Japanese learners of English as a second language (L2) and 27 speakers of English as a first language (L1) were recruited for a self-paced reading task with high and low context sentences to assess lexical processing abilities, and a reading span task to measure WM capacities. Bayesian modeling indicated that, at the group level, L2 learners had slower lexical processing times for low context sentences compared to high context ones, especially in the spillover region, while L1 speakers showed no difference. At the individual level, higher WM capacities among L2 learners appeared to mitigate these context effects, supporting the interactive-compensatory model (Stanovich in Read Res Q, 10.2307/747348, 1980; Remedial Spec Educ 5(3):11–19, 10.1177/074193258400500306, 1984). The findings highlight context effects on L2 lexical processing and the crucial role of WM in managing these effects among L2 learners.

Guessing errors made by children with dyslexia in word and text reading.

Children with dyslexia face persistent difficulties in reading acquisition, which results in poor reading accuracy. In addition to the commonly studied reading errors such as omissions, additions, substitutions, and letter reversals, they also make guessing errors characterized by replacing a word with an orthographic neighbor. These errors, which occur in the context of isolated words and sentence or text reading, might be linked to the inhibition issues that have already been demonstrated in connection to dyslexia. However, to the best of our knowledge, there is no experimental evidence that children with dyslexia make more guessing errors than typically developing children, as is the case for sequential errors. The current study aimed to evaluate whether children with dyslexia made more guessing errors than typically developing children and whether these errors were more frequent in an isolated word or sentence context. Twenty-eight children with dyslexia from Grade 4 were matched with typically developing children by either chronological age or reading level. Reading was assessed through word and text reading tasks. Error types were classified into seven categories and analyzed. A repeated-measure ANOVA showed that children with dyslexia made more guessing errors, particularly visual and morphemic errors, than typically developing children. Moreover, these errors were found at both the single word and sentence levels. These findings suggest that children with dyslexia tend to use a global treatment of words, relying on incomplete information to compensate for their difficulties. The findings have practical implications for pedagogical and therapeutic approaches.

Effective type label-based synergistic representation learning for biomedical event trigger detection

BackgroundDetecting event triggers in biomedical texts, which contain domain knowledge and context-dependent terms, is more challenging than in general-domain texts. Most state-of-the-art models rely mainly on external resources such as linguistic tools and knowledge bases to improve system performance. However, they lack effective mechanisms to obtain semantic clues from label specification and sentence context. Given its success in image classification, label representation learning is a promising approach to enhancing biomedical event trigger detection models by leveraging the rich semantics of pre-defined event type labels.ResultsIn this paper, we propose the Biomedical Label-based Synergistic representation Learning (BioLSL) model, which effectively utilizes event type labels by learning their correlation with trigger words and enriches the representation contextually. The BioLSL model consists of three modules. Firstly, the Domain-specific Joint Encoding module employs a transformer-based, domain-specific pre-trained architecture to jointly encode input sentences and pre-defined event type labels. Secondly, the Label-based Synergistic Representation Learning module learns the semantic relationships between input texts and event type labels, and generates a Label-Trigger Aware Representation (LTAR) and a Label-Context Aware Representation (LCAR) for enhanced semantic representations. Finally, the Trigger Classification module makes structured predictions, where each label is predicted with respect to its neighbours. We conduct experiments on three benchmark BioNLP datasets, namely MLEE, GE09, and GE11, to evaluate our proposed BioLSL model. Results show that BioLSL has achieved state-of-the-art performance, outperforming the baseline models.ConclusionsThe proposed BioLSL model demonstrates good performance for biomedical event trigger detection without using any external resources. This suggests that label representation learning and context-aware enhancement are promising directions for improving the task. The key enhancement is that BioLSL effectively learns to construct semantic linkages between the event mentions and type labels, which provide the latent information of label-trigger and label-context relationships in biomedical texts. Moreover, additional experiments on BioLSL show that it performs exceptionally well with limited training data under the data-scarce scenarios.

Early parafoveal semantic integration in natural reading.

Humans can read and comprehend text rapidly, implying that readers might process multiple words per fixation. However, the extent to which parafoveal words are previewed and integrated into the evolving sentence context remains disputed. We investigated parafoveal processing during natural reading by recording brain activity and eye movements using MEG and an eye tracker while participants silently read one-line sentences. The sentences contained an unpredictable target word that was either congruent or incongruent with the sentence context. To measure parafoveal processing, we flickered the target words at 60 Hz and measured the resulting brain responses (i.e. Rapid Invisible Frequency Tagging, RIFT) during fixations on the pre-target words. Our results revealed a significantly weaker tagging response for target words that were incongruent with the previous context compared to congruent ones, even within 100ms of fixating the word immediately preceding the target. This reduction in the RIFT response was also found to be predictive of individual reading speed. We conclude that semantic information is not only extracted from the parafovea but can also be integrated with the previous context before the word is fixated. This early and extensive parafoveal processing supports the rapid word processing required for natural reading. Our study suggests that theoretical frameworks of natural reading should incorporate the concept of deep parafoveal processing.

Semantic encoding during language comprehension at single-cell resolution.

From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale corticalrepresentation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding tothe words as fixed memory representations,their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively,weshow how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.

Category and Syntactic Functions in the Collocation of the Words Wabah and Pandemic: A Corpus Linguistics Overview

The COVID-19 pandemic has transformed many aspects of life, including language. Words such as 'outbreak' and 'pandemic' frequently appear in COVID-19-related news, and both carry similar meanings in referring to the rapid spread of contagious diseases that affect a large number of people in extensive areas. Although these terms are often used interchangeably, it remains unclear how they are employed in various sentence contexts. This research aims to analyze the categories and syntactic functions of the collocation of the words 'outbreak' and 'pandemic' in the Nusantara Corpus using a corpus linguistics method. The study utilizes a combined quantitative and qualitative approach to examine the collocation of 'outbreak' and 'pandemic' in the Nusantara Linguistic Corpus. Data analysis is based on corpus linguistic theory and collocation theory. The research findings indicate that the collocation of 'outbreak' and 'pandemic' words is identified in the Nusantara corpus. The frequency of the word 'outbreak' reaches 195 occurrences, while 'pandemic' appears 1,229 times. Therefore, it can be concluded that the collocation of 'outbreak' and 'pandemic' words can be syntactically categorized as verbs, nouns, adjectives, and prepositions. Moreover, in terms of syntactic functions, the collocation of 'outbreak' and 'pandemic' is classified as subjects, objects, complements, and adverbials. This research can be implemented in the use of 'outbreak' and 'pandemic' collocations in sentence construction by considering categories and syntactic functions to avoid semantic errors based on the correct context.

Could this be next for corpus linguistics? Methods of semi-automatic data annotation with contextualized word embeddings

Abstract This paper explores how linguistic data annotation can be made (semi-)automatic by means of machine learning. More specifically, we focus on the use of “contextualized word embeddings” (i.e. vectorized representations of the meaning of word tokens based on the sentential context in which they appear) extracted by large language models (LLMs). In three example case studies, we assess how the contextualized embeddings generated by LLMs can be combined with different machine learning approaches to serve as a flexible, adaptable semi-automated data annotation tool for corpus linguists. Subsequently, to evaluate which approach is most reliable across the different case studies, we use a Bayesian framework for model comparison, which estimates the probability that the performance of a given classification approach is stronger than that of an alternative approach. Our results indicate that combining contextualized word embeddings with metric fine-tuning yield highly accurate automatic annotations.