Semantic Context Effects Research Articles

DERCo: A Dataset for Human Behaviour in Reading Comprehension Using EEG

This paper introduces the DERCo (Dublin EEG-based Reading Experiment Corpus), a language resource combining electroencephalography (EEG) and next-word prediction data obtained from participants reading narrative texts. The dataset comprises behavioral data collected from 500 participants recruited through the Amazon Mechanical Turk online crowd-sourcing platform, along with EEG recordings from 22 healthy adult native English speakers. The online experiment was designed to examine the context-based word prediction by a large sample of participants, while the EEG-based experiment was developed to extend the validation of behavioral next-word predictability. Online participants were instructed to predict upcoming words and complete entire stories. Cloze probabilities were then calculated for each word so that this predictability measure could be used to support various analyses pertaining to semantic context effects in the EEG recordings. EEG-based analyses revealed significant differences between high and low predictable words, demonstrating one important type of potential analysis that necessitates close integration of these two datasets. This material is a valuable resource for researchers in neurolinguistics due to the word-level EEG recordings in context.

Semantic Context Effects in Picture and Sound Naming: Evidence from Event-related Potentials and Pupillometric Data.

When a picture is repeatedly named in the context of semantically related pictures, (homogeneous context) responses are slower than when the picture is repeatedly named in the context of unrelated pictures (heterogeneous context). This semantic interference effect in blocked-cyclic naming plays an important role in devising theories of word production. Wöhner, Mädebach, and Jescheniak [2021; Wöhner, S., Mädebach, A., & Jescheniak, J. D. Naming pictures and sounds: Stimulus type affects semantic context effects. Journal of Experimental Psychology: Human Perception and Performance, 47, 716-730, 2021] have shown that the effect is substantially larger when participants name environmental sounds than when they name pictures. We investigated possible reasons for this difference, using EEG and pupillometry. The behavioral data replicated Wöhner and colleagues. ERPs were more positive in the homogeneous compared with the heterogeneous context over central electrode locations between 140-180 msec and 250-350 msec for picture naming and between 250 and 350 msec for sound naming, presumably reflecting semantic interference during semantic and lexical processing. The later component was of similar size for pictures and sounds. ERPs were more negative in the homogeneous compared with the heterogeneous context over frontal electrode locations between 400 and 600 msec only for sounds. The pupillometric data showed a stronger pupil dilation in the homogeneous compared with the heterogeneous context only for sounds. The amplitudes of the late ERP negativity and pupil dilation predicted naming latencies for sounds in the homogeneous context. The latency of the effects indicates that the difference in semantic interference between picture and sound naming arises at later, presumably postlexical processing stages closer to articulation. We suggest that the processing of the auditory stimuli interferes with phonological response preparation and self-monitoring, leading to enhanced semantic interference.

Semantic facilitation in blocked picture categorization: Some data and considerations regarding task selection.

Semantic context effects in picture naming and categorization tasks are central to the development and evaluation of current models of word production. When pictures are named in a semantically blocked context, response latencies are delayed. Belke (2013) found that when the naming task was replaced with a semantic categorization task (natural vs. man-made), response latencies were facilitated. From this pattern, she concluded that semantic interference in blocked picture naming has its locus at the lexical level but its origin at the preceding semantic level. However, other studies using the blocking procedure have failed to find facilitation in semantic categorization tasks (Damian et al., 2001; Riley et al., 2015), calling this conclusion into question. In three blocked picture naming and categorization experiments, we investigated different variables that might account for the discrepant results in semantic categorization. We used different semantic categorization tasks, different response modalities, different response set sizes, and different blocking procedures. Semantic facilitation was reliably found in naturalness categorization, but there was no semantic effect in natural size categorization. We discuss the implications of these findings for appropriate task selection. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The Effect of Hearing Loss and Working Memory Capacity on Context Use and Reliance on Context in Older Adults.

Older adults often complain of difficulty in communicating in noisy environments. Contextual information is considered an important cue for identifying everyday speech. To date, it has not been clear exactly how context use (CU) and reliance on context in older adults are affected by hearing status and cognitive function. The present study examined the effects of semantic context on the performance of speech recognition, recall, perceived listening effort (LE), and noise tolerance, and further explored the impacts of hearing loss and working memory capacity on CU and reliance on context among older adults. Fifty older adults with normal hearing and 56 older adults with mild-to-moderate hearing loss between the ages of 60 and 95 years participated in this study. A median split of the backward digit span further classified the participants into high working memory (HWM) and low working memory (LWM) capacity groups. Each participant performed high- and low-context Repeat and Recall tests, including a sentence repeat and delayed recall task, subjective assessments of LE, and tolerable time under seven signal to noise ratios (SNRs). CU was calculated as the difference between high- and low-context sentences for each outcome measure. The proportion of context use (PCU) in high-context performance was taken as the reliance on context to explain the degree to which participants relied on context when they repeated and recalled high-context sentences. Semantic context helps improve the performance of speech recognition and delayed recall, reduces perceived LE, and prolongs noise tolerance in older adults with and without hearing loss. In addition, the adverse effects of hearing loss on the performance of repeat tasks were more pronounced in low context than in high context, whereas the effects on recall tasks and noise tolerance time were more significant in high context than in low context. Compared with other tasks, the CU and PCU in repeat tasks were more affected by listening status and working memory capacity. In the repeat phase, hearing loss increased older adults' reliance on the context of a relatively challenging listening environment, as shown by the fact that when the SNR was 0 and -5 dB, the PCU (repeat) of the hearing loss group was significantly greater than that of the normal-hearing group, whereas there was no significant difference between the two hearing groups under the remaining SNRs. In addition, older adults with LWM had significantly greater CU and PCU in repeat tasks than those with HWM, especially at SNRs with moderate task demands. Taken together, semantic context not only improved speech perception intelligibility but also released cognitive resources for memory encoding in older adults. Mild-to-moderate hearing loss and LWM capacity in older adults significantly increased the use and reliance on semantic context, which was also modulated by the level of SNR.

NPoSC-A3: A novel part of speech clues-aware adaptive attention mechanism for image captioning

Part of Speech (PoS) information has been broadly leveraged in previous image captioning methods to guide their decoder module to control whether the visual information is required for generating the target words. However, existing methods primarily focus on enhancing visual words (VWs) generation while neglecting non-visual words (NVWs) generation. So, in response, we introduce a novel PoS clues-aware adaptive attention mechanism (NPoSC-A3) to leverage the PoS clues to adaptively incorporate visual and semantic attention contexts into the language model, where the semantic information and the visual information are leveraged in generating the visual and non-visual words (VWs and NVWs). The mechanism of NPoSC-A3 comprises four key modules:global semantic context generator (GSCG), PoS context generator (PoSCG), PoS predictor (PoSP), and PoS clues-aware adaptive attention mechanism (PoSC-A3). GSCG generates a global semantic context that our model leverages for generating NVWs. PoSP predicts the PoS information of the word to be generated at the current time step. PoSC-A3 adaptively incorporates visual and global semantic features into the decoder module based on the PoS guidance. PoSCG constrains the visual context and global semantic context effect on the captioning process for generating more syntactic captions. Extensive experiments conducted using the MSCOCO standard dataset demonstrate that our presented method has raised the effectiveness of image captioning task and outperformed most recent and advanced image captioning works with evaluation metrics and attained 127.2 in CIDEr.

The use of lexical semantics for processing face-masked speech in monolinguals and bilinguals.

Face masks impede visual and acoustic cues that help make speech processing and language comprehension more efficient. Many studies report this phenomenon, but few examined how listeners utilize semantic information to overcome the challenges posed by face masks. Fewer still investigated this impact on bilinguals' processing of face-masked speech [Smiljanic, Keerstock, Meemann, and Ransom, S. M. (2021). J. Acoust. Soc. Am. 149(6), 4013-4023; Truong, Beck, and Weber (2021). J. Acoust. Soc. Am. 149(1), 142-144]. Therefore, this study aims to determine how monolingual and bilingual listeners use semantic information to compensate for the loss of visual and acoustic information when the speaker is wearing a mask. A lexical priming experiment tested how monolingual listeners and early-acquiring simultaneous bilingual listeners responded to video of English word pairs. The prime-target pairs were either strongly related, weakly related, or unrelated and were both either masked or unmasked. Analyses of reaction time results showed an overall effect of masking in both groups and an effect of semantic association strength on processing masked and unmasked speech. However, speaker groups were not different; subsequent analyses of difference values showed no effect of semantic context. These results illustrate the limited role of word-level semantic information on processing in adverse listening conditions. Results are discussed in light of semantic processing at the sentence level.

The Effect of Semantic Context on Lexical Access in Children With and Without Developmental Language Disorder

Objectives: Lexical access problems are one of the limitations observed in children with developmental language disorders during the initial years of schooling. Semantic context has a powerful influence on lexical access. The cross-modal visual-auditory picture-word interference paradigm is a method for studying adults and children's lexical access. Because few studies have examined lexical access in Persian-speaking children, the present study aimed to investigate the effect of different semantic contexts on lexical access in children with and without developmental language disorder. Methods: In this experimental study, 20 children aged 7-9 years with developmental language disorders and 20 age-matched peers were recruited according to the inclusion and exclusion criteria. At first, the picture-word interference paradigm was prepared. In so doing, 16 common pictures of objects paired with four auditory interfering words (related verb, related noun, unrelated verb, and unrelated noun) were presented to the children in a silent condition to determine their naming accuracy and latency. The DMDX software calculated the naming latency. The percentage of correct names also calculated naming accuracy. Results: Naming latencies were significantly faster in children without language disorders (P≤0.05). In addition, a reliable interference effect was found. According to the results, naming latencies were significantly faster for related verb distractors than unrelated verbs and related noun distractors (P<0.05). In addition, a significant difference was observed between the silent and interference conditions regarding the naming accuracy. However, accuracy was not affected by distractors. Discussion: Different semantic contexts affect lexical access differently in children. These differences cause semantic relatedness between verbs and nouns in lexical networks. The present study findings indicate that lexical knowledge and semantic relatedness are lower in children with developmental language disorders than in those with typical language development. These results can be useful for future studies and interventions on lexical access in children with and without language disorders.

Neighing dogs: Semantic context effects of environmental sounds in spoken word production - a replication and extension.

Semantic context effects are well established using both words and pictures as stimuli. One such effect, semantic interference, is observed in naming latencies when a categorically related distractor word or picture is presented together with a target picture (e.g., dog-LION). Recently, this effect has also been shown to occur when an environmental sound (e.g., a dog barking) is presented as an auditory distractor during picture naming and when a distractor picture is presented with a target sound for naming. The purpose of the current study was twofold: (1) to replicate the semantic interference effect in the picture-sound interference (PSI) paradigm and (2) determine whether a semantic interference effect is also observable when distractor words are presented with environmental sounds as target auditory objects for naming, using a novel sound-word interference (SWI) paradigm. We replicated the semantic interference effect in Experiment 1 with environmental sound distractors. Experiment 2 demonstrated significant semantic interference during an SWI paradigm for the first time. We discuss the implications of these results for our understanding of the origin and locus of the semantic interference effect according to current theories of lexical selection.

The Effects of Semantic and Syntactic Prediction on Reading Aloud

Semantic and syntactic prediction effects were investigated in a word naming task using semantic or syntactic contexts that varied between three and six words. Participants were asked to read the contexts silently and name a target word, which was indicated by a color change. Semantic contexts were composed of lists of semantically associated words without any syntactic information. Syntactic contexts were composed of semantically neutral sentences, in which the grammatical category but not the lexical identity of the final word was highly predictable. When the presentation time of the context words was long (1,200 ms), both semantically and syntactically related contexts facilitated reading aloud latencies of target words and syntactically related contexts produced larger priming effects than semantically related contexts in two out of three analyses. When the presentation time was short (200 ms), however, syntactic context effects disappeared, while semantic context effects remained significant. Across the three experiments, longer contexts produced faster response latencies, but longer contexts did not produce larger priming effects. The results are discussed in the context of the extant literature on semantic and syntactic priming and more recent evidence, suggesting that syntactic information constrains single word recognition.

The Effect of Semantic Context and the Task Types on Turkish EFL Learners Use of English Articles: A Comparison of Pre-Intermediate and Intermediate Level Learners

The Effect of Semantic Context and the Task Types on Turkish EFL Learners Use of English Articles: A Comparison of Pre-Intermediate and Intermediate Level Learners

Interactions of stimulus quality and semantic context on N400 in visual word recognition

AbstractThe joint effects of stimulus quality and semantic context in visual word recognition were examined with event-related potential (ERP) recordings. In one-character Chinese word recognition, we manipulated stimulus quality at two degradation levels (highly vs. slightly degraded) and semantic context at two priming levels (semantically related vs. unrelated). In a prime–target–probe trial flow, ERPs were recorded to the target character which was presented in either high or slight degradation and which was preceded by either a semantically related or unrelated prime character. The target character was then followed by a probe character which was either identical to or different from the target character. Subjects were instructed to make target–probe matching judgments. The ERP results demonstrated a degradation by priming interaction, with larger N400 semantic priming effects for slightly degraded targets. Moreover, the degradation effects were observed on the P200, N250, and N400. These findings provided evidence for the cascaded model of visual word recognition such that the visual processing cascaded into the semantic stage and thus interacted on the N400 amplitude. The results were compared to an earlier study with a null ERP degradation by priming interaction. The ramifications of these results for models of visual word recognition are discussed.

Concurrent semantic priming and lexical interference for close semantic relations in blocked-cyclic picture naming: Electrophysiological signatures.

In the present study, we employed event-related brain potentials to investigate the effects of semantic similarity on different planning stages during language production. We manipulated semantic similarity by controlling feature overlap within taxonomical hierarchies. In a blocked-cyclic naming task, participants named pictures in repeated cycles, blocked in semantically close, distant, or unrelated conditions. Only closely related items, but not distantly related items, induced semantic blocking effects. In the first presentation cycle, naming was facilitated, and amplitude modulations in the N1 component around 140-180ms post-stimulus onset predicted this behavioral facilitation. In contrast, in later cycles, naming was delayed, and a negative-going posterior amplitude modulation around 250-350ms post-stimulus onset predicted this interference. These findings indicate easier object recognition or identification underlying initial facilitation and increased difficulties during lexical selection. The N1modulation was reduced but persisted in later cycles in which interference dominated, and the posterior negativity was also present in cycle 1 in which facilitation dominated, demonstrating concurrent effects of conceptual priming and lexical interference in all naming cycles. Our assumptions about the functional role these two opposing forces play in producing semantic context effects are further supported by the finding that the joint modulation of these two ERPs on naming latency exclusively emerged when naming closely related, but not unrelated items. The current findings demonstrate that close relations, but not distant taxonomic relations, induce stronger semantic blocking effects, and that temporally overlapping electrophysiological signatures reflect a trade-off between facilitatory priming and interfering lexical competition.

Conducting Language Production Research Online: A Web-based Study of Semantic Context and Name Agreement Effects in Multi-Word Production

Few web-based experiments have explored spoken language production, perhaps due to concerns of data quality, especially for measuring onset latencies. The present study highlights how speech production research can be done outside of the laboratory by measuring utterance durations and speech fluency in a multiple-object naming task when examining two effects related to lexical selection: semantic context and name agreement. A web-based modified blocked-cyclic naming paradigm was created, in which participants named a total of sixteen simultaneously presented pictures on each trial. The pictures were either four tokens from the same semantic category (homogeneous context), or four tokens from different semantic categories (heterogeneous context). Name agreement of the pictures was varied orthogonally (high, low). In addition to onset latency, five dependent variables were measured to index naming performance: accuracy, utterance duration, total pause time, the number of chunks (word groups pronounced without intervening pauses), and first chunk length. Bayesian analyses showed effects of semantic context and name agreement for some of the dependent measures, but no interaction. We discuss the methodological implications of the current study and make best practice recommendations for spoken language production research in an online environment.

BONEs not CATs attract DOGs: Semantic context effects for picture naming in the lesioned language network

The breakdown of rapid and accurate retrieval of words is a hallmark of aphasic speech and a prime target of therapeutic intervention. Complementary, psycho- and neurolinguistic research have developed a spectrum of models, how and by which neuronal network uncompromised speakers can rely on remarkable lexical retrieval capacities. Motivated by both lines of research we invited 32 participants with a chronic left hemispheric brain lesion to name pictures in the presence of distractor words. This picture-word-interference (PWI) paradigm is widely used in psycho- and neurolinguistic research.We find that also after brain lesion categorically related words (CAT → [dog]picture) impede naming, while associatively related words (BONE → [dog]picture) ease access, when compared to unrelated distractor words. The effects largely affecting latencies in neurotypical populations, are reproduced for error rate in our participants with lesions in the language network. Unsurprisingly, overall naming abilities varied greatly across patients. Notably, however, the two effects (categorical interference / associative facilitation) differ between participants. Correlating performance with lesion patterns we find support for the notion of a divergence of brain areas affording different aspects of the task: (i) lesions in the left middle temporal gyurs (MTG) deteriorate overall naming, confirming previous work; more notably, (ii) lesions comprising the inferior frontal hub (inferior frontal gyrus, IFG) of the language-network increase the interference effect for the categorical condition; on the contrary, (iii) lesions to the mid-to-posterior temporal hub (posterior middle and superior temporal gyri, pMTG/ pSTG) increase the facilitatory effect for the associative condition on error rates.The findings can be accommodated in a neuro-linguistic framework, which localizes lexical activation but also lexical interference in posterior parts of the language network (pMTG/pITG); conversely, selection between co-activated categorically related entries is afforded by frontal language areas (IFG). While purely experimental in nature our study highlights that lesion site differentially influences specific aspects of word retrieval. Since confrontational naming is a cornerstone of aphasia rehabilitation, this may be of note when designing and evaluating novel therapeutic regimes.

Semantic Interference through Multiple Distractors in Picture Naming in People with Aphasia.

When we refer to an object or concept by its name, activation of semantic and categorical information is necessary to retrieve the correct lexical representation. Whereas in neurotypical individuals it is well established that semantic context can interfere with or facilitate lexical retrieval, these effects are much less studied in people with lesions to the language network and impairment at different steps of lexical-semantic processing. Here, we applied a novel picture naming paradigm, where multiple categorically related and unrelated words were presented as distractors before a to-be-named target picture. Using eye tracking, we investigated preferential fixation on the cohort members versus nonmembers. Thereby, we can judge the impact of explicit acknowledgment of the category and its effect on semantic interference. We found that, in contrast to neurotypical participants [van Scherpenberg, C., Abdel Rahman, R., & Obrig, H. A novel multiword paradigm for investigating semantic context effects in language production. PLoS One, 15, e0230439, 2020], participants suffering from mild to moderate aphasia did not show a fixation preference on category members but still showed a large interference effect of ∼35 msec, confirming the implicit mechanism of categorical interference. However, preferential fixation on the categorically related cohort words correlated with clinical tests regarding nonverbal semantic abilities and integrity of the anterior temporal lobe. This highlights the role of supramodal semantics for explicit recognition of a semantic category, while semantic interference is triggered if the threshold of lexical cohort activation is reached. Confirming psycholinguistic evidence, the demonstration of a large and persistent interference effect through implicit lexico-semantic activation is important to understand deficits in people with a lesion in thelanguage network, potentially relevant for individualized intervention aiming at improving naming skills.

Second‐language word recognition in noise: Interdependent neuromodulatory effects of semantic context and crosslinguistic interactions driven by word form similarity

Spoken language comprehension is a fundamental component of our cognitive skills. We are quite proficient at deciphering words from the auditory input despite the fact that the speech we hear is often masked by noise such as background babble originating from talkers other than the one we are attending to. To perceive spoken language as intended, we rely on prior linguistic knowledge and context. Prior knowledge includes all sounds and words that are familiar to a listener and depends on linguistic experience. For bilinguals, the phonetic and lexical repertoire encompasses two languages, and the degree of overlap between word forms across languages affects the degree to which they influence one another during auditory word recognition. To support spoken word recognition, listeners often rely on semantic information (i.e., the words we hear are usually related in a meaningful way). Although the number of multilinguals across the globe is increasing, little is known about how crosslinguistic effects (i.e., word overlap) interact with semantic context and affect the flexible neural systems that support accurate word recognition. The current multi-echo functional magnetic resonance imaging (fMRI) study addresses this question by examining how prime-target word pair semantic relationships interact with the target word's form similarity (cognate status) to the translation equivalent in the dominant language (L1) during accurate word recognition of a non-dominant (L2) language. We tested 26 early-proficient Spanish-Basque (L1-L2) bilinguals. When L2 targets matching L1 translation-equivalent phonological word forms were preceded by unrelated semantic contexts that drive lexical competition, a flexible language control (fronto-parietal-subcortical) network was upregulated, whereas when they were preceded by related semantic contexts that reduce lexical competition, it was downregulated. We conclude that an interplay between semantic and crosslinguistic effects regulates flexible control mechanisms of speech processing to facilitate L2 word recognition, in noise.

Naming pictures and sounds: Stimulus type affects semantic context effects.

Semantic context effects obtained in naming tasks have been most influential in devising and evaluating models of word production. We reinvestigated this effect in the frequently used blocked-cyclic naming task in which stimuli are presented repeatedly either sorted by semantic category (homogeneous context) or intermixed (heterogeneous context). Previous blocked-cyclic naming studies have shown slower picture naming responses in the homogeneous context. Our study compared this context effect in two task versions, picture naming and sound naming. Target words were identical across task versions (e.g., participants responded with the word dog to either the picture of that animal or to the sound [barking] produced by it). We found semantic interference in the homogeneous context also with sounds and the effect was substantially larger than with pictures (Experiments 1 and 2). This difference is unlikely to result from extended perceptual processing of sounds as compared with pictures (Experiments 3 and 4) or from stronger links between pictures and object names than between sounds and object names (Experiment 5). Overall, our results show that semantic context effects in blocked-cyclic naming generalize to stimulus types other than pictures and-in part-also reflect prelexical processes that depend on the nature of the stimuli used for eliciting the naming responses. This highlights the need to consider the impact of initial processing steps in naming studies when devising and evaluating theories of word production. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Ad-hoc thematic relations form through communication: effects on lexical-semantic processing during language production

ABSTRACT In this preregistered study, we investigate whether themes conveyed by task partners’ narratives reveal semantic relationships between objects that would otherwise be perceived as unrelated. Such ad-hoc formation of thematic relations should result in semantic interference when naming objects related to the theme in a blocked-cyclic naming paradigm. Participants watch pre-recorded videos of presumed partners narrating real-life events, and then name pictures either thematically related or unrelated to the narrative. Experiments 1 and 2 (N = 32 each) demonstrate semantic interference between objects related to the partner's narrative. Interestingly, this effect emerges only when unrelated pictures are named first. Interference is greatly attenuated, or even turns into facilitation when related pictures are named directly after the partner's narrative. Experiment 3 (N = 32) confirms that semantic context effects disappear when the objects cannot be related to the narrative. Our results demonstrate how flexible semantic processing adapts to context communicated by a task partner.

Effects of temporal order and intentionality on reflective attention to words in noise.

Speech perception in noise is a cognitively demanding process that challenges not only the auditory sensory system, but also cognitive networks involved in attention. The predictive coding theory has been influential in characterizing the influence of prior context on processing incoming auditory stimuli, with comparatively less research dedicated to "postdictive" processes and subsequent context effects on speech perception. Effects of subsequent semantic context were evaluated while manipulating the relationship of three target words presented in noise and the temporal position of targets compared to the subsequent contextual cue, demonstrating that subsequent context benefits were present regardless of whether the targets were related to each other and did not depend on the position of the target. However, participants instructed to focus on the relation between target and cue performed worse than those who did not receive this instruction, suggesting a disruption of a natural process of continuous speech recognition. We discuss these findings in relation to lexical commitment and stimulus-driven attention to short-term memory as mechanisms of subsequent context integration.

The influence of language dominance and domain-general executive control on semantic context effects

ABSTRACT We investigated whether semantic context effects in speech production and comprehension are sensitive to language dominance and whether they involve domain-general executive control. We indexed these effects using semantic blocking within the cyclical semantic paradigm (corresponding to poorer performance in semantically related contexts compared to unrelated contexts) in a study that addressed the limitations of previous research: (i) we compared semantic blocking between participants tested in their native language and those tested in a language they were clearly less proficient in (not just the less dominant language), and (ii) we examined the involvement of executive control with a non-linguistic (rather than a linguistic) index. Participants in both groups showed equal semantic blocking in production and comprehension. Executive control only predicted the magnitude of semantic blocking in speech production. These results suggest that semantic context effects are insensitive to language dominance, and that effects of executive control arise in production tasks.