Chinese Spoken Word Recognition Research Articles

Neural correlates of phonology-to-orthography mapping consistency effects on Chinese spoken word recognition

Previous studies have shown that reading experience reshapes speech processing. The orthography can be implemented in the brain by restructuring the phonological representations or being co-activated during spoken word recognition. This study utilized event-related functional magnetic resonance imaging and functional connectivity analysis to examine the neural mechanism underlying two types of orthographic effects in the Chinese auditory semantic category task, namely phonology-to-orthography consistency (POC) and homophone density (HD). We found that the POC effects originated from the speech network, suggesting that sublexical orthographic information could change the organization of preexisting phonological representations when learning to read. Meanwhile, the HD effects were localized to the left fusiform and lingual gyrus, suggesting that lexical orthographic knowledge may be activated online during spoken word recognition. These results demonstrated the different natures and neural mechanisms for the POC and HD effects on Chinese spoken word recognition.

Morphosemantic activation of opaque Chinese words in sentence comprehension

Two cross-modal priming experiments were conducted to investigate morphological processing in Chinese spoken word recognition during sentence comprehension. Participants heard sentences that contained opaque prime words and performed lexical decisions on visual targets that were related to second morpheme meanings of opaque words or whole-word meanings. The targets were presented at the auditory onset of the second morphemes or the subsequent syllables after the opaque primes to examine the time course of effects. In a neutral sentence context (Experiment 1), opaque word morpheme meanings produced morphological priming on target word recognition, which preceded lexical priming. When context biased toward whole opaque words (Experiment 2), morphological priming disappeared, while the effect of lexical meanings remained significant and emerged earlier than the effect of lexical meanings in the neutral context. These findings suggest that morphemes play a role in Chinese spoken word recognition, but their effects depend on the prior context during sentence comprehension.

The role of tonal information during spoken-word recognition in Chinese: Evidence from a printed-word eye-tracking study.

Two experiments were conducted to investigate the extent to which the lexical tone can affect spoken-word recognition in Chinese using a printed-word paradigm. Participants were presented with a visual display of four words-namely, a target word (e.g., , xiang4xian4, "quadrant"), a tone-consistent phonological competitor (e.g., , xiang4ce4, "photo album"), or a tone-inconsistent phonological competitor (e.g., , xiang1cai4, "coriander"), and two unrelated distractors. Simultaneously, they were asked to listen to a spoken target word presented in isolation (Experiment 1) or embedded in neutral/predictive sentence contexts (Experiment 2), and then click on the target word on the screen. Results showed significant phonological competitor effects (i.e., the fixation proportion on the phonological competitor was higher than that on the distractors) under both tone conditions. Specifically, a larger phonological competitor effect was observed in the tone-consistent condition than in the tone-inconsistent condition when the spoken word was presented in isolation and the neutral sentence contexts. This finding suggests a partial role of lexical tone in constraining spoken-word recognition. However, when embedded in a predictive sentence context, the phonological competitor effect was only observed in the tone-consistent condition and absent in the tone-inconsistent condition. This result indicates that the predictive sentence context can strengthen the role of lexical tone.

Phonological P2 or PMN During Spoken Word Recognition in Mandarin Chinese

Abstract. Word-initial phonological mismatches during spoken word recognition often elicit an event-related potential (ERP) component, namely, the phonological mapping negativity (PMN) in cross-modal priming studies or studies using sentence as context. However, recent studies also reported that a phonological P2 but not PMN has been observed for Mandarin Chinese spoken word recognition in unimodal word-matching and meaning-matching experiments, that is, both the prime and target words were presented auditorily. In the present study, the same pairs of disyllabic Mandarin Chinese words as in the prior unimodal studies were used as stimuli to investigate whether or not the phonological P2 effect is modulated by prime modality and can be replicated in a cross-modal design (i.e., written primes followed by spoken targets). Both the phonological and semantic relations between primes and targets were manipulated. Participants were instructed to judge whether the meaning of the two words were same or not. An enhanced PMN between 250 and 320 ms was elicited by word-initial phonological mismatches. In the later time window, centro-parietally distributed early N400 and late N400 were elicited in semantically unrelated conditions. The presence of PMN instead of P2 in the current study implies that ERP markers of word-initial phonological mismatches during spoken word recognition are modulated by the modality of primes at the level of phonological analysis.

Morphological and Whole-Word Semantic Processing Are Distinct: Event Related Potentials Evidence From Spoken Word Recognition in Chinese.

Behavioral and imaging studies in alphabetic languages have shown that morphological processing is a discrete and independent element of lexical access. However, there is no explicit marker of morphological structure in Chinese complex words, such that the extent to which morpheme meaning is related to word meaning is unknown. Event-related potentials (ERPs) were used in the present study to investigate the dissociation of morphemic and whole-word meaning in an auditory-auditory primed lexical decision task. All the prime and target words are compounds consisting of two Chinese morphemes. The relationship between morpheme and whole-word meaning was manipulated while controlling the phonology and orthography of the first syllable in each prime-target pair. A clear dissociation was found between morphemic and whole-word meaning on N400 amplitude and topography. Specifically, sharing a morpheme produced a larger N400 in the anterior-central electrode sites, while sharing whole-word meaning produced a smaller N400 in central-posterior electrode sites. In addition, the morphological N400 effect was negatively correlated with the participants’ reading ability, with better readers needing less orthographic information to distinguish different morphemes in compound words. These findings indicate that morphological and whole-word meaning are dissociated in spoken Chinese compound word recognition and that even in the spoken language modality, good readers are better able to access the meaning of individual morphemes in Chinese compound word processing.

The second-order effect of orthography-to-phonology mapping consistency on Chinese spoken word recognition

Abstract The influences of the orthography-to-phonology (O-to-P) mapping consistency as the first-order effect on visual word recognition are well documented. Few studies have investigated the second-order O-to-P consistency effect on spoken word recognition. To address this issue, Experiment 1 asked participants to perform a writing-to-dictation task for 230 Chinese monosyllabic words and found that the response accuracy increased with the homophone density, and the homophone density, O-to-P consistency, and character frequency also affected the generation probability and reaction time of written responses. Experiment 2 involved manipulating the homophone density of the spoken words and the O-to-P consistency of the written characters in writing to dictation with event-related potential measurement. The data revealed an interactive effect between the O-to-P consistency and homophone density on frontal-central N400 and a homophone density effect on the posterior late positivity component. The results support the reverberation effect of the O-to-P consistency on Chinese spoken word recognition.

Time Course of the Second Morpheme Processing During Spoken Disyllabic Compound Word Recognition in Chinese.

This study aimed to investigate the time course of meaning activation of the 2nd morpheme processing of compound words during Chinese spoken word recognition using eye tracking technique with the printed-word paradigm. In the printed-word paradigm, participants were instructed to listen to a spoken target word (e.g., "", /da4fang1/, generous) while presented with a visual display composed of 3 words: a morphemic competitor (e.g., "", /yuan2xing2/, circle), which was semantically related to the 2nd morpheme (e.g., "", /fang1/, square) of the spoken target word; a whole-word competitor (e.g., "", /lin4se4/, stingy), which was semantically related to the spoken target word at the whole-word level; and a distractor, which was semantically related to neither the morpheme or the whole target word. Participants were asked to respond whether the spoken target word was on the visual display or not, and their eye movements were recorded. The logit mixed-model analysis showed both the morphemic competitor and the whole-word competitor effects. Both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the 2nd-morphemic competitor effect occurred at a relatively later time window (i.e., 1000-1500 ms) compared with the whole-word competitor effect (i.e., 200-1000 ms). Findings in this study suggest that semantic information of both the 2nd morpheme and the whole word of a compound was activated in spoken word recognition and that the meaning activation of the 2nd morpheme followed the activation of the whole word.

Tonal and vowel information processing in Chinese spoken word recognition: an event-related potential study.

In the present study, the time course of tonal and vowel information processing of the spoken words in Mandarin Chinese was investigated using a delayed-response paradigm. Idiomatic materials, providing semantically highly constraining contexts, were utilized. Besides being presented normally, the terminal monosyllabic words in idioms were manipulated with Tonal, Vowel, or Triple violations (i.e. with consonantal, tonal, and vowel mismatches). Event-related potential results showed that all three violations elicited larger widespread negativities in comparison with the Control condition, with the Triple violation effect starting first from 150 ms, then the Vowel violation, and the Tonal violation being the latest. The different starting times of the violation effects suggest that the access of tonal information is slower than that of vowel information, even though the lexical tones are very important in distinguishing the meaning of Chinese words.

Visual attention shift to printed words during spoken word recognition in Chinese: The role of phonological information.

The aim of this study was to investigate the extent to which phonological information mediates the visual attention shift to printed Chinese words in spoken word recognition by using an eye-movement technique with a printed-word paradigm. In this paradigm, participants are visually presented with four printed words on a computer screen, which include a target word, a phonological competitor, and two distractors. Participants are then required to select the target word using a computer mouse, and the eye movements are recorded. In Experiment 1, phonological information was manipulated at the full-phonological overlap; in Experiment 2, phonological information at the partial-phonological overlap was manipulated; and in Experiment 3, the phonological competitors were manipulated to share either fulloverlap or partial-overlap with targets directly. Results of the three experiments showed that the phonological competitor effects were observed at both the full-phonological overlap and partial-phonological overlap conditions. That is, phonological competitors attracted more fixations than distractors, which suggested that phonological information mediates the visual attention shift during spoken word recognition. More importantly, we found that the mediating role of phonological information varies as a function of the phonological similarity between target words and phonological competitors.

The time course of morphological processing during spoken word recognition in Chinese.

We investigated the time course of morphological processing during spoken word recognition using the printed-word paradigm. Chinese participants were asked to listen to a spoken disyllabic compound word while simultaneously viewing a printed-word display. Each visual display consisted of three printed words: a semantic associate of the first constituent of the compound word (morphemic competitor), a semantic associate of the whole compound word (whole-word competitor), and an unrelated word (distractor). Participants were directed to detect whether the spoken target word was on the visual display. Results indicated that both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the morphemic competitor began to diverge from the distractor immediately at the acoustic offset of the first constituent, which was earlier than the whole-word competitor. These results suggest that lexical access to the auditory word is incremental and morphological processing (i.e., semantic access to the first constituent) that occurs at an early processing stage before access to the representation of the whole word in Chinese.

Effects of orthographic consistency and homophone density on Chinese spoken word recognition

Studies of alphabetic language have shown that orthographic knowledge influences phonological processing during spoken word recognition. This study utilized the Event-Related Potentials (ERPs) to differentiate two types of phonology-to-orthography (P-to-O) mapping consistencies in Chinese, namely homophone density and orthographic consistency. The ERP data revealed an orthographic consistency effect in the frontal-centrally distributed N400, and a homophone density effect in central-posteriorly distributed late positive component (LPC). Further source analyses using the standardized low-resolution electromagnetic tomography (sLORETA) demonstrated that the orthographic effect was not only localized in the frontal and temporal-parietal regions for phonological processing, but also in the posterior visual cortex for orthographic processing, while the homophone density effect was found in middle temporal gyrus for lexical-semantic selection, and in the temporal-occipital junction for orthographic processing. These results suggest that orthographic information not only shapes the nature of phonological representations, but may also be activated during on-line spoken word recognition.

Semantic information mediates visual attention during spoken word recognition in Chinese: Evidence from the printed-word version of the visual-world paradigm.

In the present study, we investigated whether the activation of semantic information during spoken word recognition can mediate visual attention's deployment to printed Chinese words. We used a visual-world paradigm with printed words, in which participants listened to a spoken target word embedded in a neutral spoken sentence while looking at a visual display of printed words. We examined whether a semantic competitor effect could be observed in the printed-word version of the visual-world paradigm. In Experiment 1, the relationship between the spoken target words and the printed words was manipulated so that they were semantically related (a semantic competitor), phonologically related (a phonological competitor), or unrelated (distractors). We found that the probability of fixations on semantic competitors was significantly higher than that of fixations on the distractors. In Experiment 2, the orthographic similarity between the spoken target words and their semantic competitors was manipulated to further examine whether the semantic competitor effect was modulated by orthographic similarity. We found significant semantic competitor effects regardless of orthographic similarity. Our study not only reveals that semantic information can affect visual attention, it also provides important new insights into the methodology employed to investigate the semantic processing of spoken words during spoken word recognition using the printed-word version of the visual-world paradigm.

Orthographic facilitation in Chinese spoken word recognition: An ERP study

Orthographic influences in spoken word recognition have been previously examined in alphabetic languages. However, it is unknown whether orthographic information affects spoken word recognition in Chinese, which has a clean dissociation between orthography (O) and phonology (P). The present study investigated orthographic effects using event related potentials (ERPs) and an auditory lexical decision task. We manipulated the relationship between the phonology and orthography of the first syllable in each prime-target pair using the following four conditions: P+O+, P+O−, P−O+, P−O−. Importantly, we found significantly reduced N400 amplitudes when an item was preceded by an orthographically similar prime. In addition, these reduced N400 amplitudes were positively correlated with participants’ reading skill. The findings indicate that orthographic information is activated automatically during Chinese spoken word recognition, supporting the theory that there is a reciprocal connection between speech and print.

Time course of Chinese monosyllabic spoken word recognition: Evidence from ERP analyses

Evidence from event-related potential (ERP) analyses of English spoken words suggests that the time course of English word recognition in monosyllables is cumulative. Different types of phonological competitors (i.e., rhymes and cohorts) modulate the temporal grain of ERP components differentially (Desroches, Newman, & Joanisse, 2009). The time course of Chinese monosyllabic spoken word recognition could be different from that of English due to the differences in syllable structure between the two languages (e.g., lexical tones). The present study investigated the time course of Chinese monosyllabic spoken word recognition using ERPs to record brain responses online while subjects listened to spoken words. During the experiment, participants were asked to compare a target picture with a subsequent picture by judging whether or not these two pictures belonged to the same semantic category. The spoken word was presented between the two pictures, and participants were not required to respond during its presentation. We manipulated phonological competition by presenting spoken words that either matched or mismatched the target picture in one of the following four ways: onset mismatch, rime mismatch, tone mismatch, or syllable mismatch. In contrast to the English findings, our findings showed that the three partial mismatches (onset, rime, and tone mismatches) equally modulated the amplitudes and time courses of the N400 (a negative component that peaks about 400ms after the spoken word), whereas, the syllable mismatched words elicited an earlier and stronger N400 than the three partial mismatched words. The results shed light on the important role of syllable-level awareness in Chinese spoken word recognition and also imply that the recognition of Chinese monosyllabic words might rely more on global similarity of the whole syllable structure or syllable-based holistic processing rather than phonemic segment-based processing. We interpret the differences in spoken word processing between Chinese and English listeners as being due to morphosyllabic structural differences between the two languages.