Visual Presentation Of Words Research Articles

ERP and Pupillometry Synchronization Analysis on Rapid Serial Visual Presentation of Words, Numbers, Pictures.

Hybrid brain-computer interfaces (HBCI) combining eye-tracker has attracted the attentions of researchers in target recognition. However, there are still many issues to be addressed in rapid sequence visual presentation (RSVP) tasks, such as the effect of presentation rates and target types on event-related potentials (ERP) and pupillometry, synchronization analysis of electroencephalography (EEG) and eye-tracking, and so on. In this study, the RSVP experiments with three different target types of pictures, words and numbers at the presentation rates of 100 and 200 ms were conducted. EEG data and pupillometry data were synchronously collected from 20 university students. The results of ERP analysis showed that, among three different target types at the presentation rate of 100 ms, the picture P300 component had the largest amplitude and the longest latency. From the 100 ms presentation rates to 200 ms one for the three target types, the P300 amplitudes became smaller, and the P300 latencies became shorter. The results of pupillometry analysis showed that, at the presentation rates of 100 and 200 ms, the pupil dilation of pictures had the smallest amplitude and the shortest latency. At the two presentation rates, no significant differences of pupil size and latency were found for the three target types. For the early pupil dilation within 1000 ms, the picture pupil size was significantly smaller than the other ones, and the picture pupil acceleration had the largest average amplitude and the shortest latency. These pupillometry features within 1000 ms combining with the P300 features could be taken as the effective ones for target classification. Through synchronization analysis of the EEG data and pupillometry data, the effects of target type and presentation rate on ERP and pupil dilation were different. These results could contribute to developing the fusion methods between EEG and eye-tracking, and provide valuable references for the multi-target recognition of hybrid BCI based on eye-tracking.

The neural representation of abstract words may arise through grounding word meaning in language itself.

In order to describe how humans represent meaning in the brain, one must be able to account for not just concrete words but, critically, also abstract words, which lack a physical referent. Hebbian formalism and optimization are basic principles of brain function, and they provide an appealing approach for modeling word meanings based on word co‐occurrences. We provide proof of concept that a statistical model of the semantic space can account for neural representations of both concrete and abstract words, using MEG. Here, we built a statistical model using word embeddings extracted from a text corpus. This statistical model was used to train a machine learning algorithm to successfully decode the MEG signals evoked by written words. In the model, word abstractness emerged from the statistical regularities of the language environment. Representational similarity analysis further showed that this salient property of the model co‐varies, at 280–420 ms after visual word presentation, with activity in regions that have been previously linked with processing of abstract words, namely the left‐hemisphere frontal, anterior temporal and superior parietal cortex. In light of these results, we propose that the neural encoding of word meanings can arise through statistical regularities, that is, through grounding in language itself.

Across-subjects classification of stimulus modality from human MEG high frequency activity.

Single-trial analyses have the potential to uncover meaningful brain dynamics that are obscured when averaging across trials. However, low signal-to-noise ratio (SNR) can impede the use of single-trial analyses and decoding methods. In this study, we investigate the applicability of a single-trial approach to decode stimulus modality from magnetoencephalographic (MEG) high frequency activity. In order to classify the auditory versus visual presentation of words, we combine beamformer source reconstruction with the random forest classification method. To enable group level inference, the classification is embedded in an across-subjects framework. We show that single-trial gamma SNR allows for good classification performance (accuracy across subjects: 66.44%). This implies that the characteristics of high frequency activity have a high consistency across trials and subjects. The random forest classifier assigned informational value to activity in both auditory and visual cortex with high spatial specificity. Across time, gamma power was most informative during stimulus presentation. Among all frequency bands, the 75 Hz to 95 Hz band was the most informative frequency band in visual as well as in auditory areas. Especially in visual areas, a broad range of gamma frequencies (55 Hz to 125 Hz) contributed to the successful classification. Thus, we demonstrate the feasibility of single-trial approaches for decoding the stimulus modality across subjects from high frequency activity and describe the discriminative gamma activity in time, frequency, and space.

Minimal conditions of motor inductions of approach-avoidance states: The case of oral movements.

The minimal conditions to elicit affective responses via approach-avoidance movements were explored by using oral movements (total N = 1,363). To induce oral movements, words were construed whose consonants (and vowels) wandered either from front to back of the mouth (e.g., PEKA, inward, like swallowing, approach) or from back to front (e.g., KEPA, outward, like spitting, avoidance). Participants preferred inward over outward consonant wanderings when reading only 2 phonemes (e.g., PEKA vs. KEPA), single letters (e.g., PK vs. KP), and even when only listening to a speaker uttering such stimuli (Experiments 1-4). Vowel wanderings had no systematic effect. The larger the consonantal inward and outward jumps, irrespective from where they started in the mouth, the stronger was their affective impact (Experiments 6-7). Visual presentation of words generally evoked stronger in-out effects than listening to a speaker uttering the words, which speaks against a sound symbolism explanation. Informing theorizing also on the much more common manual approach-avoidance inductions, these findings show that approach-avoidance movements can elicit affect by activating only the starting and ending point of a spatial movement gradient, even involving differing muscles for these spots, respectively. Also, the present findings imply that the magnitude of the distance of the spatial approach-avoidance gradient matters (the larger the distance, the larger the affective response), and that such effects can be induced by mere observation (by only listening to a speaker). (PsycINFO Database Record

Why do pictures, but not visual words, reduce older adults’ false memories?

Prior work shows that false memories resulting from the study of associatively related lists are reduced for both young and older adults when the auditory presentation of study list words is accompanied by related pictures relative to when auditory word presentation is combined with visual presentation of the word. In contrast, young adults, but not older adults, show a reduction in false memories when presented with the visual word along with the auditory word relative to hearing the word only. In both cases of pictures relative to visual words and visual words relative to auditory words alone, the benefit of picture and visual words in reducing false memories has been explained in terms of monitoring for perceptual information. In our first experiment, we provide the first simultaneous comparison of all 3 study presentation modalities (auditory only, auditory plus visual word, and auditory plus picture). Young and older adults show a reduction in false memories in the auditory plus picture condition, but only young adults show a reduction in the visual word condition relative to the auditory only condition. A second experiment investigates whether older adults fail to show a reduction in false memory in the visual word condition because they do not encode perceptual information in the visual word condition. In addition, the second experiment provides evidence that the failure of older adults to show the benefits of visual word presentation is related to reduced cognitive resources. (PsycINFO Database Record

Organization and Reorganization of Sensory-Deprived Cortex

The scientific literature has grown rich in research illustrating the remarkable ability of the brain to reorganize itself following sensory loss. In particular, visually deafferented regions within the occipital cortex of early blind individuals have been repeatedly shown to be functionally recruited to carry out a wide variety of nonvisual tasks. While the novelty of such a finding might be wearing off, more recent research has begun to examine whether this crossmodal takeover of the occipital cortex in blindness follows some sort of organizational principle. Here we first review the most recent evidence from neuroimaging studies that illustrate how the pre-existing functional specialization of cortical sub-regions appears to be preserved following sensory deprivation. We discuss and compare work on visual and auditory deprivation, as well as research on individuals with intact sensory systems. We suggest avenues for future exploration of these issues, such as identifying the neuroanatomical markers of crossmodal plasticity and elucidating the behavioral relevance of observed changes.

Language Effects in Trilinguals: An ERP Study

Event-related potentials were recorded during the visual presentation of words in the three languages of French-English-Spanish trilinguals. Participants monitored a mixed list of unrelated non-cognate words in the three languages while performing a semantic categorization task. Words in L1 generated earlier N400 peak amplitudes than both L2 and L3 words, which peaked together. On the other hand, L2 and L3 words did differ significantly in terms of N400 amplitude, with L3 words generating greater mean amplitudes compared with L2 words. We interpret the effects of peak N400 latency as reflecting the special status of the L1 relative to later acquired languages, rather than proficiency in that language per se. On the other hand, the mean amplitude difference between L2 and L3 is thought to reflect different levels of fluency in these two languages.

Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study

Both embodied and symbolic accounts of conceptual organization would predict partial sharing and partial differentiation between the neural activations seen for concepts activated via different stimulus modalities. But cross-participant and cross-session variability in BOLD activity patterns makes analyses of such patterns with MVPA methods challenging. Here, we examine the effect of cross-modal and individual variation on the machine learning analysis of fMRI data recorded during a word property generation task. We present the same set of living and non-living concepts (land-mammals, or work tools) to a cohort of Japanese participants in two sessions: the first using auditory presentation of spoken words; the second using visual presentation of words written in Japanese characters. Classification accuracies confirmed that these semantic categories could be detected in single trials, with within-session predictive accuracies of 80–90%. However cross-session prediction (learning from auditory-task data to classify data from the written-word-task, or vice versa) suffered from a performance penalty, achieving 65–75% (still individually significant at p « 0.05). We carried out several follow-on analyses to investigate the reason for this shortfall, concluding that distributional differences in neither time nor space alone could account for it. Rather, combined spatio-temporal patterns of activity need to be identified for successful cross-session learning, and this suggests that feature selection strategies could be modified to take advantage of this.

Effective connectivity of the left BA 44, BA 45, and inferior temporal gyrus during lexical and phonological decisions identified with DCM

Distinct regions in the left inferior frontal gyrus (IFG) preferentially support the processing of different word-types (e.g., real words, pseudowords) and tasks (e.g., lexical decisions, phonological decisions) in visual word recognition. However, the functional connectivity underlying the task-related specialisation of regions in the left IFG is not yet well understood. In this study we investigated the neural mechanisms driving the interaction of WORD-TYPE (real word vs. pseudoword) and TASK (lexical vs. phonological decision) in Brodmann's area (BA) 45 in the left IFG using dynamic causal modelling (DCM). Four different models were compared, all of which included left BA44, left BA45, and left inferior temporal gyrus (ITG). In each model, the visual presentation of words and pseudowords is assumed to directly evoke activity in the ITG and is then thought to be subsequently propagated to BA45 and to BA44 via direct intrinsic connections. The models differed with regard to which connections were modulated by the different tasks. Both tasks were assumed to either modulate the ITG_BA45 connection (Model #1), or the BA44_BA45 connection (Model #2), or both connections in parallel (Model #3). In Model #4 lexical decisions modulated the ITG_BA45 connection, whereas phonological decisions modulated the BA44_BA45 connection. Bayesian model selection revealed a superiority of Model #1. In this model, the strength of the ITG_BA45 connection was enhanced during lexical decisions. This model is in line with the hypothesis that left BA 45 supports explicit lexical decisions during visual word recognition based on lexical access in the ITG.

The early context effect reflects activity in the temporo-prefrontal semantic system: Evidence from electrical neuroimaging of abstract and concrete word reading

Spatial and temporal characteristics of lexico-semantic retrieval are frequently examined with semantic context (i.e., priming) paradigms. These paradigms measure context (i.e., priming) effects in word processing evoked by semantically related context. Besides the well-known attention-dependent N400 context effect (> 250 ms), recent studies demonstrate early automatic context effects in the P1 –N1 time period (< 200 ms). However, in visual word presentation the semantic origin of these early effects remains debated. This study examined spatio-temporal activation dynamics of the early context effect as well as the modulation of the effect by differences in structure and accessibility of verbal semantics existent in abstract and concrete words. The early context effect was measured in visually displayed words that followed semantically related single-word context. Spatial and temporal aspects of the effect were analyzed by applying topographic and source analyses on the word-triggered Event Related Potentials. The early context effect was enhanced in abstract compared to concrete words as indicated by a difference in the occurrence of P1–N1 transition map and a corresponding topographic dissimilarity (116–140 ms). This concreteness-dependent modulation demonstrates the sensitivity of the early context effect to structural differences in verbal semantics. Furthermore, the topographic difference was explained by enhanced activation in the left inferior prefrontal cortex for related compared to unrelated words in addition to temporo-parietal generators recruited in both conditions. The result suggests automatic feedforward processing of context-related information in temporo-prefrontal brain regions critical to semantic analysis. Taken together our findings show that the early context effect reflects activation processes in verbal semantic memory.

How does the incrementality of auditory word perception interplay with episodic and semantic memory?

In contrast to visual word presentation, auditory words unfold over time and stimulus information reaches subsequent processing stages only incrementally. The influence of this incrementality was assessed in the present study. Target nouns were semantically primed by synonymous or non-synonymous preceding nouns and had to be categorized by speeded choice responses according to their synonymity. Long-term repetition was manipulated by presenting these prime-target pairs twice in two halves of the experiment and the effect of incrementality was assessed by sorting the target nouns according to three bins of word length. Event-related brain potentials (ERPs) were recorded to the target words. Both behavioural and ERP-results are in agreement with an incremental auditory word processing model, where long-term repetition and semantic priming affect separable processes, presumably episodic and semantic memory, respectively.

Silence Is Golden: Transient Neural Deactivation in the Prefrontal Cortex during Attentive Reading

It is becoming increasingly clear that attention-demanding tasks engage not only activation of specific cortical regions but also deactivation of other regions that could interfere with the task at hand. At the same time, electrophysiological studies in animals and humans have found that the participation of cortical regions to cognitive processes translates into local synchronization of rhythmic neural activity at frequencies above 40 Hz (so-called gamma-band synchronization). Such synchronization is seen as a potential facilitator of neural communication and synaptic plasticity. We found evidence that cognitive processes can also involve the disruption of gamma-band activity in high-order brain regions. Intracerebral electroencephalograms were recorded in 3 epileptic patients during 2 reading tasks. Visual presentation of words induced a strong deactivation in a broad (20-150 Hz) frequency range in the left ventral lateral prefrontal cortex, in parallel with gamma-band activations within the reading network, including Broca's area. The observed energy decrease in neural signals was reproducible across patients. It peaked around 500 ms after stimulus onset and appeared subject to attention-modulated amplification. Our results suggest that cognition might be mediated by a coordinated interaction between regional gamma-band synchronizations and desynchronizations, possibly reflecting enhanced versus reduced local neural communication.

Self-awareness and the subconscious effect of personal pronouns on word encoding: A magnetoencephalography (MEG) study

The effect of personal pronouns such as “ein” (German for “a”), “mein” (German for “my”) and “sein” (German for “his”) on the processing of associated nouns was investigated using MEG. Three different encoding strategies were provided in order to vary the level of consciousness involved in verbal information processing. A shallow (alphabetic), a deep (semantic) and a very deep (contextual) encoding instruction related to visual word presentation were given to all study participants. After the encoding of pronoun–noun pairs, recognition performances of nouns only were tested. The number of correctly recognized nouns previously associated with “sein” was significantly lower than the number of correctly recognized nouns previously associated with “ein” in the shallow encoding condition. The same trend was found for “mein” associated nouns which were also less accurately recognized compared to “ein” associated nouns. Magnetic field distributions recorded during the encoding phases revealed two significant effects, one between about 200 and 400 ms after stimulus onset and the other between about 500 and 800 ms. The earlier effect was found over occipito-parietal sensors, whereas the later effect occurred over left frontal sensors. Within both time ranges, brain activation varied significantly as a function of associated pronoun independent of depth of word processing. In the respective areas of both time ranges, conditions including personal pronouns (“mein” and “sein”) showed higher magnetic field components compared to the control condition of no personal pronouns (“ein”). Evidence is shown that early stage processing is able to distinguish between no personal and personal information, whereas later stage processing is able to distinguish between information related to oneself and to another person (self and non-self). Along with other previous reports our MEG findings support the notion that particular human brain functions involved in processing neurophysiological correlates of self and non-self can be identified.

Linguistic units in word typing

This study reports on two experiments in which German participants had to type words presented to them in various modes. Experiment 1 compares typing following visual and oral word presentation with typing following picture presentation. In the second experiment typing responses following oral and visual word presentation were delayed by an extended preparatory period. Both experiments demonstrate significantly increased inter-keystroke intervals (IKIs) at exclusive syllable (S) boundaries and combined syllable and morpheme (SM) boundaries in comparison to within-syllable (L) boundaries. SM-IKIs are significantly larger than S-IKIs and influenced by word frequencies, indicating lexical dependencies. SM-IKIs were found to be significantly longer for oral than for visual word presentation. This is taken as an indication that additional processes are involved in the accessing of graphemic word forms when words are presented orally. Two effects of the typing delay were identified: a decrease of word initial latencies and the disappearance of size differences between SM-IKIs following visual and oral word presentation. On the other hand, the persistence of augmented SM- and S-IKIs in the delayed typing task indicates that input into the motor system is constituted by sub-word units instead by fully specified words. As SM- and S-IKIs reflect influences of different hierarchical levels of language processing, these findings suggest a processing architecture in which the peripheral motor system essentially connects at several hierarchical levels with central processing units.

Category specificity in the processing of color-related and form-related words: An ERP study

In this study, we investigated the spatio-temporal patterns of category-specific cortical activation elicited by the visual presentation of words whose meaning relates to a color or to a visual form or shape. We recorded the event-related potentials (ERPs) of ten healthy, right-handed volunteers while they passively read words presented tachistoscopically. As early as 150 ms after stimulus onset, the ERPs revealed significant neurophysiological differences between words and strings of hash marks. Around 200 ms after stimulus onset, we found significant differences in the ERPs elicited by color- and form-related words. We used minimum norm current estimates to investigate the spatial location of these differences. This revealed that, at the 150 ms peak, the activation advantage of words over sequences of hash marks was located in a left posterior area, proximal to what has previously been called the visual word form area. At the 200 ms peak, the advantage of words related to colors over words related to forms seemed to reside in temporal cortical areas, whereas the form-related words elicited greater activation in frontal areas than color-related words. These results provide evidence for early access to detailed category-specific representations of word meaning, with subtle differences in meaning being reflected in the activation of different cortical areas, as early as 200 ms after stimulus presentation. In line with previous studies, these differences can be related to the areas involved in the conceptual processing of sensory (visual) and action-related information.

The lack of focused anticipation of verbal information in stutterers: a magnetoencephalographic study

The motivation of this work was to investigate stuttering—a disorder of speech motor control—in the light of preparatory neural activity of voluntary movements related to speech. To this end, brain activity was recorded with a whole cortex magnetoencephalograph (MEG) in developmental stutterers and nonstutterers while three different tasks of single-word reading were performed. Visually presented words had to be silently read immediately after word presentation (condition 1), spoken aloud immediately after word presentation (condition 2), or spoken aloud after a delay of 1.3 s as indicated by a second visual stimulus (condition 3). Condition 2 clearly showed marked neurophysiological differences between stutterers and nonstutterers. Only nonstutterers showed clear neural activity before speech onset, which is interpreted as being linked to visual word presentation and to reflect focused verbal anticipation. This prespeech activity might reflect the “Bereitschaftsfeld2” (BF2) that is the later component of the “Bereitschaftsfeld”, a well-known preparatory activity described for many other voluntary movements. Our results strongly link the lack of such preparatory brain activity at the single-word level to the disability of fluent speech in stutterers. The present results strongly support the notion that stuttering is related to impaired focused attention or anticipation.

The lack of focused anticipation of verbal information in stutterers: a magnetoencephalographic study

The motivation of this work was to investigate stuttering—a disorder of speech motor control—in the light of preparatory neural activity of voluntary movements related to speech. To this end, brain activity was recorded with a whole cortex magnetoencephalograph (MEG) in developmental stutterers and nonstutterers while three different tasks of single-word reading were performed. Visually presented words had to be silently read immediately after word presentation (condition 1), spoken aloud immediately after word presentation (condition 2), or spoken aloud after a delay of 1.3 s as indicated by a second visual stimulus (condition 3). Condition 2 clearly showed marked neurophysiological differences between stutterers and nonstutterers. Only nonstutterers showed clear neural activity before speech onset, which is interpreted as being linked to visual word presentation and to reflect focused verbal anticipation. This prespeech activity might reflect the “Bereitschaftsfeld2” (BF2) that is the later component of the “Bereitschaftsfeld”, a well-known preparatory activity described for many other voluntary movements. Our results strongly link the lack of such preparatory brain activity at the single-word level to the disability of fluent speech in stutterers. The present results strongly support the notion that stuttering is related to impaired focused attention or anticipation.

Dynamic diaschisis: anatomically remote and context-sensitive human brain lesions.

Functional neuroimaging was used to investigate how lesions to the Broca's area impair neuronal responses in remote undamaged cortical regions. Four patients with speech output problems, but relatively preserved comprehension, were scanned while viewing words relative to consonant letter strings. In normal subjects, this results in left lateralized activation in the posterior inferior frontal, middle temporal, and posterior inferior temporal cortices. Each patient activated normally in the middle temporal region but abnormally in the damaged posterior inferior frontal cortex and the undamaged posterior inferior temporal cortex. In the damaged frontal region, activity was insensitive to the presence of words but in the undamaged posterior inferior temporal region, activity decreased in the presence of words rather than increasing as it did in the normal individuals. The reversal of responses in the left posterior inferior temporal region illustrate the context-sensitive nature of the abnormality and that failure to activate the left posterior temporal region could not simply be accounted for by insufficient demands on the underlying function. We propose that, in normal individuals, visual word presentation changes the effective connectivity among reading areas and, in patients, posterior temporal responses are abnormal when they depend upon inputs from the damaged inferior frontal cortex. Our results serve to introduce the concept of dynamic diaschisis; the anatomically remote and context-sensitive effects of focal brain lesions. Dynamic diaschisis reveals abnormalities of functional integration that may have profound implications for neuropsychological inference, functional anatomy and, vicariously, cognitive rehabilitation.

Picture-word matching as a paradigm in determining regions of language processing: An fMRI study

Introduction In past years much research has been dedicated to the specification of the neuroanatomic sites engaged in language processing, in particular those associated with phonological and lexico-semantic processing (1). A variety of tasks have been employed, ranging from reading or repeating a presented word to judging specific aspects of word form or meaning. Results from these studies demonstrate that the language system is a widely distributed network. Therefore, due attention must be given to task selection when language areas are to be mapped. A number of studies with visual word presentation have reported strong activity in the fusiform/inferior temporaloccipital gyrus and in a recent study investigating with the neural substrate of picture naming (2) this region is discussed in terms of semantic processing. Since patients considered for neurosurgery often display difficulties in picture naming we used a picture-word matching task aimed at assessing regions involved in language processing.

Auditory and visual word processing studied with fMRI

Brain activations associated with semantic processing of visual and auditory words were investigated using functional magnetic resonance imaging (fMRI). For each form of word presentation, subjects performed two tasks: one semantic, and one nonsemantic. The semantic task was identical for both auditory and visual presentation: single words were presented and subjects determined whether the word was concrete or abstract. In the nonsemantic task for auditory words, subjects determined whether the word had one syllable or multiple syllables. In the nonsemantic task for visual words, subjects determined whether the word was presented in lower case or upper case. There was considerable overlap in where auditory and visual word semantic processing occurred. Visual and auditory semantic tasks both activated the left inferior frontal (BA 45), bilateral anterior prefrontal (BA 10, 46), and left premotor regions (BA 6) and anterior SMA (BA 6, 8). Left posterior temporal (middle temporal and fusiform gyrus) and predominantly right-sided cerebellar activations were observed during the auditory semantic task but were not above threshold during visual word presentation. The data, when averaged across subjects, did not show obligatory activation of left inferior frontal and temporal language areas during nonsemantic word tasks. Individual subjects showed differences in the activation of the inferior frontal region while performing the same task, even though they showed similar response latency and accuracy.