Action Language Processing Research Articles

Does the Motor Cortex Want the Full Story? The Influence of Sentence Context on Corticospinal Excitability in Action Language Processing

The reading of action verbs has been shown to activate motor areas, whereby sentence context may serve to either globally strengthen this activation or to selectively sharpen it. To investigate this issue, we manipulated the presence of manual actions and sentence context, assessing the level of corticospinal excitability by means of transcranial magnetic stimulation. We hypothesized that context would serve to sharpen the neural representation of the described actions in the motor cortex, reflected in context-specific modulation of corticospinal excitability.Participants silently read manual action verbs and non-manual verbs, preceded by a full sentence (rich context) or not (minimal context). Transcranial magnetic stimulation pulses were delivered at rest or shortly after verb presentation. The coil was positioned over the cortical representation of the right first dorsal interosseous (pointer finger).We observed a general increase of corticospinal excitability while reading both manual action and non-manual verbs in minimal context, whereas the modulation was action-specific in rich context: corticospinal excitability increased while reading manual verbs, but did not differ from baseline for non-manual verbs. These findings suggest that sentence context sharpens motor representations, activating the motor cortex when relevant and eliminating any residual motor activation when no action is present.

Neural correlates of embodied action language processing: a systematic review and meta-analytic study.

The neural correlates of action language processing are still debated within embodied cognition research and little is known about the flexible involvement of modality-specific pre-motor system and multimodal high-level temporo-parietal regions as a function of explicit and implicit tasks. A systematic review and the Activation likelihood estimation (ALE) meta-analyses on functional neuroimaging studies were performed to identify neural correlates of action language processing activated during explicit and implicit tasks. The contrast ALE meta-analysis revealed activation of modality-specific premotor area and inferior frontal areas during explicit action language tasks while a greater activation of posterior temporo-occipital areas emerged for implicit tasks. The conjunction analysis revealed overlap in the temporo-parietal multimodal high-level regions for both types of tasks. Functional specialization of the middle temporal gyrus was found where the more posterior-occipital part resulted activated during implicit action language tasks whereas the antero-lateral part was involved in explicit tasks. Our findings were discussed within a conceptual flexibility perspective about the involvement of both the modality-specific and multimodal brain system during action language processing depending on different types of tasks.

Abstract Action Language Processing in Eleven-Year-Old Children: Influence of Upper Limb Movement on Sentence Comprehension.

Regarding the embodiment of language processing in adults, there is evidence of a close connection between sensorimotor brain areas and brain areas relevant to the processing of action verbs. This thesis is hotly debated and has therefore been thoroughly studied in adults. However, there are still questions concerning its development in children. The present study deals with the processing of action verbs in concrete and abstract sentences in 60 eleven-year-olds using a decision time paradigm. Sixty-five children mirrored arm movements or sat still and rated the semantic plausibility of sentences. The data of the current study suggest that eleven-year-olds are likely to misunderstand the meaning of action verbs in abstract contexts. Their decision times were faster and their error rates for action verbs in concrete sentences were lower. However, the gender of the children had a significant influence on the decision time and the number of errors, especially when processing abstract sentences. Females were more likely to benefit from an arm movement before the decision, while males were better if they sat still beforehand. Overall, children made quite a few errors when assessing the plausibility of sentences, but the female participants more often gave plausibility assessments that deviated from our expectations, especially when processing abstract sentences. It can be assumed that the embodiment of language processing plays some role in 11-year-old children, but is not yet as mature as it is in adults. Especially with regard to the processing of abstract language, the embodied system still has to change and mature in the course of child development.

HD-tDCS over motor cortex facilitates figurative and literal action sentence processing

The extent to which action and perception systems of the brain are involved in semantic comprehension remains controversial. Whether figurative language, such as metaphors and idioms, is grounded in sensory-motor systems is especially contentious. Here, we used high-definition transcranial direct current stimulation (HD-tDCS) in healthy adults to examine the role of the left-hemisphere motor cortex during the comprehension of action sentences, relative to comprehension of sentences with visual verbs. Action sentences were divided into three types: literal, metaphoric, or idiomatic. This allowed us to ask whether processing of action verbs used in figurative contexts relies on motor cortex. The results revealed that action sentence comprehension response times were facilitated relative to the visual sentence control. Significant interaction relative to visual sentences was observed for literal, metaphoric, and idiomatic action sentences with HD-tDCS of the motor cortex. These results suggest that the left motor cortex is functionally involved in action sentence comprehension. Furthermore, this involvement exists when the action content of the sentences is figurative, for both idiomatic and metaphoric cases. The results provide evidence for functional links between conceptual and action systems of the brain.

Object and action naming in a sentence context in people with Parkinson's disease free of dementia

Difficulties in action language processing (e.g. verbs) have been described in Parkinson's disease (PD). The embodied cognition approach links this difficulty to degenerative motor process. It has also been suggested that frontostriatal dysfunction could involve executive problems for lexical selection, which is generally more demanding for verbs. From this point of view, difficulties should diminish in a supportive context. 21 non demented people with PD and 16 control subjects were evaluated in an object and action naming task preceded by a sentence context that could be predictive or not of the target word (e.g. 'When the music started the couple began to…' 'dance'). The mobility of actions and the manipulability of objects were also manipulated. PD patients showed longer response latencies for verbs than the control group. In line with the embodied cognition approach, actions that implied higher mobility were more difficult for the group of people with PD. Moreover, PD patients benefited more from the predictive context for naming objects and actions. Results suggest that both a disruption at the level of action semantics and a subtle executive dysfunction contribute to lexical access difficulties in people with PD, even in the absence of overt cognitive impairment.

Multimodal neurocognitive markers of frontal lobe epilepsy: Insights from ecological text processing

The pressing call to detect sensitive cognitive markers of frontal lobe epilepsy (FLE) remains poorly addressed. Standard frameworks prove nosologically unspecific (as they reveal deficits that also emerge across other epilepsy subtypes), possess low ecological validity, and are rarely supported by multimodal neuroimaging assessments. To bridge these gaps, we examined naturalistic action and non-action text comprehension, combined with structural and functional connectivity measures, in 19 FLE patients, 19 healthy controls, and 20 posterior cortex epilepsy (PCE) patients. Our analyses integrated inferential statistics and data-driven machine-learning classifiers. FLE patients were selectively and specifically impaired in action comprehension, irrespective of their neuropsychological profile. These deficits selectively and specifically correlated with (a) reduced integrity of the anterior thalamic radiation, a subcortical structure underlying motoric and action-language processing as well as epileptic seizure spread in this subtype; and (b) hypoconnectivity between the primary motor cortex and the left-parietal/supramarginal regions, two putative substrates of action-language comprehension. Moreover, machine-learning classifiers based on the above neurocognitive measures yielded 75% accuracy rates in discriminating individual FLE patients from both controls and PCE patients. Briefly, action-text assessments, combined with structural and functional connectivity measures, seem to capture ecological cognitive deficits that are specific to FLE, opening new avenues for discriminatory characterizations among epilepsy types.

Motor resonance during linguistic processing as shown by EEG in a naturalistic VR environment

Embodied cognition studies have shown motor resonance during action language processing, indicating that linguistic representations are at least partially multimodal. However, constraints of this activation linked to linguistic and extra-linguistic context, function and timing have not yet been fully explored. Importantly, embodied cognition binds social and physical contexts to cognition, suggesting that more ecologically valid contexts will yield more valid measures of cognitive processing. Herein, we measured cortical motor activation during language processing in a fully immersive Cave automatic virtual environment (CAVE). EEG was recorded while participants engaged in a Go/No-Go task. They heard action verbs and, for Go trials, performed a corresponding action on a virtual object. ERSP (event-related spectral perturbation) was calculated during verb processing, corresponding to the pattern of power suppression (event-related desynchronization – ERD) and enhancement (event-related synchronization – ERS) relative to the reference interval. Significant ERD emerged during verb processing in both the µ (8–13 Hz) and beta band (20–30 Hz) for both Go and No-Go trials. µ ERD emerged in the 400–500 msec time window, associated with lexical-semantic processing. Greater µ ERD emerged for Go compared to No-Go trials. The present results provide compelling evidence in a naturalistic setting of how motor and linguistic processes interact.

Role of medial premotor areas in action language processing in relation to motor skills

The literature reports that the supplementary motor area (SMA) and pre-supplementary motor area (pre-SMA) are involved in motor planning and execution, and in motor-related cognitive functions such as motor imagery. However, their specific role in action language processing remains unclear. In the present study, we investigated the impact of repetitive transcranial magnetic stimulation (rTMS) over SMA and pre-SMA during an action semantic analogy task (SAT) in relation with fine motor skills (i.e., manual dexterity) and motor imagery abilities in healthy non-expert adults. The impact of rTMS over SMA (but not pre-SMA) on reaction times (RT) during SAT was correlated with manual dexterity. Specifically, results show that rTMS over SMA modulated RT for those with lower dexterity skills. Our results therefore demonstrate a causal involvement of SMA in action language processing, as well as the existence of inter-individual differences in this involvement. We discuss these findings in light of neurolinguistic theories of language processing.

EEG beta-power changes reflect motor involvement in abstract action language processing

Brain oscillations in the α- and β-range become suppressed during motor processing and motor imagery. It has recently been discussed that such power changes also occur during action language processing. In our study, we compared β2-oscillations (16–25Hz) during the observation of prototypical arm movements (revealed via motion tracking) as well as during semantic processing of concrete and abstract sentences containing arm-related action verbs. Whereas we did find a strong desynchronization in the β2-range during action observation, the processing of action sentences evoked a rather weak desynchronization. However, this desynchronization occurred for action verbs in both concrete and abstract contexts. These results might indicate a tendency for abstract action language to be processed similar to concrete action language rather than abstract sentences. The oscillation patterns reflect the close relationship between language comprehension and motor functions – one of the core claims of current theories on embodied cognition.

"Pushing the Button While Pushing the Argument": Motor Priming of Abstract Action Language.

In a behavioral study we analyzed the influence of visual action primes on abstract action sentence processing. We thereby aimed at investigating mental motor involvement during processes of meaning constitution of action verbs in abstract contexts. In the first experiment, participants executed either congruous or incongruous movements parallel to a video prime. In the second experiment, we added a no-movement condition. After the execution of the movement, participants rendered a sensibility judgment on action sentence targets. It was expected that congruous movements would facilitate both concrete and abstract action sentence comprehension in comparison to the incongruous and the no-movement condition. Results in Experiment 1 showed a concreteness effect but no effect of motor priming. Experiment 2 revealed a concreteness effect as well as an interaction effect of the sentence and the movement condition. The findings indicate an involvement of motor processes in abstract action language processing on a behavioral level.

Gradual desynchronization of β2-oscillations during language comprehension. Parallels between action imagery and action language processing

Gradual desynchronization of β2-oscillations during language comprehension. Parallels between action imagery and action language processing

Concepts within reach: Action performance predicts action language processing in stroke

The relationship between the brain's conceptual or semantic and sensory–motor systems remains controversial. Here, we tested manual and conceptual abilities of 41 chronic stroke patients in order to examine their relationship. Manual abilities were assed through a reaching task using an exoskeleton robot. Semantic abilities were assessed with implicit as well as explicit semantic tasks, for both verbs and nouns. The results show that that the degree of selective impairment for action word processing was predicted by the degree of impairment in reaching performance. Moreover, the implicit semantic measures showed a correlation with a global reaching parameter, while the explicit semantic similarity judgment task predicted performance in action initiation. These results suggest that action concepts are dynamically grounded through motoric simulations, and that more details are simulated for more explicit semantic tasks. This is evidence for a close and causal relationship between sensory–motor and conceptual systems of the brain.

Action relevance in linguistic context drives word-induced motor activity.

Many neurocognitive studies on the role of motor structures in action-language processing have implicitly adopted a “dictionary-like” framework within which lexical meaning is constructed on the basis of an invariant set of semantic features. The debate has thus been centered on the question of whether motor activation is an integral part of the lexical semantics (embodied theories) or the result of a post-lexical construction of a situation model (disembodied theories). However, research in psycholinguistics show that lexical semantic processing and context-dependent meaning construction are narrowly integrated. An understanding of the role of motor structures in action-language processing might thus be better achieved by focusing on the linguistic contexts under which such structures are recruited. Here, we therefore analyzed online modulations of grip force while subjects listened to target words embedded in different linguistic contexts. When the target word was a hand action verb and when the sentence focused on that action (John signs the contract) an early increase of grip force was observed. No comparable increase was detected when the same word occurred in a context that shifted the focus toward the agent's mental state (John wants to sign the contract). There mere presence of an action word is thus not sufficient to trigger motor activation. Moreover, when the linguistic context set up a strong expectation for a hand action, a grip force increase was observed even when the tested word was a pseudo-verb. The presence of a known action word is thus not required to trigger motor activation. Importantly, however, the same linguistic contexts that sufficed to trigger motor activation with pseudo-verbs failed to trigger motor activation when the target words were verbs with no motor action reference. Context is thus not by itself sufficient to supersede an “incompatible” word meaning. We argue that motor structure activation is part of a dynamic process that integrates the lexical meaning potential of a term and the context in the online construction of a situation model, which is a crucial process for fluent and efficient online language comprehension.

Action-verb processing in Parkinson’s disease: new pathways for motor–language coupling

Recent studies suggest that action-verb processing is particularly affected in early stage Parkinson's disease (PD), highlighting the potential role of subcortical areas in language processing and in the semantic integration of actions. However, this disorder-related language impairment is frequently unrecognized by clinicians and often remains untreated. Early detection of action-language processing deficits could be critical for diagnosing and developing treatment strategies for PD. In this article, we review how action-verb processing is affected in PD and propose a model in which multiple and parallel frontotemporal circuits between the cortex and the basal ganglia provide the anatomic substrate for supporting action-language processing. We hypothesize that contextual coupling of action-language networks are partially dependent on cortical-subcortical integration, and not only on somatotopic motor cortical organization or in a mirror neuron system. This hypothesis is supported by both experimental and clinical evidence. Then, we identify further research steps that would help to determine the reliability of action-language impairments as an early marker of PD. Finally, theoretical implications for clinical assessment and for models of action-language interaction (action-perception cycle theories, mirror system models of language, and embodied cognition approaches to language) are discussed.

The role of the premotor cortex and the primary motor cortex in action verb comprehension: Evidence from Granger causality analysis

Although numerous studies find the premotor cortex and the primary motor cortex are involved in action language comprehension, so far the nature of these motor effects is still in controversy. Some researchers suggest that the motor effects reflect that the premotor cortex and the primary motor cortex make functional contributions to the semantic access of action verbs, while other authors argue that the motor effects are caused by comprehension. In the current study, we used Granger causality analysis to investigate the roles of the premotor cortex and the primary motor cortex in processing of manual-action verbs. Regions of interest were selected in the primary motor cortex (M1) and the premotor cortex based on a hand motion task, and in the left posterior middle temporal gyrus (lexical semantic area) based on the reading task effect. We found that (1) the left posterior middle temporal gyrus had a causal influence on the left M1; and (2) the left posterior middle temporal gyrus and the left premotor cortex had bidirectional causal relations. These results suggest that the premotor cortex and the primary motor cortex play different roles in manual verb comprehension. The premotor cortex may be involved in motor simulation that contributes to action language processing, while the primary motor cortex may be engaged in a processing stage influenced by the meaning access of manual-action verbs. Further investigation combining effective connectivity analysis and technique with high temporal resolution is necessary for better clarification of the roles of the premotor cortex and the primary motor cortex in action language comprehension.

Semantic Representation in the Mirror Neuron System

The mirror neuron system is a fronto-parietal network of neurons that is activated both when a person performs an action and when he or she observes that action. The goal of this study was to investigate the semantic representation in this system during action language and gesture processing. This was done in a set of two behavioral experiments. Experiment 1 employed a simple priming paradigm—subjects viewed videos of symbolic gestures or landscapes, which served as the prime, followed by a word that was congruent or unrelated to the video prime, or a pseudo-word. The subject performed a lexical decision task on the target word. The study found a significant priming effect for semantically congruent target words, relative to semantically unrelated target words. However, this same priming effect was found for the video primes of landscapes. In experiment 2 we aimed to determine whether the videos were primed through effector-specific means, that is, whether hand and arm gestures would activate mirror neurons somatotopically and lead to different priming results when comparing hand responses to foot responses. We used the same priming study as experiment 1 except that subjects made their lexical decision responses on a foot pedal rather than a keyboard. Results suggest that symbolic gestures prime in a very diffuse way, such that semantic priming occurs independent of the effector being used to respond.