Action Verb Processing Research Articles

Effect of gender matching and attentional focus on the link between action observation and action verb processing

Several studies have demonstrated the existence of a link between action observation (AO) and language. However, the optimizing parameters for this link have not been explored until now. To answer this question, the present study proposed two experiments for assessing the role of motor repertory and attentional focus. Sixty participants performed a priming task in which they had to decide if a verb was or was not an action verb after they saw a point-light display (PLD) representing an action. Only one difference distinguished the experiments. In experiment one, the PLD was either in accordance or not with the gender kinematics of the observer, whereas in the second experiment, the PLD either focused on or was unfocused on the main limbs implied in the action. The results show that motor repertory affects the link between action observation and action verb processing, whereas attentional focus does not. Implications of these results are highlighted in the discussion, notably to better understand the mechanisms that explain the link between action observation and action verb processing.

Long-term motor training enhances functional connectivity between semantic and motor regions in an effector-specific manner: evidence from elite female football athletes.

The relation between the action verb semantic processing and sensorimotor experience remains controversial. In this study, we examined whether plasticity changes in brain are specifically related to semantic processing of foot action verbs when long-term motor training is mainly aimed at the foot. To address this question, we acquired resting-state functional magnetic resonance imaging scans and behavioral data from a verb two-choice task from female expertise football players and football novices. We compared the resting-state functional connectivity (rsFC) differences between experts and novices using motor execution regions and general semantic regions (left anterior temporal lobe, lATL) as seed, and explored the neural correlates of behavioral performance. Here, the drift rate (v) parameter of the drift diffusion model (DDM) was used to capture the semantic processing capability. We found experts showed increased correlation between lATL subregions and important brain regions for motor processing, including supplementary motor area (SMA), bilateral paracentral lobule (PL), superior parietal lobule and inferior parietal lobule, in contrast to novices. Further predictive model analysis showed the FC found in rsFC analysis can significantly predict drift rate of foot action verb in both experts and novices, but not drift rate of hand action verb. Our findings therefore establish a connection between effector-related semantic processing and the plasticity changes in brain functional connectivity, attributable to long-term foot-related motor training. This provides evidence supporting the view that semantic processing is fundamentally rooted in the sensorimotor system.

The concrete processing of Chinese action metaphors: an ERP study.

The present research adopts ERP (Event-Related Potentials) technology to investigate whether there exists a concreteness effect in the processing of Chinese action verbs within metaphorical context. The mean amplitudes of N400 activated by action metaphors were compared with those activated by literal verbs and abstract verbs. The findings indicated that the Met verbs evoked a significantly larger N400 response at frontal brain region compared to the Abs verbs at a time window 200-500 ms, while the Met verbs elicited a notably greater N400 amplitude specifically at the posterior brain region in comparison to the Lit verbs at 300-500 ms time window. These results may be interpreted as indicating that the comprehension of the Met verbs is based on the concrete action semantics.

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization.

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

The embodied typist: Bimanual actions are modulated by words' implied motility and number of evoked limbs.

The planning and execution of manual actions can be influenced by concomitant processing of manual action verbs. However, this phenomenon manifests in varied ways throughout the literature, ranging from facilitation to interference effects. Suggestively, stimuli across studies vary randomly in two potentially relevant variables: verb motility and effector quantity (i.e., the amount of movement and the number of hands implied by the word, respectively). Here we examine the role of these factors during keyboard typing, a strategic bimanual task validated in previous works. Forty-one participants read and typed high and low motility items from four categories: bimanual, unimanual, and non-manual action verbs, as well as minimally motoric verbs. Motor planning and execution were captured by first-letter lag (the lapse between word presentation and first keystroke) and whole-word lag (the lapse between the first and last keystroke). We found that verb motility modulated action planning and execution, both stages being delayed by high (relative to low) motility verbs. Effector quantity also influenced both stages, which were facilitated by bimanual verbs relative to unimanual verbs and non-manual verbs (this effect being confined to high motility items during action execution). Accordingly, motor-language coupling effects seem sensitive to words' implied motility and number of evoked limbs. These findings refine our understanding of how semantics influences bodily movement.

Body into Narrative: Behavioral and Neurophysiological Signatures of Action Text Processing After Ecological Motor Training

Embodied cognition research indicates that sensorimotor training can influence action concept processing. Yet, most studies employ isolated (pseudo)randomized stimuli and require repetitive single-effector responses, thus lacking ecological validity. Moreover, the neural signatures of these effects remain poorly understood. Here, we examined whether immersive bodily training can modulate behavioral and functional connectivity correlates of action-verb processing in naturalistic narratives. The study involved three phases. First, in the Pre-training phase, 32 healthy persons listened to an action text (rich in movement descriptions) and a non-action text (focused on its characters’ perceptual and mental processes), completed comprehension questionnaires, and underwent resting-state electroencephalogram (EEG) recordings. Second, in the four-day Training phase, half the participants completed an exergaming intervention (eliciting full-body movements for 60 min a day) while the remaining half played static videogames (requiring no bodily engagement other than button presses). Finally, in the Post-training phase, all participants repeated the Pre-training protocol with different action and non-action texts and a new EEG session. We found that exergaming selectively reduced action-verb outcomes and fronto-posterior functional connectivity in the motor-sensitive ∼ 10–20 Hz range, both patterns being positively correlated. Conversely, static videogame playing yielded no specific effect on any linguistic category and did not modulate functional connectivity. Together, these findings suggest that action-verb processing and key neural correlates can be focally influenced by full-body motor training in a highly ecological setting. Our study illuminates the role of situated experience and sensorimotor circuits in action-concept processing, addressing calls for naturalistic insights on language embodiment.

HD-tDCS of primary and higher-order motor cortex affects action word processing.

The contribution of action-perception systems of the brain to lexical semantics remains controversial. Here, we used high-definition transcranial direct current stimulation (HD-tDCS) in healthy adults to examine the role of primary (left hand motor area; HMA) and higher-order (left anterior inferior parietal lobe; aIPL) action areas in action-related word processing (action verbs and manipulable nouns) compared to non-action-related control words (non-action verbs and non-manipulable nouns). We investigated stimulation-related effects at three levels of semantic processing: subliminal, implicit, and explicit. Broadly, we found that stimulation of HMA and aIPL resulted in relative facilitation of action-related language processing compared to non-action. HMA stimulation facilitated action verb processing in subliminal and implicit task contexts, suggesting that HMA helps represent action verbs even in semantically shallow tasks. HMA stimulation also facilitated manipulable noun comprehension in an explicit semantic task, suggesting that HMA contributes to manipulable noun comprehension when semantic demands are high. aIPL stimulation facilitated both manipulable noun and action verb processing during an implicit task. We suggest that both HMA and aIPL play a functional role in action semantics. HMA plays a general role in the semantics of actions and manipulable objects, while aIPL is important only when visuo-motor coordination is required for the action.

The Link Between Action Verb Processing and Action Observation: A Developmental Study.

In this work we aimed to assess the typical link in human development between action observation and language. For this, we studied, in 68 children aged 5-11years of age, how action verbs can prime action representation. While children 7-8years of age benefited from a congruent action verb prime when they had to judge an image representing an action, this effect was not present in 5-6-year-olds. Thus, the link between language and action observation changes during development at about age 7. We discussed these findings in consideration of current theories proposed to account for the action-language link.

Abstract Action Language Processing in Eleven-Year-Old Children: Influence of Upper Limb Movement on Sentence Comprehension.

Regarding the embodiment of language processing in adults, there is evidence of a close connection between sensorimotor brain areas and brain areas relevant to the processing of action verbs. This thesis is hotly debated and has therefore been thoroughly studied in adults. However, there are still questions concerning its development in children. The present study deals with the processing of action verbs in concrete and abstract sentences in 60 eleven-year-olds using a decision time paradigm. Sixty-five children mirrored arm movements or sat still and rated the semantic plausibility of sentences. The data of the current study suggest that eleven-year-olds are likely to misunderstand the meaning of action verbs in abstract contexts. Their decision times were faster and their error rates for action verbs in concrete sentences were lower. However, the gender of the children had a significant influence on the decision time and the number of errors, especially when processing abstract sentences. Females were more likely to benefit from an arm movement before the decision, while males were better if they sat still beforehand. Overall, children made quite a few errors when assessing the plausibility of sentences, but the female participants more often gave plausibility assessments that deviated from our expectations, especially when processing abstract sentences. It can be assumed that the embodiment of language processing plays some role in 11-year-old children, but is not yet as mature as it is in adults. Especially with regard to the processing of abstract language, the embodied system still has to change and mature in the course of child development.

HD-tDCS over motor cortex facilitates figurative and literal action sentence processing

The extent to which action and perception systems of the brain are involved in semantic comprehension remains controversial. Whether figurative language, such as metaphors and idioms, is grounded in sensory-motor systems is especially contentious. Here, we used high-definition transcranial direct current stimulation (HD-tDCS) in healthy adults to examine the role of the left-hemisphere motor cortex during the comprehension of action sentences, relative to comprehension of sentences with visual verbs. Action sentences were divided into three types: literal, metaphoric, or idiomatic. This allowed us to ask whether processing of action verbs used in figurative contexts relies on motor cortex. The results revealed that action sentence comprehension response times were facilitated relative to the visual sentence control. Significant interaction relative to visual sentences was observed for literal, metaphoric, and idiomatic action sentences with HD-tDCS of the motor cortex. These results suggest that the left motor cortex is functionally involved in action sentence comprehension. Furthermore, this involvement exists when the action content of the sentences is figurative, for both idiomatic and metaphoric cases. The results provide evidence for functional links between conceptual and action systems of the brain.

When the Action to Be Performed at the Stage of Retrieval Enacts Memory of Action Verbs.

. According to the embodied approach of language, concepts are grounded in sensorimotor mental states, and when we process language, the brain simulates some of the perceptions and actions that are involved when interacting with real objects. Moreover, several studies have highlighted that cognitive performances are dependent on the overlap between the motor action simulated and the motor action required by the task. On the other hand, in the field of memory, the role of action is under debate. The aim of this work was to show that performing an action at the stage of retrieval influences memory performance in a recognition task (experiment 1) and a cued recall task (experiment 2), even if the participants were never instructed to consider the implied action. The results highlighted an action-based memory effect at the retrieval stage. These findings contribute to the debate about the implication of motor system in action verb processing and its role for memory.

Exploring the Co-occurrence of Manual Verbs and Actions in Early Mother-Child Communication.

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines (free play, bathing, and dining) when children were 1 to 2 (Group 1) and 2 to 3 (Group 2) years old. Eight mother-child dyads were video-recorded in 3-month intervals across 12 months (27 recording hours), and the timing of verbs and manual actions (21,876 entries) were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher (0.80 and 0.77) than that of random co-occurrences (0.13 and 0.15) for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals (8% of the cases) and the shortest +5 s interval (40% of the cases). Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used (74%) those verbs they shared with their children’s repertoire (31%). In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment.

Lexical-semantic processing of action verbs and non-action nouns in Persian speakers: Behavioral evidence from the semantic similarity judgment task

The processing of sensory-motor aspect of word's meaning, and its difference between nouns and verbs, is the main topic of neurolinguistic research. The present study aimed to examine the lexical-semantic processing of Persian non-action nouns and action verbs. The possible effects of semantic correlates on noun/verb dissociation were evaluated without morphological confound. A total of 62 neurologically intact Persian speakers responded to a computerized semantic similarity judgment task, including 34 triplets of non-action nouns and 34 triplets of action verbs by pressing a key. Response Time (RT) and percentage error were considered as indirect measures of lexical-semantic encoding efficiency. We also assessed the latency of hand movement execution with no linguistic demand. The results showed that action verbs elicited more errors and had slower RT compared with object nouns. Mixed ANOVA revealed that the observed noun/verb distinction was not affected by demographic factors. These results provided evidence that the lexical-semantic encoding of Persian action verbs, compared to non-action nouns, requires more support from cognitive sources‏ ‏during the processing of the motor‏-‏related semantic feature. The possible accounts for the different processing of action verbs in terms of semantic view are suggested.

How words ripple through bilingual hands: Motor-language coupling during L1 and L2 writing

The speed of our hand movements can be affected by concurrent processing of manual action verbs (MaVs). Whereas this phenomenon is well established for native languages (L1s), it remains underexplored in late foreign languages (L2s), especially during highly automatized tasks. Here we timed keystroke activity while Spanish-English bilinguals copied MaVs, non-manual action verbs, and non-action verbs in their L1 and L2. Motor planning and execution dynamics were indexed by first-letter lag (the time-lapse between word presentation and first keystroke) and whole-word lag (the time-lapse between first and last keystroke), respectively. Despite yielding no effects on motor planning, MaVs facilitated typing execution in L1 but delayed it in L2, irrespective of the subjects’ typing skills, age of L2 learning, and L2 competence. Therefore, motor-language coupling effects seem to be present in both languages though they can arise differently in each. These results extend language grounding models, illuminating the role of embodied mechanisms throughout life.

Developing a Semantic Similarity Judgment Test for Persian Action Verbs and Non-action Nouns in Patients With Brain Injury and Determining its Content Validity

Objective: Brain trauma evidences suggest that the two grammatical categories of noun and verb are processed in different regions of the brain due to differences in the complexity of grammatical and semantic information processing. Studies have shown that the verbs belonging to different semantic categories lead to neural activity in different areas of the brain, and action verb processing is related to the activity of motor and pre-motor areas of the brain. Researchers use different tasks to evaluate action verb processing. The most common tasks are action naming and action fluency tasks. Although these types of tasks are sensitive to deficits in action verb processing, they do not specify the nature of the injury. To understand whether dysfunction in action verb processing is due to difficulty in lexical access or specific impairment in semantic processing, it is necessary to design a specific test to evaluate lexical-semantic processing. Semantic Similarity Judgment (SSJ) test targets the lexical-semantic encoding at a deep and controlled processing level. The purpose of the present study was to develop a SSJ test for Persian action verbs and non-action nouns and determine its content validity. Materials & Methods: In this methodological study, 70 Persian action concrete verbs and 80 Persian non-action concrete nouns were first selected. For each word, a semantically related word based on functional, physical, categorical features and similarity in action was selected according to the opinion of 4 experts (3 speech-language pathologists and one linguist) using a 7-point scale. For semantic similarity rating, only the pairs of words with a high semantic similarity score (5 to 7) remained and the rest were omitted. Then, for each pair of semantically related words, a semantically unrelated word was selected. After determining content validity qualitatively by three experts and removing inappropriate items, for matching the two sets of nouns and verbs, the lexical and psycholinguistic characteristics of the remaining words (207 nouns and 156 verbs) including frequency, number of syllables, phonemes, letters, phonological and orthographic neighbors, action association, imageability, familiarity and age of acquisition were extracted by 18 volunteers (13 speech-language pathologists and linguists and 5 parents selected by a convenience sampling method) based on a 7-point scale. The verbs with low action associations and the nouns with high action association were removed and then, the two sets of words were matched for other lexical and psycholinguistic characteristics. Finally, 34 triples of verbs with high action association and 34 triples of nouns with low action association were selected. In both noun and verb sets, the words were chosen in such a way that, in order to judge, the semantic features of the words need to be carefully considered. Data analysis was performed using descriptive statistics and independent t-test.

The link between language and action in aging

ObjectiveMany studies have demonstrated the existence of a link between action verb processing and action. However, little is known about the changes in this relationship with aging. MethodTo assess this point, we compare the performances of younger and older people during a priming task consisting of judging whether an image contains a human after listening to an action verb. ResultsIn accordance with previous literature, the results showed that younger people were faster to detect the presence of a human in the image in congruent conditions, namely, when the action verb and the image refer to the same action. However, this effect was not present in older adults’ participants. ConclusionThese findings suggest that the link between action and language decreases with age. We discuss these findings in the context of the embodied view of cognition.

Using Action-congruent Language Facilitates the Motor Response during Action Observation: A Combined Transcranial Magnetic Stimulation and Eye-tracking Study.

There is evidence that action observation (AO) and the processing of action-related words are associated with increased activity in cortical motor regions. Research has examined the effects of AO and action verb processing on activity in the motor system independently. The aim of this experiment was to investigate, for the first time, the modulation of corticospinal excitability and visual attention during the concurrent processing of action verbs and AO stimuli. Twenty participants took part in an integrated transcranial magnetic stimulation and eye-tracking protocol. Single-pulse transcranial magnetic stimulation was delivered to the hand representation of the left motor cortex during (i) observation of a static hand, (ii) AO of a hand squeezing a sponge, (iii) AO of the same action with an audio recording of the word "squeeze," and (iv) AO of the same action with an audio recording of the word "green". Motor evoked potentials were recorded from the abductor pollicis brevis and abductor digiti minimi muscles of the right hand. Eye gaze was recorded throughout the four conditions as a proxy for visual attention. Interviews were conducted to discuss participants' preferences and imagery use for each condition. The AO and action verb condition resulted in significantly increased motor evoked potential amplitudes in the abductor pollicis brevis muscle; participants also made significantly more fixations on the sponge and reported wanting to move their hand more in the action verb condition. The inclusion of auditory action verbs, alongside AO stimuli, in movement simulation interventions could have implications for the delivery of AO interventions for motor (re)learning.

Subthalamic nucleus activity in the processing of body and mental action verbs in people with Parkinson’s disease

Local field potentials evoked by body action and mental action verbs were recorded in the subthalamic nucleus (STN) of 18 patients with Parkinson’s disease through the electrodes implanted for deep brain stimulation. Compared with the medication on-condition, the medication off-condition showed a difference in activity in the early time segments, mainly in the right STN, with larger amplitudes for body action verbs. In the on-condition a similar pattern was detected in the left STN. These patterns of early differences in activity evoked by different types of verbs might indicate the potential of the STN to rapidly detect relevant behavioural clues in verbal content and to integrate these in subsequent cortico-subcortical interactions. In addition, these lateralizations allow speculations about shifts in processing activity correlating with dopaminergic denervation. Whether this detection relies on phonological, semantic or grammatical clues remains an open question.

Neurosurgical lesions to sensorimotor cortex do not impair action verb processing

There is ongoing debate regarding the role that sensorimotor regions play in conceptual processing, with embodied theories supporting their direct involvement in processing verbs describing body part movements. Patient lesion studies examining a causal role for sensorimotor activation in conceptual task performance have suffered the caveat of lesions being largely diffuse and extensive beyond sensorimotor cortices. The current study addresses this limitation in reporting on 20 pre-operative neurosurgical patients with focal lesion to the pre- and post-central area corresponding to somatotopic representations. Patients were presented with a battery of neuropsychological tests and experimental tasks tapping into motor imagery and verbal conceptual verb processing in addition to neurophysiological measures including DTI, fMRI, and MEP being measured. Results indicated that left tumor patients who presented with a lesion at or near somatotopic hand representations performed significantly worse on the mental rotation hand task and that performance correlated with MEP amplitudes in the upper limb motor region. Furthermore, performance on tasks of verbal processing was within the normal range. Taken together, while our results evidence the involvement of the motor system in motor imagery processes, they do not support the embodied view that sensorimotor regions are necessary to tasks of action verb processing.

A review of literature on the link between action observation and action language: advancing a shared semantic theory

Understanding each other is a core concept of social cohesion and, consequently, has immense value in human society. Importantly, shared information leading to cohesion can come from two main sources: observed action and/or language (word) processing. In this paper, we propose a theoretical framework for the link between action observation and action verb processing. Based on the activation of common semantic representations of actions through semantic resonance, this model can account for the neurophysiological, behavioral and neuropsychological domains in the link between action observation and language. Semantic resonance is hypothesized to play a role beyond that of the mere observation of others and can benefit future studies trying to connect action production and language.