Action-sentence Compatibility Effect Research Articles

The influence of sentence focus on mental simulation: A possible cause of ACE instability.

Recent studies have revealed the instability of the action-sentence compatibility effect (ACE). The current study was designed to demonstrate the hypothesis that the instability of the ACE may be attributed to the instability of focused information in a sentence. A pilot study indicated that the focused information of sentences was relatively stable in the sentence-picture verification task but exhibited significant interindividual variability in the action-sentence compatibility paradigm in previous studies. Experiments 1 and 2 examined the effect of sentence focus on the shape match effect and the ACE by manipulating the focused information of sentences using the focus marker word "" (is). Experiment 1 found that the shape match effect occurred in the original sentence, while it disappeared when the word "" (is) was used to make an object noun no longer the focus of a sentence. Experiment 2 failed to observe the ACE regardless of whether the sentence focus was on the action information. Experiment 3 modified the focus manipulation to observe its impact on the ACE using different fonts and underlines to highlight the focused information. The results indicated that the ACE only occurred when the action information was the sentence focus. These findings suggest that sentence focus influences mental simulation, and the instability of the ACE is likely to be associated with the instability of sentence focus in previous studies. This outcome highlights the crucial role of identifying specific information as the critical element expressed in the current linguistic context for successful simulation.

Lack of action-sentence compatibility effect in non-clinical individuals with high autistic traits.

Patients with autism spectrum disorder (ASD) exhibit atypical responses to language use and comprehension. Recently, various degrees of primary autistic symptoms have been reported in the general population. We focused on autistic traits and examined the differences in mechanisms related to language comprehension using the action-sentence compatibility effect (ACE). ACE is a phenomenon in which response is facilitated when the action matches the behavior described in the statement. In total, 70 non-clinical individuals were divided into low autistic and high autistic groups according to their autism spectrum quotient (AQ) scores. ACEs with adverbs and onomatopoeias were examined using a stimulus set of movement-related sentences. A choice-response task helped determine the correct sentence using antonym adverbs (slow and fast) and onomatopoeia (quick and satto) related to the speed of the movement. The low-AQ group showed ACEs that modulated the reaction time in antonym sentences. The high-AQ group showed less temporal modulation, and their overall reaction time was shorter. The low-AQ group showed faster reaction times for onomatopoeic words; however, the high-AQ group showed a tendency to reverse this trend. In individuals with intermediate autistic traits, the angle effect may be moderated by individual differences in motor skills and experience rather than autistic traits. The stimulus presentation involved a passive paradigm. This study provides insight into language comprehension processes in non-clinical individuals ranging from low to high autistic idiosyncrasy and elucidates language and behavior in individuals at different locations on the autistic trait continuum.

A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE)

The Action-sentence Compatibility Effect (ACE) is a well-known demonstration of the role of motor activity in the comprehension of language. Participants are asked to make sensibility judgments on sentences by producing movements toward the body or away from the body. The ACE is the finding that movements are faster when the direction of the movement (e.g., toward) matches the direction of the action in the to-be-judged sentence (e.g., Art gave you the pen describes action toward you). We report on a pre-registered, multi-lab replication of one version of the ACE. The results show that none of the 18 labs involved in the study observed a reliable ACE, and that the meta-analytic estimate of the size of the ACE was essentially zero.

Examining the Effect of Adverbs and Onomatopoeia on Physical Movement.

Introduction: The effect of promoting a physical reaction by the described action is called the action-sentence compatibility effect (ACE). It has been verified that physical motion changes depending on the time phase and grammatical expression. However, it is unclear how adverbs and onomatopoeia change motion simulations and subsequent movements.Methods: The subjects were 35 healthy adults (11 females; mean age 21.3). We prepared 20 sentences each, expressing actions related to hands and feet. These were converted into 80 sentences (stimulus set A), with the words “Slow” or “Quick” added to the words related to the speed of movement, and 80 sentences (stimulus set B) with the words “Fast” and onomatopoeia “Satto” added. Additionally, 20 unnatural sentences were prepared for each stimulus set as pseudo sentences. Choice reaction time was adopted; subjects pressed the button with their right hand only when the presented text was correctly understood (Go no-go task). The reaction time (RTs) and the number of errors (NoE) were recorded and compared.Results: As a result of a two-way repeated ANOVA, an interaction effect (body parts × words) was observed in RTs and NoE in set A. “Hand and Fast” had significantly faster RTs than “Hand and Slow” and “Foot and Fast.” Furthermore, “Hand and Fast” had a significantly higher NoE than others. In set B, the main effects were observed in both RTs and NoE. “Hand” and “Satto” had significantly faster RTs than “Foot” and “Quick,” respectively. Additionally, an interaction effect was observed in NoE, wherein “Foot and Satto” was significantly higher than “Hand and Satto” and “Foot and Quick.”Conclusion: In this study, the word “Fast” promoted hand response, reaffirming ACE. The onomatopoeia “Satto” was a word that conveys the speed of movement, but it was suggested that the degree of understanding may be influenced by the body part and the attributes of the subject.

Interfering Embodiment Effects on Chinese “Transfer Verbs”

Abstract This research aims to explore the processing of embodied meaning during the comprehension of Chinese transfer verbs which is different from the typical structure of transfer verbs in English and other Indo-European languages. An Action-sentence Compatibility Effect (ACE) paradigm was used, in which participants were asked to read sentences describing a transfer verb either away from (At the court, a player throws tennis ball to opposite side) or toward themselves (At the court, a player throws tennis ball to my side). Following the transfer verb, a visual motion cue appeared on the screen after one of the three stimulus onset asychrony (SOA), prompting participants to move their hand either away from or toward themselves by pressing a button. The results showed that under short SOAs (cue presented 100 ms or 200 ms after the verb onset), interference occurred in the matching conditions. After larger delaying of the cue (350 ms), facilitation emerged in matching conditions. The results reflect special features in describing motion events by using Chinese transfer verbs, providing evidence that the comprehension of transfer-verb sentences in Mandarin activates the sensory-motor systems of our body, either interfering or facilitating a motor response performed in parallel.

Spatial and Motor Aspects in the "Action-Sentence Compatibility Effect".

The Action-sentence Compatibility Effect (ACE) is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal “simulation,” i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to disentangle spatial and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility (i.e., differences in reaction times simultaneously coming from block order and opposite motion conditions). Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants’ awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed.

The linguistic looming effect

Abstract We describe a new phenomenon related to language comprehension and memory: the Linguistic Looming Effect (LLE). The perceptual looming bias is the finding that objects approaching the self grab attention and generate quick adaptive action, such as avoidance of the object ( Neuhoff, 2018 ). The LLE is the finding that sentences that describe concrete objects or abstract entities moving toward the self are processed more quickly and remembered better than sentences describing motion of objects or abstract entities away from the self. The first three experiments of the present research describe the LLE as observed in experiments designed to examine the action-sentence compatibility effect, or ACE ( Glenberg & Kaschak, 2002 ) and its consequences for long-term memory. The fourth experiment was specifically designed to generate an LLE in the absence of two potential confounds, and the results again showed the effect. The fifth experiment served to replicate the effect and to analyze its occurrence when sentences with a third-person perspective were used. The LLE is discussed in relation to prior empirical findings, and it is interpreted in the light of theoretical frameworks related to the embodied approach to cognition and the role played by the self in the processing and remembering of information.

Interfering ACE on comprehending embodied meaning in action-related Chinese counterfactual sentences

abstractThe present study explores whether embodied meaning is activated in comprehension of action-related Mandarin counterfactual sentences. Participants listened to action-related Mandarin factual or counterfactual sentences describing transfer events (actions towards or away from the participant), and then performed verb-compatible or -incompatible motor action after a transfer verb (action towards or away from the participant) onset. The results demonstrated that motor simulation, specifically the interfering action-sentence compatibility effect (ACE), was obtained in both factual and counterfactual sentences. Additionally, the temporal course of motor resonance was slightly different between factual and counterfactual sentences. We concluded that embodied meaning was activated in action-related Chinese counterfactual sentences. The results supported a neural network model of Chersi, Thill, Ziemke, and Borghi (2010), proposed within the embodiment approach, which explains the interaction between processing action-related sentences and motor performance. Moreover, we speculated that the neural network model of Chersi et al. was also applicable to action-related Mandarin counterfactual comprehension.

Match, mismatch, and envisioning transfer events

Abstract Prior studies suggest that language users perform motoric simulations when construing action sentences and that verbs and constructions each contribute to simulation-based representation (Glenberg & Kaschak 2002; Richardson et al. 2003; Bergen et al. 2007; Bergen & Wheeler 2010). This raises the possibility that motorically grounded verb and construction meanings can interact during sentence understanding. In this experiment, we use the action-sentence compatibility effect methodology to investigate how a verb’s lexical-class membership, constructional context, and constructional bias modulate motor simulation effects. Stimuli represent two classes of transfer verbs and two constructions that encode transfer events, Ditransitive and Oblique Goal (Goldberg 1995). Findings reveal two kinds of verb-construction interactions. First, verbs in their preferred construction generate stronger simulation effects overall than those in their dispreferred construction. Second, verbs that entail change of possession generate strong motor-simulation effects irrespective of constructional context, while those entailing causation of motion exert such effects only when enriched up to change-of-possession verbs in the semantically mismatched Ditransitive context. We conclude that simulation effects are not isolable to either verbs or constructions but instead arise from the interplay of verb and construction meaning.

Embodied Simulations Are Modulated by Sentential Perspective

There is considerable evidence that language comprehenders derive lexical-semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations-including the level of detail that is incorporated and contexts under which simulations occur-is not well understood. Here, we examine the effects of first- versus third-person perspective on mental simulations during sentence comprehension. First-person sentences describing physical transfer towards or away from the body (e.g., "You threw the microphone," "You caught the microphone") modulated response latencies when responses were made along a front-back axis, consistent with the action-sentence compatibility effect (ACE). This effect was not observed for third-person sentences ("He threw the microphone," "He caught the microphone"). The ACE was observed when making responses along a left-right axis for third-person, but not first-person sentences. Abstract sentences (e.g., "He heard the message") did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence.

"Just out of reach: On the reliability of the action-sentence compatibility effect": Correction to Papesh (2015).

Reports an error in "Just out of reach: On the reliability of the action-sentence compatibility effect" by Megan H. Papesh (Journal of Experimental Psychology: General, 2015[Dec], Vol 144[6], e116-e141). In the article, the Procedure did not directly state that response options were not visible on the computer screen during Experiments 7 and 8. The first sentence of the Procedure for Experiment 7 should read, “Participants completed a modified button-press version of the experiment described in Experiment 4; unlike Experiment 4, Experiment 7 included no visible on-screen elements apart from the to-be-judged sentences, which came from Glenberg and Kaschak (2002).” (The following abstract of the original article appeared in record 2015-53127-006.) The action-sentence compatibility effect (ACE; Glenberg & Kaschak, 2002), a hallmark finding in Embodied Cognition, implicates the motor system in language comprehension. In the ACE, people process sentences implying movement toward or away from themselves, responding with actions toward or away from their bodies. These processes interact, implying a linkage between linguistic and motor systems. From a theoretical perspective, the ACE has been extremely influential, being widely cited evidence in favor of embodied cognition. The present study began as an attempt to extend the ACE in a new direction, but eventually became a series of attempts to simply replicate the effect. Across 8 experiments, I tested whether the ACE extends to a novel mouse-tracking method and/or is susceptible to higher-order cognitive influences. In 3 experiments, attempts were made to “disembody” the ACE by presenting participants’ names on the computer screen (as in Markman & Brendl, 2005). In each experiment, the ACE could not be disembodied, because the ACE did not occur. In further experiments, the ACE was not observed in reading times, regardless of response mode (mouse movements vs. button-presses) or stimuli, including those from the original research. Similarly, no ACE was observed in physical movement times. Bayes Factor analyses of the current experiments, and the previous ACE literature, suggest that the evidence for the ACE is generally weak: Many studies considered as positive evidence actually support the null hypothesis, and very few published results offer strong evidence for the ACE. Implications for the embodiment hypothesis are discussed.

When do language comprehenders mentally simulate locations?

Abstract Embodied approaches to comprehension propose that understanding language entails performing mental simulations of its content. The evidence, however, is mixed. Action-sentence Compatibility Effect studies (Glenberg and Kaschak 2002) report mental simulation of motor actions during processing of motion language. But the same studies find no evidence that language comprehenders perform spatial simulations of the corresponding locations. This challenges simulation-based approaches. If locations are not represented in simulation, but are still understood, then simulation may be unnecessary for understanding. We conducted a Location-sentence Compatibility experiment, to determine whether understanders mentally simulate locations. People did indeed simulate locations, but only when sentences used progressive (and not perfect) grammatical aspect. Moreover, mental simulations of locations differed for language about concrete versus abstract events. These findings substantiate the role of mental simulation in language understanding, while highlighting the importance of the grammatical form of utterances as well as their content.

Just out of reach: On the reliability of the action-sentence compatibility effect.

The action-sentence compatibility effect (ACE; Glenberg & Kaschak, 2002), a hallmark finding in Embodied Cognition, implicates the motor system in language comprehension. In the ACE, people process sentences implying movement toward or away from themselves, responding with actions toward or away from their bodies. These processes interact, implying a linkage between linguistic and motor systems. From a theoretical perspective, the ACE has been extremely influential, being widely cited evidence in favor of embodied cognition. The present study began as an attempt to extend the ACE in a new direction, but eventually became a series of attempts to simply replicate the effect. Across 8 experiments, I tested whether the ACE extends to a novel mouse-tracking method and/or is susceptible to higher-order cognitive influences. In 3 experiments, attempts were made to "disembody" the ACE by presenting participants' names on the computer screen (as in Markman & Brendl, 2005). In each experiment, the ACE could not be disembodied, because the ACE did not occur. In further experiments, the ACE was not observed in reading times, regardless of response mode (mouse movements vs. button-presses) or stimuli, including those from the original research. Similarly, no ACE was observed in physical movement times. Bayes Factor analyses of the current experiments, and the previous ACE literature, suggest that the evidence for the ACE is generally weak: Many studies considered as positive evidence actually support the null hypothesis, and very few published results offer strong evidence for the ACE. Implications for the embodiment hypothesis are discussed.

Cortical dynamics and subcortical signatures of motor-language coupling in Parkinson's disease.

Impairments of action language have been documented in early stage Parkinson’s disease (EPD). The action-sentence compatibility effect (ACE) paradigm has revealed that EPD involves deficits to integrate action-verb processing and ongoing motor actions. Recent studies suggest that an abolished ACE in EPD reflects a cortico-subcortical disruption, and recent neurocognitive models highlight the role of the basal ganglia (BG) in motor-language coupling. Building on such breakthroughs, we report the first exploration of convergent cortical and subcortical signatures of ACE in EPD patients and matched controls. Specifically, we combined cortical recordings of the motor potential, functional connectivity measures, and structural analysis of the BG through voxel-based morphometry. Relative to controls, EPD patients exhibited an impaired ACE, a reduced motor potential, and aberrant frontotemporal connectivity. Furthermore, motor potential abnormalities during the ACE task were predicted by overall BG volume and atrophy. These results corroborate that motor-language coupling is mainly subserved by a cortico-subcortical network including the BG as a key hub. They also evince that action-verb processing may constitute a neurocognitive marker of EPD. Our findings suggest that research on the relationship between language and motor domains is crucial to develop models of motor cognition as well as diagnostic and intervention strategies.

The Action-Sentence Compatibility Effect in ASL: the role of semantics vs. perception.

Embodied theories of cognition propose that humans use sensorimotor systems in processing language. The Action-Sentence Compatibility Effect (ACE) refers to the finding that motor responses are facilitated after comprehending sentences that imply movement in the same direction. In sign languages there is a potential conflict between sensorimotor systems and linguistic semantics: movement away from the signer is perceived as motion toward the comprehender. We examined whether perceptual processing of sign movement or verb semantics modulate the ACE. Deaf ASL signers performed a semantic judgment task while viewing signed sentences expressing toward or away motion. We found a significant congruency effect relative to the verb's semantics rather than to the perceived motion. This result indicates that (a) the motor system is involved in the comprehension of a visual-manual language, and (b) motor simulations for sign language are modulated by verb semantics rather than by the perceived visual motion of the hands.

How embodied is action language? Neurological evidence from motor diseases

Although motor-language coupling is now being extensively studied, its underlying mechanisms are not fully understood. In this sense, a crucial opposition has emerged between the non-representational and the representational views of embodiment. The former posits that action language is grounded on the non-brain motor system directly engaged by musculoskeletal activity – i.e., peripheral involvement of ongoing actions. Conversely, the latter proposes that such grounding is afforded by the brain’s motor system – i.e., activation of neural areas representing motor action. We addressed this controversy through the action-sentence compatibility effect (ACE) paradigm, which induces a contextual coupling of motor actions and verbal processing. ACEs were measured in three patient groups – early Parkinson’s disease (EPD), neuromyelitis optica (NMO), and acute transverse myelitis (ATM) patients – as well as their respective healthy controls. NMO and ATM constitute models of injury to non-brain motor areas and the peripheral motor system, whereas EPD provides a model of brain motor system impairment. In our study, EPD patients exhibited impaired ACE and verbal processing relative to healthy participants, NMO, and ATM patients. These results indicate that the processing of action-related words is mainly subserved by a cortico-subcortical motor network system, thus supporting a brain-based embodied view on action language. More generally, our findings are consistent with contemporary perspectives for which action/verb processing depends on distributed brain networks supporting context-sensitive motor-language coupling.

Embodiment during reading: Simulating a story character’s linguistic actions.

According to theories of embodied cognition, a critical element in language comprehension is the formation of sensorimotor simulations of the actions and events described in a text. Although much of the embodied cognition research has focused on simulations of motor actions, we ask whether readers form simulations of story characters' linguistic actions. For example, when a character is described as speaking, do readers form an auditory image of the character's words? Furthermore, if a character is described as reading, do readers form a visual image of the words on the page? In 4 experiments, a character was described as either reading or speaking, quickly or slowly. Critically, participants either read silently or read aloud so that their action matched or mismatched the character's action. Consistent with the action-sentence compatibility effect (Glenberg & Kaschak, 2002), only when the participant's and the character's actions matched--when both were reading or both were speaking--was a rate effect found, with participants reading/speaking more slowly when the character was described as reading/speaking slowly. We conclude that comprehension of a character's linguistic action involves the same types of sensorimotor simulations as have been shown across a vast array of other types of actions.

The effect of perceptual motor information on the action-sentence compatibility effect

The effect of perceptual motor information on the action-sentence compatibility effect

Action-Sentence Compatibility: The Role of Action Effects and Timing

Research on embodied approaches to language comprehension suggests that we understand linguistic descriptions of actions by mentally simulating these actions. Evidence is provided by the action-sentence compatibility effect (ACE) which shows that sensibility judgments for sentences are faster when the direction of the described action matches the response direction. In two experiments, we investigated whether the ACE relies on actions or on intended action effects. Participants gave sensibility judgments of auditorily presented sentences by producing an action effect on a screen at a location near the body or far from the body. These action effects were achieved by pressing a response button that was located in either the same spatial direction as the action effect, or in the opposite direction. We used a go/no-go task in which the direction of the to-be-produced action effect was either cued at the onset of each sentence (Experiment 1) or at different points in time before and after sentence onset (Experiment 2). Overall, results showed a relationship between the direction of the described action and the direction of the action effect. Furthermore, Experiment 2 indicated that depending on the timing between cue presentation and sentence onset, participants responded either faster when the direction of the described action matched the direction of the action effect (positive ACE), or slower (negative ACE). These results provide evidence that the comprehension of action sentences involves the activation of representations of action effects. Concurrently activated representations in sentence comprehension and action planning can lead to both priming and interference, which is discussed in the context of the theory of event coding.

Motor-language coupling: Direct evidence from early Parkinson’s disease and intracranial cortical recordings

Language and action systems are functionally coupled in the brain as demonstrated by converging evidence using Functional magnetic resonance imaging (fMRI), electroencephalography (EEG), transcranial magnetic stimulation (TMS), and lesion studies. In particular, this coupling has been demonstrated using the action-sentence compatibility effect (ACE) in which motor activity and language interact. The ACE task requires participants to listen to sentences that described actions typically performed with an open hand (e.g., clapping), a closed hand (e.g., hammering), or without any hand action (neutral); and to press a large button with either an open hand position or closed hand position immediately upon comprehending each sentence. The ACE is defined as a longer reaction time (RT) in the action-sentence incompatible conditions than in the compatible conditions. Here we investigated direct motor-language coupling in two novel and uniquely informative ways. First, we measured the behavioural ACE in patients with motor impairment (early Parkinson’s disease – EPD), and second, in epileptic patients with direct electrocorticography (ECoG) recordings. In experiment 1, EPD participants with preserved general cognitive repertoire, showed a much diminished ACE relative to non-EPD volunteers. Moreover, a correlation between ACE performance and action-verb processing (kissing and dancing test – KDT) was observed. Direct cortical recordings (ECoG) in motor and language areas (experiment 2) demonstrated simultaneous bidirectional effects: motor preparation affected language processing (N400 at left inferior frontal gyrus and middle/superior temporal gyrus), and language processing affected activity in movement-related areas (motor potential at premotor and M1). Our findings show that the ACE paradigm requires ongoing integration of preserved motor and language coupling (abolished in EPD) and engages motor-temporal cortices in a bidirectional way. In addition, both experiments suggest the presence of a motor-language network which is not restricted to somatotopically defined brain areas. These results open new pathways in the fields of motor diseases, theoretical approaches to language understanding, and models of action-perception coupling.