Action Observation Tasks Research Articles

Gaze and body cues interplay during interactive requests.

Although observing other’s gaze and body movements provides a crucial source of information to successfully interact with other people, it remains unclear whether observers weigh differently these cues and whether the convergence of gaze and body’s directions determines facilitation effects. Here we aim to shed more light on this issue by testing the reliance upon these cues from both a behavioral and a neurophysiological perspective in a social interactive context. In Experiment 1, we manipulated the convergence between the direction of an actor’s upper limb movement and gaze direction while he attempts to socially interact with the participants observing the scene. We determined the direction of gaze as well as the duration of participants’ ocular fixations during the observation of the scene. In Experiment 2, we measured and correlated the effect of the body/gaze manipulation on corticospinal excitability and on the readiness to interact—a disposition to engage in social situations. Eye-tracking data revealed that participants fixated chiefly the actor’s head when his hand and gaze directions were divergent. Possibly a strategy to disambiguate the scene. Whereas participants mainly fixated the actor’s hand when he performed an interactive request toward the participants. From a neurophysiological point of view, the more participants felt involved in the interaction, the lower was motor preparation in the muscle potentially needed to fulfill the actor’s request. We contend that social contexts are more likely to elicit motor preparation compared to non-social ones, and that muscular inhibition is a necessary mechanism in order to prevent unwanted overt reactions during action observation tasks.

Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement.

In a social world, observing the actions of others is fundamental to understanding what they are doing, as well as their intentions and feelings. Studies of the neural basis and decoding of action observation are important for understanding action-related processes and have implications for cognitive, social neuroscience, and human-machine interaction (HMI). In the current study, we first investigated temporal-spatial dynamics during action observation using a combined 64-channel electroencephalography (EEG) and 48-channel functional near-infrared spectroscopy (fNIRS) system. We measured brain activation while 16 healthy participants observed three action tasks: (1) grasping a cup with the intention of drinking; (2) grasping a cup with the intention of moving it; and (3) touching a cup with an unclear intention. The EEG and fNIRS source analysis results revealed the dynamic involvement of both the mirror neuron system (MNS) and the theory of mind (ToM)/mentalizing network during action observation. The source analysis results suggested that the extent to which these two systems were engaged was determined by the clarity of the intention of the observed action. Based on the difference in neural activity observed among different action-observation tasks in the first experiment, we conducted a second experiment to classify the neural processes underlying action observation using a feature classification method. We constructed complex brain networks based on the EEG and fNIRS data. Fusing features from both EEG and fNIRS complex brain networks resulted in a classification accuracy of 72.7% for the three action observation tasks. This study provides a theoretical and empirical basis for elucidating the neural mechanisms of action observation and intention understanding, and a feasible method for decoding the underlying neural processes.

Short-term physical training enhances mirror system activation to action observation

ABSTRACTThe mirroring of actions is performed by a specialized system of neurons found in the sensorimotor cortex, termed the mirror neuron system. This system is considered an important mechanism that facilitates social understanding. We present a pre-registered experiment that used EEG to investigate whether short-term training via physical rehearsal or observational learning elicit distinct changes in mirror neuron activity for unfamiliar hand actions, and whether these training effects are influenced by the degree of familiarity (i.e., the frequency of action repetitions during training). Sixty adults completed a pre- and post-training EEG action observation task. Half of the participants completed 30 min of execution training (i.e., observing and performing unfamiliar hand actions), and half completed observation-only training (i.e., observing unfamiliar hand actions being performed). Post-training familiarity was manipulated by varying the number of training repetitions for each hand action (from 0 to 50 repetitions). Results revealed that sensorimotor cortex activity to the observation of hand actions increased following execution training, but did not change when training was simply observational. Moreover, the frequency of training repetitions did not modulate sensorimotor cortex activation after training, suggesting that short-term physical rehearsal enhances general processes involved in action understanding, rather than specific motor representations.

Feasibility of Action Observation and Repetitive Task Practice on Upper Extremity Outcomes in Chronic Stroke Survivors

Feasibility of Action Observation and Repetitive Task Practice on Upper Extremity Outcomes in Chronic Stroke Survivors

Brain Activation of Elite Race Walkers in Action Observation, Motor Imagery, and Motor Execution Tasks: A Pilot Study.

Walking plays an important role in human daily life. Many previous studies suggested that long-term walking training can modulate brain functions. However, due to the use of measuring techniques such as fMRI and PET, which are highly motion-sensitive, it is difficult to record individual brain activities during the movement. This pilot study used functional near-infrared spectroscopy (fNIRS) to measure the hemodynamic responses in the frontal-parietal cortex of four elite race walkers (experimental group, EG) and twenty college students (control group, CG) during tasks involving action observation, motor imagery, and motor execution. The results showed that activation levels of the pars triangularis of the inferior frontal gyrus (IFG), dorsolateral prefrontal cortex (DLPFC), premotor and supplementary motor cortex (PMC and SMC), and primary somatosensory cortex (S1) in the EG were significantly lower than in the CG during motor execution and observation tasks. And primary motor cortex (M1) of EG in motor execution task was significantly lower than its in CG. During the motor imagery task, activation intensities of the DLPFC, PMC and SMC, and M1 in the EG were significantly higher than in the CG. These findings suggested that the results of motor execution and observation tasks might support the brain efficiency hypothesis, and the related brain regions strengthened the efficiency of neural function, but the results in motor imagery tasks could be attributed to the internal forward model of elite race walkers, which showed a trend opposed to the brain efficiency hypothesis. Additionally, the activation intensities of the pars triangularis and PMC and SMC decreased with the passage of time in the motor execution and imagery tasks, whereas during the action observation task, no significant differences in these regions were found. This reflected differences of the internal processing among the tasks.

Measuring Brain Complexity During Neural Motor Resonance.

Background: EEG mu-desynchronization is an index of motor resonance (MR) and is used to study social interaction deficiencies, but finding differences in mu-desynchronization does not reveal how nonlinear brain dynamics are affected during MR. The current study explores how nonlinear brain dynamics change during MR. We hypothesized that the complexity of the mu frequency band (8–13 Hz) changes during MR, and that this change would be frequency specific. Additionally, we sought to determine whether complexity at baseline and changes in complexity during action observation would predict MR and changes in network dynamics.Methods: EEG was recorded from healthy participants (n = 45) during rest and during an action observation task. Baseline brain activity was measured followed by participants observing videos of hands squeezing stress balls. We used multiscale entropy (MSE) to quantify the complexity of the mu rhythm during MR. We then performed post-hoc graph theory analysis to explore whether nonlinear dynamics during MR affect brain network topology.Results: We found significant mu-desynchronization during the action observation task and that mu entropy was significantly increased during the task compared to rest, while gamma, beta, theta, and delta bands showed decreased entropy. Moreover, resting-state entropy was significantly predictive of the degree of mu desynchronization. We also observed a decrease in the clustering coefficient in the mu band only and a significant decrease in global alpha efficiency during action observation. MSE during action observation was strongly correlated with alpha network efficiency.Conclusions: The current findings suggest that the desynchronization of the mu wave during MR results in a local increase of mu entropy in sensorimotor areas, potentially reflecting a release from alpha inhibition. This release from inhibition may be mediated by the baseline MSE in the mu band. The dynamical complexity and network analysis of EEG may provide a useful addition for future studies of MR by incorporating measures of nonlinearity.

Using an interactive virtual environment to integrate a digital Action Research Arm Test, motor imagery and action observation to assess and improve upper limb motor function in patients with neuromuscular impairments: a usability and feasibility study protocol

IntroductionIn the recent past, training systems using an interactive virtual environment have been introduced to neurorehabilitation. Such systems can be applied to encourage purposeful limb movements and will increasingly be...

Effect of Different Movement Speed Modes on Human Action Observation: An EEG Study.

Action observation (AO) generates event-related desynchronization (ERD) suppressions in the human brain by activating partial regions of the human mirror neuron system (hMNS). The activation of the hMNS response to AO remains controversial for several reasons. Therefore, this study investigated the activation of the hMNS response to a speed factor of AO by controlling the movement speed modes of a humanoid robot's arm movements. Since hMNS activation is reflected by ERD suppressions, electroencephalography (EEG) with BCI analysis methods for ERD suppressions were used as the recording and analysis modalities. Six healthy individuals were asked to participate in experiments comprising five different conditions. Four incremental-speed AO tasks and a motor imagery (MI) task involving imaging of the same movement were presented to the individuals. Occipital and sensorimotor regions were selected for BCI analyses. The experimental results showed that hMNS activation was higher in the occipital region but more robust in the sensorimotor region. Since the attended information impacts the activations of the hMNS during AO, the pattern of hMNS activations first rises and subsequently falls to a stable level during incremental-speed modes of AO. The discipline curves suggested that a moderate speed within a decent inter-stimulus interval (ISI) range produced the highest hMNS activations. Since a brain computer/machine interface (BCI) builds a path-way between human and computer/mahcine, the discipline curves will help to construct BCIs made by patterns of action observation (AO-BCI). Furthermore, a new method for constructing non-invasive brain machine brain interfaces (BMBIs) with moderate AO-BCI and motor imagery BCI (MI-BCI) was inspired by this paper.

Using guitar learning to probe the Action Observation Network's response to visuomotor familiarity

Watching other people move elicits engagement of a collection of sensorimotor brain regions collectively termed the Action Observation Network (AON). An extensive literature documents more robust AON responses when observing or executing familiar compared to unfamiliar actions, as well as a positive correlation between amplitude of AON response and an observer's familiarity with an observed or executed movement. On the other hand, emerging evidence shows patterns of AON activity counter to these findings, whereby in some circumstances, unfamiliar actions lead to greater AON engagement than familiar actions. In an attempt to reconcile these conflicting findings, some have proposed that the relationship between AON response amplitude and action familiarity is nonlinear in nature. In the present study, we used an elaborate guitar training intervention to probe the relationship between movement familiarity and AON engagement during action execution and action observation tasks. Participants underwent fMRI scanning while executing one set of guitar sequences with a scanner-compatible bass guitar and observing a second set of sequences. Participants then acquired further physical practice or observational experience with half of these stimuli outside the scanner across 3 days. Participants then returned for an identical scanning session, wherein they executed and observed equal numbers of familiar (trained) and unfamiliar (untrained) guitar sequences. Via region of interest analyses, we extracted activity within AON regions engaged during both scanning sessions, and then fit linear, quadratic and cubic regression models to these data. The data best support the cubic regression models, suggesting that the response profile within key sensorimotor brain regions associated with the AON respond to action familiarity in a nonlinear manner. Moreover, by probing the subjective nature of the prediction error signal, we show results consistent with a predictive coding account of AON engagement during action observation and execution that also takes into account effects of changes in neural efficiency.

Motor activation during action perception depends on action interpretation

Since the discovery of motor mirroring, the involvement of the motor system in action interpretation has been widely discussed. While some theories proposed that motor mirroring underlies human action understanding, others suggested that it is a corollary of action interpretation. We put these two accounts to the test by employing superficially similar actions that invite radically different interpretations of the underlying intentions. Using an action-observation task, we assessed motor activation (as indexed by the suppression of the EEG mu rhythm) in response to actions typically interpreted as instrumental (e.g., grasping) or referential (e.g., pointing) towards an object. Only the observation of instrumental actions resulted in enhanced mu suppression. In addition, the exposure to grasping actions failed to elicit mu suppression when they were preceded by speech, suggesting that the presence of communicative signals modulated the interpretation of the observed actions. These results suggest that the involvement of sensorimotor cortices during action processing is conditional on a particular (instrumental) action interpretation, and that action interpretation relies on inferential processes and top-down mechanisms that are implemented outside of the motor system.

Altered mu-rhythm suppression in Borderline Personality Disorder

Borderline Personality Disorder (BPD) is characterized, among other symptoms, by interpersonal dysfunction and difficulties in empathizing. According to Simulation Theory empathy is linked to the activity of the mirror neuron system (MNS). Mu-rhythm desynchronization, as reflected in a suppression of electroencephalographic alpha-frequency bands (8–13Hz) provides a non-invasive electrophysiological window into MNS function. Here, we analyzed mu-desynchronization in twenty-two patients with BPD and twenty-three matched healthy controls in a reward and punishment-sensitive action observation task. In addition, we examined empathy using the Interpersonal Reactivity Index. BPD patients and controls did not differ with regard to mu-desynchronization when the entire time course was compared. However, differences in mu-suppression between groups occurred after the goal of the action became discernible. Correlations between mu-suppression and empathy ratings emerged only in controls, but not in the patient group. These findings suggest that BPD patients do not have a generalized impairment in MNS activity, though associations with contextual factors seem plausible.

The role of cortical sensorimotor oscillations in action anticipation

The human mirror neuron system is believed to play an important role in facilitating the ability of athletes to anticipate the actions of an opponent. This system is often assessed with EEG by measuring event-related changes in mu (8–13Hz) sensorimotor oscillations. However, traditional channel-based analyses of this measure are flawed in that due to volume conduction effects mu and non-mu alpha activity can become mixed. This flaw means it is unclear the extent to which mu activity indexes the mirror system, as opposed to other processes such as attentional demand. As a solution to this problem, we use independent component analysis to separate out the underlying brain processes during a tennis-related action observation and anticipation task. We investigated expertise-related differences in independent component activity. Experienced tennis players (N=18) were significantly more accurate than unexperienced novices (N=21) on the anticipation task. EEG results found significant group differences in both the mu and beta (15–25Hz) frequency bands in sensorimotor components, with earlier and greater desynchronisation in the experienced tennis players. In particular, only experienced players showed desynchronisation in the high mu (11–13Hz) band. No group differences were found in posterior alpha components. These results show for the first time that expertise differences during action observation and anticipation are unique to sensorimotor sources, and that no expertise-related differences exist in attention modulated, posterior alpha sources. As such, this paper provides a much cleaner measure of the human mirror system during action observation, and its modulation by motor expertise, than has been possible in previous work.

A third-person perspective on co-speech action gestures in Parkinson's disease

A combination of impaired motor and cognitive function in Parkinson's disease (PD) can impact on language and communication, with patients exhibiting a particular difficulty processing action verbs. Co-speech gestures embody a link between action and language and contribute significantly to communication in healthy people. Here, we investigated how co-speech gestures depicting actions are affected in PD, in particular with respect to the visual perspective—or the viewpoint – they depict. Gestures are closely related to mental imagery and motor simulations, but people with PD may be impaired in the way they simulate actions from a first-person perspective and may compensate for this by relying more on third-person visual features. We analysed the action-depicting gestures produced by mild-moderate PD patients and age-matched controls on an action description task and examined the relationship between gesture viewpoint, action naming, and performance on an action observation task (weight judgement). Healthy controls produced the majority of their action gestures from a first-person perspective, whereas PD patients produced a greater proportion of gestures produced from a third-person perspective. We propose that this reflects a compensatory reliance on third-person visual features in the simulation of actions in PD. Performance was also impaired in action naming and weight judgement, although this was unrelated to gesture viewpoint. Our findings provide a more comprehensive understanding of how action-language impairments in PD impact on action communication, on the cognitive underpinnings of this impairment, as well as elucidating the role of action simulation in gesture production.

Eye Gaze Correlates of Motor Impairment in VR Observation of Motor Actions.

This article is part of the Focus Theme of Methods of Information in Medicine on "Methodologies, Models and Algorithms for Patients Rehabilitation". Identify eye gaze correlates of motor impairment in a virtual reality motor observation task in a study with healthy participants and stroke patients. Participants consisted of a group of healthy subjects (N = 20) and a group of stroke survivors (N = 10). Both groups were required to observe a simple reach-and-grab and place-and-release task in a virtual environment. Additionally, healthy subjects were required to observe the task in a normal condition and a constrained movement condition. Eye movements were recorded during the observation task for later analysis. For healthy participants, results showed differences in gaze metrics when comparing the normal and arm-constrained conditions. Differences in gaze metrics were also found when comparing dominant and non-dominant arm for saccades and smooth pursuit events. For stroke patients, results showed longer smooth pursuit segments in action observation when observing the paretic arm, thus providing evidence that the affected circuitry may be activated for eye gaze control during observation of the simulated motor action. This study suggests that neural motor circuits are involved, at multiple levels, in observation of motor actions displayed in a virtual reality environment. Thus, eye tracking combined with action observation tasks in a virtual reality display can be used to monitor motor deficits derived from stroke, and consequently can also be used for rehabilitation of stroke patients.

Action observation network in childhood: a comparative fMRI study with adults.

Very little is known about the action observation network and the mirror neuron system (AON/MNS) in children and its age-related properties compared with those observed in adults. In the present fMRI study we explored the activation of areas belonging to the AON/MNS in children and adults during observation of complex hand-grasping actions, as compared to observation of simple grasping acts executed with the left and the right hand, seen from a first person perspective. The results indicate that during the action observation tasks in children there was activation of a cortical network similar to that found in adults, including the premotor cortex, the posterior part of the inferior frontal gyrus and the posterior parietal lobe. However, the activation in children was more widespread and showed a higher inter-subject variability compared with adults. Furthermore, the activated network seems more lateralized to the left hemisphere in adults and more bilateral in children, with a linear growth of lateralization index as a function of age. Finally, in children the activation in the anterior intraparietal cortex (AIP) of each hemisphere was higher during observation of the contralateral hand (hand identity effect) and during the observation of complex actions relative to simple grasping acts, confirming the role of AIP for action-related hand identity previously described in adults. These results support the assumption that structure and size of action representations are sensitive to mechanisms of development and show physiological plasticity. These properties of the AON/MNS could constitute a powerful tool for spontaneous reorganization and recovery of motor deficits after brain injury in children and in adults, as well as for specific rehabilitation programmes.

Empathy, autistic traits, and motor resonance in adults with Turner syndrome

Turner syndrome is a genetic condition resulting from the partial or complete absence of an X-chromosome in phenotypic females. Individuals with Turner syndrome often display social difficulties that are reminiscent of those associated with autistic spectrum disorders (ASD), conditions associated with empathy and mirror-neuron system (MNS) deficits. The goal of the present study was (1) to investigate the extent to which adults with Turner syndrome display autistic and empathic traits, and (2) to probe the integrity of the MNS in this neurogenetic disorder. Sixteen individuals with Turner syndrome and 16 age-, sex-, and IQ-matched controls took part in a neuropsychological assessment where the Weschler Abbreviated Scale of Intelligence, the Autism Spectrum Quotient and the Empathy Quotient were administered. Functioning of the MNS was assessed by measuring motor cortex activity with transcranial magnetic stimulation during an action-observation task. Results show that individuals with Turner syndrome do not differ significantly from controls regarding autistic or empathic traits, and present normal functioning of the MNS during action observation. Correlational analysis showed a significant positive relationship between scores on the Empathy Quotient and motor facilitation during action observation, bringing further support to the hypothesis that MNS activity is related to sociocognitive competence.

Power changes how the brain responds to others.

Power dynamics are a ubiquitous feature of human social life, yet little is known about how power is implemented in the brain. Motor resonance is the activation of similar brain networks when acting and when watching someone else act, and is thought to be implemented, in part, by the human mirror system. We investigated the effects of power on motor resonance during an action observation task. Separate groups of participants underwent a high-, neutral, or low-power induction priming procedure, prior to observing the actions of another person. During observation, motor resonance was determined with transcranial magnetic stimulation (TMS) via measures of motor cortical output. High-power participants demonstrated lower levels of resonance than low-power participants, suggesting reduced mirroring of other people in those with power. These differences suggest that decreased motor resonance to others' actions might be one of the neural mechanisms underlying power-induced asymmetries in processing our social interaction partners.

Action Observation Therapy in the Subacute Phase Promotes Dexterity Recovery in Right-Hemisphere Stroke Patients

The clinical impact of action observation (AO) on upper limb functional recovery in subacute stroke patients is recent evidence. We sought to test the hypothesis that training everyday life activities through AO coupled with task execution might activate the left hemisphere different from the right one. Sixty-seven first-ever ischemic stroke subjects were randomly assigned to receive upper limb training coupled with AO tasks or standard rehabilitation. The groups were matched by age and gender, Bamford category, and interval from stroke and lesion side. Fugl-Meyer (FM) and Box and Block Test (BBT) were used to measure hand function recovery at the end (T1) and 4-5 months after the treatment (T2). At T1, FM was increased by 31% (±26%), of maximum achievable recovery, whereas BBT was increased by 17% (±18%); at T2, FM had reached 43% (±45%) of maximum recovery, while BBT had reached 25% (±22%). Combining the effects of treatment to those of lesion side revealed significantly higher gains, in both FM and BBT scores, in left hemiparetic subjects when exposed to AO as compared to standard rehabilitation alone (P < .01). The findings lead to recommend the use of AO in addition to motor training in left hemiparetic patients.

Classification of brain hemodynamic signals arising from visual action observation tasks for brain–computer interfaces: A functional near-infrared spectroscopy study

A brain–computer interface (BCI) is a way of translating an individuals’ thoughts to control a computer or an external mechanical device. Studying brain activities in a reproducible manner, this study explores the possibility of using real-time functional-near infrared spectroscopy (fNIRS) to detect brain hemodynamic features for BCI commands. Sixteen channel brain activities associated with two distinct mental tasks were measured from seven healthy subjects. The tasks represented neural activities arising from a visual observation of a motor action related to hand movements of the subjects. Sensitive signatures of task relevant neural activities were further extracted from hemodynamic signals in the prefrontal cortex of the brain, and subsequently were translated into pre-determined computer commands using a set of algorithms. The decoded commands allowed volunteer subjects to control an external device in real-time through their mental intentions. The obtained results demonstrate the potential of the current study as an alternative fNIRS-BCI paradigm.

The effect of video-guidance on passive movement in patients with cerebral palsy: fMRI study

In patients with cerebral palsy (CP), neuroimaging studies have demonstrated that passive movement and action-observation tasks have in common to share neuronal activation in all or part of areas involved in motor system. Action observation with simultaneous congruent passive movements may have additional effects in the recruitment of brain motor areas. The aim of this functional magnetic resonance imaging (fMRI) study was to examine brain activation in patients with unilateral CP during passive movement with and without simultaneous observation of simple hand movement. Eighteen patients with unilateral CP (fourteen male, mean age 14 years and 2 months) participated in the study. Using fMRI block design, brain activation following passive simple opening-closing hand movement of either the paretic or nonparetic hand with and without simultaneous observation of a similar movement performed by either the left or right hand of an actor was compared. Passive movement of the paretic hand performed simultaneously to the observation of congruent movement activated more "higher motor areas" including contralesional pre-supplementary motor area, superior frontal gyrus (extending to premotor cortex), and superior and inferior parietal regions than nonvideo-guided passive movement of the paretic hand. Passive movement of the paretic hand recruited more ipsilesional sensorimotor areas compared to passive movement of the nonparetic hand. Our study showed that the combination of observation of congruent hand movement simultaneously to passive movement of the paretic hand recruits more motor areas, giving neuronal substrate to propose video-guided passive movement of paretic hand in CP rehabilitation.