Mental Simulation Of Movement Research Articles

Transfer Learning with CNN Models for Brain-Machine Interfaces to command lower-limb exoskeletons: A Solution for Limited Data.

This study evaluates the performance of two convolutional neural networks (CNNs) in a brain-machine interface (BMI) based on motor imagery (MI) by using a small dataset collected from five participants wearing a lower-limb exoskeleton. To address the issue of limited data availability, transfer learning was employed by training models on EEG signals from other subjects and subsequently fine-tuning them to specific users. A combination of common spatial patterns (CSP) and linear discriminant analysis (LDA) was used as a benchmark for comparison. The study's primary aim is to examine the potential of CNNs and transfer learning in the development of an automatic neural classification system for a BMI based on MI to command a lower-limb exoskeleton that can be used by individuals without specialized training.Clinical Relevance- BMI can be used in rehabilitation for patients with motor impairment by using mental simulation of movement to activate robotic exoskeletons. This can promote neural plasticity and aid in recovery.

DYNAMICS OF THE EEG SENSORIMOTOR RHYTHM DURING MENTAL REPETITION OF THE OBSERVED MOVEMENT

Mental simulation of one’s own movement, or imagery of movement, as well as observation of other people’s movements are used in neurorehabilitation as methods of stimulation of sensorimotor parts of the brain. The present work tests a new way of representation - mental simulation of movement, synchronous with the movement observed from the first person on a video screen. The objectives of the study were to compare the reactivity of sensorimotor EEG rhythms during voluntary movement representation and representation following a video stimulus, and to identify the relationship between the phases of movement in the video and the dynamics of EEG patterns. The study involved 30 healthy volunteers in whom a 69-channel encephalogram was recorded during their performance and presentation of right thumb movements in two modes: arbitrarily (without an external reference) and synchronously imitating movement on a video clip. During EEG analysis, individual spatial-frequency components with the highest EEG mu-rhythm reactivity (8–14 Hz) were identified in the subjects, followed by quantitative assessment of desynchronization under the studied conditions based on analysis of probability density distributions of mu-rhythm power. A generalized additive model describing the function of responses to single events in the observed movements and their summation during serial execution or presentation of the movements was applied to assess the relationship between the dynamics of mu-rhythm desynchronization and video events. It was shown that the mental kinesthetic simulation of the observed movement did not result in increased desynchronization of sensorimotor rhythms compared to the voluntary representation of the same movement. It was found for the first time that there are perturbations in the temporal course of desynchronization of the mu-rhythm that depend on the phase and speed of the observed movement both during its synchronous muscle repetition and during mental synchronous imitation. The results obtained can be used to optimize movement parameters in individual systems of ideomotor training with EEG control to achieve the greatest sensorimotor activation.

Motor imagery vividness and symptom severity in Parkinson's disease.

Motor imagery (MI), the mental simulation of movement in the absence of overt motor output, has demonstrated potential as a technique to support rehabilitation of movement in neurological conditions such as Parkinson's disease (PD). Existing evidence suggests that MI is largely preserved in PD, but previous studies have typically examined global measures of MI and have not considered the potential impact of individual differences in symptom presentation on MI. The present study investigated the influence of severity of overall motor symptoms, bradykinesia and tremor on MI vividness scores in 44 individuals with mild to moderate idiopathic PD. Linear mixed effects modelling revealed that imagery modality and the severity of left side bradykinesia significantly influenced MI vividness ratings. Consistent with previous findings, participants rated visual motor imagery (VMI) to be more vivid than kinesthetic motor imagery (KMI). Greater severity of left side bradykinesia (but not right side bradykinesia) predicted increased vividness of KMI, while tremor severity and overall motor symptom severity did not predict vividness of MI. The specificity of the effect of bradykinesia to the left side may reflect greater premorbid vividness for the dominant (right) side or increased attention to more effortful movements on the left side of the body resulting in more vivid motor imagery.

Improving motor imagery classification during induced motor perturbations

Objective. Motor imagery is the mental simulation of movements. It is a common paradigm to design brain-computer interfaces (BCIs) that elicits the modulation of brain oscillatory activity similar to real, passive and induced movements. In this study, we used peripheral stimulation to provoke movements of one limb during the performance of motor imagery tasks. Unlike other works, in which induced movements are used to support the BCI operation, our goal was to test and improve the robustness of motor imagery based BCI systems to perturbations caused by artificially generated movements. Approach. We performed a BCI session with ten participants who carried out motor imagery of three limbs. In some of the trials, one of the arms was moved by neuromuscular stimulation. We analysed 2-class motor imagery classifications with and without movement perturbations. We investigated the performance decrease produced by these disturbances and designed different computational strategies to attenuate the observed classification accuracy drop. Main results. When the movement was induced in a limb not coincident with the motor imagery classes, extracting oscillatory sources of the movement imagination tasks resulted in BCI performance being similar to the control (undisturbed) condition; when the movement was induced in a limb also involved in the motor imagery tasks, the performance drop was significantly alleviated by spatially filtering out the neural noise caused by the stimulation. We also show that the loss of BCI accuracy was accompanied by weaker power of the sensorimotor rhythm. Importantly, this residual power could be used to predict whether a BCI user will perform with sufficient accuracy under the movement disturbances. Significance. We provide methods to ameliorate and even eliminate motor related afferent disturbances during the performance of motor imagery tasks. This can help improving the reliability of current motor imagery based BCI systems.

A feasibility study of a complete low-cost consumer-grade brain-computer interface system.

Brain-computer interfaces (BCIs) are technologies that provide the user with an alternative way of communication. A BCI measures brain activity (e.g. EEG) and converts it into output commands. Motor imagery (MI), the mental simulation of movements, can be used as a BCI paradigm, where the movement intention of the user can be translated into a real movement, helping patients in motor recovery rehabilitation. One of the main limitations for the broad use of such devices is the high cost associated with the high-quality equipment used for capturing the biomedical signals. Different low-cost consumer-grade alternatives have emerged with the objective of bringing these systems closer to the final users. The quality of the signals obtained with such equipments has already been evaluated and found to be competitive with those obtained with well-known clinical-grade devices. However, how these consumer-grade technologies can be integrated and used for practical MI-BCIs has not yet been explored. In this work, we provide a detailed description of the advantages and disadvantages of using OpenBCI boards, low-cost sensors and open-source software for constructing an entirely consumer-grade MI-BCI system. An analysis of the quality of the signals acquired and the MI detection ability is performed. Even though communication between the computer and the OpenBCI board is not always stable and the signal quality is sometimes affected by ambient noise, we find that by means of a filter-bank based method, similar classification performances can be achieved with an MI-BCI built under low-cost consumer-grade devices as compared to when clinical-grade systems are used. By means of this work we share with the BCI community our experience on working with emerging low-cost technologies, providing evidence that an entirely low-cost MI-BCI can be built. We believe that if communication stability and artifact rejection are improved, these technologies will become a valuable alternative to clinical-grade devices.

Task-dependent activation of distinct fast and slow(er) motor pathways during motor imagery

BackgroundMotor imagery and actual movements share overlapping activation of brain areas but little is known about task-specific activation of distinct motor pathways during mental simulation of movements. For real contractions, it was demonstrated that the slow(er) motor pathways are activated differently in ballistic compared to tonic contractions but it is unknown if this also holds true for imagined contractions. ObjectiveThe aim of the present study was to assess the activity of fast and slow(er) motor pathways during mentally simulated movements of ballistic and tonic contractions. MethodsH-reflexes were conditioned with transcranial magnetic stimulation at different interstimulus intervals to assess the excitability of fast and slow(er) motor pathways during a) the execution of tonic and ballistic contractions, b) motor imagery of these contraction types, and c) at rest. ResultsIn contrast to the fast motor pathways, the slow(er) pathways displayed a task-specific activation: for imagined ballistic as well as real ballistic contractions, the activation was reduced compared to rest whereas enhanced activation was found for imagined tonic and real tonic contractions. ConclusionsThis study provides evidence that the excitability of fast and slow(er) motor pathways during motor imagery resembles the activation pattern observed during real contractions. The findings indicate that motor imagery results in task- and pathway-specific subliminal activation of distinct subsets of neurons in the primary motor cortex.

Functional topography of the primary motor cortex during motor execution and motor imagery as revealed by functional MRI

Controversy exists regarding the involvement of the primary motor cortex (M1) during motor imagery (MI) and also regarding the differential somatotopic representation of motor execution (ME) and mental simulation of movement, that is, MI within M1. Although some research reported clear M1 involvement during MI without overt motor output, others did not. However, possible somatotopic representation between execution and imagery has not been clearly investigated to date. The aim of the present study was to aid in the resolution of this controversy by investigating the possible involvement of M1 during MI, and the differential, within M1, somatotopic representation between execution and imagery by quantitatively assessing different location markers such as activation peak and center of mass as well as intensity differences between the two tasks in case of with and without the overlap between the two representations. Forty-one healthy volunteers participated in two functional MRI runs of mouth-stretching ME and MI tasks. Our findings suggest the clear involvement of M1 (BA 4) during MI with lower signal intensity compared with ME, and further showed distinct centers for each representation along the y-axis (anteroposterior plane), with MI showing more involvement of the anterior sector of M1 (BA 4a), whereas ME recruited more of the posterior sector (BA 4p). These results parallel the pioneering findings of a functional distinction between BA 4a and BA 4p, where BA 4a is more involved in the cognitive aspects of MI, whereas BA 4p is more related to executive function, promoting the idea of distinctive somatotopic mapping between execution and imagery within M1 sectors.

Primary Motor Cortex Excitability Is Modulated During the Mental Simulation of Hand Movement.

It is unclear whether the primary motor cortex (PMC) is involved in the mental simulation of movement [i.e., motor imagery (MI)]. The present study aimed to clarify PMC involvement using a highly novel adaptation of the hand laterality task (HLT). Participants were administered single-pulse transcranial magnetic stimulation (TMS) to the hand area of the left PMC (hPMC) at either 50 ms, 400 ms, or 650 ms post stimulus presentation. Motor-evoked potentials (MEPs) were recorded from the right first dorsal interosseous via electromyography. To avoid the confound of gross motor response, participant response (indicating left or right hand) was recorded via eye tracking. Participants were 22 healthy adults (18 to 36 years), 16 whose behavioral profile on the HLT was consistent with the use of a MI strategy (MI users). hPMC excitability increased significantly during HLT performance for MI users, evidenced by significantly larger right hand MEPs following single-pulse TMS 50 ms, 400 ms, and 650 ms post stimulus presentation relative to baseline. Subsequent analysis showed that hPMC excitability was greater for more complex simulated hand movements, where hand MEPs at 50 ms were larger for biomechanically awkward movements (i.e., hands requiring lateral rotation) compared to simpler movements (i.e., hands requiring medial rotation). These findings provide support for the modulation of PMC excitability during the HLT attributable to MI, and may indicate a role for the PMC during MI. (JINS, 2017, 23, 185-193).

New evidence of corticospinal network modulation induced by motor imagery.

Motor imagery (MI) is the mental simulation of movement, without the corresponding muscle contraction. Whereas the activation of cortical motor areas during MI is established, the involvement of spinal structures is still under debate. We used original and complementary techniques to probe the influence of MI on spinal structures. Amplitude of motor-evoked potentials (MEPs), cervico-medullary-evoked potentials (CMEPs), and Hoffmann (H)-reflexes of the flexor carpi radialis (FCR) muscle and of the triceps surae muscles was measured in young, healthy subjects at rest and during MI. Participants were asked to imagine maximal voluntary contraction of the wrist and ankle, while the targeted limb was fixed (static condition). We confirmed previous studies with an increase of FCR MEPs during MI compared with rest. Interestingly, CMEPs, but not H-reflexes, also increased during MI, revealing a possible activation of subcortical structures. Then, to investigate the effect of MI on the spinal network, we used two techniques: 1) passive lengthening of the targeted muscle via an isokinetic dynamometer and 2) conditioning of H-reflexes with stimulation of the antagonistic nerve. Both techniques activate spinal inhibitory presynaptic circuitry, reducing the H-reflex amplitude at rest. In contrast, no reduction of H-reflex amplitude was observed during MI. These findings suggest that MI has modulatory effects on the spinal neuronal network. Specifically, the activation of low-threshold spinal structures during specific conditions (lengthening and H-reflex conditioning) highlights the possible generation of subliminal cortical output during MI.

Laterality effects in motor learning by mental practice in right-handers

Converging evidences suggest that mental movement simulation and actual movement production share similar neurocognitive and learning processes. Although a large body of data is available in the literature regarding mental states involving the dominant arm, examinations for the nondominant arm are sparse. Does mental training, through motor-imagery practice, with the dominant arm or the nondominant arm is equally efficient for motor learning? In the current study, we investigated laterality effects in motor learning by motor-imagery practice. Four groups of right-hander adults mentally and physically performed as fast and accurately as possible (speed/accuracy trade-off paradigm) successive reaching movements with their dominant or nondominant arm (physical-training-dominant-arm, mental-training-dominant-arm, physical-training-nondominant-arm, and mental-training-nondominant-arm groups). Movement time was recorded and analyzed before, during, and after the training sessions. We found that physical and mental practice had a positive effect on the motor performance (i.e., decrease in movement time) of both arms through similar learning process (i.e., similar exponential learning curves). However, movement time reduction in the posttest session was significantly higher after physical practice than motor-imagery practice for both arms. More importantly, motor-imagery practice with the dominant arm resulted in larger and more robust improvements in movement speed compared to motor-imagery practice with the nondominant arm. No such improvements were observed in the control group. Our results suggest a superiority of the dominant arm in motor learning by mental practice. We discussed these findings from the perspective of the internal models theory.

Dominant vs. nondominant arm advantage in mentally simulated actions in right handers

Although plentiful data are available regarding mental states involving the dominant-right arm, the evidence for the nondominant-left arm is sparse. Here, we investigated whether right-handers can generate accurate predictions with either the right or the left arm. Fifteen adults carried out actual and mental arm movements in two directions with varying inertial resistance (inertial anisotropy phenomenon). We recorded actual and mental movement times and used the degree of their similarity as an indicator for the accuracy of motor imagery/prediction process. We found timing correspondences (isochrony) between actual and mental right arm movements in both rightward (low inertia resistance) and leftward (high inertia resistance) directions. Timing similarities between actual and mental left arm movements existed for the leftward direction (low inertia resistance) but not for the rightward direction (high inertia resistance). We found similar results when participants reaching towards the midline of the workspace, a result that excludes a hemispace effect. Electromyographic analysis during mental movements showed that arm muscles remained inactivate, thus eliminating a muscle activation strategy that could explain intermanual differences. Furthermore, motor-evoked potentials enhancement in both right and left biceps brachii during mental actions indicated that subjects were actively engaged in mental movement simulation and that the disadvantage of the left arm cannot be attributed to the nonactivation of the right motor cortex. Our findings suggest that predictive mechanisms are more robust for the right than the left arm in right-handers. We discussed these findings from the perspective of the internal models theory and the dynamic-dominance hypothesis of laterality.

The relation between geometry and time in mental actions.

Mental imagery is a cognitive tool that helps humans take decisions by simulating past and future events. The hypothesis has been advanced that there is a functional equivalence between actual and mental movements. Yet, we do not know whether there are any limitations to its validity even in terms of some fundamental features of actual movements, such as the relationship between space and time. Although it is impossible to directly measure the spatiotemporal features of mental actions, an indirect investigation can be conducted by taking advantage of the constraints existing in planar drawing movements and described by the two-thirds power law (2/3PL). This kinematic law describes one of the most impressive regularities observed in biological movements: movement speed decreases when curvature increases. Here, we compared the duration of identical actual and mental arm movements by changing the constraints imposed by the 2/3PL. In the first two experiments, the length of the trajectory remained constant, while its curvature (Experiment 1) or its number of inflexions (Experiment 2) was manipulated. The results showed that curvature, but not the number of inflexions, proportionally and similarly affected actual and mental movement duration, as expected from the 2/3PL. Two other control experiments confirmed that the results of Experiment 1 were not attributable to eye movements (Experiment 3) or to the perceived length of the displayed trajectory (Experiment 4). Altogether, our findings suggest that mental movement simulation is tuned to the kinematic laws characterizing actions and that kinematics of actual and mental movements is completely specified by the representation of their geometry.

Modulation of Cortical Activity in Patients Suffering from Upper Arm Spasticity following Stroke and Treated with Botulinum Toxin A: An fMRI Study

Botulinum toxin (BTX) treatment can relieve focal arm spasticity after stroke, presumably through dynamic changes at multiple levels of the motor system, including the cerebral cortex. However, the neuroanatomical correlate of BTX spasticity relief is not known and should be reflected in changes of cortical activation during motor tasks assessed using repeated functional magnetic resonance imaging (fMRI). Four patients (2 males, 2 females, mean age 25.5 years) with hemiplegia and distal arm spasticity after chronic ischemic stroke sparing the motor cortex were studied. fMRI during mental movement simulation of the impaired hand was performed in 2 sessions before and 4 weeks after BTX treatment. The change in arm spasticity was assessed using the modified Ashworth scale (MAS). BTX treatment significantly decreased arm spasticity across the group (mean MAS change 2.1). Whereas fMRI during imagined movement pre-BTX treatment showed extensive bilateral network of active areas, post-BTX activation was confined to the midline and contralateral sensorimotor cortices. The pre- > post-BTX contrast revealed a significant decrease in activation of the posterior cingulate/precuneus region after BTX treatment. This small study suggests that structures outside the classical motor system, such as the posterior cingulate/precuneus region, may be associated with the relief of poststroke arm spasticity.

Impaired body movement representation in DYT1 mutation carriers

ObjectiveThe only known genetic cause of early-onset primary torsion dystonia is the GAG deletion in the DYT1 gene. Due to the reduced penetrance, many mutation carriers remain clinically asymptomatic, despite the presence of subclinical abnormalities, mainly in the motor control circuitry. Our aim was to investigate whether the DYT1 mutation impairs the inner simulation of movements, a fundamental function for motor planning and execution, which relies upon cortical and subcortical systems, dysfunctional in dystonia. MethodsDYT1 manifesting patients, DYT1 non-manifesting carriers and control subjects were asked to fixate body (hand, foot, face) or non-body (car) stimuli on a computer screen. Stimuli were presented at different degrees of orientations and subjects had to mentally rotate them, in order to give a laterality judgement. Reaction times and accuracy were collected. ResultsDYT1 carriers, manifesting and non-manifesting dystonic symptoms, were slower in mentally rotating body parts (but not cars) than control subjects. ConclusionsThe DYT1 gene mutation is associated with a slowness in mental simulation of movements, independently from the presence of motor symptoms. SignificanceThese findings suggest that the cognitive representation of body movements may be altered subclinically in dystonia, thus contributing to the endophenotypic trait of disease.

Effects of active movement and mental movement simulation on somatosensory evoked potentials: A current density reconstruction approach

Effects of active movement and mental movement simulation on somatosensory evoked potentials: A current density reconstruction approach

P07.18 The effect of volitional immobilization of the muscle and mental simulation of movement on the excitability of anterior horn cells

P07.18 The effect of volitional immobilization of the muscle and mental simulation of movement on the excitability of anterior horn cells

Motor imagery in blind subjects: The influence of the previous visual experience

Mental simulation of movements has been widely used to infer about representational aspects of action. On a daily basis, motor planning and execution depends crucially both upon vision and kinesthesia. What if the former is lost? In this study we investigate the physiological changes induced during a mental simulation task in subjects with early and late onset blindness, analyzing simultaneously stabilometric (body sway), electromyographic (EMG, lateral gastrocnemius) and eletrocardiographic (ECG) signals. Subjects were asked to stand up on a force platform and instructed either to: rest during 20 s; count mentally from 1 to 15; imagine themselves executing a bilateral plantar flexion 15 times and execute the same movement 15 times. Discriminant analysis was employed to have access to the differences in the groups with respect to heart rate variability (HRV), EMG and body sway measurements for each condition. We found an overall correct classification of 100 and 90.9%, respectively, for the stabilometric parameters and HRV. This result was found only for the mental simulation task ( p < 0.05), being absent for resting, counting and executing. Previous studies have shown that motor simulation in a kinesthetic mode strongly associates with somatic and autonomic changes. In late blind subjects, however, movement simulation would tend to unfold with the use of both visual and kinesthetic representations. Thus, our results suggest that early and late blind subjects make use of distinct body representations during motor imagery.

Effects of active movement and mental movement simulation on somatosensory evoked potentials: a current density reconstruction approach

Effects of active movement and mental movement simulation on somatosensory evoked potentials: a current density reconstruction approach

Effects of motor imagery on motor cortical output topography in Parkinson's disease.

The motor impairment in Parkinson's disease (PD) could partly reflect a failure to activate processes of motor imagery. To verify any selective changes of motor output during motor imagery, lateralized to the hemisphere contralateral to the clinically affected side of hemiparkinsonian patients. Transcranial magnetic stimulation (TMS) was used to map the cortical representations of the contralateral abductor digiti minimi muscle (ADM) during rest, contraction, and motor imagery in a group of patients with hemi-PD and in a group of healthy volunteers. Seven patients with hemi-PD and seven healthy subjects were examined. Focal TMS was applied over a grid of 20 scalp positions on each hemiscalp. Maps were characterized by area (number of excitable positions), volume (the sum of motor evoked potential amplitudes at all scalp positions), and center of gravity (a map position representing an amplitude-weighted calculation of the excitable area). In healthy control subjects, the area of cortical representation of ADM was symmetrically increased in both hemispheres by mental simulation of movement and real muscle contraction. In patients with hemi-PD, there was a hemispheric asymmetry in the area of cortical representation elicited by motor imagery. The area was reduced in the clinically affected hemisphere. The volume of cortical representation was increased under all conditions and in both hemispheres in patients with PD. However, largely because the volume was so high at rest in patients, the increment in volume associated with contraction was smaller than in control subjects. This study demonstrates the presence of a tonic hyperactivation of motor cortical circuitry in PD in conjunction with an abnormality of either motor imagery or the process by which motor imagery engages the sensorimotor cortices in the clinically affected hemisphere.

Sensory and motor interfering influences on somatosensory evoked potentials.

The interfering influences by which the different components of the early somatosensory evoked potentials are modified are reviewed from both neurophysiologic and clinical perspectives. Special consideration is given to the specific differences between sensory and motor interferences. In this context, the specific effect of the mental movement simulation task on the frontal N30 component is discussed in relation to the involvement of this evoked wave as a physiologic index of the dopaminergic motor pathways. Relevant interfering approaches, including concurrent events ranging from tactile stimulation to locomotion, are reviewed and discussed insofar as these data provide insights into the neurophysiologic processes of interaction between competing internal models controlling motor acts and sensory information.