Visuo-manual Tracking Research Articles

A Novel Approach to the Characterization of Stretching and Folding in Pursuit Tracking with Chaotic and Intermittent Behaviors

Detection of Stretching And Folding (SAF) traits in a time series is still controversial and of great interest. Also, visuo-manual tracking studies did not pay attention to SAF in hand motion trajectories. This research aims to find out the relevance of SAF to the discontinuities in chaotic dynamics of hand motion through target tracking tasks. Specifically, a new method is constructed based on this relation in which SAF can extract accurately trajectories in both time domain and phase space. Consequently, we designed experiments to track sinusoidal and trapezoidal target movements shown on a monitor. In these experiments, fourteen participants were instructed to move the joystick handle by wrist flexion-extension movements. Results confirm intermittency in significant human motor control behavior which results in discontinuities in hand motion trajectories. The relation between SAF and these discontinuities is realized by chaotic and intermittent behaviors of tracking dynamics. Verification of the method’s accuracy is also carried out by taking advantage of the Poincaré section. Our method can provide insight into the dynamical behaviors of chaotic and intermittent systems involving mechanisms in human motor control. It can be applied to general systems with intermittent behavior and other systems with modification.

Age-related changes in the interference between cognitive task components and concurrent sensorimotor coordination

Continuous sensorimotor coordinations (CSCs) such as driving, walking, using control interfaces or maintaining the body’s balance are often performed alongside concurrent cognitive tasks involving attention and executive function. A range of these task combinations show interference, particularly in older adults, but the timing, direction and reciprocity of interference is not yet understood at the level of the tasks’ information-processing operations. This paper compares the chronometry of dual task interference between a visual oddball task and a continuous visuomanual tracking task performed by young and older adults. The oddball task’s constituent operations were identified using electrophysiological correlates, and deviations in the tracking task reflected perturbations to state monitoring and adjustment characteristics of CSC tasks. Despite instructions to give equal priority to both tasks, older participants maintained a high level of resourcing of the oddball task when dual tasking whereas young participants reduced resourcing to accommodate the demands of the tracking task. Older participants had a longer period of tracking inaccuracy during the executive function component of the oddball task, and unlike in young participants, this decrement was also observed when the stimulus was not a target and the executive function of updating the target tally was not required. These detailed chronometric results clarify that age-related amplification of CSC-cognitive interference are largely due to greater inflexibility in task prioritization. Prioritization of the cognitive task over the CSC in this type of dual tasking may have safety implications in everyday task settings.

Asymmetric interference between cognitive task components and concurrent sensorimotor coordination.

Everyday cognitive tasks are frequently performed under dual-task conditions alongside continuous sensorimotor coordinations (CSCs) such as driving, walking, or balancing. Observed interference in these dual-task settings is commonly attributed to demands on executive function or attentional resources, but the time course and reciprocity of interference are not well understood at the level of information-processing components. Here we used electrophysiology to study the detailed chronometry of dual-task interference between a visual oddball task and a continuous visuomanual tracking task. The oddball task's electrophysiological components were linked to underlying cognitive processes, and the tracking task served as a proxy for the continuous cycle of state monitoring and adjustment inherent to CSCs. Dual-tasking interfered with the oddball task's accuracy and attentional processes (attenuated P2 and P3b magnitude and parietal alpha-band event-related desynchronization), but errors in tracking due to dual-tasking accrued at a later timescale and only in trials in which the target stimulus appeared and its tally had to be incremented. Interference between cognitive tasks and CSCs can be asymmetric in terms of timing as well as affected information-processing components. NEW & NOTEWORTHY Interference between cognitive tasks and continuous sensorimotor coordination (CSC) has been widely reported, but this is the first demonstration that the cognitive operation that is impaired by concurrent CSC may not be the one that impairs the CSC. Also demonstrated is that interference between such tasks can be temporally asymmetric. The asynchronicity of this interference has significant implications for understanding and mitigating loss of mobility in old age, and for rehabilitation for neurological impairments.

Investigating three types of continuous auditory feedback in visuo-manual tracking.

The use of continuous auditory feedback for motor control and learning is still understudied and deserves more attention regarding fundamental mechanisms and applications. This paper presents the results of three experiments studying the contribution of task-, error-, and user-related sonification to visuo-manual tracking and assessing its benefits on sensorimotor learning. First results show that sonification can help decreasing the tracking error, as well as increasing the energy in participant's movement. In the second experiment, when alternating feedback presence, the user-related sonification did not show feedback dependency effects, contrary to the error and task-related feedback. In the third experiment, a reduced exposure of 50% diminished the positive effect of sonification on performance, whereas the increase of the average energy with sound was still significant. In a retention test performed on the next day without auditory feedback, movement energy was still superior for the groups previously trained with the feedback. Although performance was not affected by sound, a learning effect was measurable in both sessions and the user-related group improved its performance also in the retention test. These results confirm that a continuous auditory feedback can be beneficial for movement training and also show an interesting effect of sonification on movement energy. User-related sonification can prevent feedback dependency and increase retention. Consequently, sonification of the user's own motion appears as a promising solution to support movement learning with interactive feedback.

When eyes drive hand: Influence of non-biological motion on visuo-motor coupling

Many studies stressed that the human movement execution but also the perception of motion are constrained by specific kinematics. For instance, it has been shown that the visuo-manual tracking of a spotlight was optimal when the spotlight motion complies with biological rules such as the so-called 1/3 power law, establishing the co-variation between the velocity and the trajectory curvature of the movement. The visual or kinesthetic perception of a geometry induced by motion has also been shown to be constrained by such biological rules. In the present study, we investigated whether the geometry induced by the visuo-motor coupling of biological movements was also constrained by the 1/3 power law under visual open loop control, i.e. without visual feedback of arm displacement. We showed that when someone was asked to synchronize a drawing movement with a visual spotlight following a circular shape, the geometry of the reproduced shape was fooled by visual kinematics that did not respect the 1/3 power law. In particular, elliptical shapes were reproduced when the circle is trailed with a kinematics corresponding to an ellipse. Moreover, the distortions observed here were larger than in the perceptual tasks stressing the role of motor attractors in such a visuo-motor coupling. Finally, by investigating the direct influence of visual kinematics on the motor reproduction, our result conciliates previous knowledge on sensorimotor coupling of biological motions with external stimuli and gives evidence to the amodal encoding of biological motion.

Adaptive intermittent control: A computational model explaining motor intermittency observed in human behavior

It is a fundamental question how our brain performs a given motor task in a real-time fashion with the slow sensorimotor system. Computational theory proposed an influential idea of feed-forward control, but it has mainly treated the case that the movement is ballistic (such as reaching) because the motor commands should be calculated in advance of movement execution. As a possible mechanism for operating feed-forward control in continuous motor tasks (such as target tracking), we propose a control model called “adaptive intermittent control” or “segmented control,” that brain adaptively divides the continuous time axis into discrete segments and executes feed-forward control in each segment. The idea of intermittent control has been proposed in the fields of control theory, biological modeling and nonlinear dynamical system. Compared with these previous models, the key of the proposed model is that the system speculatively determines the segmentation based on the future prediction and its uncertainty. The result of computer simulation showed that the proposed model realized faithful visuo-manual tracking with realistic sensorimotor delays and with less computational costs (i.e., with fewer number of segments). Furthermore, it replicated “motor intermittency”, that is, intermittent discontinuities commonly observed in human movement trajectories. We discuss that the temporally segmented control is an inevitable strategy for brain which has to achieve a given task with small computational (or cognitive) cost, using a slow control system in an uncertain variable environment, and the motor intermittency is the side-effect of this strategy.

Children with Developmental Coordination Disorder are deficient in a visuo-manual tracking task requiring predictive control

The aim of this study was to examine how feedback, or its absence, affects children with Developmental Coordination Disorder (DCD) during a visuo-manual tracking task. This cross-sectional study included 40 children with DCD and 40 typically developing (TD) children between 6 and 10years old. Participants were required to track a target moving along a circular path presented on a monitor by moving an electronic pen on a digitizing tablet. The task was performed under two visibility conditions (target visible throughout the trajectory and target intermittently occluded) and at two different target velocities (30° and 60° per second). Variables reflecting tracking success and tracking behavior within the target were compared between groups. Results showed that children with DCD were less proficient in tracking a moving target than TD children. Their performance deteriorated even more when the target was occluded and when the target speed increased. The mean tracking speed of the DCD group exceeded the speed at which the target rotated which was attributed to accelerations and decelerations made during tracking. This suggests that children with DCD have significant difficulties in visuo-manual tracking especially when visual feedback is reduced. It appears that their impaired ability to predict together with impairments in fine-tuning arm movements may be responsible for poor performance in the intermittently occluded visuo-manual tracking task.

Periodic change in phase relationship between target and hand motion during visuo-manual tracking task: Behavioral evidence for intermittent control

When one performs visuo-manual tracking tasks, velocity profile of hand movements shows discontinuous patterns even if the target moves smoothly. A crucial factor of this “intermittency” is considerable delay in the sensorimotor feedback loop, and several researchers have suggested that the cause is intermittent correction of motor commands. However, when and how the brain monitors task performance and updates motor commands in a continuous motor task is uncertain. We examined how tracking error was affected by the timing of target disappearance during a tracking task. Results showed that tracking error, defined as the average phase difference between target and hand, varied periodically in all conditions. Hand preceded target at one specific phase but followed it at another, implying that motor control was not performed in a temporally uniform manner. Tracking stability was evaluated by the variance in phase difference, and changed depending on the timing of target-removal. The variability was larger when target disappeared around turning points than that when it disappeared around the center of motion. This shows that visual information at turning points is more effectively exploited for motor control of sinusoidal target tracking, suggesting that our brain controls hand movements with intermittent reference to visual information.

Human control of an inverted pendulum: Is continuous control necessary? Is intermittent control effective? Is intermittent control physiological?

Human motor control is often explained in terms of engineering 'servo' theory. Recently, continuous, optimal control using internal models has emerged as a leading paradigm for voluntary movement. However, these engineering paradigms are designed for high band-width, inflexible, consistent systems whereas human control is low bandwidth and flexible using noisy sensors and actuators. By contrast, engineering intermittent control was designed for bandwidth-limited applications. Our general interest is whether intermittent rather than continuous control is generic to human motor control. Currently, it would be assumed that continuous control is the superior and physiologically natural choice for controlling unstable loads, for example as required for maintaining human balance. Using visuo-manual tracking of an unstable load, we show that control using gentle, intermittent taps is entirely natural and effective. The gentle tapping method resulted in slightly superior position control and velocity minimisation, a reduced feedback time delay, greater robustness to changing actuator gain and equal or greater linearity with respect to the external disturbance. Control was possible with a median contact rate of 0.8±0.3 s(-1). However, when optimising position or velocity regulation, a modal contact rate of 2 s(-1) was observed. This modal rate was consistent with insignificant disturbance-joystick coherence beyond 1-2 Hz in both tapping and continuous contact methods. For this load, these results demonstrate a motor control process of serial ballistic trajectories limited to an optimum rate of 2 s(-1). Consistent with theoretical reasoning, our results suggest that intermittent open loop action is a natural consequence of human physiology.

Force-Field Compensation in a Manual Tracking Task

This study addresses force/movement control in a dynamic “hybrid” task: the master sub-task is continuous manual tracking of a target moving along an eight-shaped Lissajous figure, with the tracking error as the primary performance index; the slave sub-task is compensation of a disturbing curl viscous field, compatibly with the primary performance index. The two sub-tasks are correlated because the lateral force the subject must exert on the eight-shape must be proportional to the longitudinal movement speed in order to perform a good tracking. The results confirm that visuo-manual tracking is characterized by an intermittent control mechanism, in agreement with previous work; the novel finding is that the overall control patterns are not altered by the presence of a large deviating force field, if compared with the undisturbed condition. It is also found that the control of interaction-forces is achieved by a combination of arm stiffness properties and direct force control, as suggested by the systematic lateral deviation of the trajectories from the nominal path and the comparison between perturbed trials and catch trials. The coordination of the two sub-tasks is quickly learnt after the activation of the deviating force field and is achieved by a combination of force and the stiffness components (about 80% vs. 20%), which is a function of the implicit accuracy of the tracking task.

Kinematic movement strategies in primary school children with 22q11.2 Deletion Syndrome compared to age- and IQ-matched controls during visuo-manual tracking

The present study focused on the mechanism subserving the production of kinematic patterns in 21 children with 22q11.2DS (mean age = 9.6 ± 1.9; mean FSIQ = 73.05 ± 10.2) and 21 age- and IQ-matched control children (mean age = 9.6 ± 1.9; mean FSIQ = 73.38 ± 12.0) when performing a visuo-manual tracking task in which they had to track a cursor rhythmically between 2 target zones. Children with 22q11.2DS moved faster (overall) and reached their maximum velocity sooner when compared to controls. However, the number of corrective submovements to attain the target did not differ. Children with 22q11.2DS seem to adopt a young ballistic movement strategy, with a fast ballistic first movement phase, followed by a second movement phase with very little online corrections to attain the target. Children with 22q11.2DS are not able to process the incoming feedback during the second movement phase to maximize the accuracy of the ongoing movement and use this phase to prepare the following. The fact that the parietal cortex and cerebellum are involved in action prediction and internal representation and are implicated in children with 22q11.2DS provides a possible neurological basis for their problems with prospective control and tracking behavior.

Prospective control abilities during visuo-manual tracking in children with 22q11.2 Deletion syndrome compared to age- and IQ-matched controls

To examine whether children with a 22q11.2 Deletion syndrome (22q11.2DS) are able to use prospective control, 21 children with 22q11.2DS (mean age = 9.6 ± 1.9; mean FSIQ = 73.05 ± 10.2) and 21 control children (mean age = 9.6 ± 1.9; mean FSIQ = 73.38 ± 12.0) were asked to perform a visuo-manual tracking task in which they had to track a cursor rhythmically between 2 target zones. Children with 22q11.2DS performed worse than the age- and IQ-matched controls (higher absolute time and distance errors) suggesting that the 22q11.2DS group experiences an additional (syndrome specific) processing deficit that cannot be attributed to their lower intellectual abilities. The 22q11.2DS group neither the control group improved their tracking performance throughout five identical full feedback conditions of the tracking task possibly due to a slow visuo-motor adaptation process, a short span of attention and cognitive flexibility impairments. The results showed that both the 22q11.2DS group and the controls had difficulties anticipating the movement of the target (prospective control) and thus are assumed to rely more on feedback instead of on an internal representation of the movement.

Children with a learning disorder show prospective control impairments during visuomanual tracking

To examine whether children with a learning disorder (LD) are able to use prospective motor control, 30 children with LD (mean age 8 years and 11 months) and an age- and gender-matched control group were asked to smoothly track an accelerating dot presented on a monitor by moving an electronic pen on a digitizer. Children with LD performed worse than controls: the number of drawn circles was smaller, the maximum target velocity lower, and the number of submovements was higher. It is suggested that a decreased ability to predict the movement of the target leads to impaired visuomanual tracking in children with LD. Furthermore, children with LD did not improve from the 1st to the 2nd trial, possibly as a result of slower visuomotor adaptation processes.

Haptic Guidance Improves the Visuo-Manual Tracking of Trajectories

BackgroundLearning to perform new movements is usually achieved by following visual demonstrations. Haptic guidance by a force feedback device is a recent and original technology which provides additional proprioceptive cues during visuo-motor learning tasks. The effects of two types of haptic guidances-control in position (HGP) or in force (HGF)–on visuo-manual tracking (“following”) of trajectories are still under debate.Methodology/Principals FindingsThree training techniques of haptic guidance (HGP, HGF or control condition, NHG, without haptic guidance) were evaluated in two experiments. Movements produced by adults were assessed in terms of shapes (dynamic time warping) and kinematics criteria (number of velocity peaks and mean velocity) before and after the training sessions. Trajectories consisted of two Arabic and two Japanese-inspired letters in Experiment 1 and ellipses in Experiment 2. We observed that the use of HGF globally improves the fluency of the visuo-manual tracking of trajectories while no significant improvement was found for HGP or NHG.Conclusion/SignificanceThese results show that the addition of haptic information, probably encoded in force coordinates, play a crucial role on the visuo-manual tracking of new trajectories.

Shape Distortion Produced by Isolated Mismatch Between Vision and Proprioception

To investigate the nature of the visuomotor transformation, previous studies have used pointing tasks and examined how adaptation to a spatially localized mismatch between vision and proprioception generalizes across the workspace. Whereas some studies found extensive spatial generalization of single-point remapping, consistent with the hypothesis of a global realignment of visual and proprioceptive spaces, other studies reported limited transfer associated with variations in initial limb posture. Here, we investigated the effects of spatially localized remapping in the context of a visuomanual tracking task. Subjects tracked a visual target tracing a simple two-dimensional geometrical form without visual feedback except at a single point, where the visual display of the hand was shifted relative to its actual position. After adaptation, hand paths exhibited distortions relative to the visual templates that were inconsistent with the idea of a global realignment of visual and proprioceptive spaces. Results of a visuoproprioceptive matching task showed that these distortions were not limited to active movements but also affected perception of passive limb movements.

The functional anatomy of parkinsonian bradykinesia

To investigate the difficulty that patients with Parkinson’s disease (PD) have in performing fast movements, we used H 2 15O PET to study regional cerebral blood flow (rCBF) associated with performance of a simple predictive visuomanual tracking task at three different velocities. Tracking movements in PD patients (versus tracking with the eyes alone) were associated with a general underactivation of the areas normally activated by the task (sensorimotor cortex contralateral to the moving arm, bilateral dorsal premotor cortices, and ipsilateral cerebellum). Presupplementary motor cortex (pre-SMA) ipsilateral to the moving arm had greater than normal movement-related activations. Increasing movement velocity led to increased rCBF in multiple premotor and parietal cortical areas and basal ganglia in the patients as opposed to the few cerebral locations that are normally velocity-related. The functional correlates of PD bradykinesia are: (1) impaired recruitment of cortical and subcortical systems that normally regulate kinematic parameters of movement such as velocity; and (2) increased recruitment of multiple premotor areas including both regions specialized for visuomotor control (ventral premotor and parietal cortices) and some that are not (pre-SMA). The overactivation of cortical regions observed in patients may be functional correlates of compensatory mechanisms and/or impaired suppression as a facet of the primary pathophysiology of PD.

The Effect of a Concurrent Task on Parkinsonian Speech

The aim of the study was to examine the role of attention in Parkinsonian speech control, by using a dual-task paradigm. Whilst it is well-known that skeletal motor performance is impaired when Parkinson's disease (PD) patients are required to perform two motor acts simultaneously, this has not been examined in the context of speech motor control. Fifteen idiopathic PD patients and matched controls performed two speech tasks (spontaneous conversation and numerical recitation), with and without simultaneous engagement on a visuo-manual tracking task. Volumetric and temporal parameters of speech control were examined. The findings show a trend towards reduced overall speech volume, and a significant increase in progressive volume decay for patients relative to controls, for the concurrent task condition. Patients' speech was also characterised by increased speech initiation time and pause time, while speech rate was reduced upon introduction of the concurrent task. Performance on the visuo-motor task by patients, however, was similar to that of controls. The PD patients demonstrated a deterioration of volumetric and temporal measures of speech motor control, when attentional resources were reduced by a distractor task. Consistent with dual-task studies of skeletal movement control, these findings also show that there is a Parkinsonian disadvantage for the more automatic and non-visually controlled task, that is, speech, in the present study. It is, therefore, suggested that speech and skeletal movement control are similarly driven by the higher-order frontostriatal impairment inherent in PD.

Sinusoidal Visuomotor Tracking: Intermittent Servo-Control or Coupled Oscillations?

In visuomotor tasks that involve accuracy demands, small directional changes in the trajectories have been taken as evidence of feedback-based error corrections. In the present study variability, or intermittency, in visuomanual tracking of sinusoidal targets was investigated. Two lines of analyses were pursued: First, the hypothesis that humans fundamentally act as intermittent servo-controllers was re-examined, probing the question of whether discontinuities in the movement trajectory directly imply intermittent control. Second, an alternative hypothesis was evaluated: that rhythmic tracking movements are generated by entrainment between the oscillations of the target and the actor, such that intermittency expresses the degree of stability. In 2 experiments, participants (N = 6 in each experiment) swung 1 of 2 different hand-held pendulums, tracking a rhythmic target that oscillated at different frequencies with a constant amplitude. In 1 line of analyses, the authors tested the intermittency hypothesis by using the typical kinematic error measures and spectral analysis. In a 2nd line, they examined relative phase and its variability, following analyses of rhythmic interlimb coordination. The results showed that visually guided corrective processes play a role, especially for slow movements. Intermittency, assessed as frequency and power components of the movement trajectory, was found to change as a function of both target frequency and the manipulandum's inertia. Support for entrainment was found in conditions in which task frequency was identical to or higher than the effector's eigenfrequency. The results suggest that it is the symmetry between task and effector that determines which behavioral regime is dominant.

Development of the corticospinal system and hand motor function: central conduction times and motor performance tests

Maturation of the corticospinal (CS) tract and hand motor function provide paradigms for central nervous system development. In this study, involving 112 participants (aged from 0.2 to 30 years), we evaluated central motor conduction times (CMCT) obtained with transcranial magnetic stimulation (TMS) during preinnervation conditions of facilitation and relaxation. Auditory reaction time, velocity of a ballistic movement of the arm, finger tapping, diadochokinesis, and fine motor visuomanual tracking were also examined. The maturation profiles for every parameter were calculated. CMCTs for the different preinnervation conditions reached adult values at different times and this could be explained by maturation of excitability at the cortical and spinal level. A stable phase for CMCTs and reaction time was reached during childhood. Parameters which measured motor speed and skill indicated that the development of these continued into adulthood. The maturation of the fast CS tract seems to be completed before the acquisition of the related motor performance has been accomplished. In conclusion, we could demonstrate that data from several neurophysiological methods can be combined and used to study the maturation of the function of the nervous system. This approach could allow appraisal of pathological conditions that show parallels with omissions or lack of developmental progress.

Development of the corticospinal system and hand motor function: central conduction times and motor performance tests

Maturation of the corticospinal (CS) tract and hand motor function provide paradigms for central nervous system development. In this study, involving 112 participants (aged from 0.2 to 30 years), we evaluated central motor conduction times (CMCT) obtained with transcranial magnetic stimulation (TMS) during preinnervation conditions of facilitation and relaxation. Auditory reaction time, velocity of a ballistic movement of the arm, finger tapping, diadochokinesis, and fine motor visuomanual tracking were also examined. The maturation profiles for every parameter were calculated. CMCTs for the different preinnervation conditions reached adult values at different times and this could be explained by maturation of excitability at the cortical and spinal level. A stable phase for CMCTs and reaction time was reached during childhood. Parameters which measured motor speed and skill indicated that the development of these continued into adulthood. The maturation of the fast CS tract seems to be completed before the acquisition of the related motor performance has been accomplished. In conclusion, we could demonstrate that data from several neurophysiological methods can be combined and used to study the maturation of the function of the nervous system. This approach could allow appraisal of pathological conditions that show parallels with omissions or lack of developmental progress.