Interpersonal Motor Coordination Research Articles

Interpersonal Motor Coordination in Children with Autism and the Establishment of Machine Learning Models to Objectively Classify Children with Autism and Typical Development

BackgroundThe global prevalence of autism spectrum disorder (ASD) is around 1%. Yet the current diagnosis of ASD mainly depends on clinicians' experience and caregivers' report, which are subjective, time consuming, and labor demanding. An objective and efficient way to diagnose ASD is urgently needed. The objective of this study was to quantify an omnipresent yet least studied behavioral characteristic in children with ASD – interpersonal motor coordination (IMC), and to investigate the feasibility of using IMC related features to identify ASD by implementing machine learning algorithms. MethodsTwenty children with ASD and twenty-three children with typical development (TD) were filmed in a conversation with an interviewer. Motion energy analysis was implemented to obtain the movement time series, and cross wavelet analysis (CWA) quantified the level of IMC at different movement frequencies. Machine learning algorithms were utilized to examine whether these two groups of children could be accurately classified using features of IMC. ResultsStatistical analysis revealed reduced IMC in the ASD group at relatively high movement frequencies. The establishment of machine learning (ML) models showed that the maximum classification accuracy was 85.37% (specificity = 95.24%, sensitivity = 75.00%) using five original coherence values computed with CWA. In addition, the classification accuracy could be improved to 92.68% (specificity = 95.24%, sensitivity = 90.00%) with three novel features created by taking the sum of statistically significant features. ConclusionsChildren with ASD demonstrated an atypical profile of IMC, and IMC could be used to objectively classify children with ASD and TD. In addition, our analyses showed that creating novel features based on statistically significant features could help improve classification performance. It is proposed that such economic, contactless, and calibration-free approach to data collection might well serve both ASD research and practice, particularly early objective identification. However, this study could be improved with respect to larger sample size with balanced gender ratio and different severity.

Submovement interpersonal coupling is associated to audio-motor coordination performance

Acting in concert with others, a key aspect of our social life, requires behavioral coordination between persons on multiple timescales. When zooming in on the kinematic properties of movements, it appears that small speed fluctuations, called submovements, are embedded within otherwise smooth end-point trajectories. Submovements, by occurring at a faster timescale than that of movements, offer a novel window upon the functional relationship between distinct motor timescales. In this regard, it has previously been shown that when partners visually synchronize their movements, they also coordinate the timing of their submovement by following an alternated pattern. However, it remains unclear whether the mechanisms behind submovement coordination are domain-general or specific to the visual modality, and whether they have relevance for interpersonal coordination also at the scale of whole movements. In a series of solo and dyadic tasks, we show that submovements are also present and coordinated across partners when sensorimotor interactions are mediated by auditory feedback only. Importantly, the accuracy of task-instructed interpersonal coordination at the movement level correlates with the strength of submovement coordination. These results demonstrate that submovement coordination is a potentially fundamental mechanism that participates in interpersonal motor coordination regardless of the sensory domain mediating the interaction.

The Increasing Effect of Interoception on Brain Frontal Responsiveness During a Socially Framed Motor Synchronization Task.

This research explored the effect of explicit Interoceptive Attentiveness (IA) manipulation on hemodynamic brain correlates during a task involving interpersonal motor coordination framed with a social goal. Participants performed a task requiring interpersonal movement synchrony with and without a social framing in both explicit IA and control conditions. Functional Near-Infrared Spectroscopy (fNIRS) was used to record oxygenated (O2Hb) and deoxygenated hemoglobin (HHb) changes during the tasks. According to the results, the prefrontal cortex (PFC), which is involved in high-order social cognition and interpersonal relations processing, was more responsive when inducing the explicit focus (IA) on the breath during the socially framed motor task requiring synchronization, as indicated by increased O2Hb. In the absence of a broader social frame, this effect was not significant for the motor task. Overall, the present study suggests that when a joint task is performed and the individual focuses on his/her physiological body reactions, the brain hemodynamic correlates are “boosted” in neuroanatomical regions that support sustained attention, reorientation of attention, social responsiveness, and synchronization. Furthermore, the PFC responds significantly more as the person consciously focuses on physiological interoceptive correlates and performs a motor task requiring synchronization, particularly when the task is socially framed.

Helping the waiter to hold his tray: Rigid haptic linkage promotes inter-personal motor coordination.

When a glass is lifted from a tray, there is a challenge for the waiter. He must quickly compensate for the reduction in the weight of the tray to keep it balanced. This compensation is easily achieved if the waiter lifts the glass himself. Because he has, himself, initiated the action, he can predict the timing and the magnitude of the perturbation of the tray and respond (via the holding hand) accordingly. In this study, we examined coordination when either one or two people hold the tray while either one of them or a third person removes the glass. Our results show that there is exquisite coordination between the two people holding the tray. We suggest that this coordination depends upon the haptic link provided by the rigid platform that both people are holding. We conclude that the guest at a reception should not lift his drink from the waiter’s tray until they have the waiter’s attention but, if too thirsty to wait, should lend a hand holding the tray.

Influence of perceived emotion and gender on social motor coordination.

Theorists have long postulated that facial properties such as emotion and sex are potent social stimuli that influence how individuals act. Yet extant scientific findings were mainly derived from investigations on the prompt motor response upon the presentation of affective stimuli, which were mostly delivered by means of pictures, videos, or text. A theoretical question remains unaddressed concerning how the perception of emotion and sex would modulate the dynamics of a continuous coordinated behaviour. Conceived in the framework of dynamical approach to interpersonal motor coordination, the present study aimed to address this question by adopting the coupled-oscillators paradigm. Twenty-one participants performed in-phase and anti-phase coordination with two avatars (male and female) displaying three emotional expressions (neutral, happy, and angry) at different frequencies (100% and 150% of the participant's preferred frequency) by executing horizontal rhythmic left-right oscillatory movements. Time to initiate movement (TIM), mean relative phase error (MnRP), and standard deviation of relative phase (SDRP) were calculated as indices of reaction time, deviation from the intended pattern of coordination, and coordination stability, respectively. Results showed that in anti-phase condition at 150% frequency, MnRP was lower with the angry and the female avatar. In addition, coordination was found to be more stable with the male avatar than the female one when both displaying neutral emotion. But the happy female avatar was found to elicit more stable coordination than the neutral female avatar. These results implied that individuals are more relaxed to coordinate with the female than the male, and the sensorimotor system becomes more flexible to coordinate with an angry person. It is also suggested social roles influence how people coordinate, and individuals attend more to interact with a happy female. In sum, the present study evidenced that social perception is embodied in the interactive behaviour during social interaction.

Neural correlates of action monitoring and mutual adaptation during interpersonal motor coordination: Comment on “The body talks: Sensorimotor communication and its brain and kinematic signatures” by G. Pezzulo et al.

Neural correlates of action monitoring and mutual adaptation during interpersonal motor coordination: Comment on “The body talks: Sensorimotor communication and its brain and kinematic signatures” by G. Pezzulo et al.

The Effect of Pairing Individuals With Different Social Skills on Interpersonal Motor Coordination.

Previous studies have demonstrated that combining individuals with different social skills affects performance in rhythmic interpersonal motor coordination, with individuals with lower social skills, such as individuals with autism spectrum disorder or schizophrenia, being found to follow the actions of partners with higher social skills. In this study, we investigated whether this finding could be generalized among pairs of individuals without disability. To perform this, we applied an interpersonal motor coordination task that required participants to perform rhythmic movements featuring an interpersonal relative phase pattern of 90°. We did not assign the two roles (i.e., the preceding and following roles) to the participants, meaning they were forced to determine which roles to adopt by observing each other’s movements, without verbal communication. Individual social skills were measured using the autism-spectrum quotient (AQ). We found that pairs of participants with widely differing AQ scores performed better than did pairs with similar AQ scores. Most notably, the participants with higher AQ scores tended to precede their partners in the present task, which is the opposite result to that reported in previous studies. Our findings suggest that paring individuals without disability according to their social skills influences their interpersonal coordination performance in tasks wherein they must determine the preceding and following roles themselves.

Interpersonal motor coordination during joint actions in children with and without autism spectrum disorder: The role of motor information

BackgroundKinematics plays a key role in action prediction, imitation and joint action coordination. Despite people with autism spectrum disorder (ASD) show a failure to use kinematic cues during observation and imitation, there is a paucity of studies exploring the role of this dysfunction during joint actions in children with ASD. AimTo evaluate the interpersonal motor coordination of children with ASD and typically developing (TD) children during a joint action task. MethodTwenty-two participants performed two cooperative tasks. In the first one (Clear End-Point), children were provided with a priori information on movement end-point. In the second one (Unclear End-Point), the end-point was unknown and children had to use kinematic cues to accomplish the shared goal. ResultsWe found no between-group differences in the first task, even if children with ASD displayed greater reaction time variability. In the second task, they showed less accurate and slower movements than TD children. Moreover, their movement features did not differ between the two tasks, whereas TD children showed reduced reaction time variability and number of errors in the second task. ConclusionChildren with ASD were impaired in joint action coordination when they had to rely only on kinematic information. They were not able to pay more attention to the kinematic cues in absence of a visual goal.

Likability's Effect on Interpersonal Motor Coordination: Exploring Natural Gaze Direction.

Although existing studies indicate a positive effect of interpersonal motor coordination (IMC) on likability, no consensus has been reached as for the effect of likability back onto IMC. The present study specifically investigated the causal effect of likability on IMC and explored, by tracking the natural gaze direction, the possible underlying mechanisms. Twenty-two participants were engaged in an interpersonal finger-tapping task with a confederate in three likability conditions (baseline, likable, and unlikable), while wearing an eye tracker. They had to perform finger tapping at their comfort tempo with the confederate who tapped at the same or 1.5 times of the participant’s preferred frequency. Results showed that when tapping at the same frequency, the effect of likability on IMC varied with time. Participants coordinated at a higher level in the baseline condition at the beginning of the coordination task, and a facilitative effect of likability on IMC was revealed in the last session. As a novelty, our results evidenced a positive correlation between IMC and the amount of gaze onto the coordination partner’s movement only in the likable condition. No effect of likability was found when the confederate was tapping at 1.5 times of the participant’s preferred frequency. Our research suggests that the psychosocial property of the coordinating partner should be taken into consideration when investigating the performance of IMC and that IMC is a parameter that is sensitive to multiple factors.

Autistic traits affect interpersonal motor coordination by modulating strategic use of role-based behavior

BackgroundDespite the fact that deficits in social communication and interaction are at the core of Autism Spectrum Conditions (ASC), no study has yet tested individuals on a continuum from neurotypical development to autism in an on-line, cooperative, joint action task. In our study, we aimed to assess whether the degree of autistic traits affects participants' ability to modulate their motor behavior while interacting in a Joint Grasping task and according to their given role.MethodsSixteen pairs of adult participants played a cooperative social interactive game in which they had to synchronize their reach-to-grasp movements. Pairs were comprised of one ASC and one neurotypical with no cognitive disability. In alternate experimental blocks, one participant knew what action to perform (instructed role) while the other had to infer it from his/her partner’s action (adaptive role). When in the adaptive condition, participants were told to respond with an action that was either opposite or similar to their partner. Participants also played a non-social control game in which they had to synchronize with a non-biological stimulus.ResultsIn the social interactive task, higher degree of autistic traits predicted less ability to modulate joint action according to one’s interactive role. In the non-social task, autistic traits did not predict differences in movement preparation and planning, thus ruling out the possibility that social interactive task results were due to basic motor or executive function difficulties. Furthermore, when participants played the non-social game, the higher their autistic traits, the more they were interfered by the non-biological stimulus.ConclusionsOur study shows for the first time that high autistic traits predict a stereotypical interaction style when individuals are required to modulate their movements in order to coordinate with their partner according to their role in a joint action task. Specifically, the infrequent emergence of role-based motor behavior modulation during on-line motor cooperation in participants with high autistic traits sheds light on the numerous difficulties ASC have in nonverbal social interactions.

Effects of time-delay in a model of intra- and inter-personal motor coordination

Motor coordination is an important feature of intra- and inter-personal interactions, and several scenarios --- from finger tapping to human-computer interfaces --- have been investigated experimentally. In the 1980, Haken, Kelso and Bunz formulated a coupled nonlinear two-oscillator model, which has been shown to describe many observed aspects of coordination tasks. We present here a bifurcation study of this model, where we consider a delay in the coupling. The delay is shown to have a significant effect on the observed dynamics. In particular, we find a much larger degree of bistablility between in-phase and anti-phase oscillations in the presence of a frequency detuning.

Role of Gaze Cues in Interpersonal Motor Coordination: Towards Higher Affiliation in Human-Robot Interaction

BackgroundThe ability to follow one another’s gaze plays an important role in our social cognition; especially when we synchronously perform tasks together. We investigate how gaze cues can improve performance in a simple coordination task (i.e., the mirror game), whereby two players mirror each other’s hand motions. In this game, each player is either a leader or follower. To study the effect of gaze in a systematic manner, the leader’s role is played by a robotic avatar. We contrast two conditions, in which the avatar provides or not explicit gaze cues that indicate the next location of its hand. Specifically, we investigated (a) whether participants are able to exploit these gaze cues to improve their coordination, (b) how gaze cues affect action prediction and temporal coordination, and (c) whether introducing active gaze behavior for avatars makes them more realistic and human-like (from the user point of view).Methodology/Principal Findings43 subjects participated in 8 trials of the mirror game. Each subject performed the game in the two conditions (with and without gaze cues). In this within-subject study, the order of the conditions was randomized across participants, and subjective assessment of the avatar’s realism was assessed by administering a post-hoc questionnaire. When gaze cues were provided, a quantitative assessment of synchrony between participants and the avatar revealed a significant improvement in subject reaction-time (RT). This confirms our hypothesis that gaze cues improve the follower’s ability to predict the avatar’s action. An analysis of the pattern of frequency across the two players’ hand movements reveals that the gaze cues improve the overall temporal coordination across the two players. Finally, analysis of the subjective evaluations from the questionnaires reveals that, in the presence of gaze cues, participants found it not only more human-like/realistic, but also easier to interact with the avatar.Conclusion/SignificanceThis work confirms that people can exploit gaze cues to predict another person’s movements and to better coordinate their motions with their partners, even when the partner is a computer-animated avatar. Moreover, this study contributes further evidence that implementing biological features, here task-relevant gaze cues, enable the humanoid robotic avatar to appear more human-like, and thus increase the user’s sense of affiliation.

Beyond in-phase and anti-phase coordination in a model of joint action.

In 1985, Haken, Kelso and Bunz proposed a system of coupled nonlinear oscillators as a model of rhythmic movement patterns in human bimanual coordination. Since then, the Haken–Kelso–Bunz (HKB) model has become a modelling paradigm applied extensively in all areas of movement science, including interpersonal motor coordination. However, all previous studies have followed a line of analysis based on slowly varying amplitudes and rotating wave approximations. These approximations lead to a reduced system, consisting of a single differential equation representing the evolution of the relative phase of the two coupled oscillators: the HKB model of the relative phase. Here we take a different approach and systematically investigate the behaviour of the HKB model in the full four-dimensional state space and for general coupling strengths. We perform detailed numerical bifurcation analyses and reveal that the HKB model supports previously unreported dynamical regimes as well as bistability between a variety of coordination patterns. Furthermore, we identify the stability boundaries of distinct coordination regimes in the model and discuss the applicability of our findings to interpersonal coordination and other joint action tasks.

Can low-cost motion-tracking systems substitute a Polhemus system when researching social motor coordination in children?

Functionally stable and robust interpersonal motor coordination has been found to play an integral role in the effectiveness of social interactions. However, the motion-tracking equipment required to record and objectively measure the dynamic limb and body movements during social interaction has been very costly, cumbersome, and impractical within a non-clinical or non-laboratory setting. Here we examined whether three low-cost motion-tracking options (Microsoft Kinect skeletal tracking of either one limb or whole body and a video-based pixel change method) can be employed to investigate social motor coordination. Of particular interest was the degree to which these low-cost methods of motion tracking could be used to capture and index the coordination dynamics that occurred between a child and an experimenter for three simple social motor coordination tasks in comparison to a more expensive, laboratory-grade motion-tracking system (i.e., a Polhemus Latus system). Overall, the results demonstrated that these low-cost systems cannot substitute the Polhemus system in some tasks. However, the lower-cost Microsoft Kinect skeletal tracking and video pixel change methods were successfully able to index differences in social motor coordination in tasks that involved larger-scale, naturalistic whole body movements, which can be cumbersome and expensive to record with a Polhemus. However, we found the Kinect to be particularly vulnerable to occlusion and the pixel change method to movements that cross the video frame midline. Therefore, particular care needs to be taken in choosing the motion-tracking system that is best suited for the particular research.

The socio-motor interactions learning paradigm, a promising tool for rehabilitation protocol of social pathologies

In psychiatry, behavioral therapies do not focus on motor behaviors embedded in social interaction. Yet, it is well known that nonverbal motor behaviors play a fundamental role in the success of our interactions [1] . Several studies have previously shown that our motor behaviors of imitation (i.e. behavioural matching : BM) and of synchronization (i.e. temporal matching : TM) improve social competences such as affiliation between interactants or pro-social behaviors. However, no study has investigated theirs effects of the acquisition of motor competences. At both fundamental and clinical levels, it seems crucial to understand the mechanisms that underlie the acquisition and the improvement of socio-motor competences. We hypothesized a beneficial effect of theses “matching” on the acquisition of social and motor competences. 48 dyads of healthy subjects were split in a two-by-two experimental design. They were asked to perform three sessions of a mirror game task. Between each session, participants performed an interpersonal motor coordination task in which BM and TM have been manipulated (BM: Similar or Dissimilar amplitude; TM: Easy or Difficult movements). Motor competences were evaluated by the accuracy and by the variety of movements performed in the mirror game tasks; and social competences by the affiliation score between participants evaluated before and after the experiment. The results showed that Similar groups and Easy groups improved their motor and social competences whereas Dissimilar groups and Difficult groups only improved their social competences. These results suggest that socio-motor competences could be improved and that BM and TM promote this acquisition. Consequently, the manipulation of motor behaviors of imitation and of synchronization seems relevant to foster the acquisition of theses competences. A complementary study, including patients suffering from schizophrenia, confirms our results showing the beneficial effect of this paradigm in social pathologies. This study has been funded by the European project AlterEgo (Grant #600610).

Moving attractive virtual agent improves interpersonal coordination stability

Interpersonal motor coordination is influenced not only by biomechanical factors such as coordination pattern, oscillating frequency, and individual differences, but also by psychosocial factor such as likability and social competences. Based on the social stereotype of “what is beautiful is good”, the present study aimed at investigating whether people coordinate differently with physically attractive people compared to less attractive people. 34 participants were engaged in an interpersonal coordination task with different looking (virtual) agents while performing at the same time a reaction time task. Results showed that participants had more stable motor coordination with the moving attractive than with the less attractive agent, and that the difference in motor coordination could not be interpreted by a specific attention allocation strategy. Our findings provide the evidence that physical attractiveness genuinely affects how people interact with another person, and that the temporal-spatial coordinated movement varies with the partner’s psychosocial characteristics. The study broadens the perspective of exploring the effect of additional psychosocial factors on social motor coordination.

Can Real-Time, Adaptive Human–Robot Motor Coordination Improve Humans’ Overall Perception of a Robot?

Previous research on social interaction among humans suggested that interpersonal motor coordination can help to establish social rapport. Our research addresses the question of whether, in a human–humanoid interaction experiment, the human’s overall perception of a robot can be improved by realizing motor coordination behavior that allows the robot to adapt in real-time to a person’s behavior. A synchrony detection method using information distance was adopted to realize the real-time human–robot motor coordination behavior, which guided the humanoid robot to coordinate its movements to a human by measuring the behavior synchrony between the robot and the human. The feedback of the participants indicated that most of the participants preferred to interact with the humanoid robot with the adaptive motor coordination capability. The results of this proof-of-concept study suggest that the motor coordination mechanism improved humans’ overall perception of the humanoid robot. Together with our previous findings, namely that humans actively coordinate their behaviors to a humanoid robot’s behaviors, this study further supports the hypothesis that bidirectional motor coordination could be a valid approach to facilitate adaptive human–humanoid interaction.

Copying You Copying Me: Interpersonal Motor Co-Ordination Influences Automatic Imitation

Moving in a co-ordinated fashion with another individual changes our behaviour towards them; we tend to like them more, find them more attractive, and are more willing to co-operate with them. It is generally assumed that this effect on behaviour results from alterations in representations of self and others. Specifically, through neurophysiological perception-action matching mechanisms, interpersonal motor co-ordination (IMC) is believed to forge a neural coupling between actor and observer, which serves to blur boundaries in conceptual self-other representations and causes positive views of the self to be projected onto others. An investigation into this potential neural mechanism is lacking, however. Moreover, the specific components of IMC that might influence this mechanism have not yet been specified. In the present study we exploited a robust behavioural phenomenon – automatic imitation – to assess the degree to which IMC influences neural action observation-execution matching mechanisms. This revealed that automatic imitation is reduced when the actions of another individual are perceived to be synchronised in time, but are spatially incongruent, with our own. We interpret our findings as evidence that IMC does indeed exert an effect on neural perception-action matching mechanisms, but this serves to promote better self-other distinction. Our findings demonstrate that further investigation is required to understand the complex relationship between neural perception-action coupling, conceptual self-other representations, and social behaviour.

Dynamical methods for evaluating the time-dependent unfolding of social coordination in children with autism

Children with Autism Spectrum Disorder (ASD) suffer from numerous impairments in social interaction that affect both their mental and bodily coordination with others. We explored here whether interpersonal motor coordination may be an important key for understanding the profound social problems of children with ASD. We employed a set of experimental techniques to evaluate not only traditional cognitive measures of social competence but also the dynamical structure of social coordination by using dynamical measures of social motor coordination and analyzing the time series records of behavior. Preliminary findings suggest that children with ASD were equivalent to typically developing children on many social performance outcome measures. However, significant relationships were found between cognitive social measures (e.g., intentionality) and dynamical social motor measures. In addition, we found that more perceptually-based measures of social coordination were not associated with social motor coordination. These findings suggest that social coordination may not be a unitary construct and point to the promise of this multi-method and process-oriented approach to analyzing social coordination as an important pathway for understanding ASD-specific social deficits.

Social Motor Coordination in Unaffected Relatives of Schizophrenia Patients: A Potential Intermediate Phenotype

Intermediate endophenotypes emerge as an important concept in the study of schizophrenia. Although research on phenotypes mainly investigated cognitive, metabolic or neurophysiological markers so far, some authors also examined the motor behavior anomalies as a potential trait-marker of the disease. However, no research has investigated social motor coordination despite the possible importance of its anomalies in schizophrenia. The aim of this study was thus to determine whether coordination modifications previously demonstrated in schizophrenia are trait-markers that might be associated with the risk for this pathology. Interpersonal motor coordination in 27 unaffected first-degree relatives of schizophrenia patients and 27 healthy controls was assessed using a hand-held pendulum task to examine the presence of interpersonal coordination impairments in individuals at risk for the disorder. Measures of neurologic soft signs, clinical variables and neurocognitive functions were collected to assess the cognitive and clinical correlates of social coordination impairments in at-risk relatives. After controlling for potential confounding variables, unaffected relatives of schizophrenia patients had impaired intentional interpersonal coordination compared to healthy controls while unintentional interpersonal coordination was preserved. More specifically, in intentional coordination, the unaffected relatives of schizophrenia patients exhibited coordination patterns that had greater variability and in which relatives did not lead the coordination. These results show that unaffected relatives of schizophrenia patients, like the patients themselves, also present deficits in intentional interpersonal coordination. For the first time, these results suggest that intentional interpersonal coordination impairments might be a potential motor intermediate endophenotype of schizophrenia opening new perspectives for early diagnosis.