Perception-action Coupling Research Articles

Virtual vs. actual body: applicability of anthropomorphic avatars to enhance exploratory creativity in architectural design education

This study examines the relationship between the virtual bodies of anthropomorphic avatars and exploratory creativity in empirical architectural design education. In Study 1, architecture major students (N = 83) conducted two design tasks via each of an actual human body in a real environment with a full-scale mockup model and avatars in a 3D virtual environment with a digital model. Following the tasks, students evaluated self-exploration levels, aiming to discover unexpected, novel, and functional solutions. In Study 2, students (N = 106) designed two architectural 3D digital models, without and with the presence of avatars, with self-evaluations as in Study 1. The statistical analyses revealed that (1) the virtual and actual bodies were not statistically different in supporting the students’ exploratory creativity. However, (2) in digital modeling, using the virtual body of an avatar better facilitated the search for functional aspects of design and consequently promoted exploratory creativity, relevant to perception-action coupling and para-perception.

Strategy and tactics in sports from an ecological-dynamical-perspective: What is in there for coaches and players?

In sports, strategy and tactics play a decisive role. This is certainly so in sport games like volleyball in which the players need to promptly adapt their actions to the continuously changing game situations. In this paper, we will take a closer look at how strategic and tactical decisions come about. Our goal is twofold. First, we want to tackle this discussion from the angle of the ecological-dynamical approach, in which concepts as perception-action coupling, affordances, and self-organization are put forward as vital elements to explain the control of actions/sport skills. In referring to animal behavior, we will push the idea that cognitive interventions are not a prerequisite for strategic and tactical interventions. Second, we want to translate these theoretical concepts into some general guidelines for coaches and practitioners. In doing so, we hope to increase the understanding that for practice the environmental constraints should be embraced in order to improve the strategic and tactical capacities of the players.

Fewer fixations of longer duration? Expert gaze behavior revisited

In the current study, we investigated gaze behavior in sports by reviewing expertise-related differences in fixation duration, number of fixations, gaze location, and quiet eye duration. The review was conducted following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines and included a total of 101 studies. Applying the vote-counting procedure, differences in gaze variables were aggregated as a function of the total number and the publication year. Moreover, for fixation duration and number of fixations an effect-size analysis was conducted. For gaze location and quiet eye duration, different gaze behavior in experts was found, in particular, when compared to novices. However, for fixation duration and number of fixations the results were less clear. Overall, there were more studies with nonsignificant results than studies with significant (positive and negative) results. These findings were confirmed by the effect-size analysis with average effect sizes in 2017 being small or just above the null effect (fixation duration: d = 0.21; number of fixations: d = 0.01). There was only minor mediation by the factors representativeness of the experimental design, type of sports, and type of task. Overall, the findings suggest that the empirical evidence on expertise-related differences in gaze behavior declined in recent years. Rather, the expert advantage in cognitive and motor tasks might be better explained with an optimal perception–action coupling.

Effect of Skill Level on Allocation of Visual Attention in Volleyball Blocking

Dynamic motor skills such as volleyball blocking rely on efficient perception–action coupling and are influenced by individual, environmental, and task constraints. However, limited research studies have assessed the effect of an individual constraint such as blocking skill on visual attention during an in-situ volleyball blocking task. Therefore, this study used a cross-sectional, observational design to investigate the gaze behavior of 18 male volleyball players (25.6 ± 4.9 years), of two different levels of blocking skill determined a priori according to success during an on-court blocking task. When compared to relatively unsuccessful players (RUS), the gaze of relatively successful players (RS) was observed to fixate more often (RUS: 0.7 ± 0.7 n, RS: 1.3 ± 0.3 n) and dwell for longer (Total; RUS: 12.2 ± 18.4%, RS: 48.0 ± 37.2%, Phase 4; RUS: 6.6 ± 8.8%, RS: 16.9 ± 12.4%) on the opposition spiker, demonstrating that important perceptual information about an opposing team’s attack lies within the behavior of the opposition spiker. More successful blockers were also observed to be taller (RUS: 181.8 ± 6.6 cm, RS: 192.6 ± 3.9 cm), longer in arm-span (RUS: 185.7 ± 5.6 cm, RS: 195.2 ± 5.6 cm), and heavier (RUS: 78.6 ± 11.4 kg, RS: 90.5 ± 8.5 kg). These results can consequently be used to develop a profile of the visual attention and physical attributes of successful blockers for use in developing talented players.

Probing the time course of facilitation and inhibition in gaze cueing of attention in an upper-limb reaching task.

Previous work has revealed that social cues, such as gaze and pointed fingers, can lead to a shift in the focus of another person's attention. Research investigating the mechanisms of these shifts of attention has typically employed detection or localization button-pressing tasks. Because in-depth analyses of the spatiotemporal characteristics of aiming movements can provide additional insights into the dynamics of the processing of stimuli, in the present study we used a reaching paradigm to further explore the processing of social cues. In Experiments 1 and 2, participants aimed to a left or right location after a nonpredictive eye gaze cue toward one of these target locations. Seven stimulus onset asynchronies (SOAs), from 100 to 2,400 ms, were used. Both the temporal (reaction time, RT) and spatial (initial movement angle, IMA) characteristics of the movements were analyzed. RTs were shorter for cued (gazed-at) than for uncued targets across most SOAs. There were, however, no statistical differences in IMAs between movements to cued and uncued targets, suggesting that action planning was not affected by the gaze cue. In Experiment 3, the social cue was a finger pointing to one of the two target locations. Finger-pointing cues generated significant cueing effects in both RTs and IMAs. Overall, these results indicate that eye gaze and finger-pointing social cues are processed differently. Perception-action coupling (i.e., a tight link between the response and the social cue that is presented) might play roles in both the generation of action and the deviation of trajectories toward cued and uncued targets.

The experience of flow during sensorimotor synchronization to musical rhythms

Sensorimotor integration tasks, such as body movements in time with music, can foster the experience of flow – a pleasurable state of full engagement and concentration occurring during a seemingly effortless and automatic activity. As it can be argued that both music and flow are embodied phenomena, perception-action coupling might be the core of the intimate relationship between flow and music. The current study examines the relationship between the subjective experience of flow and sensorimotor synchronization accuracy/stability in a finger-tapping task with music. In a between-subjects design, participants tapped in time with the beat of music clips with either low, medium, or high rhythmic complexity. After the tapping task, they rated their flow state on the Flow Short Scale with the two subscales fluency of performance and absorption by activity. Tapping accuracy and stability were assessed by the circular variance and the SD of inter-tap-intervals (ITIs), respectively. Both tapping accuracy and stability were significantly correlated with fluency of performance for music clips with medium and high rhythmic complexity, but not for music clips with low rhythmic complexity. No significant correlations were found between tapping accuracy/stability and absorption by activity. The findings add to evidence that perception-action coupling plays a key role in explaining the relationship between flow experience and musical activities. They also suggest that absorption by activity is not as relevant to the experience of flow during musical activities as one might initially assume.

Increased Risk of Musculoskeletal Injury Following Sport-Related Concussion: A Perception-Action Coupling Approach.

Recent studies have concluded that athletes have increased risk of musculoskeletal injury following sport-related concussion. While an underlying explanation is still unknown, perceptual-motor control may be implicated in this increased risk. Some authors have purported that indirect perception (i.e., a "top-down" view of neuromuscular control) may be disrupted following sport-related concussion. Direct perception theory states that the athlete and environment are inextricably linked in a continuous perception-action coupling loop. That is, the athlete is able to directly perceive opportunities for action (e.g., "affordances") in the environment. Based on these notions, the aim of the current paper was to introduce a theoretical model that argues that sport-related concussion may dysregulate the direct perception process, potentially increasing behavioral risk of musculoskeletal injury during sport. Our model is integrated with a sport-related concussion clinical treatment model, which highlights individualized profiles that characterize the heterogeneous response to sport-related concussion. These profiles have a typical constellation of symptoms (e.g., anxiety, fatigue, ocular dysfunction, etc.), which themselves have been associated with disrupted perception-action coupling, independent of sport-related concussion. Therefore, we argue that athletes who have not re-established perception-action coupling loops following sport-related concussion may be at increased risk of subsequent musculoskeletal injury.

Does the motor system contribute to the perception of changes in objects visual attributes? The neural dynamics of sensory binding by action

The contribution of the motor system to perception has been highlighted in research investigating the effect of performing an action on the conscious processing of information received from the sensory systems. For example, the perceptual temporal asynchrony observed when passively reporting changes in visual object attributes (e.g., colour and position) was found to disappear virtually when the changes resulted from a voluntary motor action. Although the spatio-temporal constraints of sensory binding by action have been broadly investigated, the underlying neural correlates are still largely unknown. In the present study, participants performed temporal order judgments of changes in the colour and position of a visual stimulus, while adapting to a 750 ms delay between a sound (perceptual condition) or the end of a manual reaching action (motor condition), and the visual changes. Behavioural observations indicated that temporal asynchrony (-30.2 ms) decreased in the motor condition (2.7 ms), as a result of sensorimotor adaptation, but not in the perceptual condition (-29.6 ms). EEG-evoked potentials on posterior visual regions showed that early components were altered by sensorimotor adaptation, with in particular a broad reduction in the amplitude of the early P1 component. Furthermore, time-frequency analysis of EEG signals during the 350 ms period preceding the visual changes revealed an increase of the 15–25 Hz frequency band amplitude in the central region and a decrease of the 8–12 Hz frequency band amplitude in the posterior region. Overall the results suggest that sensory binding by action depends on an early top-down modulation of the visual regions by the motor system - in agreement with the pre-activation theory of action-perception coupling - associated with an increase of attentional resources.

Minimum predicted distance: Applying a common metric to collision avoidance strategies between children and adult walkers

BackgroundCollision avoidance between two walkers involves a mutual adaptation to speed and orientation in order to successfully avoid a collision. Minimum Predicted Distance (MPD) is the distance at which two walkers would collide if their speed and path trajectory were maintained at first sight of one another. MPD has been used to describe the risk of collision and its evolution over time between two adult walkers when on a collision course. Middle-aged children have been shown to have poor perception-action coupling during static and dynamic collision avoidance tasks. Research has yet to examine whether perception-action coupling deficits persist in a dynamic collision avoidance task involving a child and another walker. Research questionCan the metric MPD(t) be used to examine collision avoidance strategies between children and adults? MethodsEighteen children (age: 10 ± 1.5 years) and eighteen adults (34 ± 9.6 years) walked along a 12.6 m pathway while avoiding another participant (child or adult). Groups of three children and three adults were recruited per session. Trials were randomized equally such that each adult interacted with another adult 20 times, each child interacted with another child 20 times, and each adult interacted with a child 21 times, for a total of 141 trials. 3D kinematic data of each participant’s head was recorded using the Vicon system. ResultsThe results demonstrated: (1) MPD(t) can be used to predict future collisions in children, (2) MPD(t) is an absolute measure that is consistently lower when a child is involved compared to two adult walkers, (3) the individual passing second, even when it is a child, contributes more to MPD(t) than the walker passing first. SignificanceIt appears children have developed adult-like strategies during a collision avoidance task involving two walkers. Body anthropometrics should be considered when determining collision avoidance strategies between children and adults.

The direct learning theory: a naturalistic approach to learning for the post-cognitivist era

In 2017, Di Paolo, Buhrmann, and Barandiarán proposed a list of criteria that post-cognitivist theories of learning should fulfill. In this article, we review the ecological theory of direct learning. We argue that this theory fulfills most of the criteria put forward by Di Paolo et al. and that its tools and concepts can be useful to other post-cognitivist theories of learning. Direct learning holds that improvements with practice are driven by information for learning that can be found in the dynamic organism-environment interaction. The theory formally describes information for learning as a vector field that spans a space with all the perception-action couplings that may be used to perform an action. Being located at a point of such a space means using a specific perception-action coupling. Changes in perception-action couplings due to learning can be represented as paths across the space, and can be explained with the vector field of information for learning. Previous research on direct learning considered actions that were best understood with single perception-action couplings. To conclude the article, and inspired by the criteria of Di Paolo et al., we discuss an extension of the theory to actions that are best understood with multiple perception-action couplings.

Epigenetic modification of the oxytocin receptor gene is associated with emotion processing in the infant brain

The neural capacity to discriminate between emotions emerges early in development, though little is known about specific factors that contribute to variability in this vital skill during infancy. In adults, DNA methylation of the oxytocin receptor gene (OXTRm) is an epigenetic modification that is variable, predictive of gene expression, and has been linked to autism spectrum disorder and the neural response to social cues. It is unknown whether OXTRm is variable in infants, and whether it is predictive of early social function. Implementing a developmental neuroimaging epigenetics approach in a large sample of infants (N = 98), we examined whether OXTRm is associated with neural responses to emotional expressions. OXTRm was assessed at 5 months of age. At 7 months of age, infants viewed happy, angry, and fearful faces while functional near-infrared spectroscopy was recorded. We observed that OXTRm shows considerable variability among infants. Critically, infants with higher OXTRm show enhanced responses to anger and fear and attenuated responses to happiness in right inferior frontal cortex, a region implicated in emotion processing through action-perception coupling. Findings support models emphasizing oxytocin’s role in modulating neural response to emotion and identify OXTRm as an epigenetic mark contributing to early brain function.

Hand Shape Familiarity Affects Guitarists’ Perception of Sonic Congruence

ABSTRACTMusical performance depends on the anticipation of the perceptual consequences of motor behavior. Altered auditory feedback (AAF) has previously been used to investigate auditory-motor coupling but studies to date have predominantly used MIDI piano in experimental tasks. In the present study, we extend the AAF paradigm to the guitar, which differs from the piano both motorically and in its pitch-to-place mapping, allowing further investigation into the nature of this coupling. Guitarists played chords on a MIDI guitar in response to tablature diagrams. In half of the trials, one of the notes in the heard chord was artificially altered. Participants judged whether the feedback was altered or not, responding as quickly and accurately as possible by pressing one of two buttons on a footswitch. Participants ranked the familiarity of the chord shapes and the hand shapes of the stimuli. Judgement of sonic congruence was faster when the chord and hand shape were familiar, and when feedback was congruent, though there was no interaction between these factors. Our findings suggest that guitarists’ auditory-motor coupling is heterogenous with respect to their technique, and that perception-action coupling operates at the abstract level of the gesture. We discuss implications of these findings with regard to forward models and embodiment.

Aging and the prevalence of 'ironic' action errors under avoidant instruction.

Action errors can put older adults at risk of injury. Our study is the first to investigate whether older adults are more prone than younger adults to making ‘ironic’ motor errors (i.e., actions they have been instructed not to perform), or over-compensatory motor errors (e.g., moving more to the right when instructed not to move to the left). We also investigated whether error patterns change under cognitive load, and assessed whether age effects in the ability to inhibit a prohibited action are comparable to the age decrements found in the ability to inhibit a natural perception-action coupling in the Simon task. Sixty-four older (Mean = 70.64 years, SD = 5.81) and 39 younger (Mean = 28.74 years, SD = 16.39) adults completed an avoidant instruction line-drawing task (with and without cognitive load), and the Simon task. Older adults showed significantly slower inhibition times than younger adults on the Simon task, as expected, and in line with previous research. Surprisingly, however, older adults outperformed younger adults on the avoidant instruction task, producing fewer ironic and over-compensatory errors, and they performed similarly to the younger adults under cognitive load. Age-related decrements on the Simon but not the avoidant instruction task suggests that the two different types of motor tasks involve different subtypes of inhibition which likely recruit independent cognitive processes and neural circuitry in older age. It is speculated that the older adults’ superior ability to inhibit a prohibited action could be the result of age-related changes in distractibility.

Does Concussion Affect Perception-Action Coupling Behavior? Action Boundary Perception as a Biomarker for Concussion.

After a concussion, athletes may be at increased risk of musculoskeletal injuries. Altered perception of action boundaries (ABP), or the limits of one's action capabilities, is one possible mechanism for this increase in injury risk after concussion. To evaluate differences in symptoms, neurocognitive, vestibular/oculomotor, and action boundary function between subjects with no concussion history (NoHx) and concussion history (ConcHX). Cross-sectional study. Laboratory at the University of Pittsburgh. ConcHx (n = 22; age: 21.8 ± 3.0 years, height: 174.0 ± 8.3 cm, and mass: 77.8 ± 14.8 kg) and NoHx athletes (n = 24; age: 21.6 ± 2.0 years, height: 176.0 ± 10.0 cm, and mass: 72.0 ± 15.3 kg). Immediate Postconcussion Assessment and Cognitive Testing (ImPACT) and Post-Concussion Symptom Scale (PCSS), Vestibular-Ocular Motor Screening (VOMS) tool, and the Perception-Action Coupling Task (PACT). The PACT measures the accuracy of ABP. Neurocognitive domain scores, PCSS, VOMS subdomain symptom gain, ABP accuracy, and actualization. ConcHx reported 2.7 ± 1.5 previous concussions occurring on average 263.8 ± 228.9 days prior. ConcHx was higher on several VOMS items including vertical/horizontal saccades (P = 0.001; P = 0.05), vertical/horizontal vestibular-ocular reflex (P < 0.001; P = 0.04), and visual motion sensitivity (P < 0.001). Average PACT movement time (P = 0.01) and reaction time (P = 0.01) were longer in ConcHx. These findings provide preliminary support for impaired vestibular/oculomotor function and ABP in ConcHx compared with NoHx. The current results may enhance our understanding of the mechanisms for increased musculoskeletal injury risk after concussion.

A Predictive Processing Model of Perception and Action for Self-Other Distinction.

During interaction with others, we perceive and produce social actions in close temporal distance or even simultaneously. It has been argued that the motor system is involved in perception and action, playing a fundamental role in the handling of actions produced by oneself and by others. But how does it distinguish in this processing between self and other, thus contributing to self-other distinction? In this paper we propose a hierarchical model of sensorimotor coordination based on principles of perception-action coupling and predictive processing in which self-other distinction arises during action and perception. For this we draw on mechanisms assumed for the integration of cues for a sense of agency, i.e., the sense that an action is self-generated. We report results from simulations of different scenarios, showing that the model is not only able to minimize free energy during perception and action, but also showing that the model can correctly attribute sense of agency to own actions.

Perceived Fatigability: Utility of a Three-Dimensional Dynamical Systems Framework to Better Understand the Psychophysiological Regulation of Goal-Directed Exercise Behaviour.

A three-dimensional framework of perceived fatigability emphasises the need to differentiate between the qualitatively distinct inputs of sensory-discriminatory, affective-motivational and cognitive-evaluative processes that shape the perceptual milieu during prolonged endurance exercise. This article reviews the framework's utility to better understand how cause-effect relationships come to be and how perception-action coupling underpins pacing behaviour and performance fatigability. Preliminary evidence supports the hypotheses that perceived strain plays a primary role in trajectory regulation of pacing behaviour, core affect plays a primary and mediatory role in behavioural performance regulation, and the mindset shift associated with an action crisis plays a primary role in the intensity dependent volitional self-regulatory control of conflicting motivational drives. The constructs hypothesised to underpin perceived fatigability are systematically linked,context-dependent, constraint-based, distinguishable and show proportional continuous interdependency. They are further interrelated with dynamic changes in pacing behaviour, performance fatigability and physiological disturbance. Appropriate measurement selections for the subordinate constructs perceived physical strain, perceived mental strain, valence, arousal, action crisis and flow state are discussed. To better understand the non-proportional discontinuous effects of fatigue on discrete shifts in thought states and mindsets, non-linear dynamical systems theory is introduced as an unbiased overarching theory of governing principles in the temporal evolution of complex systems. This provides the opportunity to discuss the bio-psycho-social fatigue phenomenon from a dynamical and holistic perspective. The proposed framework offers a sophisticated alternative to the Gestalt concept of perceived exertion and comprehensively accounts for the psychophysiological processes that determine pacing behaviour and performance. It has the potential to enrich theory development and facilitate a deeper understanding of the psychophysiological regulation of goal-directed exercise behaviour.

Cognitive models modulate action-perception coupling in perceptual multistability

Cognitive models modulate action-perception coupling in perceptual multistability

Steady-state evoked potentials distinguish brain mechanisms of self-paced versus synchronization finger tapping

Sensorimotor synchronization (SMS) requires aligning motor actions to external events and represents a core part of both musical and dance performances. In the current study, to isolate the brain mechanisms involved in synchronizing finger tapping with a musical beat, we compared SMS to pure self-paced finger tapping and listen-only conditions at different tempi. We analyzed EEG data using frequency domain steady-state evoked potentials (SSEPs) to identify sustained electrophysiological brain activity during repetitive tasks. Behavioral results revealed different timing modes between SMS and self-paced finger tapping, associated with distinct scalp topographies, thus suggesting different underlying brain sources. After subtraction of the listen-only brain activity, SMS was compared to self-paced finger tapping. Resulting source estimations showed stronger activation of the left inferior frontal gyrus during SMS, and stronger activation of the bilateral inferior parietal lobule during self-paced finger tapping. These results point to the left inferior frontal gyrus as a pivot for perception–action coupling. We discuss our findings in the context of the ongoing debate about SSEPs interpretation given the variety of brain events contributing to SSEPs and similar EEG frequency responses.

Timing Training in Female Soccer Players: Effects on Skilled Movement Performance and Brain Responses

Although trainers and athletes consider “good timing skills” critical for optimal sport performance, little is known in regard to how sport-specific skills may benefit from timing training. Accordingly, this study investigated the effects of timing training on soccer skill performance and the associated changes in functional brain response in elite- and sub-elite female soccer players. Twenty-five players (mean age 19.5 years; active in the highest or second highest divisions in Sweden), were randomly assigned to either an experimental- or a control group. The experimental group (n = 12) was subjected to a 4-week program (12 sessions) of synchronized metronome training (SMT). We evaluated effects on accuracy and variability in a soccer cross-pass task. The associated brain response was captured by functional magnetic resonance imaging (fMRI) while watching videos with soccer-specific actions. SMT improved soccer cross-pass performance, with a significant increase in outcome accuracy, combined with a decrease in outcome variability. SMT further induced changes in the underlying brain response associated with observing a highly familiar soccer-specific action, denoted as decreased activation in the cerebellum post SMT. Finally, decreased cerebellar activation was associated with improved cross-pass performance and sensorimotor synchronization. These findings suggest a more efficient neural recruitment during action observation after SMT. To our knowledge, this is the first controlled study providing behavioral and neurophysiological evidence that timing training may positively influence soccer-skill, while strengthening the action-perception coupling via enhanced sensorimotor synchronization abilities, and thus influencing the underlying brain responses.

Modelling perception-action coupling in the phenomenological experience of \u201chitting the wall\u201d during long-distance running with exercise-induced muscle damage in highly trained runners

Background“Hitting the wall” (HTW) can be understood as a psychophysiological stress process characterised by (A) discrete and poignant onset, (B) dynamic interplay between physiological, affective, motivational, cognitive, and behavioural systems, and (C) unintended alteration of pace and performance. A preceding companion article investigated the psychophysiological responses to 20-km self-paced treadmill time trials after producing exercise-induced muscle damage (EIMD) via a standardised muscle-lengthening contraction protocol.MethodsA 5-step procedure was applied determining the extent to which the observed data fit the hypothesised cause-effect relationships. Running with EIMD negatively impacts performance fatigability via (A) amplified physiological responses and a non-adaptive distress response and (B) deterioration in perceived fatigability: increase in perceived physical strain precedes decrease in valence, which in turn precedes increase in action crisis, eventually dissolving the initially aspired performance goal.ResultsFirst, haematological indicators of EIMD predicted increased blood cortisol concentration, which in turn predicted increased performance fatigability. Second, perceived physical strain explained 44% of the relationship between haematological indicators of EIMD and valence, which in turn predicted increased action crisis, which in turn predicted increased performance fatigability. The observed data fitted the hypothesised dual-pathway model well with good model-fit indices throughout.ConclusionsThe hypothesised interrelationships between physiological strain, perception, and heuristic and deliberative decision-making processes in self-regulated and goal-directed exercise behaviour were applied, tested, and confirmed: amplified physiological strain and non-adaptive distress response as well as strain-perception-thinking-action coupling impact performance fatigability. The findings provide novel insights into the psychophysiological processes that underpin the phenomenological experience of HTW and alteration in pacing behaviour and performance.