Recognition Of Biological Motion Research Articles

Perception of biological motion by jumping spiders.

The body of most creatures is composed of interconnected joints. During motion, the spatial location of these joints changes, but they must maintain their distances to one another, effectively moving semirigidly. This pattern, termed "biological motion" in the literature, can be used as a visual cue, enabling many animals (including humans) to distinguish animate from inanimate objects. Crucially, even artificially created scrambled stimuli, with no recognizable structure but that maintains semirigid movement patterns, are perceived as animated. However, to date, biological motion perception has only been reported in vertebrates. Due to their highly developed visual system and complex visual behaviors, we investigated the capability of jumping spiders to discriminate biological from nonbiological motion using point-light display stimuli. These kinds of stimuli maintain motion information while being devoid of structure. By constraining spiders on a spherical treadmill, we simultaneously presented 2 point-light displays with specific dynamic traits and registered their preference by observing which pattern they turned toward. Spiders clearly demonstrated the ability to discriminate between biological motion and random stimuli, but curiously turned preferentially toward the latter. However, they showed no preference between biological and scrambled displays, results that match responses produced by vertebrates. Crucially, spiders turned toward the stimuli when these were only visible by the lateral eyes, evidence that this task may be eye specific. This represents the first demonstration of biological motion recognition in an invertebrate, posing crucial questions about the evolutionary history of this ability and complex visual processing in nonvertebrate systems.

Perception of biological motion. No sensitivity differences between patients with Parkinson’s disease and healthy observers

The use of biological motion (BM) stimuli (point-light walkers PLW) may be a novel alternative to improve the clinical impact of Action Observation treatments in Parkinson’s Disease, by directing the patient’s attentional focus on gait kinematics. However, the recognition of biological motion in Parkinson’s patients has thus far been controversial. To evaluate the clinical feasibility of using BM stimuli in Action Observation treatments, we aimed at investigating whether Parkinson’s patients in the ON-state condition can identify and use gender-specific cues conveyed by the body structure and by the kinematics of gait of a PLW. 30 Parkinson’s patients and 30 healthy elderly observers were tested in a gender identification task with PLW. Parkinson’s patients were able to correctly identify the gender of PLW; no differences were found between the two groups of observers. While for both groups, the gender identification task was easier when it required a judgment on a healthy PLW. Lastly, we found that females were more sensitive than males in our identification task. Our study shows that Parkinson’s patients in the ON-state condition are able to extract subtle structural and kinematic characteristics from biological motion stimuli, which is favorable to the use of BM in Action Observation treatments.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs’ lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.

Enhancement of visual biological motion recognition in early-deaf adults: Functional and behavioral correlates.

Deafness leads to brain modifications that are generally associated with a cross-modal activity of the auditory cortex, particularly for visual stimulations. In the present study, we explore the cortical processing of biological motion that conveyed either non-communicative (pantomimes) or communicative (emblems) information, in early-deaf and hearing individuals, using fMRI analyses. Behaviorally, deaf individuals showed an advantage in detecting communicative gestures relative to hearing individuals. Deaf individuals also showed significantly greater activation in the superior temporal cortex (including the planum temporale and primary auditory cortex) than hearing individuals. The activation levels in this region were correlated with deaf individuals' response times. This study provides neural and behavioral evidence that cross-modal plasticity leads to functional advantages in the processing of biological motion following lifelong auditory deprivation.

Autism, kinematics and social cognition

Autism, kinematics and social cognition

Face recognition ability does not predict person identification performance: using individual data in the interpretation of group results

There are large individual differences in people’s face recognition ability. These individual differences provide an opportunity to recruit the best face-recognisers into jobs that require accurate person identification, through the implementation of ability-screening tasks. To date, screening has focused exclusively on face recognition ability; however real-world identifications can involve the use of other person-recognition cues. Here we incorporate body and biological motion recognition as relevant skills for person identification. We test whether performance on a standardised face-matching task (the Glasgow Face Matching Test) predicts performance on three other identity-matching tasks, based on faces, bodies, and biological motion. We examine the results from group versus individual analyses. We found stark differences between the conclusions one would make from group analyses versus analyses that retain information about individual differences. Specifically, tests of correlation and analysis of variance suggested that face recognition ability was related to performance for all person identification tasks. These analyses were strikingly inconsistent with the individual differences data, which suggested that the screening task was related only to performance on the face task. This study highlights the importance of individual data in the interpretation of results of person identification ability.

Investigating the neural basis of basic human movement perception using multi-voxel pattern analysis.

Humans can skillfully recognize actions from others' body motion and make a judgment or response at once. Previous neuroimaging studies have mostly utilized diminished and brief human motion stimuli and indicated that human occipito-temporal cortex plays a critical role at biological motion recognition. It remains unclear to what extent that the areas related to human motion perception are involved in decoding basic movements. Because human movement naturally stems from the sequences of body posture, so we utilized the stimulus of real movements. Participants were presented four categories of human movements (jump, run, skip and walk) in a blocked fMRI experiment. Multi-voxel pattern analysis (MVPA) was adopted to assess whether different movements could be discriminated in four regions. We found that movement-specific information was represented in both human body-sensitive areas, extrastriate body area (EBA) and motion-sensitive areas, posterior superior temporal sulcus (pSTS) and human middle temporal complex (hMT+). Additionally, a further functional connectivity analysis using EBA as a seed was conducted and it suggested that EBA showed a task-modulated functional connectivity with multiple areas that were involved in the behavior perception and motor control. Human motion processing appeared to be completed in a distributed network. The occipito-temporal cortex may perform the initial processing of human motion information extracting, and then transform them to interconnected areas for a further utilization.

Natural Translating Locomotion Modulates Cortical Activity at Action Observation.

The present study verified if the translational component of locomotion modulated cortical activity recorded at action observation. Previous studies focusing on visual processing of biological motion mainly presented point light walker that were fixed on a spot, thus removing the net translation toward a goal that yet remains a critical feature of locomotor behavior. We hypothesized that if biological motion recognition relies on the transformation of seeing in doing and its expected sensory consequences, a significant effect of translation compared to centered displays on sensorimotor cortical activity is expected. To this aim, we explored whether EEG activity in the theta (4–8 Hz), alpha (8–12 Hz), beta 1 (14–20 Hz) and beta 2 (20–32 Hz) frequency bands exhibited selectivity as participants viewed four types of stimuli: a centered walker, a centered scrambled, a translating walker and a translating scrambled. We found higher theta synchronizations for observed stimulus with familiar shape. Higher power decreases in the beta 1 and beta 2 bands, indicating a stronger motor resonance was elicited by translating compared to centered stimuli. Finally, beta bands modulation in Superior Parietal areas showed that the translational component of locomotion induced greater motor resonance than human shape. Using a Multinomial Logistic Regression classifier we found that Dorsal-Parietal and Inferior-Frontal regions of interest (ROIs), constituting the core of action-observation system, were the only areas capable to discriminate all the four conditions, as reflected by beta activities. Our findings suggest that the embodiment elicited by an observed scenario is strongly mediated by horizontal body displacement.

Impairments in the Visual Processing of Global Biological Motion Cues in Down Syndrome.

Down syndrome (DS) is one of the most common chromosomal disorders and is often associated with a number of motor and cognitive impairments. Little research has been dedicated to investigating the perceptual abilities of individuals with DS. The visual processing of biological motion has been shown to be impaired in DS. It has been proposed that these impairments may stem from an inability to process the global patterns of full-body motion produced by a moving actor; however, this has not been explicitly investigated. We tested groups of participants with and without DS on a task requiring the visual discrimination of point-light walkers from spatially scrambled versions of point-light walkers. Participants with DS demonstrated poorer performance and slower reaction times on the task than healthy controls. From these results, we conclude that biological motion processing is impaired in DS and that this deficit is related to an inability to integrate global configural cues. In a second experiment, individuals with DS were able to discriminate the direction in which laterally translating walkers moved, suggesting that the global motion processing deficit observed in Experiment 1 is specific to biological motion recognition and does not generalise to other types of global motion.

Neural model of biological motion recognition based on shading cues

Point-light or stick-figure biological motion stimuli, due to the absence of depth cues, can induce bistable perception, where the walker is perceived as heading in two alternating directions [1,2]. Psychophysical studies suggested an importance of depth cues for biological motion perception [3]. However, neural models of biological motion perception so far have focused on the processing of features that characterize the 2D structure and motion of the human body [4,5]. We extend such models for the processing of shading cues in order to analyze the three-dimensional structure of walkers from monocular stimuli.

Children's looking preference for biological motion may be related to an affinity for mathematical chaos.

Recognition of biological motion is pervasive in early child development. Further, viewing the movement behavior of others is a primary component of a child’s acquisition of complex, robust movement repertoires, through imitation and real-time coordinated action. We theorize that inherent to biological movements are particular qualities of mathematical chaos and complexity. We further posit that this character affords the rich and complex inter-dynamics throughout early motor development. Specifically, we explored whether children’s preference for biological motion may be related to an affinity for mathematical chaos. Cross recurrence quantification analysis (cRQA) was used to investigate the coordination of gaze and posture with various temporal structures (periodic, chaotic, and aperiodic) of the motion of an oscillating visual stimulus. Children appear to competently perceive and respond to chaotic motion, both in rate (cRQA-percent determinism) and duration (cRQA-maxline) of coordination. We interpret this to indicate that children not only recognize chaotic motion structures, but also have a preference for coordination with them. Further, stratification of our sample (by age) uncovers the suggestion that this preference may become refined with age.

Electrophysiological markers of biological motion and human form recognition

Current models suggest that human form and motion information are initially processed through separate pathways, then integrated in action perception. Testing such a sequential model requires techniques with high temporal resolution. Prior work demonstrated sensitivity of a posterior temporal event-related potential (ERP) effect — the N2 — to biological motion, but did not test whether the N2 indexes biological motion perception specifically, or human form/action perception more generally. We recorded ERPs while participants viewed stimuli across 3 blocks: (1) static (non-moving) point-light displays of humans performing actions; (2) static stick figures with clear forms; and (3) point-light biological motion. A similar sequence of ERP components was elicited by human forms in all blocks (stationary and moving), and reliably discriminated between human and scrambled forms. The N2 showed similar scalp distribution and sensitivity to stimulus manipulations for both stick figures and biological motion, suggesting that it indexes integration of form and motion information, rather than biological motion perception exclusively — and that form and motion information are therefore integrated by approximately 200ms. We identified a component subsequent to the N2, which we label the medial parietal positivity/ventral–anterior negativity (MPP/VAN), that was also sensitive to both human form and motion information. We propose that the MPP/VAN reflects higher-order human action recognition that occurs subsequent to the integration of form and motion information reflected by the N2.

Deficient biological motion perception in schizophrenia: results from a motion noise paradigm

Background: Schizophrenia patients exhibit deficient processing of perceptual and cognitive information. However, it is not well-understood how basic perceptual deficits contribute to higher level cognitive problems in this mental disorder. Perception of biological motion, a motion-based cognitive recognition task, relies on both basic visual motion processing and social cognitive processing, thus providing a useful paradigm to evaluate the potentially hierarchical relationship between these two levels of information processing.Methods: In this study, we designed a biological motion paradigm in which basic visual motion signals were manipulated systematically by incorporating different levels of motion noise. We measured the performances of schizophrenia patients (n = 21) and healthy controls (n = 22) in this biological motion perception task, as well as in coherent motion detection, theory of mind, and a widely used biological motion recognition task.Results: Schizophrenia patients performed the biological motion perception task with significantly lower accuracy than healthy controls when perceptual signals were moderately degraded by noise. A more substantial degradation of perceptual signals, through using additional noise, impaired biological motion perception in both groups. Performance levels on biological motion recognition, coherent motion detection and theory of mind tasks were also reduced in patients.Conclusion: The results from the motion-noise biological motion paradigm indicate that in the presence of visual motion noise, the processing of biological motion information in schizophrenia is deficient. Combined with the results of poor basic visual motion perception (coherent motion task) and biological motion recognition, the association between basic motion signals and biological motion perception suggests a need to incorporate the improvement of visual motion perception in social cognitive remediation.

Recognizing Biological Motion and Emotions from Point-Light Displays in Autism Spectrum Disorders

One of the main characteristics of Autism Spectrum Disorder (ASD) are problems with social interaction and communication. Here, we explored ASD-related alterations in ‘reading’ body language of other humans. Accuracy and reaction times were assessed from two observational tasks involving the recognition of ‘biological motion’ and ‘emotions’ from point-light displays (PLDs). Eye movements were recorded during the completion of the tests. Results indicated that typically developed-participants were more accurate than ASD-subjects in recognizing biological motion or emotions from PLDs. No accuracy differences were revealed on two control-tasks (involving the indication of color-changes in the moving point-lights). Group differences in reaction times existed on all tasks, but effect sizes were higher for the biological and emotion recognition tasks. Biological motion recognition abilities were related to a person’s ability to recognize emotions from PLDs. However, ASD-related atypicalities in emotion recognition could not entirely be attributed to more basic deficits in biological motion recognition, suggesting an additional ASD-specific deficit in recognizing the emotional dimension of the point light displays. Eye movements were assessed during the completion of tasks and results indicated that ASD-participants generally produced more saccades and shorter fixation-durations compared to the control-group. However, especially for emotion recognition, these altered eye movements were associated with reductions in task-performance.

Local-to-global form interference in biological motion perception

Point-light walkers have been useful to study the contribution of form and motion to biological motion perception by manipulating the lifetime, number, or spatial distribution of the light points. Recent studies have also manipulated the light points themselves, replacing them with small images of objects. This manipulation degraded the recognizability of biological motion, particularly for local images of human bodies. This result suggests an interference of body form information in the local images with the body form analysis necessary for global biological motion recognition at the global level. We further explored this interference with respect to its selectivity for body orientation and motion. Participants had to either discriminate the facing direction (left/right) or the walking direction (forward/backward) of a global walker composed of local stick figures that could face left or right and either stand still or walk forward or backward. Local stick figures interfered stronger with the facing direction task if they were facing in the same direction as the global walker. Walking (forward/backward/static) of the stick figures influenced neither the facing direction task nor the walking direction task. We conclude that the interference is highly specific since it concerns not only the category (human form), but even the facing direction.

The Inversion Effect: Biological Motion and Gender Recognition

The Inversion Effect: Biological Motion and Gender Recognition

Magnetoencephalography Study of Right Parietal Lobe Dysfunction of the Evoked Mirror Neuron System in Antipsychotic-Free Schizophrenia

IntroductionPatients with schizophrenia commonly exhibit deficits of non-verbal communication in social contexts, which may be related to cognitive dysfunction that impairs recognition of biological motion. Although perception of biological motion is known to be mediated by the mirror neuron system, there have been few empirical studies of this system in patients with schizophrenia.MethodsUsing magnetoencephalography, we examined whether antipsychotic-free schizophrenia patients displayed mirror neuron system dysfunction during observation of biological motion (jaw movement of another individual).ResultsCompared with normal controls, the patients with schizophrenia had fewer components of both the waveform and equivalent current dipole, suggesting aberrant brain activity resulting from dysfunction of the right inferior parietal cortex. They also lacked the changes of alpha band and gamma band oscillation seen in normal controls, and had weaker phase-locking factors and gamma-synchronization predominantly in right parietal cortex.ConclusionsOur findings demonstrate that untreated patients with schizophrenia exhibit aberrant mirror neuron system function based on the right inferior parietal cortex, which is characterized by dysfunction of gamma-synchronization in the right parietal lobe during observation of biological motion.

Feature-based attention promotes biological motion recognition

Motion perception is important for visually segregating and identifying objects from their surroundings, but in some cases extracting motion cues can be taxing to the human attention system. We measured the strength of feature salience required for individuals to correctly judge three types of moving events: biological motion, coherent motion, and multiple object tracking. The motion animations were embedded within a larger Gabor grid and constructed such that motion was conveyed by a salient single-feature dimension (second order) or by alternating across equisalient feature dimensions (third order). In the single-feature displays, we found biological motion to require less difference in the Gabor features (relative to background) to yield equivalent task performance as the coherent motion or multiple object tracking. This main effect of feature magnitude may reflect the inherent salience of biological motion as a visual stimulus. In the alternating-feature displays, both the biological motion and coherent motion discriminations needed additional salience, as compared to the single-feature displays, to achieve threshold discrimination levels. Accuracy in the multiple object tracking task did not vary as a function of salience. Together, these findings demonstrate the effectiveness with which attention-based motion mechanisms operate in complex dynamic sequences and argue for a critical role of feature-based attention in promoting biological motion perception.

Attention, biological motion, and action recognition

Interacting with others in the environment requires that we perceive and recognize their movements and actions. Neuroimaging and neuropsychological studies have indicated that a number of brain regions, particularly the superior temporal sulcus, are involved in a number of processes essential for action recognition, including the processing of biological motion and processing the intentions of actions. We review the behavioral and neuroimaging evidence suggesting that while some aspects of action recognition might be rapid and effective, they are not necessarily automatic. Attention is particularly important when visual information about actions is degraded or ambiguous, or if competing information is present. We present evidence indicating that neural responses associated with the processing of biological motion are strongly modulated by attention. In addition, behavioral and neuroimaging evidence shows that drawing inferences from the actions of others is attentionally demanding. The role of attention in action observation has implications for everyday social interactions and workplace applications that depend on observing, understanding and interpreting actions.

Adaptation to biological motion leads to a motion and a form aftereffect

Recent models have proposed a two-stage process of biological motion recognition. First, template or snapshot neurons estimate the body form. Then, motion is estimated from body form change. This predicts separate aftereffects for body form and body motion. We tested this prediction. Observers viewing leftward- or rightward-facing point-light walkers that walked forward or backward subsequently experienced oppositely directed aftereffects in stimuli ambiguous in the facing or the walking direction. These aftereffects did not originate from adaptation to the motion of the individual light points, because they occurred for limited-lifetime stimuli that restrict local motion. They also occurred when the adaptor displayed a random sequence of body postures that did not induce the walking motion percept. We thus conclude that biological motion gives rise to separate form and motion aftereffects and that body form representations are involved in biological motion perception.