Emotional Body Expressions Research Articles

Amygdala Activation for Eye Contact Despite Complete Cortical Blindness

Cortical blindness refers to the loss of vision that occurs after destruction of the primary visual cortex. Although there is no sensory cortex and hence no conscious vision, some cortically blind patients show amygdala activation in response to facial or bodily expressions of emotion. Here we investigated whether direction of gaze could also be processed in the absence of any functional visual cortex. A well-known patient with bilateral destruction of his visual cortex and subsequent cortical blindness was investigated in an fMRI paradigm during which blocks of faces were presented either with their gaze directed toward or away from the viewer. Increased right amygdala activation was found in response to directed compared with averted gaze. Activity in this region was further found to be functionally connected to a larger network associated with face and gaze processing. The present study demonstrates that, in human subjects, the amygdala response to eye contact does not require an intact primary visual cortex.

Self-Relevance Appraisal Influences Facial Reactions to Emotional Body Expressions

People display facial reactions when exposed to others' emotional expressions, but exactly what mechanism mediates these facial reactions remains a debated issue. In this study, we manipulated two critical perceptual features that contribute to determining the significance of others' emotional expressions: the direction of attention (toward or away from the observer) and the intensity of the emotional display. Electromyographic activity over the corrugator muscle was recorded while participants observed videos of neutral to angry body expressions. Self-directed bodies induced greater corrugator activity than other-directed bodies; additionally corrugator activity was only influenced by the intensity of anger expresssed by self-directed bodies. These data support the hypothesis that rapid facial reactions are the outcome of self-relevant emotional processing.

Effort-Shape Characteristics of Emotion-Related Body Movement

The purpose of this study was to characterize the movement qualities of 5 target emotions during walking. We used an autobiographical memories paradigm for elicitation and observer judgments for emotion recognition. For each of the felt and recognized emotion portrayals, 6 Effort-Shape qualities were judged on a continuum between opposite qualities at the anchor points. Three general categories of movement style emerged, so that anger and joy shared anchor qualities at one end of the continuum, sadness had qualities at the opposite anchor, and content and neutral had qualities between the anchor extremes. The Effort-Shape profiles were unique for each target emotion, however, and mean scores were different between emotions even when emotions shared similar qualities. Emotions were classified using the Effort-Shape scores with accuracies ranging from 74–32 % for sad, anger, content and joy, respectively. For most of the target emotions, decoding accuracy was related to at least 4 Effort-Shape qualities, suggesting that decoding accuracy may be associated with a profile of movement qualities. This study highlights the importance of movement quality in bodily expression of emotion and demonstrates the effectiveness of Effort-Shape analysis in distinguishing among emotion-related movement styles.

Perception of Face and Body Expressions Using Electromyography, Pupillometry and Gaze Measures

Traditional emotion theories stress the importance of the face in the expression of emotions but bodily expressions are becoming increasingly important as well. In these experiments we tested the hypothesis that similar physiological responses can be evoked by observing emotional face and body signals and that the reaction to angry signals is amplified in anxious individuals. We designed three experiments in which participants categorized emotional expressions from isolated facial and bodily expressions and emotionally congruent and incongruent face-body compounds. Participants’ fixations were measured and their pupil size recorded with eye-tracking equipment and their facial reactions measured with electromyography. The results support our prediction that the recognition of a facial expression is improved in the context of a matching posture and importantly, vice versa as well. From their facial expressions, it appeared that observers acted with signs of negative emotionality (increased corrugator activity) to angry and fearful facial expressions and with positive emotionality (increased zygomaticus) to happy facial expressions. What we predicted and found, was that angry and fearful cues from the face or the body, attracted more attention than happy cues. We further observed that responses evoked by angry cues were amplified in individuals with high anxiety scores. In sum, we show that people process bodily expressions of emotion in a similar fashion as facial expressions and that the congruency between the emotional signals from the face and body facilitates the recognition of the emotion.

Modeling and identification of emotional aspects of locomotion

The studies of emotional facial expressions and emotional body language are currently receiving a lot of attention in the cognitive sciences. In this project, we study implicit bodily expression of emotions during standard motions, such as walking forwards.An underlying assumption of our work is that all human motion is optimal in some sense and that different emotions induce different objective functions, which result in different deformations of normal motion.We created a 3D rigid-body model of a human of which we use the forward dynamics simulation in an optimal control context. We performed two kinds of optimizations: (i) reconstruction of dynamic quantities, such as joint torques, of pre-recorded data of emotional walking motions and (ii) forward optimization that generates neutral and varied walking motions using different objective functions. Optimizations are performed with the software package MUSCOD-II, which uses a direct multiple-shooting discretization scheme. The results of this work form the foundation for further analysis of emotional motions using inverse optimal control methods.

Perception of synthetically generated interactive human emotional body expressions

Perception of synthetically generated interactive human emotional body expressions

The neural correlates of affect reading: An fMRI study on faces and gestures

As complex social beings, people communicate, in addition to spoken language, also via nonverbal behavior. In social face-to-face situations, people readily read the affect and intentions of others in their face expressions and gestures recognizing their meaning. Importantly, the addressee further has to discriminate the meanings of the seen communicative motor acts in order to be able to react upon them appropriately. In this functional magnetic resonance imaging study 15 healthy non-alexithymic right-handers observed video-clips that showed the dynamic evolution of emotional face expressions and gestures evolving from a neutral to a fully developed expression. We aimed at disentangling the cerebral circuits related to the observation of the incomplete and the subsequent discrimination of the evolved bodily expressions of emotion which are typical for everyday social situations. We show that the inferior temporal gyrus and the inferior and dorsal medial frontal cortex in both cerebral hemispheres were activated early in recognizing faces and gestures, while their subsequent discrimination involved the right dorsolateral frontal cortex. Interregional correlations showed that the involved regions constituted a widespread circuit allowing for a formal analysis of the seen expressions, their empathic processing and the subjective interpretation of their contextual meanings. Right–left comparisons revealed a greater activation of the right dorsal medial frontal cortex and the inferior temporal gyrus which supports the notion of a right hemispheric dominance for processing affective body expressions. These novel data provide a neurobiological basis for the intuitive understanding of other people which is relevant for socially appropriate decisions and intact social functioning.

Continuous Recognition of Player's Affective Body Expression as Dynamic Quality of Aesthetic Experience

The emergence of full-body computer games raises an interesting question: Can body movement be used to measure the aesthetic experience of players? In this paper, we aim to take a first step toward answering this question. Such a question emerges from the fact that various studies have shown the dual role of body movement, i.e., a window on people's emotional and mental states as well as a means to affect people's cognitive and affective processes. In this paper, first, we investigate the possibility of automatically recognizing the emotional expressions conveyed by the player's body movement in a Nintendo sport game. Our results showed that our automatic recognition system achieved recognition rates comparable to human observers' benchmarks. Second, by taking a pragmatist definition of aesthetic experience into account, we argue that the tracked body expressions do not only express what the player may be feeling. Given their modulating role on cognition and affect, these body expressions also let the player actively construct and assign affective meanings to the unfolding of the game. We argue that the player's variety of emotional bodily expressions constitutes the emotional rhythmic dynamic of aesthetic experience and, as such, they provide a measure of its distinctive quality.

How bodies and voices interact in early emotion perception.

Successful social communication draws strongly on the correct interpretation of others' body and vocal expressions. Both can provide emotional information and often occur simultaneously. Yet their interplay has hardly been studied. Using electroencephalography, we investigated the temporal development underlying their neural interaction in auditory and visual perception. In particular, we tested whether this interaction qualifies as true integration following multisensory integration principles such as inverse effectiveness. Emotional vocalizations were embedded in either low or high levels of noise and presented with or without video clips of matching emotional body expressions. In both, high and low noise conditions, a reduction in auditory N100 amplitude was observed for audiovisual stimuli. However, only under high noise, the N100 peaked earlier in the audiovisual than the auditory condition, suggesting facilitatory effects as predicted by the inverse effectiveness principle. Similarly, we observed earlier N100 peaks in response to emotional compared to neutral audiovisual stimuli. This was not the case in the unimodal auditory condition. Furthermore, suppression of beta–band oscillations (15–25 Hz) primarily reflecting biological motion perception was modulated 200–400 ms after the vocalization. While larger differences in suppression between audiovisual and audio stimuli in high compared to low noise levels were found for emotional stimuli, no such difference was observed for neutral stimuli. This observation is in accordance with the inverse effectiveness principle and suggests a modulation of integration by emotional content. Overall, results show that ecologically valid, complex stimuli such as joined body and vocal expressions are effectively integrated very early in processing.

A Computational Feedforward Model Predicts Categorization of Masked Emotional Body Language for Longer, but Not for Shorter, Latencies

Given the presence of massive feedback loops in brain networks, it is difficult to disentangle the contribution of feedforward and feedback processing to the recognition of visual stimuli, in this case, of emotional body expressions. The aim of the work presented in this letter is to shed light on how well feedforward processing explains rapid categorization of this important class of stimuli. By means of parametric masking, it may be possible to control the contribution of feedback activity in human participants. A close comparison is presented between human recognition performance and the performance of a computational neural model that exclusively modeled feedforward processing and was engineered to fulfill the computational requirements of recognition. Results show that the longer the stimulus onset asynchrony (SOA), the closer the performance of the human participants was to the values predicted by the model, with an optimum at an SOA of 100 ms. At short SOA latencies, human performance deteriorated, but the categorization of the emotional expressions was still above baseline. The data suggest that, although theoretically, feedback arising from inferotemporal cortex is likely to be blocked when the SOA is 100 ms, human participants still seem to rely on more local visual feedback processing to equal the model's performance.

Music: a unique window into the world of autism

Understanding emotions is fundamental to our ability to navigate the complex world of human social interaction. Individuals with autism spectrum disorders (ASD) experience difficulties with the communication and understanding of emotions within the social domain. Their ability to interpret other people's nonverbal, facial, and bodily expressions of emotion is strongly curtailed. However, there is evidence to suggest that many individuals with ASD show a strong and early preference for music and are able to understand simple and complex musical emotions in childhood and adulthood. The dissociation between emotion recognition abilities in musical and social domains in individuals with ASD provides us with the opportunity to consider the nature of emotion processing difficulties characterizing this disorder. There has recently been a surge of interest in musical abilities in individuals with ASD, and this has motivated new behavioral and neuroimaging studies. Here, we review this new work. We conclude by providing some questions for future directions.

Effort-Shape and kinematic assessment of bodily expression of emotion during gait

The purpose of this study was to identify the movement characteristics associated with positive and negative emotions experienced during walking. Joy, contentment, anger, sadness, and neutral were elicited in 16 individuals, and motion capture data were collected as they walked while experiencing the emotions. Observers decoded the target emotions from side and front view videos of the walking trials; other observers viewed the same videos to rate the qualitative movement features using an Effort-Shape analysis. Kinematic analysis was used to quantify body posture and limb movements during walking with the different emotions. View did not affect decoding accuracy except for contentment, which was slightly enhanced with the front view. Walking speed was fastest for joy and anger, and slowest for sadness. Although walking speed may have accounted for increased amplitude of hip, shoulder, elbow, pelvis and trunk motion for anger and joy compared to sadness, neck and thoracic flexion with sadness, and trunk extension and shoulder depression with joy were independent of gait speed. More differences among emotions occurred with the Effort-Shape rather than the kinematic analysis, suggesting that observer judgments of Effort-Shape characteristics were more sensitive than the kinematic outcomes to differences among emotions.

Methodology for Assessing Bodily Expression of Emotion

The purpose of this study was to develop methods for assessing bodily expression and to provide a preliminary description of movement characteristics associated with positive and negative emotions during a single movement task—knocking. We used an autobiographical memories paradigm for elicitation, observer rating of emotion intensities for recognition, and Effort-Shape and kinematic analyses for movement description. Actors felt the target emotions in nearly all the trials but observers recognized them in relatively few movement trials, especially for the positive emotions. Differences in movement characteristics were identified for the target emotions with both the qualitative and quantitative movement analyses.

Learning and perceiving informative spatio-temporal components from emotional body expressions

Learning and perceiving informative spatio-temporal components from emotional body expressions

Not just the face: asymmetry of emotional body expression

Not just the face: asymmetry of emotional body expression

Inter-hemispheric cooperation for facial and bodily emotional expressions is independent of visual similarities between stimuli

Inter-hemispheric cooperation for facial and bodily emotional expressions is independent of visual similarities between stimuli

Optimal bayesian integration of components during the visual recognition of emotional body expressions

Optimal bayesian integration of components during the visual recognition of emotional body expressions

The neural basis of perceiving emotional bodily expressions in monkeys

Higher animals invest considerable time and brain resources in monitoring each others' body language. A network of dedicated brain structures is presumably involved in social perception. We hypothesized that functional magnetic resonance imaging may reveal portions of inferior temporal cortex participating in processing social signals. We used contrast agent-enhanced awake monkey functional magnetic resonance imaging to test whether subdivisions of inferior temporal cortex are sensitive to emotional body displays of conspecifics, and whether the degree of activation reflects the social intention expressed. We show that portions of superior temporal sulcus play a central role in processing body images of conspecifics and that these areas are preferentially sensitive to threat signals indicating that threat may be the most salient social signal.

Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions

Many studies provide support for the role of the fusiform gyrus in face recognition and its sensitivity to emotional expressions. Recently, category-specific representation was also observed for neutral human bodies in the middle temporal/middle occipital gyrus (extrastriate body area) but it is not clear whether this area is also sensitive to emotional bodily expressions. Besides these areas, other regions that process the affective information carried by the face and the body may be common and/or specific to the face or the body. To clarify these issues we performed a systematic comparison of how the whole brain processes faces and bodies and how their affective information is represented. Participants categorized emotional facial and bodily expressions while brain activity was measured using functional magnetic resonance imaging. Our results show that, first, the amygdala and the fusiform gyrus are sensitive to recognition of facial and bodily fear signals. Secondly, the extrastriate body area–area V5/MT is specifically involved in processing bodies without being sensitive to the emotion displayed. Thirdly, other important areas such as the superior temporal sulcus, the parietal lobe and subcortical structures represent selectively facial and bodily expressions. Finally, some face/body differences in activation are a function of the emotion expressed.

Body expressions influence recognition of emotions in the face and voice.

The most familiar emotional signals consist of faces, voices, and whole-body expressions, but so far research on emotions expressed by the whole body is sparse. The authors investigated recognition of whole-body expressions of emotion in three experiments. In the first experiment, participants performed a body expression-matching task. Results indicate good recognition of all emotions, with fear being the hardest to recognize. In the second experiment, two alternative forced choice categorizations of the facial expression of a compound face-body stimulus were strongly influenced by the bodily expression. This effect was a function of the ambiguity of the facial expression. In the third experiment, recognition of emotional tone of voice was similarly influenced by task irrelevant emotional body expressions. Taken together, the findings illustrate the importance of emotional whole-body expressions in communication either when viewed on their own or, as is often the case in realistic circumstances, in combination with facial expressions and emotional voices.