Nonverbal Emotional Expressions Research Articles

Emotion expression and cooperation under collective risks

The difficulties associated with solving Humanity's major global challenges have increasingly led world leaders and everyday citizens to publicly adopt strong emotional responses, with either mixed or unknown impacts on others' actions. Here, we present two experiments showing that non-verbal emotional expressions in group interactions play a critical role in determining how individuals behave when contributing to public goods entailing future and uncertain returns. Participants' investments were not only shaped by emotional expressions but also enhanced by anger when compared with joy. Our results suggestthat global coordination may benefit from interaction in which emotion expressions can be paramount.

Trainee psychotherapists' emotion recognition accuracy improves after training: emotion recognition training as a tool for psychotherapy education.

Psychotherapists' emotional and empathic competencies have a positive influence on psychotherapy outcome and alliance. However, it is doubtful whether psychotherapy education in itself leads to improvements in trainee psychotherapists' emotion recognition accuracy (ERA), which is an essential part of these competencies. In a randomized, controlled, double-blind study (N = 68), we trained trainee psychotherapists (57% psychodynamic therapy and 43% cognitive behavioral therapy) to detect non-verbal emotional expressions in others using standardized computerized trainings - one for multimodal emotion recognition accuracy and one for micro expression recognition accuracy - and compared their results to an active control group one week after the training (n = 60) and at the one-year follow up (n = 55). The participants trained once weekly during a three-week period. As outcome measures, we used a multimodal emotion recognition accuracy task, a micro expression recognition accuracy task and an emotion recognition accuracy task for verbal and non-verbal (combined) emotional expressions in medical settings. The results of mixed multilevel analyses suggest that the multimodal emotion recognition accuracy training led to significantly steeper increases than the other two conditions from pretest to the posttest one week after the last training session. When comparing the pretest to follow-up differences in slopes, the superiority of the multimodal training group was still detectable in the unimodal audio modality and the unimodal video modality (in comparison to the control training group), but not when considering the multimodal audio-video modality or the total score of the multimodal emotion recognition accuracy measure. The micro expression training group showed a significantly steeper change trajectory from pretest to posttest compared to the control training group, but not compared to the multimodal training group. However, the effect vanished again until the one-year follow-up. There were no differences in change trajectories for the outcome measure about emotion recognition accuracy in medical settings. We conclude that trainee psychotherapists' emotion recognition accuracy can be effectively trained, especially multimodal emotion recognition accuracy, and suggest that the changes in unimodal emotion recognition accuracy (audio-only and video-only) are long-lasting. Implications of these findings for the psychotherapy education are discussed.

Subjective experience, self-efficacy, and motivation of professional football referees during the COVID-19 pandemic

The present multi-study article investigates the subjective experience of professional football (a.k.a. soccer) referees and players during the COVID-19 pandemic and the so-called ghost games (i.e., games without supporters). Referees from the Austrian Football Association completed questionnaires inquiring about self-efficacy, motivation, and general personal observations and perceptions (e.g., arousal or confidence). In addition, two players and one referee in the Austrian Football Bundesliga were interviewed retrospectively regarding their subjective experience during ghost games and the effects of emotions on behavior and performance using semi-structured, video-taped interviews. Results of the referee survey indicate that the most profound differences between regular games and ghost games lie in the domain of intrinsic motivation and multiple aspects of subjective experience. Specifically, the experience in ghost games compared with regular games was reported by referees as being significantly less motivating, less excited/tense, less emotional, less focused, and overall, more negative, despite being easier to referee and the players behaving more positively. Qualitative analyses of the video-taped interview footage indicated (i) substantial inter-individual variability regarding the extent of the effect of the empty stadiums on the subjective experience of emotions, (ii) consequently, different strategies to regulate emotions and arousal from suboptimal to optimal levels, both before and during competition, and (iii) interactions between reported emotions, arousal, motivation, self-confidence, behavior and performance on the pitch. In addition, non-verbal expressions of emotion were captured using fully automated AI-software that coded facial movements during interviews. The results of this exploratory facial expression analysis revealed varying degrees of arousal and valence in relation to the content of the statements during the interviews, demonstrating the convergent validity of our findings. Our findings contribute to the growing literature on the effects of football games without fans during the COVID-19 pandemic and provide insights into the subjective experience of professional football referees. Concerning referees and players alike, emotions are investigated as potential processes related to home-field advantage and performance in professional football by means of a multi-methods approach. Further, the combination of qualitative and quantitative measures—as well as verbal and non-verbal communication channels—can deepen our understanding of the emotional influence of (missing) spectators on the subjective experience and the behavior of sports professionals is discussed.

Validation and application of the Non-Verbal Behavior Analyzer: An automated tool to assess non-verbal emotional expressions in psychotherapy

Emotions play a key role in psychotherapy. However, a problem with examining emotional states via self-report questionnaires is that the assessment usually takes place after the actual emotion has been experienced which might lead to biases and continuous human ratings are time and cost intensive. Using the AI-based software package Non-Verbal Behavior Analyzer (NOVA), video-based emotion recognition of arousal and valence can be applied in naturalistic psychotherapeutic settings. In this study, four emotion recognition models (ERM) each based on specific feature sets (facial: OpenFace, OpenFace-Aureg; body: OpenPose-Activation, OpenPose-Energy) were developed and compared in their ability to predict arousal and valence scores correlated to PANAS emotion scores and processes of change (interpersonal experience, coping experience, affective experience) as well as symptoms (depression and anxiety in HSCL-11). A total of 183 patient therapy videos were divided into a training sample (55 patients), a test sample (50 patients), and a holdout sample (78 patients). The best ERM was selected for further analyses. Then, ERM based arousal and valence scores were correlated with patient and therapist estimates of emotions and processes of change. Furthermore, using regression models arousal and valence were examined as predictors of symptom severity in depression and anxiety. The ERM based on OpenFace produced the best agreement to the human coder rating. Arousal and valence correlated significantly with therapists' ratings of sadness, shame, anxiety, and relaxation, but not with the patient ratings of their own emotions. Furthermore, a significant negative correlation indicates that negative valence was associated with higher affective experience. Negative valence was found to significantly predict higher anxiety but not depression scores. This study shows that emotion recognition with NOVA can be used to generate ERMs associated with patient emotions, affective experiences and symptoms. Nevertheless, limitations were obvious. It seems necessary to improve the ERMs using larger databases of sessions and the validity of ERMs needs to be further investigated in different samples and different applications. Furthermore, future research should take ERMs to identify emotional synchrony between patient and therapists into account.

Nonverbal Emotions While Disclosing Child Abuse: The Role of Interviewer Support.

Statements by alleged victims are important when child abuse is prosecuted; triers-of-fact often attend to nonverbal emotional expressions when evaluating those statements. This study examined the associations among interviewer supportiveness, children's nonverbal emotions, and informativeness during 100 forensic interviews with alleged victims of child abuse. Raters coded the silent videotapes for children's nonverbal emotional expressions while other raters coded the transcripts for interviewer support, children's verbal emotions, and informativeness. Results showed that children's nonverbal signals were more common than and preceded the verbal signs. Interviewer support was associated with children's expressivity. When children expressed more nonverbal emotions, they were more responsive during the pre-substantive phases and more informative about the abuse. Nonverbal emotions partially mediated the association between support and informativeness. The findings underline the value of nonverbal emotional expression during forensic interviews and demonstrate how the interviewers' supportive demeanor can facilitate children's emotional displays and increase informativeness.

The red-beard evolutionary explanation of human sociality

Recent evolutionary studies on cooperation devote specific attention to non-verbal expressions of emotions. In this paper, I examine Robert Frank’s popular attempt to explain emotions, non-verbal markers and social behaviours. Following this line of work, I focus on the green-beard explanation of social behaviours. In response to the criticisms raised against this controversial ultimate explanation, based on resources found in Frank’s work, I propose an alternative red-beard explanation of human sociality. The red-beard explanation explains the emergence and evolution of emotions, a proximate cause, rather than patterns of behaviour. In contrast to simple evolutionary models that invoke a green-beard mechanism, I demonstrate that the red-beard explanation can be evolutionary stable. Social emotions are a common cause of a social behaviour and a phenotypic marker and therefore cooperative behaviour cannot be suppressed without also changing the marker.

Neuropsychological functions of nonverbal hand movements and gestures during sports

ABSTRACT Emotional body-distant gestures are a prominent feature of winning athletes. Because negative emotions have been associated to increased self-touch behaviour, we investigated the hypothesis that athletes change from a more body-distant nonverbal hand movement behaviour when winning to a body-focused behaviour when losing. Nonverbal hand movements of professional right-handed tennis athletes were video-taped during competition and analyzed by certified raters using the NEUROpsychological GESture(NEUROGES)System. The results showed that losing athletes increase their irregular, on body, and phasic on body hand movements, particularly with the left hand. Emotion / attitude rise gestures with the right hand characterised winning athletes. The data suggest that the nonverbal hand movements of athletes serve different neuropsychological functions. Winners nonverbally express their positive feelings by body-distant gestures but change towards their own body to regulate stress when losing. Highlights Irregular, on body, and phasic on body hand movements serve self-regulation when losing during competition Athletes express positive emotions by emotion / attitude rise gestures Nonverbal expression of emotions underlie hemispherically lateralised processes

Emotional intelligence and drawing inferences from nonverbal cues in sports

ABSTRACT We aimed to investigate whether emotional competencies (EC) correlate with the ability to judge or predict the score in sports competitions based on thin slices of nonverbal emotional expressions. We created a German version of the Profile of Emotional Competence (PEC; Brasseur, S., Grégoire, J., Bourdu, R., & Mikolajczak, M. (2013). The Profile of Emotional Competence (PEC): Development and validation of a measure that fits dimensions of Emotional Competence theory. PLoS ONE, 8(5), e62635) and assessed its psychometric properties. In Study 1, 379 participants completed the PEC and rated whether videotaped athletes were leading or trailing. We hypothesised that the ability to distinguish between leading and trailing athletes was predicted by participants’ interpersonal, but not intrapersonal EC. In Study 2, 310 participants completed the PEC, a test assessing individual differences in emotion recognition competence (ERI; Scherer, K. R., & Scherer, U. (2011). Assessing the ability to recognize facial and vocal expressions of emotion: Construction and validation of the emotion recognition index. Journal of Nonverbal Behavior, 35(4), 305–326), and predicted the performance of darts players based on their nonverbal behaviour. In Study 1, we found small correlations between intrapersonal EC and accuracy of score estimates, but no correlations between interpersonal EC and accuracy of score estimates. Contrary to study 1, in study 2, intraindividual EC correlated neither with accuracy of performance predictions nor with ERI scores, whereas interpersonal EC correlated with ERI scores. Our results suggest that further evidence for the validity of EC measures in the context of sports is needed.

Designing Acceptable Robots for Assisting Older Adults: A Pilot Study on the Willingness to Interact.

The aim of this paper was to explore the psychosocial determinants that lead to acceptability and willingness to interact with a service robot, starting with an analysis of older users’ behaviors toward the Robot-Era platform, in order to provide strategies for the promotion of social assistive robotics. A mixed-method approach was used to collect information on acceptability, usability, and human–robot interaction, by analyzing nonverbal behaviors, emotional expressions, and verbal communication. The study involved 35 older adults. Twenty-two were women and thirteen were men, aged 73.8 (±6) years old. Video interaction analysis was conducted to capture the users’ gestures, statements, and expressions. A coded scheme was designed on the basis of the literature in the field. Percentages of time and frequency of the selected events are reported. The statements of the users were collected and analyzed. The results of the behavioral analysis reveal a largely positive attitude, inferred from nonverbal clues and nonverbal emotional expressions. The results highlight the need to provide robotic solutions that respect the tasks they offer to the users It is necessary to give older consumers dedicated training in technological literacy to guarantee proper, long-lasting, and successful use.

Recognition of vocal socioemotional expressions at varying levels of emotional intensity.

Nonverbal expressions of emotion can vary in intensity, from ambiguous to prototypical exemplars: for instance, facial displays of happiness may range from a faint smile to a full-blown grin. Previous work suggests that the accuracy with which facial expressions are recognized as the intended emotion increases with emotional intensity, although this pattern depends on the displayed emotion. Less is known about the association between emotional intensity and the recognition of vocal emotional expressions (affective prosody), which also convey information about others' socioemotional intent but are perceived and interpreted differently than facial expressions. The current study examined listeners' ability to recognize emotional intent in morphed vocal prosody recordings that varied in emotional intensity from neutral to prototypical exemplars of basic emotions (anger, disgust, fear, happiness, sadness) and social expressions (friendliness, meanness). Results suggest that listeners' accuracy in identifying the intended emotional intent in each recording increased nonlinearly with emotional intensity. This pattern varied by emotion type: for instance, accuracy for anger rose steeply with increasing emotional intensity before plateauing, whereas accuracy for happiness remained unchanged across low-intensity exemplars but increased thereafter. These findings highlight emotion-specific ways in which dynamic changes in emotional intensity inform perceptions of socioemotional intent in emotional prosody. Moreover, these results also point to potential challenges in emotional communication in social interactions that rely primarily on the voice, with many low-intensity expressions having a higher probability of being misinterpreted. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Do People Agree on How Positive Emotions Are Expressed? A Survey of Four Emotions and Five Modalities Across 11 Cultures

While much is known about how negative emotions are expressed in different modalities, our understanding of the nonverbal expressions of positive emotions remains limited. In the present research, we draw upon disparate lines of theoretical and empirical work on positive emotions, and systematically examine which channels are thought to be used for expressing four positive emotions: feeling moved, gratitude, interest, and triumph. Employing the intersubjective approach, an established method in cross-cultural psychology, we first explored how the four positive emotions were reported to be expressed in two North American community samples (Studies 1a and 1b: n = 1466). We next confirmed the cross-cultural generalizability of our findings by surveying respondents from ten countries that diverged on cultural values (Study 2: n = 1826). Feeling moved was thought to be signaled with facial expressions, gratitude with the use of words, interest with words, face and voice, and triumph with body posture, vocal cues, facial expressions, and words. These findings provide cross-culturally consistent findings of differential expressions across positive emotions. Notably, positive emotions were thought to be expressed via modalities that go beyond the face.

Impaired recognition of nonverbal expressions of emotions in depressed individuals

IntroductionDepressive individuals are impaired in the recognition of emotions in others’. Recent research suggests that the recognition of nonverbal expressions of emotions in other people may depend on the analysis of bodily rather than facial expressions. Therefore, we investigated if an impaired recognition of emotions by depressed individuals is body part specific. MethodsClinically diagnosed depressed and healthy matched controls were instructed to identify nonverbal expressions of positive (happiness), neutral, and negative emotions (sadness) via the face, the body, or the body and face. ResultsDepressed participants responded significantly less correctly overall when compared to non-depressed individuals. The recognition of nonverbal expressions of happiness by the body negatively predicted the Beck Depression Inventory II (BDI-II) score. DiscussionThe data revealed that the impaired recognition of nonverbal expressions of emotions in others by depressed individuals is not body part specific. Nevertheless, depressive symptoms seem to be related to the recognition of bodily expressions of happiness. Future studies must address whether impairments of depressive individuals are related to nonverbal expressions of the whole body.

Revisiting the Embryology of the Facial Muscles, the Superficial Musculoaponeurotic System, and the Facial Nerve

The facial muscles are responsible for nonverbal expression, and the manner by which these muscles function to express various emotions are reviewed. How one recognizes these various facial expressions and how individuals can alter their facial expression are discussed. The methodology for cataloging facial expressions is also presented. The embryology of the facial muscles; the facial ligaments; and the supporting superficial musculoaponeurotic system, which magnifies the muscle movements, is also reviewed as is the embryology of the facial nerve, which innervates these muscles. Also, a detailed MR imaging atlas of the facial muscles is presented.Learning Objective: The reader will learn how the facial muscles develop and how they are the means of human nonverbal emotional expression. The anatomy of the facial ligaments and the superficial musculoaponeurotic system are also discussed

Psychophysiological Therapy from a Distance: The Art of Sharing

Psychophysiological Therapy from a Distance: The Art of Sharing

Non-verbal Emotional Expressions for Social Presence of Chatbot Interface

Non-verbal Emotional Expressions for Social Presence of Chatbot Interface

Autism, Emotion Recognition and the Mirror Neuron System: The Case of Music

Understanding emotions is fundamental to our ability to navigate and thrive in a complex world of human social interaction. Individuals with Autism Spectrum Disorders (ASD) are known to experience difficulties with the communication and understanding of emotion, such as the nonverbal expression of emotion and the interpretation of emotions of others from facial expressions and body language. These deficits often lead to loneliness and isolation from peers, and social withdrawal from the environment in general. In the case of music however, there is evidence to suggest that individuals with ASD do not have difficulties recognizing simple emotions. In addition, individuals with ASD have been found to show normal and even superior abilities with specific aspects of music processing, and often show strong preferences towards music. It is possible these varying abilities with different types of expressive communication may be related to a neural system referred to as the mirror neuron system (MNS), which has been proposed as deficient in individuals with autism. Music's power to stimulate emotions and intensify our social experiences might activate the MNS in individuals with ASD, and thus provide a neural foundation for music as an effective therapeutic tool. In this review, we present literature on the ontogeny of emotion processing in typical development and in individuals with ASD, with a focus on the case of music.

We don't make WEIRD faces: A brief history of emotion expression research in small-scale societies

Abstract Research in the social sciences has largely relied on Western, Educated, Industrialized, Rich, and Democratic (WEIRD) participants, yet scholars tend to use findings from such WEIRD samples to draw conclusions about human psychology at large. There is, however, one prominent area of psychological science drawing on evolutionary theory that marks a major exception to this trend: research on the nonverbal expression of emotion. We briefly review the major findings from this literature, highlighting the ways in which researchers have effectively used participant samples from “maximally divergent populations” to address questions about universality and, in turn, the evolutionary basis of nonverbal displays.

A Provisional Taxonomy of Subjectively Experienced Positive Emotions.

Over the past two decades, scholars have conducted studies on the subjective experience of over 30 positive emotional states (see Weidman, Steckler, & Tracy, 2017). Yet, evidence from research on the non-verbal expression and biological correlates of positive emotions suggests that people likely experience far fewer than 30 distinct positive emotions. The present research provided an initial, lexically driven examination of how many, and which, positive emotions cohere as distinct subjective experiences, at both the state and trait levels. Four studies (including two pre-registered replications) using factor and network analyses of 5939 participants' emotional experiences, elicited through the relived emotions task, found consistent evidence for nine distinct positive emotion states and five distinct traits. At both levels, many frequently studied positive emotions were found to overlap considerably or entirely with other ostensibly distinct states in terms of the subjective components used to describe them, suggesting that researchers currently study more positive emotions than individuals experience distinctively. These findings provide the first-ever comprehensive portrait of the taxonomic structure of subjectively experienced positive emotions, with the ultimate aim of inspiring further examination of the positive emotion space at the subjective experiential as well as more biological and behavioral levels of analysis.

Claims in Surfing: The Influence of Emotional Postperformance Expressions on Performance Evaluations.

The goal of the present research was to investigate whether claims (postperformance nonverbal emotional expressions) influence people in evaluating performance during surf contests. To test this research question, the authors sampled videos from professional surf contests and asked laypeople (Experiment 1; N = 110) and surf judges (Experiment 2; N = 41) to evaluate the performance in 2 online experiments. A subset of the surfing performances showed surfers displaying postperformance emotional expressions (claims), while another subset showed the same performances without the claims (nonverbal emotional expressions). Both experiments provided evidence that both laypeople and surf judges were biased by claims in judging surfing performances, with claims better than the performances without claims. The findings are in line with social-cognitive models emphasizing the socioconsequences of emotion expressions. The authors discuss the implications of the findings for sport competitions that rely on judging sport performance.

The Impact Of Emotional Intelligence On Leadership Excellence Of Executive Empoloyees In Public Sector Organizationin Ampara District Of Sri Lanka

Emotional Intelligence is play a vital role to decide leadership excellence. So this paper to study the impact of emotional intelligence on leadership excellence of executive employee in public sector organization.Hence the objective of this research is to identify the impact of emotional intelligence on leadership excellence of executive employee in Public Sector Organization in Ampara districtof Sri Lanka.emotional intelligence includes the verbal and non-verbal appraisal and expression of emotion, the regulation of emotion in the self and others, and the utilization of emotional content in problem solving. Cook (2006)[1]. Emotional intelligence is one of the essential skill for leaders to manage their subordinate. Accordingly although there is some research done under “Emotional intelligence on leadership excellence of the executive employee in the public organization in Ampara district so this study full filed the gap. Based on the analysis, Self-awareness, Self-management, Social-awareness and Relationship management are the positively affect to the Leadership excellence. So, executive employees should consider about the Emotions of their subordinators when they completing their targets. leaders should pay the attention for recognize the situation, hove to impact their feelings for the performance & recognized their own feelings. Leaders should consider and see their own emotions when they work with others by listening carefully, understand the person by asking questions, identifying non-verbal expressions and solving problems without helming someone’s. Leadersshould consider their subordinators emotions when they find a common idea, government should give to moderate freedom to executive employees in public organization to take the decision with competing the private sector organizations.