Emotional Facial Expressions Research Articles

Facial mimicry and metacognitive judgments in emotion recognition are distinctly modulated by social anxiety and autistic traits

Facial mimicry as well as the accurate assessment of one's performance when judging others’ emotional expressions have been suggested to inform successful emotion recognition. Differences in the integration of these two information sources might explain alterations in the perception of others’ emotions in individuals with Social Anxiety Disorder and individuals on the autism spectrum. Using a non-clinical sample (N = 57), we examined the role of social anxiety and autistic traits in the link between facial mimicry, or confidence in one’s performance, and emotion recognition. While participants were presented with videos of spontaneous emotional facial expressions, we measured their facial muscle activity, asked them to label the expressions and indicate their confidence in accurately labelling the expressions. Our results showed that confidence in emotion recognition was lower with higher social anxiety traits even though actual recognition was not related to social anxiety traits. Higher autistic traits, in contrast, were associated with worse recognition, and a weakened link between facial mimicry and performance. Consequently, high social anxiety traits might not affect emotion recognition itself, but the top-down evaluation of own abilities in emotion recognition contexts. High autistic traits, in contrast, may be related to lower integration of sensorimotor simulations, which promote emotion recognition.

Adults with a history of childhood maltreatment with and without mental disorders show alterations in the recognition of facial expressions

ABSTRACT Background: Individuals with child maltreatment (CM) experiences show alterations in emotion recognition (ER). However, previous research has mainly focused on populations with specific mental disorders, which makes it unclear whether alterations in the recognition of facial expressions are related to CM, to the presence of mental disorders or to the combination of CM and mental disorders, and on ER of emotional, rather than neutral facial expressions. Moreover, commonly, recognition of static stimulus material was researched. Objective: We assessed recognition of dynamic (closer to real life) negative, positive and neutral facial expressions in individuals characterised by CM, rather than a specific mental disorder. Moreover, we assessed whether they show a negativity bias for neutral facial expressions and whether the presence of one or more mental disorders affects recognition. Methods: Ninety-eight adults with CM experiences (CM+) and 60 non-maltreated (CM−) adult controls watched 200 non-manipulated coloured video sequences, showing 20 neutral and 180 emotional facial expressions, and indicated whether they interpreted each expression as neutral or as one of eight emotions. Results: The CM+ showed significantly lower scores in the recognition of positive, negative and neutral facial expressions than the CM− group (p < .050). Furthermore, the CM+ group showed a negativity bias for neutral facial expressions (p < .001). When accounting for mental disorders, significant effects stayed consistent, except for the recognition of positive facial expressions: individuals from the CM+ group with but not without mental disorder scored lower than controls without mental disorder. Conclusions: CM might have long-lasting influences on the ER abilities of those affected. Future research should explore possible effects of ER alterations on everyday life, including implications of the negativity bias for neutral facial expressions on emotional wellbeing and relationship satisfaction, providing a basis for interventions that improve social functioning.

Ostracism modulates children's recognition of emotional facial expressions.

Ostracism has been shown to induce considerable physiological, behavioral and cognitive changes in adults. Previous research demonstrated its effects on children's cognitive and behavioral abilities, but less is known about its impact on their capacity to recognize subtle variations in social cues. The present study aimed at investigating whether social manipulations of inclusion and ostracism modulate emotion recognition abilities in children, and whether this modulation varies across childhood. To do so, 5- and 10-year-old children participated in a computer-based ball tossing game called Cyberball during which they were either included or ostracized. Then, they completed a facial emotion recognition task in which they were required to identify neutral facial expressions, or varying levels of intensity of angry and fearful facial expressions. Results indicated lower misidentification rates for children who were previously ostracized as compared to children who were previously included, both at 5 and 10 years of age. Moreover, when looking at children's accuracy and sensitivity to facial expressions, 5-year-olds' decoding abilities were affected by the social manipulation, while no difference between included and ostracized participants was observed for 10-year-olds. In particular, included and ostracized 10-year-old children as well as ostracized 5-year-olds showed higher accuracy and sensitivity for expressions of fear as compared to anger, while no such difference was observed for included 5-year-olds. Overall, the current study presents evidence that Cyberball-induced inclusion and ostracism modulate children's recognition of emotional faces.

Facial and Vocal Emotion Recognition in Adolescence: A Systematic Review

AbstractThe ability to recognize emotion is important to wellbeing and building relationships with others, making this skill important in adolescence. Research investigating adolescents’ ability to recognize facial and vocal emotion expressions has reported differing conclusions about the pattern of emotion recognition across this developmental period. This systematic review aimed to clarify the pattern of recognition for facial and vocal emotion expressions, and the relationship of performance to different task and emotion expression characteristics. A comprehensive and systematic search of the literature was conducted using six databases. To be eligible for inclusion, studies had to report data for adolescents between 11 and 18 years of age and measure accuracy of the recognition of emotion cues in either the face or voice. A total of 2333 studies were identified and 47 met inclusion criteria. The majority of studies focused on facial emotion recognition. Overall, early, mid-, and late-adolescents showed a similar pattern of recognition for both facial and vocal emotion expressions with the exception of Sad facial expressions. Sex of the participant also had minimal impact on the overall recognition of different emotions. However, analysis showed considerable variability according to task and emotion expression characteristics. Future research needs to increase focus on recognition of complex emotions, and low-intensity emotion expressions as well as the influence of the inclusion of Neutral as a response option.

Pain and related suffering reduce attention toward others.

It has been proposed that the expression of pain-related suffering may lead to an enhanced focus on oneself and reduced attention toward the external world. This study aimed at investigating whether experimentally induced painrelated suffering may lead persons to withdraw into themselves, causing a reduced focus on external stimuli as reflected by impaired performance in a facial recognition task and heightened perception of internal stimuli measured by interoceptive awareness. Thirty-two participants had to recognize different emotional facial expressions (neutral, sad, angry, happy), or neutral geometrical figures under conditions of no pain, low, and high prolonged pain intensities. Interoceptive accuracy was measured using a heartbeat-detection task prior to and following the pain protocol. Males but not females were slower to recognize facial expressions under the condition of high painful stimulation compared to the condition of no pain. In both, male and female participants, the difficulty in recognizing another person's emotions from a facial expression was directly related to the level of suffering and unpleasantness experienced during pain. Interoceptive accuracy was higher after the pain experiment. However, neither the initial interoceptive accuracy nor the change were significantly related to the pain ratings. Our results suggest that long-lasting and intense painful stimuli, which induce suffering, lead to attentional shifts leading to withdrawal from others. These findings contribute to a better understanding of the social dynamics of pain and pain-related suffering.

Control over emotional facial expressions: Evidence from facial EMG and ERPs in a Stroop-like task

Facial expressions carry important social signals that must be precisely regulated despite potentially conflicting demands on veridicality, communicative intent, and the social situation. In a sample of 19 participants we investigated the challenges of deliberately controlling two facial expressions (smiles and frowns) by the emotional congruency with the expressions of adult and infant counterparts. In a Stroop-like task requiring participants’ deliberate expressions of anger or happiness, we investigated the impact of task-irrelevant background pictures of adults and infants showing negative, neutral, or positive facial expressions. Participants’ deliberate expressions were measured with electromyogram (EMG) of the M. zygomaticus major and M. corrugator supercilii. The latencies of EMG onsets revealed similar congruency effects for smiles and frowns with significant facilitation and inhibition components relative to the neutral condition. Interestingly, the facilitation effect for frown responses by negative facial expressions was significantly smaller vis a vis infant as compared to adult background faces. This diminished facilitation of frowns by infant’s expressions of distress may relate to the activation of caregiver behavior or empathy. We investigated the neural correlates of the observed performance effects by recording event-related-potentials (ERPs). Increased amplitudes in ERP components were observed in incongruent relative to neutral conditions, revealing interference effects on both types of deliberate facial expressions, at different processing stages, namely, structural facial encoding (N170), conflict monitoring (N2), to semantic analysis (N400).

Time to Smile: How Onset Asynchronies Between Reciprocal Facial Expressions Influence the Experience of Responsiveness of a Virtual Agent

Human social interactions are highly coordinated in time and involve the reciprocal exchange of facial emotional expressions. While timing has been identified as an important factor in social communication via gaze or speech, so far there has been no systematic investigation on how the temporal delays in the exchange of facial emotional expressions between interactive partners influence the experience of responsiveness. In the present study, 40 participants were cued to direct a facial emotional expression (angry or happy) towards a virtual agent in front of them and the virtual agent would then react with a congruent facial expression. The temporal delay between the cue and the reaction was manipulated as an independent variable. Exact delays between facial expressions were determined based on the onset latencies of participants’ facial expressions measured via facial EMG (M. Zygomaticus and M. Corrugator). Ratings of experienced responsiveness of the virtual agent were collected as a dependent measure. Using a linear mixed effect model in a growth curve analysis revealed that experienced responsiveness peaked at delays around 700 ms. Moreover, experienced responsiveness at shorter temporal delays was higher when happy versus angry facial expressions were exchanged, while the reversed pattern was found at longer delays. Our results demonstrate a crucial role of timing in non-verbal communication, suggesting that temporal relations between facial expressions are processed as social information. Furthermore, our results can inform the implementation of virtual social interactions.

Exploring Preschoolers' Emotions in Pediatric Dentistry.

Emotion is a feeling that someone can feel. Emotions are generally shown through behavior or facial expressions. Emotions are essential for dental treatment because there is a relation between the emotions felt by children and the success of the dental treatment that the dentist will give. This study aimed to describe variables of emotions about dental treatment. Descriptive analysis using a convenience nonrandom sampling technique was conducted on 58 preschool children aged 3 to 6 years old who came for dental treatment at the Bandung Dental Center in Bandung, Indonesia. The instrument used to ask children how they feel about dental care is a 7-item questionnaire derived from the children's fear survey scale-dental subscale. Meanwhile, the media used by children to respond was a card with facial expressions from the Facial Expression Emotion Scale. The results showed that only participants aged 4 responded with one type of emotion (happy), while the other age groups gave various emotional responses. Fear emotion began to appear in the age group of 5 and 6 years and only in girls, while emotions of anger also appeared in girls and only at the age of 5. In this study, the emotions that children choose about dental care at the Bandung Dental Center clinic are happy emotions. The emotions of fear and sadness were chosen more by girl participants, while none of the boy participants chose the emotion of fear. This sad and fearful response is associated with invasive dental treatment. Anger was chosen as a child's response dominantly because of the parents' invitation to the dentist.

Botulinum Toxin Therapy for Psychiatric Disorders in Clinical Practice: A Retrospective Case Study.

Inhibiting the facial expression of negative emotions via botulinum toxin A (BTX) has been shown to mitigate symptoms of clinical depression in randomized controlled trials. This retrospective case study sought to reproduce the beneficial effects of BTX in a naturalistic setting for major depressive disorder and collect casuistic data on its effect on other mental disorders. Moreover, we describe symptom development across multiple treatment cycles with BTX, and assess the implementation of additional injection targets in the lower face region. Participants were N = 51 adult psychiatric outpatients mainly seeking treatment for depression. Over 50% suffered from comorbid psychiatric conditions, predominantly generalized anxiety disorder (GAD) or borderline personality disorder (BPD). A pre-post case series design was adapted. All participants received BTX-injections in the glabellar region on at least one occasion. Some received additional injections in the mouth region and over multiple treatment cycles. Treatment response was followed up by self-rated scales at varying time intervals post treatment. The results showed that BTX may yield favorable outcomes across multiple and comorbid mental disorders, especially, however, for patients suffering from depression. It potentially prevents the recurrence of clinical symptoms if applied regularly. Adding additional regions of the face does not seem to be superior over applying it to the glabellar region alone. The results add to the growing evidence that BTX therapy is effective in alleviating symptoms of depression. Positive effects can be sustained and reinstated, when applied over multiple treatment cycles. Observed symptom reduction in other psychiatric disorders was less pronounced. Further research is needed to understand the mechanisms by which BTX therapy reduces psychiatric symptoms.

Masking our emotions: Emotion recognition and perceived intensity differ by race and use of medical masks.

Although medical masks have played a key role in decreasing the transmission of communicable disease, they simultaneously reduce the availability of nonverbal cues fundamental to social interaction. In the present study, we determined the collective impact of medical masks on emotional expression recognition and perceived intensity as a function of actor race. Participants completed an emotional expression recognition task involving stimuli with or without medical masks. Across six basic emotional facial expressions, medical masks were associated with significantly more emotional expression recognition errors. Overall, the effects associated with race varied depending on the emotion and appearance of masks. Whereas recognition accuracy was higher for White relative to Black actors for anger and sadness, the opposite pattern was observed for disgust. Medical mask-wearing exacerbated actor-race related recognition differences for anger and surprise, but attenuated these differences for fear. Emotional expression intensity ratings were significantly reduced for all emotions except fear, where masks were associated with increased perceived intensity. Masks further increased already higher intensity ratings for anger in Black versus White actors. In contrast, masks eliminated the tendency to give higher intensity ratings for Black versus White sad and happy facial expressions. Overall, our results suggest that the interaction between actor race and mask wearing status with respect to emotional expression judgements is complex, varying by emotion in both direction and degree. We consider the implications of these results particularly in the context of emotionally charged social contexts, such as in conflict, healthcare, and policing.

Images, Emotions, and Credibility: Effect of Emotional Facial Expressions on Perceptions of News Content Bias and Source Credibility in Social Media

Images are an indispensable part of the news we consume. Highly emotional images from mainstream and misinformation sources can greatly influence our trust in the news. We present two studies on the effects of emotional facial images on users' perception of bias in news content and the credibility of sources. In study 1, we investigate the impact of repeated exposure to content with images containing positive or negative facial expressions on users’ judgements of source credibility and bias. In study 2, we focus on sources' systematic emotional portrayal of specific politicians. Our results show the presence of negative (angry) facial emotions can lead to perceptions of higher bias in content. We also find that systematic portrayal negative portrayal of different politicians leads to lower perceptions of source credibility. These results highlight how implicit visual propositions manifested by emotions in facial expressions might have a substantial effect on our trust in news.

Dissociating affective and perceptual effects of schematic faces on attentional scope.

Attention allocation to positive and negative stimuli differs. For example, the flanker-interference asymmetry describes a pattern of results on flanker tasks using emotional stimuli, where a typical flanker-interference effect is observed for positive targets but not for negative targets. There are two dominant explanations for the flanker-interference asymmetry. According to the emotion-first explanation, negative targets are preferentially processed to facilitate the processing of potentially threatening stimuli. In contrast, feature-first explanations argue that the asymmetry results from differences in perceptual complexity between positive and negative stimuli. Three experiments used schematic emotional faces in a flanker task to directly compare these explanations. To manipulate the perceptual complexity of the stimuli, an enclosing circle was present on half of the trials. In all three experiments, reaction times showed the expected flanker-interference asymmetry, but the pattern was not influenced by the presence of the circle. However, event-related potentials showed that perceptual complexity influenced both the structural encoding and evaluative processing of the faces in the N170 and P3b time windows. These results suggest that both perceptual complexity and emotional valence play an important role in the processing of schematic emotional faces, but that emotional valence may have a stronger effect at evaluative stages of processing. Other findings show that the enclosing circle may alter the perceived emotional expression of neutral faces. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A smile is not a smile: Implicit social motives moderate the impact of facial expressions of emotion on effort-related cardiovascular reactivity

A smile is not a smile: Implicit social motives moderate the impact of facial expressions of emotion on effort-related cardiovascular reactivity

Breathing in through the nose facilitates discrimination of emotional facial expressions

Breathing in through the nose facilitates discrimination of emotional facial expressions

An examination of autonomic and facial responses to prototypical facial emotion expressions in psychopathy

An examination of autonomic and facial responses to prototypical facial emotion expressions in psychopathy

Infrequent facial expressions of emotion do not bias attention.

Despite the obvious importance of facial expressions of emotion, most studies have found that they do not bias attention. A critical limitation, however, is that these studies generally present face distractors on all trials of the experiment. For other kinds of emotional stimuli, such as emotional scenes, infrequently presented stimuli elicit greater attentional bias than frequently presented stimuli, perhaps due to suppression or habituation. The goal of the current study then was to test whether such modulation of attentional bias by distractor frequency generalizes to facial expressions of emotion. In Experiment 1, both angry and happy faces were unable to bias attention, despite being infrequently presented. Even when the location of these face cues were more unpredictable-presented in one of two possible locations-still no attentional bias was observed (Experiment 2). Moreover, there was no bottom-up influence for angry and happy faces shown under high or low perceptual load (Experiment 3). We conclude that task-irrelevant posed facial expressions of emotion cannot bias attention even when presented infrequently.

Effects of fearful face presentation time and observer’s eye movement on the gaze cue effect

BackgroundThere are many conflicting findings on the gaze cueing effect (GCE) of emotional facial expressions. This study aimed to investigate whether an averted gaze, accompanied by a fearful expression of different durations, could enhance attentional orientation, as measured by a participant’s eye movements.MethodsTwelve participants (3 females) completed the gaze cue task, reacting to a target location after observing changes in the gaze and expression of a face illustrated on a computer screen. Meanwhile, participants’ eye movements were monitored by electrooculography. The GCE was calculated by reaction time as an indicator of attention shift.ResultsThe analysis of the overall data did not find a significant effect of fearful facial expressions on the GCE. However, analysis of trial data that excluded a participant’s eye movement data showed that brief (0, 100 ms) presentation of the fearful facial expression enhanced the GCE compared to that during a neutral facial expression, although when the presentation time of the fearful expression was increased to 200 or 400 ms, the GCE of the fearful expression was at the same level as when model showed a neutral expression.ConclusionsThe results suggest that the attention-enhancing effect of gaze cues induced by rapidly presented fearful expressions occurs only when the effect of eye movement trials is excluded. This effect may be mediated by reflexively neural circuits in the amygdala that process threatening stimuli. However, as the expression duration increased, the fearful expression’s attention-enhancing effect decreased. We suggest that future studies on the emotion modulation of GCE should consider the negative effects of participants’ saccades and blinks on the experimental results.

Toward an integrative socio-cognitive approach in autism spectrum disorder: NEAR method adaptation-study protocol.

BackgroundThe cognitive impairments exhibited by people with ASD, threaten the development of social skills that are essential for establishing and maintaining harmonious social relationships. Cognitive remediation and social skills training are now considered as crucial therapeutic approaches in the management of these disorders. Several programs have already been validated and have shown improvements in social skills or cognitive performance. However, the effects of these training methods seem to be difficult to generalize to other everyday life. The aim of our study is to alleviate cognitive and social deficiencies by using a socio-cognitive framework to adapt the Neuropsychological Educational Approach to Remediation (NEAR) method for adolescents with ASD.Methods/designAdolescents meeting the DSM-5 criteria for ASD, older than 13 years, and following a regular school curriculum will be recruited from clinical population at the Child and Adolescent Psychiatry in Razi University Hospital-Manouba- Tunisia. Our study is an open and non-randomized controlled trial including 30 patients: NEAR group / control group. The NEAR method combines computerized cognitive exercises and bridging groups inspired from cognitive behavioral therapy. NEAR group will be divided into three groups of five patients each. The duration of the sessions will vary according to the capacities of the participants and the exchanges between them (about 60–120 min). In our study, bridging groups will be amended by adding other tasks including planning role plays and scenarios of problematic social situations in autism, taking into account cultural particularities in order to promote social skills. Computerized exercises will be enriched by adding other tasks aiming to improve the recognition and expression of facial emotions by using digital videos and photographs expressing the six basic emotions. The duration of the program will be about 6 months. All selected patients will have an assessment of cognitive function: social cognition, neurocognition and pragmatic skills, social skills, self-esteem and global functioning at baseline, 1 week after the end of the NEAR program and 6 months later.ConclusionThis adaptive program is a promising socio-cognitive intervention that create new perspectives for adolescents with autism spectrum disorder.

Study on emotion recognition bias in different regional groups

Human-machine communication can be substantially enhanced by the inclusion of high-quality real-time recognition of spontaneous human emotional expressions. However, successful recognition of such expressions can be negatively impacted by factors such as sudden variations of lighting, or intentional obfuscation. Reliable recognition can be more substantively impeded due to the observation that the presentation and meaning of emotional expressions can vary significantly based on the culture of the expressor and the environment within which the emotions are expressed. As an example, an emotion recognition model trained on a regionally-specific database collected from North America might fail to recognize standard emotional expressions from another region, such as East Asia. To address the problem of regional and cultural bias in emotion recognition from facial expressions, we propose a meta-model that fuses multiple emotional cues and features. The proposed approach integrates image features, action level units, micro-expressions and macro-expressions into a multi-cues emotion model (MCAM). Each of the facial attributes incorporated into the model represents a specific category: fine-grained content-independent features, facial muscle movements, short-term facial expressions and high-level facial expressions. The results of the proposed meta-classifier (MCAM) approach show that a) the successful classification of regional facial expressions is based on non-sympathetic features b) learning the emotional facial expressions of some regional groups can confound the successful recognition of emotional expressions of other regional groups unless it is done from scratch and c) the identification of certain facial cues and features of the data-sets that serve to preclude the design of the perfect unbiased classifier. As a result of these observations we posit that to learn certain regional emotional expressions, other regional expressions first have to be “forgotten”.

Neurophysiological indices of face processing in people with psychosis and their siblings: An event-related potential study.

People with schizophrenia experience difficulties with social interactions. One contributor to these social deficits is dysfunction in processing facial features and facial emotional expressions. However, it is not known whether face processing deficits are evident in those with other psychotic disorders or in those genetically at-risk for psychosis (i.e., first-degree relatives of those with psychosis). We assessed event-related potentials (ERPs) during a facial and emotion processing task in 100 people with a diagnosis of schizophrenia or another psychotic condition (PSY), 32 of their siblings (SIB) and 45 healthy comparison participants (CTL). In separate blocks, participants identified the sex (male or female) or emotion (happy, angry, neutral) of faces. In a comparison condition, participants indicated whether buildings had one or two floors. ERPs were examined in two stages. First, we compared ERPs across the emotion, sex and building identification conditions. Second, we compared ERPs among the three different facial emotions. PSY exhibited significantly lower amplitudes over parietal-occipital regions between 111 and 151 ms when viewing faces but not buildings than CTL, consistent with a face-selective N170 ERP component deficit. The SIB group was intermediate for faces, but not significantly different than PSY or CTL. During emotion identification, all three groups showed increased N170 amplitudes to angry and happy versus neutral expressions, with no group differences. In follow up analyses, we examined differences between PSY with or without affective psychosis, and differences between those with schizophrenia versus other psychotic disorders; there were no significant differences in these analyses. Face processing deficits assessed with ERPs were observed in a group of diverse psychotic disorders, though deficits were not seen to be modulated by facial emotion expression. Additionally, N170 deficits are not evident in siblings of those with PSY.