Recognition Of Emotional Expressions Research Articles

Parenthood status and plasma oxytocin levels predict specific emotion perception abilities.

Superior recognition of positive emotional facial expressions compared to negative expressions is well established. However, it is unclear whether this superiority effect differs between non-parents and parents, for whom emotion perception (EP) is an indispensable skill. Although EP has been shown to be modulated by the neuropeptide oxytocin, a central factor in the development of parental care, very little research has addressed the relationship between EP skills, the transition to parenthood, and plasma oxytocin levels. In the present study, we assessed EP abilities with a test battery and measured plasma oxytocin in 77 non-parent and 79 parent couples and applied structural equation modelling to the data. The results showed increased happiness perception abilities in both parents and individuals with elevated oxytocin levels. Furthermore, non-parents showed superior abilities to recognise anger expressions. No significant associations were found regarding the perception of other basic emotion categories or with a general EP factor. The findings are consistent with previous research indicating that elevated oxytocin levels are associated with enhanced EP abilities. They also extend the existing literature by demonstrating that mothers and fathers, regardless of their oxytocin levels, exhibit increased EP superiority.

Emotional scenes as context in emotional expression recognition: The role of emotion or valence match.

Emotion recognition is influenced by contextual information such as social category cues or background scenes. However, past studies yielded mixed findings regarding whether broad valence or specific emotion matches drive context effects and how multiple sources of contextual information may influence emotion recognition. To address these questions, participants were asked to categorize expressions on male and female faces posing happiness and anger and happiness and fear on pleasant and fearful backgrounds (Experiment 1, conducted in 2019), fearful and disgusted expressions on fear and disgust eliciting backgrounds (Experiment 2, conducted in 2022), and fearful and sad expressions on fear and sadness eliciting backgrounds (Experiment 3, conducted in 2022). In Experiment 1 (where stimuli varied in valence), a broad valence match effect was observed. Faster recognition of happiness than fear and anger was more pronounced in pleasant compared to fearful scenes. In Experiments 2 and 3 (where stimuli were negative in valence), specific emotion match effects were observed. Faster recognition occurred when expression and background were emotionally congruent. In Experiments 1 and 3, poser sex independently moderated emotional expression recognition speed. These results suggest that the effect of emotional scenes on facial emotion recognition is mediated by a match in valence when broad valence is task-relevant. Specific emotion matches drive context effects when participants categorize expressions of a single valence. Looking at the influence of background contexts and poser sex together suggests that these two sources of contextual information have an independent rather than an interactive influence on emotional expression recognition speed. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Comparative study of emotional facial expression recognition among Prader-Willi syndrome subtypes.

Prader-Willi syndrome (PWS) is a congenital disease caused by a rare and generally non-inherited genetic disorder. The inability to recognise facial expressions of emotion is an apparent social cognition deficit in people diagnosed with PWS. The main objective of the present study is to compare the ability to recognise emotional facial expression, in both non-contextualised and contextualised scenarios, among the main subtypes of PWS and a control group. The sample consisted of 46 children divided into three groups: deletion (n=10), maternal uniparental disomy (mUPD) (n=13) and control (n=23). The protocol included the Facially Expressed Emotion Labeling and the Deusto-e-Motion 1.0. The control group recognised facial emotions more accurately and quickly in both non-contextualised and contextualised scenarios than children with PWS, regardless of genetic subtype. Despite no differences being detected between PWS subtypes when non-contextualised scenarios were analysed, in contextualised situations, a longer reaction time was observed in children with the mUPD subtype. This is the first study to assess the ability to recognise emotional facial expressions in contextualised situations among PWS subtypes and a control group. The findings suggest that some of the social cognitive deficits evidenced in children with mUPD PWS may be similar to those in autism spectrum disorder.

The Development of Ambiguity Processing Is Explained by an Inverted U-Shaped Curve.

Understanding the developmental trajectories for recognizing facial expressions is important for a better understanding of development of psychiatric disorders. In this study, we examined the recognition of emotional and neutral facial expressions in 93 typically developing adolescents and adults. The Emotion Intensity Rating task required participants to rate the intensity of emotional expression in happy, neutral, and sad faces on a scale from 1 to 9. A score of '5' had to be assigned to neutral faces, scores between '6' (slightly happy) and '9' (very happy) to happy faces, and scores between '4' (slightly sad) and '1' (very sad) to sad faces. Mixed effects models were used to examine the effects of age and emotion on recognition accuracy, reaction time (RT), and emotional intensity. Participants tended to misjudge neutral faces as sad. Adolescents were less accurate than adults for neutral face recognition. There were significant quadratic effects of age on accuracy (negative quadratic effect) and RT (positive quadratic effect). The most accurate and fastest performance was observed in 25- to 35-year-old subjects. This trajectory may be associated with prefrontal cortex maturation, which provides top-down control over the heightened amygdala response to ambiguity that may be misinterpreted as emotional content.

Recognition of Dynamic Emotional Expressions in Children and Adults and Its Associations with Empathy.

This present study investigates emotion recognition in children and adults and its association with EQ and motor empathy. Overall, 58 children (33 5-6-year-olds, 25 7-9-year-olds) and 61 adults (24 young adults, 37 parents) participated in this study. Each participant received an EQ questionnaire and completed the dynamic emotion expression recognition task, where participants were asked to identify four basic emotions (happy, sad, fearful, and angry) from neutral to fully expressed states, and the motor empathy task, where participants' facial muscle activity was recorded. The results showed that "happy" was the easiest expression for all ages; 5- to 6-year-old children performed equally well as adults. The accuracies for "fearful," "angry," and "sad" expressions were significantly lower in children than in adults. For motor empathy, 7- to 9-year-old children exhibited the highest level of facial muscle activity, while the young adults showed the lowest engagement. Importantly, individual EQ scores positively correlated with the motor empathy index in adults but not in children. In sum, our study echoes the previous literature, showing that the identification of negative emotions is still difficult for children aged 5-9 but that this improves in late childhood. Our results also suggest that stronger facial mimicry responses are positively related to a higher level of empathy in adults.

Gray matter volume alterations in de novo Parkinson's disease: A mediational role in the interplay between sleep quality and anxiety.

Parkinson's disease (PD) is increasingly recognized for its non-motor symptoms, among which emotional disturbances and sleep disorders frequently co-occur. The commonality of neuroanatomical underpinnings for these symptoms is not fully understood. This study is intended to investigate the differences in gray matter volume (GMV) between PD patients with anxiety (A-PD) and those without anxiety (NA-PD). Additionally, it seeks to uncover the interplay between GMV variations and the manifestations of anxiety and sleep quality. A total of 37 A-PD patients, 43 NA-PD patients, and 36 healthy controls (HCs) were recruited, all of whom underwent voxel-based morphometry (VBM) analysis. Group differences in GMV were assessed using analysis of covariance (ANCOVA). Partial correlation between GMV, anxiety symptom, and sleep quality were analyzed. Mediation analysis explored the mediating role of the volume of GMV-distinct brain regions on the relationship between sleep quality and anxiety within the PD patient cohort. A-PD patients showed significantly lower GMV in the fusiform gyrus (FG) and right inferior temporal gyrus (ITG) compared to HCs and NA-PD patients. GMV in these regions correlated negatively with Hamilton Anxiety Rating Scale (HAMA) scores (right ITG: r = -0.690, p < 0.001; left FG: r = -0.509, p < 0.001; right FG: r = -0.576, p < 0.001) and positively with sleep quality in PD patients (right ITG: r = 0.592, p < 0.001; left FG: r = 0.356, p = 0.001; right FG: r = 0.470, p < 0.001). Mediation analysis revealed that GMV in the FG and right ITG mediated the relationship between sleep quality and anxiety symptoms, with substantial effect sizes accounted for by the right ITG (25.74%) and FG (left: 11.90%, right: 15.59%). This study has shed further light on the relationship between sleep disturbances and anxiety symptoms in PD patients. Given the pivotal roles of the FG and the ITG in facial recognition and the recognition of emotion-related facial expressions, our findings indicate that compromised sleep quality, under the pathological conditions of PD, may exacerbate the reduction in GMV within these regions, impairing the recognition of emotional facial expressions and thereby intensifying anxiety symptoms.

Social Skills Development for Students with Autism Spectrum Disorders in Inclusive Classrooms by Social Stories Approach

The research aimed to employ the social story approach to enhance the social skills of students with autism spectrum disorders (ASDs), particularly those in the high-functioning category, within a full inclusion setting. Despite their enrollment in an inclusive classroom, these students encountered challenges related to social skills, including the recognition of emotional expressions, interactions with peers, appropriate behavior in societal settings, collaboration with others, and adherence to social norms. The research utilized the Individual Implementation Plan (IIP) for social stories and a social skill's observation form tailored for students with ASDs. This study employed a single-subject across behaviors, or an A1-B-A2 design, dividing the intervention into three stages: the initial baseline (A1), the subsequent treatment phase (B), and the final withdrawal or post-trial period (A2). The findings indicated that following the implementation of social stories, students with ASDs in inclusive classrooms exhibited significant improvements in recognizing others' emotions and expressions, engaging in social interactions, demonstrating appropriate behavior in various societal contexts, collaborating effectively with peers, and adhering to social rules. Notably, these advancements were most pronounced during the withdrawal or post-trial period (A2).

The role of emotional factors in face processing abilities in autism spectrum conditions

Facial emotion recognition is considered atypical in individuals with autism spectrum conditions (ASC), but emotion recognition abilities vary widely in autistic people, and there are inconsistent findings on the causes of these differences. Research indicates alexithymia may result in facial emotion recognition differences in ASC. Alternatively, mood disorders have been linked to atypical facial emotional expression recognition abilities in neurotypical adults. Investigating both the effects of alexithymia and mood disorders (depression and anxiety) is necessary to establish which of these factors may cause atypical facial emotion recognition in ASC. This study aimed to examine whether alexithymia or mood disorder symptomology is a predictor of atypical facial emotion recognition in individuals with ASC. Ninety-eight non-autistic adults and 80 autistic adults were recruited. Participants completed an online facial processing task to examine emotion and identity recognition abilities, the AQ-28, the TAS-20, and the HADS to measure autism severity, alexithymia symptoms, and depression and anxiety symptoms. Regression-based analyses found that autistic traits and autistic group membership did not predict facial emotion processing abilities after accounting for demographic variables, alexithymia and mood disorders: however, neither alexithymia nor mood disorder symptoms predicted variance in face processing abilities either. Our results concur with previous meta-analyses of facial emotion processing in autism spectrum disorder which report that studies do not always report deficits in face processing in autism: our findings are also not supportive of the model that argues that alexithymia explains facial emotion processing difficulties in autism.

Painful Experiences in Social Contexts Facilitate Sensitivity to Emotional Signals of Pain from Conspecifics in Laboratory Rats.

Previous studies demonstrated that laboratory rats could visually receive emotional pain signals from conspecifics through pictorial stimuli. The present study examined whether a prior painful emotional experience of the receiver influenced the sensitivity of emotional expression recognition in laboratory rats. The experiment comprised four phases: the baseline preference test, pain manipulation test, post-manipulation preference test, and state anxiety test. In the baseline phase, the rats explored an apparatus comprising two boxes to which pictures of pain or neutral expressions of other conspecifics were attached. In the pain manipulation phase, each rat was allocated to one of three conditions: foot shock alone (pained-alone; PA), foot shock with other unfamiliar conspecifics (pained-with-other; PWO), or no foot shock (control). In the post-manipulation phase, the animals explored the apparatus in the same manner as they did in the baseline phase. Finally, an open-field test was used to measure state anxiety. These findings indicate that rats in the PWO group stayed longer per entry in a box with photographs depicting a neutral disposition than in a box with photographs depicting pain after manipulation. The results of the open-field test showed no significant differences between the groups, suggesting that the increased sensitivity to pain expression in other individuals due to pain experiences in social settings was not due to increased primary state anxiety. Furthermore, the results indicate that rats may use a combination of self-painful experiences and the states of other conspecifics to process the emotional signal of pain from other conspecifics. In addition, changes in the responses of rats to facial expressions in accordance with social experience suggest that the expression function of rats is not only used for emotional expressions but also for communication.

Visual Field Restriction in the Recognition of Basic Facial Expressions: A Combined Eye Tracking and Gaze Contingency Study.

Uncertainties and discrepant results in identifying crucial areas for emotional facial expression recognition may stem from the eye tracking data analysis methods used. Many studies employ parameters of analysis that predominantly prioritize the examination of the foveal vision angle, ignoring the potential influences of simultaneous parafoveal and peripheral information. To explore the possible underlying causes of these discrepancies, we investigated the role of the visual field aperture in emotional facial expression recognition with 163 volunteers randomly assigned to three groups: no visual restriction (NVR), parafoveal and foveal vision (PFFV), and foveal vision (FV). Employing eye tracking and gaze contingency, we collected visual inspection and judgment data over 30 frontal face images, equally distributed among five emotions. Raw eye tracking data underwent Eye Movements Metrics and Visualizations (EyeMMV) processing. Accordingly, the visual inspection time, number of fixations, and fixation duration increased with the visual field restriction. Nevertheless, the accuracy showed significant differences among the NVR/FV and PFFV/FV groups, despite there being no difference in NVR/PFFV. The findings underscore the impact of specific visual field areas on facial expression recognition, highlighting the importance of parafoveal vision. The results suggest that eye tracking data analysis methods should incorporate projection angles extending to at least the parafoveal level.

이미지 메타 정보 기반 한국인 표정 감정 인식

Due to the recent pandemic and the development of ICT technology, the use of non-face-to-face and unmanned systems is expanding, and it is very important to understand emotions in communication in non-face-to-face situations. As emotion recognition methods for various facial expressions are required to understand emotions, artificial intelligence-based research is being conducted to improve facial expression emotion recognition in image data. However, existing research on facial expression emotion recognition requires high computing power and a lot of learning time because it utilizes a large amount of data to improve accuracy. To improve these limitations, this paper proposes a method of recognizing facial expressions using age and gender, which are image meta information, as a method of recognizing facial expressions with even a small amount of data. For facial expression emotion recognition, a face was detected using the Yolo Face model from the original image data, and age and gender were classified through the VGG model based on image meta information, and then seven emotions were recognized using the EfficientNet model. The accuracy of the proposed data classification learning model was higher as a result of comparing the meta-information-based data classification model with the model trained with all data.

Facial expressions and identities recognition in Parkinson disease

Parkinson's Disease (PD) is associated with motor and non-motor symptoms. Among the latter are deficits in matching, identification, and recognition of emotional facial expressions. On one hand, this deficit has been attributed to a dysfunction in emotion processing. Another explanation (which does not exclude the former) links this deficit with reduced facial expressiveness in these patients, which prevents them from properly understanding or embodying emotions. To disentangle the specific contribution of emotion comprehension and that of facial expression processing in PD's observed deficit with emotions we performed two experiments on non-emotional facial expressions. In Experiment 1, a group of PD patients and a group of Healthy Controls (HC) underwent a task of non-emotional expression recognition in faces of different identity and a task of identity recognition in faces with different expression. No differences were observed between the two groups in accuracies. In Experiment 2, PD patients and Healthy Controls underwent a task where they had to recognize the identity of faces encoded through a non-emotional facial expression, through a rigid head movement, or as neutral. Again, no group differences were observed. In none of the two experiments hypomimia scores had a specific effect on expression processing. We conclude that in PD patients the observed impairment with emotional expressions is likely due to a specific deficit for emotions to a greater extent than for facial expressivity processing.

Vision plays a calibrating role in discriminating threat-related vocal emotions.

The ability to reliably discriminate vocal expressions of emotion is crucial to engage in successful social interactions. This process is arguably more crucial for blind individuals, since they cannot extract social information from faces and bodies, and therefore chiefly rely on voices to infer the emotional state of their interlocutors. Blind have demonstrated superior abilities in several aspects of auditory perception, but research on their ability to discriminate vocal features is still scarce and has provided unclear results. Here, we used a gating psychophysical paradigm to test whether early blind people would differ from individually matched sighted controls at the recognition of emotional expressions. Surprisingly, blind people showed lower performance than controls in discriminating specific vocal emotions. We presented segments of nonlinguistic emotional vocalizations of increasing duration (100-400 ms), portraying five basic emotions (fear, happy, sad, disgust, and angry), and we asked our participants for an explicit emotion categorization task. We then calculated sensitivity indices and confusion patterns of their performance. We observed better performance of the sighted group in the discrimination of angry and fearful expression, with no between-group differences for other emotions. This result supports the view that vision plays a calibrating role for specific threat-related emotions specifically. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

3DEmo: For Portrait Emotion Recognition with New Dataset

Emotional Expression Recognition (EER) and Facial Expression Recognition (FER) are active research areas in the affective computing field, which involves studying human emotion, recognition, and sentiment analysis. The main objective of this research is to develop algorithms that can accurately interpret and estimate human emotions from portrait images. The emotions depicted in a portrait can reflect various factors such as psychological and physiological states, the artist’s emotional responses, social and environmental aspects, and the period in which the painting was created. This task is challenging because (i) the portraits are often depicted in an artistic or stylized manner rather than realistically or naturally, (ii) the texture and color features obtained from natural faces and paintings differ, affecting the success rate of emotion recognition algorithms, and (iii) it is a new research area, where practically we do not have visual arts portrait facial emotion estimation models or datasets. To address these challenges, we need a new class of tools and a database specifically tailored to analyze portrait images. This study aims to develop art portrait emotion recognition methods and create a new digital portrait dataset containing 927 images. The proposed model is based on (i) a 3-dimensional estimation of emotions learned by a deep neural network and (ii) a novel deep learning module (3DEmo) that could be easily integrated into existing FER models. To evaluate the effectiveness of the developed models, we also tested their robustness on a facial emotion recognition dataset. The extensive simulation results show that the presented approach outperforms established methods. We expect that this dataset and the developed new tools will encourage further research in recognizing emotions in portrait paintings and predicting artists’ emotions in the painting period based on their artwork.

Comparative analysis of emotional facial expression recognition and empathy in children with prader-willi syndrome and autism spectrum disorder

BackgroundPrader-Willi Syndrome (PWS) is a rare neurodevelopmental disorder that is often comorbid with Autism Spectrum Disorder (ASD). Due to the close association between these two conditions, and recognizing that Theory of Mind (ToM) is related to social behaviors in ASD, there is a growing interest in studying the reciprocity of social communication between these two groups.MethodThe primary objective of this study was to compare how children (n = 45) with PWS (n = 15), ASD (n = 15), and a control group (n = 15) respond to emotion recognition of facial expressions and empathy, which are both concepts related to ToM. The study utilized two tools named FEEL and Deusto-e-Motion 1.0. We also evaluated the Working Memory index of the WISC-IV scale, the Social Perception domain of the NEPSY-II battery, and the SCQ in both clinical groups.ResultsOur findings suggest that individuals with PWS exhibit lower accuracy in recognizing facial expressions and empathy compared to the control group. Both clinical groups exhibited a delayed reaction time compared to the control group. Children with PWS display difficulties in recognizing emotions of disgust and surprise. In terms of cognitive empathy, children with PWS showed a greater inclination to respond to disgust as compared to children with ASD.ConclusionsThis study represents the initial stage in comprehending the emotional and empathetic abilities of children with PWS and ASD. The findings can provide valuable insights for developing future interventions.

No influence of emotional expression on size underestimation of upright faces.

Faces are a primary means of conveying social information between humans. One important factor modulating the perception of human faces is emotional expression. Face inversion also affects perception, including judgments of emotional expression, possibly through the disruption of configural processing. One intriguing inversion effect is an illusion whereby faces appear to be physically smaller when upright than when inverted. This illusion appears to be highly selective for faces. In this study, we investigated whether the emotional expression of a face (neutral, happy, afraid, and angry) modulates the magnitude of this size illusion. Results showed that for all four expressions, there was a clear bias for inverted stimuli to be judged as larger than upright ones. This demonstrates that there is no influence of emotional expression on the size underestimation of upright faces, a surprising result given that recognition of different emotional expressions is known to be affected unevenly by inversion. Results are discussed considering recent neuroimaging research which used population receptive field (pRF) mapping to investigate the neural mechanisms underlying face perception features and which may provide an explanation for how an upright face appears smaller than an inverted one. Elucidation of this effect would lead to a greater understanding of how humans communicate.

The role of the differential outcomes procedure and schizotypy in the recognition of dynamic facial expressions of emotions

Emotional facial expression recognition is a key ability for adequate social functioning. The current study aims to test if the differential outcomes procedure (DOP) may improve the recognition of dynamic facial expressions of emotions and to further explore whether schizotypal personality traits may have any effect on performance. 183 undergraduate students completed a task where a face morphed from a neutral expression to one of the six basic emotions at full intensity over 10 s. Participants had to press spacebar as soon as they identified the emotion and choose which had appeared. In the first block, participants received no outcomes. In the second block, a group received specific outcomes associated to each emotion (DOP group), while another group received non-differential outcomes after correctly responding (NOP group). Employing generalized linear models (GLMs) and Bayesian inference we estimated different parameters to answer our research goals. Schizotypal personality traits did not seem to affect dynamic emotional facial expression recognition. Participants of the DOP group were less likely to respond incorrectly to faces showing Fear and Surprise at fewer intensity levels. This may suggest that the DOP could lead to better identification of the main features that differentiate each facial expression of emotion.

Rational and Continuous Measurement of the Emotional Decision Making in Visual Recognition of Facial Emotional Expressions with M.A.R.I.E.: First Half

Rational and Continuous Measurement of the Emotional Decision Making in Visual Recognition of Facial Emotional Expressions with M.A.R.I.E.: First Half

Altered attentional processing of facial expression features in severe alcohol use disorder: An eye-tracking study.

Social cognition impairments, and notably emotional facial expression (EFE) recognition difficulties, as well as their functional and clinical correlates, are increasingly documented in severe alcohol use disorder (SAUD). However, insights into their underlying mechanisms are lacking. Here, we tested if SAUD was associated with alterations in the attentional processing of EFEs. In a preregistered study, 40 patients with SAUD and 40 healthy controls (HCs) had to identify the emotional expression conveyed by faces while having their gaze recorded by an eye-tracker. We assessed indices of initial (first fixation locations) and later (number of fixations and dwell-time) attention with reference to regions of interest corresponding to the eyes, mouth, and nose, which carry key information for EFE recognition. We centrally found that patients had less first fixations to key facial features in general, as well as less fixations and dwell time to the eyes specifically, relative to the rest of the face, compared to controls. These effects were invariant across emotional expressions. Additional exploratory analyses revealed that patients with SAUD had a less structured viewing pattern than controls. These results offer novel, direct, evidence that patients with SAUD's socioaffective difficulties already emerge at the facial attentional processing stage, along with precisions regarding the nature and generalizability of the effects. Potential implications for the mechanistic conceptualization and treatment of social cognition difficulties in SAUD are discussed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

To see or not to see: the parallel processing of self-relevance and facial expressions

The self, like the concept of central "gravity", facilitates the processing of information that is directly relevant to the self. This phenomenon is known as the self-prioritization effect. However, it remains unclear whether the self-prioritization effect extends to the processing of emotional facial expressions. To fill this gap, we used a self-association paradigm to investigate the impact of self-relevance on the recognition of emotional facial expressions while controlling for confounding factors such as familiarity and overlearning. Using a large and diverse sample, we replicated the effect of self-relevance on face processing but found no evidence for a modulation of self-relevance on facial emotion recognition. We propose two potential theoretical explanations to account for these findings and emphasize that further research with different experimental designs and a multitasks measurement approach is needed to understand this mechanism fully. Overall, our study contributes to the literature on the parallel cognitive processing of self-relevance and facial emotion recognition, with implications for both social and cognitive psychology.