Perception Of Facial Expressions Research Articles

The influence of body posture on facial expression perception in Autism.

Facial expression perception is influenced by body posture, with perception biased toward the body emotion. Previous research has suggested that the magnitude of this biasing influence of body posture is driven by individual differences in the precision of facial expression representations underlying discrimination abilities, where lower precision leads to a greater influence of body posture. It is unclear however whether similar mechanisms might drive the influence of contextual cues in Autism, which is often characterised by reduced facial expression discrimination abilities. Here, we addressed this question by using online psychophysical methods to determine the precision of isolated face and body expression representations of anger and disgust, and the influence of body on facial expression perception, in autistic and non-autistic adults. Both groups showed a strong influence of body context on facial expression perception, but this influence was larger in the autistic group, mirroring their lower overall precision of facial expression representations relative to non-autistic individuals. Crucially, the magnitude of the biasing influence of body posture in both groups was related to the precision of individuals' facial expression representations. The results suggest that similar principles govern the integration of facial expression and body posture information in both autistic and non-autistic individuals.

Distinct neural correlates of accuracy and bias in the perception of facial emotion expressions

ABSTRACT We investigated neural correlates of Emotion Recognition Accuracy (ERA) using the Assessment of Contextualized Emotions (ACE). ACE infuses context by presenting emotion expressions in a naturalistic group setting and distinguishes between accurately perceiving intended emotions (signal), and bias due to perceiving additional, secondary emotions (noise). This social perception process is argued to induce perspective taking in addition to pattern matching in ERA. Thirty participants were presented with an fMRI-compatible adaptation of the ACE consisting of blocks of neutral and emotional faces in single and group-embedded settings. Participants rated the central character’s expressions categorically or using scalar scales in consequent fMRI scans. Distinct brain activations were associated with the perception of emotional vs. neutral faces in the four conditions. Moreover, accuracy and bias scores from the original ACE task performed on another day were associated with brain activation during the scalar (vs. categorical) condition for emotional (vs. neutral) faces embedded in group. These findings suggest distinct cognitive mechanisms linked to each type of emotional rating and highlight the importance of considering cognitive bias in the assessment of social emotion perception.

Perception of emotional facial expressions in aggression and psychopathy.

Altered affective state recognition is assumed to be a root cause of aggressive behavior, a hallmark of psychopathologies such as psychopathy and antisocial personality disorder. However, the two most influential models make markedly different predictions regarding the underlying mechanism. According to the integrated emotion system theory (IES), aggression reflects impaired processing of social distress cues such as fearful faces. In contrast, the hostile attribution bias (HAB) model explains aggression with a bias to interpret ambiguous expressions as angry. In a set of four experiments, we measured processing of fearful and angry facial expressions (compared to neutral and other expressions) in a sample of 65 male imprisoned violent offenders rated using the Hare Psychopathy Checklist-Revised (PCL-R, Hare, R. D. (1991). The psychopathy checklist-revised. Toronto, ON: Multi-Health Systems) and in 60 age-matched control participants. There was no evidence for a fear deficit in violent offenders or for an association of psychopathy or aggression with impaired processing of fearful faces. Similarly, there was no evidence for a perceptual bias for angry faces linked to psychopathy or aggression. However, using highly ambiguous stimuli and requiring explicit labeling of emotions, violent offenders showed a categorization bias for anger and this anger bias correlated with self-reported trait aggression (but not with psychopathy). These results add to a growing literature casting doubt on the notion that fear processing is impaired in aggressive individuals and in psychopathy and provide support for the idea that aggression is related to a hostile attribution bias that emerges from later cognitive, post-perceptual processing stages.

Emotion perception through the nose: how olfactory emotional cues modulate the perception of neutral facial expressions in affective disorders

Humans can decode emotional states from the body odors of the conspecifics and this type of emotional communication is particularly relevant in conditions in which social interactions are impaired, as in depression and social anxiety. The present study aimed to explore how body odors collected in happiness and fearful conditions modulate the subjective ratings, the psychophysiological response and the neural processing of neutral faces in individuals with depressive symptoms, social anxiety symptoms, and healthy controls (N = 22 per group). To this aim, electrocardiogram (ECG) and HD-EEG were recorded continuously. Heart Rate Variability (HRV) was extracted from the ECG as a measure of vagal tone, event-related potentials (ERPs) and event-related spectral perturbations (ERPSs) were extracted from the EEG. The results revealed that the HRV increased during the fear and happiness body odors conditions compared to clean air, but no group differences emerged. For ERPs data, repeated measure ANOVA did not show any significant effects. However, the ERPSs analyses revealed a late increase in delta power and a reduced beta power both at an early and a late stage of stimulus processing in response to the neutral faces presented with the emotional body odors, regardless of the presence of depressive or social anxiety symptoms. The current research offers new insights, demonstrating that emotional chemosignals serve as potent environmental cues. This represents a substantial advancement in comprehending the impact of emotional chemosignals in both individuals with and without affective disorders.

Incomplete Faces Do but Masked Faces Do Not Affect Mind Perception.

The human face plays a critical role in how we perceive the minds of others. The current research across two studies explored whether face masks also impact mind perception, with the expectation that they lead to lower attributions of agency and experience to individuals, making them seem less mentally capable due to their association with reduced facial expression perception and impaired communication. In the first study, participants' ratings of masked and unmasked faces for agency and experience did not yield significant differences, suggesting that wearing a face mask does not affect the perception of the mind. To explore whether these findings applied when the lower face was cropped instead of masked, results of the second study showed that removing the lower face led to decreased agency ratings, but similar to the first study, there were no changes in experience ratings. Altogether, our results showed that wearing face masks does not reduce the perception of mental capacity. Moreover, female faces received higher ratings for both agency and experience compared to male faces. The complex relationship between face masks, gender, and mind perception warrants further exploration.

Registered report “Categorical perception of facial expressions of anger and disgust across cultures”

ABSTRACT Previous research has demonstrated that individuals from Western cultures exhibit categorical perception (CP) in their judgments of emotional faces. However, the extent to which this phenomenon characterises the judgments of facial expressions among East Asians remains relatively unexplored. Building upon recent findings showing that East Asians are more likely than Westerners to see a mixture of emotions in facial expressions of anger and disgust, the present research aimed to investigate whether East Asians also display CP for angry and disgusted faces. To address this question, participants from Canada and China were recruited to discriminate pairs of faces along the anger-disgust continuum. The results revealed the presence of CP in both cultural groups, as participants consistently exhibited higher accuracy and faster response latencies when discriminating between-category pairs of expressions compared to within-category pairs. Moreover, the magnitude of CP did not vary significantly across cultures. These findings provide novel evidence supporting the existence of CP for facial expressions in both East Asian and Western cultures, suggesting that CP is a perceptual phenomenon that transcends cultural boundaries. This research contributes to the growing literature on cross-cultural perceptions of facial expressions by deepening our understanding of how facial expressions are perceived categorically across cultures.

Facial expressions affect the memory of facial colors.

Facial color influences the perception of facial expressions, and emotional expressions bias how facial color is remembered. However, it remains unclear whether facial expressions affect daily facial color memory. The memory color effect demonstrates that knowledge about typical colors affects the perception of the actual color of given objects. To investigate the effect of facial color memory, we examined whether the memory color effect for faces varies depending on facial expression. We calculated the subjective achromatic point of the facial expression image stimulus and compared the degree to which it was shifted from the actual achromatic point between facial expression conditions. We hypothesized that if the memory of facial color is influenced by the facial expression color (e.g., anger is a warm color, fear is a cold color), then the subjective achromatic point would vary with facial expression. In Experiment 1, we recruited 13 participants who adjusted the color of facial expression stimuli (anger, neutral, and fear) and a banana stimulus to be achromatic. No significant differences in the subjective achromatic point between facial expressions were observed. Subsequently, we conducted Experiment 2 with 23 participants because Experiment 1 did not account for the sensitivity to color changes on the face; humans perceive greater color differences in faces than in non-faces. Participants selected which facial color they believed the expression stimulus appeared to be, choosing one of two options provided to them. The results indicated that the subjective achromatic points of anger and fear faces significantly shifted toward the opposite color direction compared with neutral faces in the brief presentation condition. This research suggests that the memory color of faces differs depending on facial expressions and supports the idea that the perception of emotional expressions can bias facial color memory.

Consistent social information perceived in animated backgrounds improves ensemble perception of facial expressions.

Observers can rapidly extract the mean emotion from a set of faces with remarkable precision, known as ensemble coding. Previous studies have demonstrated that matched physical backgrounds improve the precision of ongoing ensemble tasks. However, it remains unknown whether this facilitation effect still occurs when matched social information is perceived from the backgrounds. In two experiments, participants decided whether the test face in the retrieving phase appeared more disgusted or neutral than the mean emotion of the face set in the encoding phase. Both phases were paired with task-irrelevant animated backgrounds, which included either the forward movement trajectory carrying the "cooperatively chasing" information, or the backward movement trajectory conveying no such chasing information. The backgrounds in the encoding and retrieving phases were either mismatched (i.e., forward and backward replays of the same trajectory), or matched (i.e., two identical forward movement trajectories in Experiment 1, or two different forward movement trajectories in Experiment 2). Participants in both experiments showed higher ensemble precisions and better discrimination sensitivities when backgrounds matched. The findings suggest that consistent social information perceived from memory-related context exerts a context-matching facilitation effect on ensemble coding and, more importantly, this effect is independent of consistent physical information.

Attention modulates facial expression processing in subsyndromal depression: A behavioral and ERP study

Impaired facial expression perception is a core element in depression, but the underlying mechanism remains controversial. This event-related potential study investigated how attention modulates facial expression perception in depression using a nonclinical sample. A group of healthy controls (HC, N = 39) and a group of individuals with subsyndromal depression (SD, N = 39) categorized faces based on either facial expression (happy vs. sad) or gender (male vs. female). Behaviorally, the SD group was less sensitive to the emotional valence of facial expression than the HC group when their attention was directed to facial expression, as revealed by comparable subjective ratings and accuracy rates in response to facial expressions. When attention was directed towards facial gender, the SD group versus the HC group showed a negative bias, as revealed by a faster N170 for sad faces than happy faces. Together, our findings suggest that attention plays a role in understanding the relationship between depression and facial expression perception.

Cognitive Neuroscience of Autism Spectrum Disorder: The Neurobiology of Empathic Process

IntroductionAutism Spectrum Disorders (ASD) is diagnosed when an individual displays irregularity in three key domains: social development, communication, and repetitive behavior/obsessive interests.The theory of mind-blindness in ASD suggests that individuals on the autism spectrum exhibit deficiencies in the typical empathic process, relative to their mental age.Empathy comprises two primary components: firstly, the capacity to attribute mental states to both oneself and others, and secondly, experiencing an emotional response that aligns with the mental state of the other person.ObjectivesThis study aimed to synthetase the latest evidence about the neuropsychiatric basis of empathy in ASD.MethodsA review was conducted, drawing on reputable sources (PubMed and Web of Science databases).Results A neural basis of empathy has built on a model first proposed by Brothers. It was suggested that social intelligence was a function of three regions: the amygdala, the orbitofrontal and medial frontal cortex, and the superior temporal sulcus and gyrus - the “social brain”. Abnormalities in autism have been found in the amygdala, the orbito and the medial frontal cortex.Amygdala has been implicated primarily in fear perception of facial expressions, as well as in the recognition of other emotions such as sadness and “social” emotions. In addition to fear perception, the amygdala has also been implicated in related processes including eye gaze, affective memory, olfactory learning, and social judgment.To date, findings on amygdala structure in autism have been mixed, with studies indicating reduced and increased volumes, as well as nonsignificant differences.ConclusionsASD is one of the most heterogeneous neurodevelopmental disorders, and cognitive theories as well as structural findings have linked likely frontal lobe abnormalities to the social and cognitive profiles of autism.Future studies may elucidate existing data by taking advantage of new and infrequently used data acquisition technologies such as Transcranial Magnetic Stimulation.Disclosure of InterestNone Declared

Visual perception of facial expressions of emotions and alexithymia among people suffering from schizophrenia

Aim of the studyThe aim of the study is to find out whether there is a relationship between the severity of alexithymia and the visual perception of facial expressions of emotions among people suffering from schizophrenia.Subject or material and methods41 people suffering from schizophrenia and 41 healthy people participated in the study. In the first stage, the subjects completed the Toronto Alexithymia Scale (TAS-20) questionnaire. The second stage was based on eye-tracking measurements made during a computer experiment of recognising facial expressions.ResultsPeople with schizophrenia showed significantly higher intensity of alexithymia than healthy people. In the group of patients with schizophrenia, a negative correlation between alexithymia and the length of saccades on the nose was found.DiscussionIn the group of people with schizophrenia, alexithymia is associated with less intensive exploration of the nasal area. A wrinkled nose is an important area, first of all, in the manifestation of negative emotions, in recognition of which the sick people make the most mistakes.ConclusionsProblems with recognising emotions in people suffering from schizophrenia are associated with neuronal dysfunction and abnormalities in the eye movement. These factors disrupt the early stages of sensory processing. The relationship of alexithymia with the visual perception of patients with schizophrenia suggests that top-down processes may also contribute to the development of these deficits.

On the Role of Sensorimotor Experience in Facial Expression Perception.

Humans recognize the facial expressions of others rapidly and effortlessly. Although much is known about how we perceive expressions, the role of facial experience in shaping this remarkable ability remains unclear. Is our perception of expressions linked to how we ourselves make facial expressions? Are we better at recognizing other's facial expressions if we are experts at making the same expressions ourselves? And if we could not make facial expressions at all, would it impact our ability to recognize others' facial expressions? The current article aims to examine these questions by explicating the link between facial experience and facial expression recognition. It includes a comprehensive appraisal of the related literature and examines three main theories that posit a connection between making and recognizing facial expressions. First, recent studies in individuals with Moebius syndrome support the role of facial ability (i.e., the ability to move one's face to make facial expressions) in facial expression recognition. Second, motor simulation theory suggests that humans recognize others' facial expressions by covertly mimicking the observed expression (without overt motor action) and that this facial mimicry helps us identify and feel the associated emotion. Finally, the facial feedback hypothesis provides a framework for enhanced emotional experience via proprioceptive feedback from facial muscles when mimicking a viewed facial expression. Evidence for and against these theories is presented as well as some considerations and outstanding questions for future research studies investigating the role of facial experience in facial expression perception.

Additive effects of emotional expression and stimulus size on the perception of genuine and artificial facial expressions: an ERP study

Seeing an angry individual in close physical proximity can not only result in a larger retinal representation of that individual and an enhanced resolution of emotional cues, but may also increase motivation for rapid visual processing and action preparation. The present study investigated the effects of stimulus size and emotional expression on the perception of happy, angry, non-expressive, and scrambled faces. We analyzed event-related potentials (ERPs) and behavioral responses of N = 40 participants who performed a naturalness classification task on real and artificially created facial expressions. While the emotion-related effects on accuracy for recognizing authentic expressions were modulated by stimulus size, ERPs showed only additive effects of stimulus size and emotional expression, with no significant interaction with size. This contrasts with previous research on emotional scenes and words. Effects of size were present in all included ERPs, whereas emotional expressions affected the N170, EPN, and LPC, irrespective of size. These results imply that the decoding of emotional valence in faces can occur even for small stimuli. Supra-additive effects in faces may necessitate larger size ranges or dynamic stimuli that increase arousal.

Perception and memory-based representations of facial emotions: Associations with personality functioning, affective states and recognition abilities

Personality traits and affective states are associated with biases in facial emotion perception. However, the precise personality impairments and affective states that underlie these biases remain largely unknown. To investigate how relevant factors influence facial emotion perception and recollection, Experiment 1 employed an image reconstruction approach in which community-dwelling adults (N = 89) rated the similarity of pairs of facial expressions, including those recalled from memory. Subsequently, perception- and memory-based expression representations derived from such ratings were assessed across participants and related to measures of personality impairment, state affect, and visual recognition abilities. Impairment in self-direction and level of positive affect accounted for the largest components of individual variability in perception and memory representations, respectively. Additionally, individual differences in these representations were impacted by face recognition ability. In Experiment 2, adult participants (N = 81) rated facial image reconstructions derived in Experiment 1, revealing that individual variability was associated with specific visual face properties, such as expressiveness, representation accuracy, and positivity/negativity. These findings highlight and clarify the influence of personality, affective state, and recognition abilities on individual differences in the perception and recollection of facial expressions.

Facial icons as indexes of emotions and intentions.

Various objects and artifacts incorporate representations of faces, encompassing artworks like portraits, as well as ethnographic or industrial artifacts such as masks or humanoid robots. These representations exhibit diverse degrees of human-likeness, serving different functions and objectives. Despite these variations, they share common features, particularly facial attributes that serve as building blocks for facial expressions-an effective means of communicating emotions. To provide a unified conceptualization for this broad spectrum of face representations, we propose the term "facial icons" drawing upon Peirce's semiotic concepts. Additionally, based on these semiotic principles, we posit that facial icons function as indexes of emotions and intentions, and introduce a significant anthropological theory aligning with our proposition. Subsequently, we support our assertions by examining processes related to face and facial expression perception, as well as sensorimotor simulation processes involved in discerning others' mental states, including emotions. Our argumentation integrates cognitive and experimental evidence, reinforcing the pivotal role of facial icons in conveying mental states.

A neurophysiological signature of dynamic emotion recognition associated with social communication skills and cortical gamma-aminobutyric acid levels in children.

Emotion recognition is a core feature of social perception. In particular, perception of dynamic facial emotional expressions is a major feature of the third visual pathway. However, the classical N170 visual evoked signal does not provide a pure correlate of such processing. Indeed, independent component analysis has demonstrated that the N170 component is already active at the time of the P100, and is therefore distorted by early components. Here we implemented, a dynamic face emotional paradigm to isolate a more pure face expression selective N170. We searched for a neural correlate of perception of dynamic facial emotional expressions, by starting with a face baseline from which a facial expression evolved. This allowed for a specific facial expression contrast signal which we aimed to relate with social communication abilities and cortical gamma-aminobutyric acid (GABA) levels. We recorded event-related potentials (ERPs) and Magnetic Resonance (MRS) measures in 35 typically developing (TD) children, (10-16 years) sex-matched, during emotion recognition of an avatar morphing/unmorphing from neutral to happy/sad expressions. This task allowed for the elimination of the contribution low-level visual components, in particular the P100, by morphing baseline isoluminant neutral faces into specific expressions, isolating dynamic emotion recognition. Therefore, it was possible to isolate a dynamic face sensitive N170 devoid of interactions with earlier components. We found delayed N170 and P300, with a hysteresis type of dependence on stimulus trajectory (morphing/unmorphing), with hemispheric lateralization. The delayed N170 is generated by an extrastriate source, which can be related to the third visual pathway specialized in biological motion processing. GABA levels in visual cortex were related with N170 amplitude and latency and predictive of worse social communication performance (SCQ scores). N170 latencies reflected delayed processing speed of emotional expressions and related to worse social communication scores. In sum, we found a specific N170 electrophysiological signature of dynamic face processing related to social communication abilities and cortical GABA levels. These findings have potential clinical significance supporting the hypothesis of a spectrum of social communication abilities and the identification of a specific face-expression sensitive N170 which can potentially be used in the development of diagnostic and intervention tools.

Influence of stimulus manipulation on conscious awareness of emotional facial expressions in the match-to-sample paradigm

The conscious perception of emotional facial expressions plays an indispensable role in social interaction. However, previous psychological studies have reported inconsistent findings regarding whether conscious awareness is greater for emotional expressions than for neutral expressions. Furthermore, whether this phenomenon is attributable to emotional or visual factors remains unknown. To investigate these issues, we conducted five psychological experiments to test the conscious perception of emotional and neutral facial expressions using the match-to-sample paradigm. Facial stimuli were momentarily presented in the peripheral visual fields while participants read simultaneously presented letters in the central visual fields. The participants selected a perceived face from nine samples. The results of all experiments demonstrated that emotional expressions were more accurately identified than neutral expressions. Furthermore, Experiment 4 showed that angry expressions were identified more accurately than anti-angry expressions, which expressed neutral emotions with comparable physical changes to angry expressions. Experiment 5, testing the interaction between emotional expression and face direction, showed that angry expressions looking toward participants were more accurately identified than those looking away from participants, even though they were physically identical. These results suggest that the conscious awareness of emotional facial expressions is enhanced by their emotional significance.

Trust in the police and affective evaluation of police faces: a preliminary study.

A study was conducted to investigate if an individual's trust in law enforcement affects their perception of the emotional facial expressions displayed by police officers. The study invited 77 participants to rate the valence of 360 face images. Images featured individuals without headgear (condition 1), or with a baseball cap (condition 2) or police hat (condition 3) digitally added to the original photograph. The images were balanced across sex, race/ethnicity (Asian, African American, Latine, and Caucasian), and facial expression (Happy, Neutral, and Angry). After rating the facial expressions, respondents completed a survey about their attitudes toward the police. The results showed that, on average, valence ratings for "Angry" faces were similar across all experimental conditions. However, a closer examination revealed that faces with police hats were perceived as angrier compared to the control conditions (those with no hat and those with a baseball cap) by individuals who held negative views of the police. Conversely, participants with positive attitudes toward the police perceived faces with police hats as less angry compared to the control condition. This correlation was highly significant for angry faces (p < 0.01), and stronger in response to male faces compared to female faces but was not significant for neutral or happy faces. The study emphasizes the substantial role of attitudes in shaping social perception, particularly within the context of law enforcement.

Inability to move one's face dampens facial expression perception

Humans rely heavily on facial expressions for social communication to convey their thoughts and emotions and to understand them in others. One prominent but controversial view is that humans learn to recognize the significance of facial expressions by mimicking the expressions of others. This view predicts that an inability to make facial expressions (e.g., facial paralysis) would result in reduced perceptual sensitivity to others' facial expressions. To test this hypothesis, we developed a diverse battery of sensitive emotion recognition tasks to characterize expression perception in individuals with Moebius Syndrome (MBS), a congenital neurological disorder that causes facial palsy. Using computer-based detection tasks we systematically assessed expression perception thresholds for static and dynamic face and body expressions. We found that while MBS individuals were able to perform challenging perceptual control tasks and body expression tasks, they were less efficient at extracting emotion from facial expressions, compared to matched controls. Exploratory analyses of fMRI data from a small group of MBS participants suggested potentially reduced engagement of the amygdala in MBS participants during expression processing relative to matched controls. Collectively, these results suggest a role for facial mimicry and consequent facial feedback and motor experience in the perception of others' facial expressions.

Effects of wearing an opaque or transparent face mask on the perception of facial expressions: A comparative study between Japanese school-aged children and adults.

The negative side effects of mask-wearing on reading facial emotional cues have been investigated in several studies with adults post-2020. However, little is known about children. This study aimed to determine the negative influence of mask-wearing on reading emotions of adult faces by Japanese school-aged children, compared to Japanese adults. We also examined whether this negative influence could be alleviated by using a transparent face mask instead of an opaque one (surgical mask). The performance on reading emotions was measured using emotion categorization and emotion intensity rating tasks for adult faces. As per the findings, the accuracy of emotion recognition in children was impaired for various facial expressions (disgust, fear, happy, neutral, sad, and surprise faces), except for angry faces. Conversely, in adults, it was impaired for a few facial expressions. The perceived intensity for happy faces with a surgical mask was weaker in both children and adults than in those without the mask. A negative influence of wearing surgical masks was generally not observed for faces wearing a transparent mask in both children and adults. Thus, negative side effects of mask-wearing on reading emotions are observed for more facial expressions in children than in adults; transparent masks can help remedy these.