Processing Of Facial Expressions Research Articles

Spatiotemporal Dynamics of Covert vs. Overt Emotional Face Processing in Dysphoria.

People at risk of developing clinical depression exhibit attentional biases for emotional faces. To clarify whether such effects occur at an early, automatic, or at a late, deliberate processing stage of emotional processing, the present study used high-density electroencephalography during both covert and overt processing of sad, fearful, happy, and neutral expressions in healthy participants with high dysphoria (n = 16) and with low dysphoria (n = 19). A state-of-the-art non-parametric permutation-based statistical approach was then used to explore the effects of emotion, attentional task demands, and group. Behaviorally, participants responded faster and more accurately when overtly categorizing happy faces and they were slower and less accurate when categorizing sad and fearful faces, independent of the dysphoria group. Electrophysiologically, in an early time-window (N170: 140–180 ms), there was a significant main effect for the dysphoria group, with greater negative voltage for the high vs. low dysphoria group over the left-sided temporo-occipital scalp. Furthermore, there was a significant group by emotional interaction, with the high dysphoria group displaying greater negative amplitude N170 for happy than fearful faces. Attentional task demands did not influence such early effects. In contrast, in an intermediate time-window (EPN: 200–400 ms) and in a late time-window (LPP: 500–750 ms) there were no significant main effects nor interactions involving the dysphoria Group. The LPP results paralleled the behavioral results, with greater LPP voltages for sad and fearful relative to happy faces only in the overt task, but similarly so in the two dysphoria groups. This study provides novel evidence that alterations in face processing in dysphoric individuals can be seen at the early stages of face perception, as indexed by the N170, although not in the form of a typical pattern of mood-congruent attentional bias. In contrast, intermediate (EPN) and late (LPP) stages of emotional face processing appear unaffected by dysphoria. Importantly, the early dysphoria effect appears to be independent of the top-down allocation of attention, further supporting the idea that dysphoria may influence a stage of automatic emotional appraisal. It is proposed that it may be a consequence of a shift from holistic to feature-based processing of facial expressions, or may be due to the influence of negative schemas acting as a negative context for emotional facial processing.

Examining featural processing of emotional facial expressions: Is trait anxiety a factor?

Examining featural processing of emotional facial expressions: Is trait anxiety a factor?

Intact prioritization of fearful faces during continuous flash suppression in psychopathy.

Affective state recognition and in particular the identification of fear is known to be impaired in psychopathy. It is unclear, however, whether this reflects a deficit in basic perception ('fear blindness') or a deficit in later cognitive processing. To test for a perceptual deficit, 63 male incarcerated offenders, assessed with the Hare Psychopathy Checklist-Revised (PCL-R), detected fearful, neutral, and happy facial expressions rendered invisible through continuous flash suppression (CFS). Fearful faces were detected faster than neutral and happy faces. There was no reduction of the fear advantage in the 20 offenders diagnosed with psychopathy according to the PCL-R, and there was no correlation between the fear advantage and PCL-R scores. Deficits in the processing of fearful facial expressions in psychopathy may thus not reflect fear blindness, but impairments at later postperceptual processing stages. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Neural Mechanisms of Perceiving and Subsequently Recollecting Emotional Facial Expressions in Young and Older Adults.

It is known that emotional facial expressions modulate the perception and subsequent recollection of faces and that aging alters these modulatory effects. Yet, the underlying neural mechanisms are not well understood, and they were the focus of the current fMRI study. We scanned healthy young and older adults while perceiving happy, neutral, or angry faces paired with names. Participants were then provided with the names of the faces and asked to recall the facial expression of each face. fMRI analyses focused on the fusiform face area (FFA), the posterior superior temporal sulcus (pSTS), the OFC, the amygdala (AMY), and the hippocampus (HC). Univariate activity, multivariate pattern (MVPA), and functional connectivity analyses were performed. The study yielded two main sets of findings. First, in pSTS and AMY, univariate activity and MVPA discrimination during the processing of facial expressions were similar in young and older adults, whereas in FFA and OFC, MVPA discriminated facial expressions less accurately in older than young adults. These findings suggest that facial expression representations in FFA and OFC reflect age-related dedifferentiation and positivity effect. Second, HC-OFC connectivity showed subsequent memory effects (SMEs) for happy expressions in both age groups, HC-FFA connectivity exhibited SMEs for happy and neutral expressions in young adults, and HC-pSTS interactions displayed SMEs for happy expressions in older adults. These results could be related to compensatory mechanisms and positivity effects in older adults. Taken together, the results clarify the effects of aging on the neural mechanisms in perceiving and encoding facial expressions.

Facing Uncertainty: Interpretation of Ambiguous Emotional Faces in Childhood Social Anxiety Disorder

ABSTRACT Objective The current study examined whether children with a social anxiety disorder (SAD) demonstrate divergent facial emotion processing and a disorder-specific negative interpretation bias in the processing of facial emotional expressions. This study aimed to overcome previous study limitations by including both a nonsocially anxious control group and a healthy control group to examine whether childhood SAD is characterized by a general emotion labeling deficit, and/or by a negative interpretation bias, indicated by systematic misclassifications, or a lower threshold for recognizing threatening emotions. Method Participants were 132 children aged 7–12 years (M age = 9.15; 45.5% female). Children with SAD (n = 42) were compared to children with other, nonsocial, anxiety disorders (n = 40) and healthy control children (n = 50) on a novel facial emotion recognition task. Children judged ambiguous happy/neutral, angry/neutral and fear/neutral faces that were morphed at different intensities (10%, 30%, 50%, 70%). Results Children with SAD did not differ from other groups in their accuracy of identifying emotions. They did not show systematic misclassifications or a heightened sensitivity to negative, threatening faces either. Rather, children with nonsocial anxiety disorders showed a generally heightened sensitivity to emotional faces. Conclusions The current study does not provide evidence for a general deficit in labeling of emotional faces in childhood SAD. Childhood SAD was not characterized by an interpretation bias in processing emotional faces. Children with nonsocial anxiety disorders may benefit from assistance in accurately interpreting the degree of emotionality in interpersonal situations.

Valence processing alterations in SAPAP3 knockout mice and human OCD

Abnormalities in valence processing – the processing of aversive or appetitive stimuli – may be an underrecognized component of obsessive-compulsive disorder (OCD). Preclinical rodent models have been critical in furthering pathophysiological understanding of OCD, yet there is a dearth of investigations examining whether rodent models of compulsive behavior show alterations in valence systems congruent with those seen in individuals with OCD. In this study, we sought to assess valence processing in a preclinical rodent model of compulsive behavior, the SAPAP3 knockout (KO) mouse model, and compare our preclinical findings to similar behavioral phenomena in OCD patients. In SAPAP3 KO mice, we used auditory fear conditioning and extinction to examine alterations in negative valence processing and reward-based operant conditioning to examine alterations in positive valence processing. We find that SAPAP3 KO mice show evidence of heightened negative valence processing through enhanced fear learning and impaired fear extinction. SAPAP3 KO mice also show deficits in reward acquisition and goal-directed behavior, suggesting impaired positive valence processing. In OCD patients, we used validated behavioral tests to assess explicit and implicit processing of fear-related facial expressions (negative valence) and socially-rewarding happy expressions (positive valence). We find similar trends towards enhanced negative and impaired positive valence processing in OCD patients. Overall, our results reveal valence processing abnormalities in a preclinical rodent model of compulsive behavior similar to those seen in OCD patients, with implications for valence processing alterations as novel therapeutic targets across a translational research spectrum.

Emotion Facial Processing in Children With Autism Spectrum Disorder: A Pilot Study of the Impact of Service Dogs.

Processing and recognizing facial expressions are key factors in human social interaction. Past research suggests that individuals with autism spectrum disorder (ASD) present difficulties to decode facial expressions. Those difficulties are notably attributed to altered strategies in the visual scanning of expressive faces. Numerous studies have demonstrated the multiple benefits of exposure to pet dogs and service dogs on the interaction skills and psychosocial development of children with ASD. However, no study has investigated if those benefits also extend to the processing of facial expressions. The aim of this study was to investigate if having a service dog had an influence on facial expression processing skills of children with ASD. Two groups of 15 children with ASD, with and without a service dog, were compared using a facial expression recognition computer task while their ocular movements were measured using an eye-tracker. While the two groups did not differ in their accuracy and reaction time, results highlighted that children with ASD owning a service dog directed less attention toward areas that were not relevant to facial expression processing. They also displayed a more differentiated scanning of relevant facial features according to the displayed emotion (i.e., they spent more time on the mouth for joy than for anger, and vice versa for the eyes area). Results from the present study suggest that having a service dog and interacting with it on a daily basis may promote the development of specific visual exploration strategies for the processing of human faces.

Far from the eyes, far from the heart: COVID-19 confinement dampened sensitivity to painful facial features.

In the last 2 years, governments of many countries imposed heavy social restrictions to contain the spread of the COVID-19 virus, with consequent increase of bad mood, distress, or depression for the people involved. Few studies investigated the impact of these restrictive measures on individual social proficiency, and specifically the processing of emotional facial information, leading to mixed results. The present research aimed at investigating systematically whether, and to which extent, social isolation influences the processing of facial expressions. To this end, we manipulated the social exclusion experimentally through the well-known Cyberball game (within-subject factor), and we exploited the occurrence of the lockdown for the Swiss COVID-19 first wave by recruiting participants before and after being restricted at home (grouping factor). We then tested whether either form of social segregation influenced the processing of pain, disgust, or neutral expressions, across multiple tasks probing access to different components of affective facial responses (state-specific, shared across states). We found that the lockdown (but not game-induced exclusion) affected negatively the processing of pain-specific information, without influencing other components of the affective facial response related to disgust or broad unpleasantness. In addition, participants recruited after the confinement reported lower scores in empathy questionnaires. These results suggest that social isolation affected negatively individual sensitivity to other people's affect and, with specific reference to the processing of facial expressions, the processing of pain-diagnostic information.

Olfactory interference on the emotional processing speed of visual stimuli: The influence of facial expressions intensities.

Research on olfactory stimulation indicates that it can influence human cognition and behavior, as in the perception of facial expressions. Odors can facilitate or impair the identification of facial expressions, and apparently its hedonic valence plays an important role. However, it was also demonstrated that the presentation of happiness and disgust faces can influence the emotional appraisal of odorants, indicating a bilateral influence in this phenomenon. Hence, it’s possible that odor influences on emotional categorization vary depending on the intensity of expressions. To investigate this hypothesis, we performed an emotion recognition task using facial expressions of five emotional categories (happiness, fear, disgust, anger and sadness) with ten different intensities. Thirty-five participants completed four blocks of the task, each with a different olfactory condition, and we found that odorants’ effects varied according to the facial expressions intensity. Odorants enhanced the Reaction Time (RT) differences between threshold and high-intensity expressions for disgust and fear faces. Also, analysis of the RT means for high-intensity facial expressions revealed that the well-known advantage in recognition of happiness facial expressions, compared to other emotions, was enhanced in the positive olfactory stimulation and decreased in the negative condition. We conclude that olfactory influences on emotional processing of facial expressions vary along intensities of the latter, and the discrepancies of past research in this field may be a result of a bilateral effect in which the odorants influence the identification of emotional faces just as the facial expressions influence the emotional reaction to the odor.

Early Influence of Emotional Scenes on the Encoding of Fearful Expressions With Different Intensities: An Event-Related Potential Study.

Contextual affective information influences the processing of facial expressions at the relatively early stages of face processing, but the effect of the context on the processing of facial expressions with varying intensities remains unclear. In this study, we investigated the influence of emotional scenes (fearful, happy, and neutral) on the processing of fear expressions at different levels of intensity (high, medium, and low) during the early stages of facial recognition using event-related potential (ERP) technology. EEG data were collected while participants performed a fearful facial expression recognition task. The results showed that (1) the recognition of high-intensity fear expression was higher than that of medium- and low-intensity fear expressions. Facial expression recognition was the highest when faces appeared in fearful scenes. (2) Emotional scenes modulated the amplitudes of N170 for fear expressions with different intensities. Specifically, the N170 amplitude, induced by high-intensity fear expressions, was significantly higher than that induced by low-intensity fear expressions when faces appeared in both neutral and fearful scenes. No significant differences were found between the N170 amplitudes induced by high-, medium-, and low-intensity fear expressions when faces appeared in happy scenes. These results suggest that individuals may tend to allocate their attention resources to the processing of face information when the valence between emotional context and expression conflicts i.e., when the conflict is absent (fear scene and fearful faces) or is low (neutral scene and fearful faces).

High Emotional Similarity Will Enhance the Face Memory and Face-Context Associative Memory.

Previous research has explored how emotional valence (positive or negative) affected face-context associative memory, while little is known about how arousing stimuli that share the same valence but differ in emotionality are bound together and retained in memory. In this study, we manipulated the emotional similarity between the target face and the face associated with the context emotion (i.e., congruent, high similarity, and low similarity), and examined the effect of emotional similarity of negative emotion (i.e., disgust, anger, and fear) on face-context associative memory. Our results showed that the greater the emotional similarity between the faces, the better the face memory and face-context associative memory were. These findings suggest that the processing of facial expression and its associated context may benefit from taking into account the emotional similarity between the faces.

Changes in neural processing and evaluation of negative facial expressions after administration of an open-label placebo

A recent event-related potential (ERP) study found that an open-label placebo (OLP) reduced emotional distress during the viewing of unpleasant scenes and the amplitude of the late positive potential (LPP). The present ERP experiment aimed at a conceptual replication of this finding and investigated OLP effects during affective face processing. The participants (109 females) were presented with images depicting angry and neutral facial expressions after the administration of a saline nasal spray. The spray was either introduced as a placebo that could help reduce the emotional reactions to viewing angry faces (OLP group) or to improve the electrophysiological recordings (Control group). The OLP was associated with reduced LPP amplitudes (1000–6000 ms) to anger expressions across a frontal cluster. Additionally, the OLP reduced LPP amplitudes (400–1000 ms) to both anger and neutral faces across a centroparietal cluster. Compared to the Control group, the OLP group reported less arousal when confronted with angry faces, and rated the anger expressions as less intense. This study demonstrates that an OLP can alter both subjective and neural responses to anger cues. Future research should directly compare OLP treatment with other strategies for emotion regulation (e.g., cognitive reappraisal) to demonstrate the specificity of this approach.

Facial Expression Time Processing in Typical Development and in Patients with Congenital Facial Palsy.

Temporal dynamics of behavior, particularly facial expressions, are fundamental for communication between individuals from very early in development. Facial expression processing has been widely demonstrated to involve embodied simulative processes mediated by the motor system. Such processes may be impaired in patients with congenital facial palsy, including those affected by Moebius syndrome (MBS). The aims of this study were to investigate (a) the role of motor mechanisms in the processing of dynamic facial expression timing by testing patients affected by congenital facial palsy and (b) age-dependent effects on such processing. Accordingly, we recruited 38 typically developing individuals and 15 individuals with MBS, ranging in age from childhood to adulthood. We used a time comparison task where participants were asked to identify which one of two dynamic facial expressions was faster. Results showed that MBS individuals performed worse than controls in correctly estimating the duration of facial expressions. Interestingly, we did not find any performance differences in relation to age. These findings provide further evidence for the involvement of the motor system in processing facial expression duration and suggest that a sensorimotor matching mechanism may contribute to such timing perception from childhood.

The role of temporal attention in the processing of facial expression: Evidence from attentional blink paradigm

The role of temporal attention in the processing of facial expression: Evidence from attentional blink paradigm

Face-selective multi-unit activity in the proximity of the FFA modulated by facial expression stimuli

When we see someone's face, our brain usually effortlessly extracts a variety of information such as facial identity, expression, or gaze direction. While it is widely accepted that dedicated subsystems are responsible for different aspects of face processing, how these subsystems work together is not yet fully understood. To this extent, one of the most explored questions is whether and if so, to what extent facial expression processing interacts with other stages of facial processing. In the present study, we report a rare case of a patient for whom we were able to record multi-unit activity (MUA) in the proximity of the fusiform face area (FFA) while two out of four recorded multi-units were face-selective. In our experiment, the human subject was shown images of neutral and fearful faces as well as everyday objects and frightening images of natural disaster. We found that activity of both face-selective units was modulated by facial expression stimuli, starting at about 150 ms from stimulus onset. For both facial conditions we observed abrupt increase in firing rate with a simultaneous peak, suggesting that this activity and the modulation by facial expression stimuli likely reflected feed-forward processing. Interestingly, while in one multi-unit, the firing rate for fearful faces was higher than for neutral faces, in the other multi-units the polarity was reversed. Finally, modulation in the face-selective units was specific to emotional facial stimuli, but not to emotional stimuli in general. The present multi-unit results, albeit obtained only for several multi-units, nevertheless are potentially valuable for understanding mechanisms of facial processing in humans.

Changes in functional connectivity associated with facial expression processing over the working adult lifespan

The recognition of negative emotions from facial expressions is shown to decline across the adult lifespan, with some evidence that this decline begins around middle age. While some studies have suggested ageing may be associated with changes in neural response to emotional expressions, it is not known whether ageing is associated with changes in the network connectivity associated with processing emotional expressions. In this study, we examined the effect of participant age on whole-brain connectivity to various brain regions that show connectivity during emotion processing, namely, the left and right amygdalae, medial prefrontal cortex (mPFC), and right posterior superior temporal sulcus (rpSTS). The study involved healthy participants aged 20–65 years who completed an implicit affect processing task involving facial expressions displaying anger, fear, happiness, and neutral expressions during functional magnetic resonance imaging (fMRI). Participants were also tested on recognition accuracy during an emotion labelling task. We found that participant age was negatively associated with connectivity between the left amygdala and voxels in the left occipital pole; between the rpSTS and voxels in the orbitofrontal cortex; and between the mPFC and cingulate cortex and left insular cortex. Furthermore, these effects were due to a greater age-related decline in brain connectivity for negative expressions compared to happy and neutral expressions. There was, however, no significant relationship between age and emotion recognition accuracy (though in the expected direction), and between connectivity strength and emotion recognition accuracy. Together, these results provide evidence for a specific age-related decline in the neural processing of negative emotions, and could suggest that changes in underlying network connectivity over the working adult lifespan might occur before any marked decline in the recognition of the emotion.

Rapid processing of threatening faces in the amygdala of nonhuman primates: subcortical inputs and dual roles.

A subcortical pathway through the superior colliculus and pulvinar has been proposed to provide the amygdala with rapid but coarse visual information about emotional faces. However, evidence for short-latency, facial expression-discriminating responses from individual amygdala neurons is lacking; even if such a response exists, how it might contribute to stimulus detection is unclear. Also, no definitive anatomical evidence is available for the assumed pathway. Here we showed that ensemble responses of amygdala neurons in monkeys carried robust information about open-mouthed, presumably threatening, faces within 50ms after stimulus onset. This short-latency signal was not found in the visual cortex, suggesting a subcortical origin. Temporal analysis revealed that the early response contained excitatory and suppressive components. The excitatory component may be useful for sending rapid signals downstream, while the sharpening of the rising phase of later-arriving inputs (presumably from the cortex) by the suppressive component might improve the processing of facial expressions over time. Injection of a retrograde trans-synaptic tracer into the amygdala revealed presumed monosynaptic labeling in the pulvinar and disynaptic labeling in the superior colliculus, including the retinorecipient layers. We suggest that the early amygdala responses originating from the colliculo-pulvino-amygdalar pathway play dual roles in threat detection.

Eye Tracking Research on the Influence of Spatial Frequency and Inversion Effect on Facial Expression Processing in Children with Autism Spectrum Disorder.

Facial expression processing mainly depends on whether the facial features related to expressions can be fully acquired, and whether the appropriate processing strategies can be adopted according to different conditions. Children with autism spectrum disorder (ASD) have difficulty accurately recognizing facial expressions and responding appropriately, which is regarded as an important cause of their social disorders. This study used eye tracking technology to explore the internal processing mechanism of facial expressions in children with ASD under the influence of spatial frequency and inversion effects for improving their social disorders. The facial expression recognition rate and eye tracking characteristics of children with ASD and typical developing (TD) children on the facial area of interest were recorded and analyzed. The multi-factor mixed experiment results showed that the facial expression recognition rate of children with ASD under various conditions was significantly lower than that of TD children. TD children had more visual attention to the eyes area. However, children with ASD preferred the features of the mouth area, and lacked visual attention and processing of the eyes area. When the face was inverted, TD children had the inversion effect under all three spatial frequency conditions, which was manifested as a significant decrease in expression recognition rate. However, children with ASD only had the inversion effect under the LSF condition, indicating that they mainly used a featural processing method and had the capacity of configural processing under the LSF condition. The eye tracking results showed that when the face was inverted or facial feature information was weakened, both children with ASD and TD children would adjust their facial expression processing strategies accordingly, to increase the visual attention and information processing of their preferred areas. The fixation counts and fixation duration of TD children on the eyes area increased significantly, while the fixation duration of children with ASD on the mouth area increased significantly. The results of this study provided theoretical and practical support for facial expression intervention in children with ASD.

Reading and reacting to faces, the effect of facial mimicry in improving facial emotion recognition in individuals with antisocial behavior and psychopathic traits

Individuals with antisocial behavior and psychopathic traits are characterized by deficits in processing facial expressions, which results in poor social adaptation and dysfunctional interpersonal relationships. However, it is not clear how individuals with varying levels of these traits differ in this emotional impairment and if these deficits are due to correctly identifying or reacting appropriately to facial expressions. The aim of the study was to examine how individuals with these traits recognized and responded to affective facial expressions by using FaceReader software (which analyses footage of faces) across different experimental conditions (imitation, suppression, and control). Imitating facial expressions was introduced to examine whether it could direct participants’ attention to the facial cues and improve participants’ performance on the facial task. A total of 643 individuals from the community were pre-screened and a sample (N = 107; M age = 21.08, SD = 1.55), differentiated on levels of antisocial personality disorder (APD) symptoms and psychopathic (PSY) traits, who were selected based on extreme scores (high/low), were invited to participate in the study. Individuals with higher levels of APD symptoms and PSY traits (APD + PSY) expressed more anger than other groups, while those in the APD-only group expressed more sadness, compared to other groups. Overall, participants were compliant in following the instructions to imitate facial expressions. However, only the group with predominantly APD symptoms and the group with combined symptoms (APD + PSY) showed improvement in their accuracy ratings specifically when instructed to imitate facial expressions, compared to when no instructions were provided. The study offers a promising direction for targeting deficits in facial emotion recognition, suggesting that the deficits found in individuals with behavioral problems (with and without psychopathic traits) can be improved by asking them to imitate facial expressions.

The cerebellum as a moderator of negative bias of facial expression processing in depressive patients

• Negative bias (NB) in emotion processing is an important aspect of MDD. • Neural basis of NB in facial expression processing in MDD was assessed. • Higher activation in posterior cerebellum was found to relate to higher NB in MDD. • Higher activation in the same area was related to a lower NB in the HC group. • This area might mediate biasing emotion processing by reflecting self-mood. Negative bias—a mood-congruent bias in emotion processing—is an important aspect of major depressive disorder (MDD), and such a bias in facial expression recognition has a significant effect on patients’ social lives. Neuroscience research shows abnormal activity in emotion-processing systems regarding facial expressions in MDD. However, the neural basis of negative bias in facial expression processing has not been explored directly. Sixteen patients with MDD and twenty-three healthy controls (HC) who underwent an fMRI scan during an explicit facial emotion task with happy to sad faces were selected. We identified brain areas in which the MDD and HC groups showed different correlations between the behavioral negative bias scores and functional activities. Behavioral data confirmed the existence of a higher negative bias in the MDD group. Regarding the relationship with neural activity, higher activity of happy faces in the posterior cerebellum was related to a higher negative bias in the MDD group, but lower negative bias in the HC group. The sample size was small, and the possible effects of medication were not controlled for in this study. We confirmed a negative bias in the recognition of facial expressions in patients with MDD. fMRI data suggest the cerebellum as a moderator of facial emotion processing, which biases the recognition of facial expressions toward their own mood.