Processing Of Emotional Facial Expressions Research Articles

Deficits of unconscious emotional processing in patients with major depression: An ERP study

BackgroundMajor depressive disorder (MDD) is associated with behavioral and neurobiological evidences of negative bias in unconscious emotional processing. However, little is known about the time course of this deficit. The current study aimed to explore the unconscious processing of emotional facial expressions in MDD patients by means of event-related potentials (ERPs). MethodsThe ERP responses to subliminally presented happy/neutral/sad faces were recorded in 26 medication-free patients and 26 healthy controls in a backward masking task. Three ERP components were compared between patients and controls. ResultsDetection accuracy was at chance level for both groups, suggesting that the process was performed in the absence of conscious awareness of the emotional stimuli. Robust emotion×group interactions were observed in P1, N170 and P3. Compared with the neutral faces, 1) the patients showed larger P1 for sad and smaller P1 for happy faces; however, the controls showed a completely inverse P1 pattern; 2) the controls exhibited larger N170 in the happy but not in the sad trials, whereas patients had comparable larger N170 amplitudes in sad and happy trials; 3) although both groups exhibited larger P3 for emotional faces, the patients showed a priority for sad trials while the controls showed a priority for happy trials. ConclusionOur data suggested that negative processing bias exists on the unconscious level in individuals with MDD. The ERP measures indicated that the unconscious emotional processing in MDD patients has a time course of three-stage deflection.

Implicit and explicit processing of emotional facial expressions in Parkinson’s disease

ObjectiveBesides motor problems, Parkinson’s disease (PD) is associated with detrimental emotional and cognitive functioning. Deficient explicit emotional processing has been observed, whilst patients also show impaired Theory of Mind (ToM) abilities. However, it is unclear whether this PD patients’ ToM deficit is based on an inability to infer otherś emotional states or whether it is due to explicit emotional processing deficits. We investigated implicit and explicit emotional processing in PD with an affective priming paradigm in which we used pictures of human eyes for emotional primes and a lexical decision task (LDT) with emotional connoted words for target stimuli. MethodSixteen PD patients and sixteen matched healthy controls performed a LTD combined with an emotional priming paradigm providing emotional information through the facial eye region to assess implicit emotional processing. Second, participants explicitly evaluated the emotional status of eyes and words used in the implicit task. ResultsCompared to controls implicit emotional processing abilities were generally preserved in PD with, however, considerable alterations for happiness and disgust processing. Furthermore, we observed a general impairment of patients for explicit evaluation of emotional stimuli, which was augmented for the rating of facial expressions. ConclusionsThis is the first study reporting results for affective priming with facial eye expressions in PD patients. Our findings indicate largely preserved implicit emotional processing, with a specific altered processing of disgust and happiness. Explicit emotional processing was considerably impaired for semantic and especially for facial stimulus material. Poor ToM abilities in PD patients might be based on deficient explicit emotional processing, with preserved ability to implicitly infer other people’s feelings.

Stimulus-dependent amygdala involvement in affective theory of mind generation

Successful social interaction requires knowledge about another person's emotional states, represented in an affective theory of mind (ToM). This information can be acquired either directly or indirectly, i.e., by observing emotional facial expressions (EFE) or indirectly by inferring emotions through cognitive perspective taking. Therefore, it is of great interest how the function of the cortical ToM network and the limbic system in affective ToM depends on the presence of facial expressions.We addressed this question in a functional magnetic resonance imaging (fMRI) study. The experimental paradigm applied a well-established ToM cartoon task to test functional effects of EFE on the activation of the amygdala and the anterior ToM network during affective ToM judgments. During the task, 22 healthy participants had to judge the changes of the emotional state of the stories protagonist in the presence or absence of EFE. After quality control, 21 data sets entered the final analyses.The presence of EFE during affective ToM judgments was associated with shorter reaction times as well as increased activation of the right amygdala, most probably located in the basolateral nucleus (BLA), coincident with reduced activation of ToM-related regions of the prefrontal cortex. Psychophysiological interactions (PPI) revealed EFE-dependent modulation of connectivity between the right BLA and the contralateral ToM network regions.In combination with the functional interaction of EFE and affective ToM in the right amygdala, our data suggest a complementary but parallel organization of EFE processing and affective ToM. In this framework, the amygdala seems to act as an EFE detector when affective ToM judgments are demanded. Additionally, the facts that EFE induced exclusively right-sided amygdala activation and modulated the connectivity with the contralateral ToM network support the idea of a functional lateralization of stimulus driven components of affective ToM.

“The Inner Theater”

Nonverbal affective signals may not only serve as a valuable guide in any day-to-day social encounter, but their role may also translate to the world of literature and storytelling. This article presents a series of three experiments aimed at investigating the processing of emotional facial expressions and nonverbal vocal signals (e.g., prosody, laughter) described in literature. Experiments addressed research questions relating to processes of imagery and simulation that may guide the decoding of described vocal and facial cue with the experimental designs relying on both behavioral and psychophysiological measures (e.g., ratings of emotional valence, auditory and visual imagery, and skin conductance response). Results obtained in these studies indicated that not only the codes and symbols used to convey emotional information in literature may resemble real-life experiences, but similarities may also emerge with respect to the perceptual mechanisms used to derive meaning from described emotional cues. Observations of a vivid, modality-specific mental imagery evoked during reading suggest that reader may, in fact, emulate perceptual experiences associated with actually seeing or hearing similar affective cues during everyday social exchange. Latter assumptions are further corroborated by the observations of emotion-modulated changes in skin conductance responses elicited during reading suggesting that mental representations formed in the process may not only include vivid visual or auditory impressions of described facial and vocal cues but may also comprise bodily representations of the emotional states associated with the depicted affective cues.

When do fearful faces override inhibition of return?

Inhibition of return (IOR) occurs when more than about 300ms elapses between the cue and the target in atypical peripheral cueing task: reaction times (RTs) become longer when the cue and target locations are the same versus different. IOR could serve the adaptive role of optimizing visual search by discouraging the re-inspection of previously attended locations. As such, IOR should not reduce our chances of noticing relevant event information and emotional stimuli, in particular. However, previous studies have led to inconsistent results. The present study offers a systematic investigation of the conditions under which target fearful faces can modulate either the magnitude or the time course of the IOR effect. Notably, we manipulated the depth of facial processing required to perform the task and/or the task relevance of the facial expressions. When participants localized target faces (Experiment 1) or discriminated them from non-face stimuli (Experiment 2), their emotional expression had no impact on IOR whatsoever. However, IOR occurred later for fearful versus neutral faces when the participants performed emotion (Experiment 3) or gender (Experiment 4) discrimination tasks. These findings are discussed with regard to the mechanisms responsible for IOR and to the processing of emotional facial expressions.

Passing faces: sequence-dependent variations in the perceptual processing of emotional faces

ABSTRACTThere is broad evidence that contextual factors influence the processing of emotional facial expressions. Yet temporal-dynamic aspects, inter alia how face processing is influenced by the specific order of neutral and emotional facial expressions, have been largely neglected. To shed light on this topic, we recorded electroencephalogram from 168 healthy participants while they performed a gender-discrimination task with angry and neutral faces. Our event-related potential (ERP) analyses revealed a strong emotional modulation of the N170 component, indicating that the basic visual encoding and emotional analysis of a facial stimulus happen, at least partially, in parallel. While the N170 and the late positive potential (LPP; 400–600 ms) were only modestly affected by the sequence of preceding faces, we observed a strong influence of face sequences on the early posterior negativity (EPN; 200–300 ms). Finally, the differing response patterns of the EPN and LPP indicate that these two ERPs represent distinct processes during face analysis: while the former seems to represent the integration of contextual information in the perception of a current face, the latter appears to represent the net emotional interpretation of a current face.

Precentral and inferior prefrontal hypoactivation during facial emotion recognition in patients with schizophrenia: A functional near-infrared spectroscopy study

Although patients with schizophrenia demonstrate abnormal processing of emotional face recognition, the neural substrates underlying this process remain unclear. We previously showed abnormal fronto-temporal function during facial expression of emotions, and cognitive inhibition in patients with schizophrenia using functional near-infrared spectroscopy (fNIRS). The aim of the current study was to use fNIRS to identify which brain regions involved in recognizing emotional faces are impaired in patients with schizophrenia, and to determine the neural substrates underlying the response to emotional facial expressions per se, and to facial expressions with cognitive inhibition. We recruited 19 patients with schizophrenia and 19 healthy controls, statistically matched on age, sex, and premorbid IQ. Brain function was measured by fNIRS during emotional face assessment and face identification tasks. Patients with schizophrenia showed lower activation of the right precentral and inferior frontal areas during the emotional face task compared to controls. Further, patients with schizophrenia were slower and less accurate in completing tasks compared to healthy participants. Decreasing performance was associated with increasing severity of the disease. Our present and prior studies suggest that the impaired behavioral performance in schizophrenia is associated with different mechanisms for processing emotional facial expressions versus facial expressions combined with cognitive inhibition.

Emotional decoding abilities in alcohol-dependence: A categorical perception study

Emotional and interpersonal difficulties have been widely described in alcohol-dependence [1] and are thought to play a crucial role in the development and maintenance of this disease [2]. In particular, impairments in the decoding of emotional facial expression (EFE) have been repeatedly reported and may have serious deleterious effects for the everyday life of alcohol-dependent individuals (ADI), notably by affecting their interpersonal relationships [3]. However, the large majority of earlier studies that assessed emotional decoding abilities among ADI were interested in the processing of prototypical full-blown EFE while in everyday social life, EFE are usually not entirely straightforward but are rather composed of a mix of different emotions [4]. The aim of this study was therefore to determine whether ADI exhibit the categorical perception effect, which is a critical process observed in healthy populations to efficiently decode ambiguous EFE. Nineteen recently detoxified ADI and 19 healthy controls (HC), matched for age and gender, were presented with facial stimuli depicting [4] EFE (happy, angry, sad, and neutral), morphed along continua between each possible pair of emotions. Participants had to indicate the predominant emotion within the randomly presented facial stimuli. For each EFE, a sigmoid function that estimated the percentage of identifications according to the morph steps was adjusted for each participant's data. While there was no significant group difference regarding the response slope (indicating how abruptly the shift in responses happens), the identification threshold (i.e. the function midpoint) was significantly increased in ADI compared to HC, independently of the EFE category. The categorical perception of EFE per se appeared thus preserved in alcohol-dependence, but ADI exhibited a bias in EFE decoding characterized by a global under-identification. To conclude, this study is the first to evidence an EFE processing deficit in ADI by using this kind of emotional continuum paradigm measuring the categorical perception effect.

Brain response during the M170 time interval is sensitive to socially relevant information

Deciphering the social meaning of facial displays is a highly complex neurological process. The M170, an event related field component of MEG recording, like its EEG counterpart N170, was repeatedly shown to be associated with structural encoding of faces. However, the scope of information encoded during the M170 time window is still being debated. We investigated the neuronal origin of facial processing of integrated social rank cues (SRCs) and emotional facial expressions (EFEs) during the M170 time interval. Participants viewed integrated facial displays of emotion (happy, angry, neutral) and SRCs (indicated by upward, downward, or straight head tilts). We found that the activity during the M170 time window is sensitive to both EFEs and SRCs. Specifically, highly prominent activation was observed in response to SRC connoting dominance as compared to submissive or egalitarian head cues. Interestingly, the processing of EFEs and SRCs appeared to rely on different circuitry. Our findings suggest that vertical head tilts are processed not only for their sheer structural variance, but as social information. Exploring the temporal unfolding and brain localization of non-verbal cues processing may assist in understanding the functioning of the social rank biobehavioral system.

CHANGES IN REGIONAL BRAIN ACTIVATION RELATED TO DEPRESSIVE STATE: A 2-YEAR LONGITUDINAL FUNCTIONAL MRI STUDY.

Abnormal brain activations during processing of emotional facial expressions in depressed patients have been demonstrated. We investigated the natural course of brain activation in response to emotional faces in depression, indexed by functional magnetic resonance imaging (fMRI) scans preceding and following change in depressive state. We hypothesized a decrease in activation in the amygdala, anterior cingulate cortex (ACC), and insula with a decrease in depressive pathology. A 2-year longitudinal fMRI study was conducted as part of the Netherlands Study of Depression and Anxiety. We included 32 healthy controls and 49 depressed patients. During the second scan, 27 patients were in remission (remitters), the other 22 were not (nonremitters). All participants viewed faces with emotional expressions during scanning. Rostral ACC activation during processing of happy faces was predictive of a decrease in depressive state (PFWE = .003). In addition, remitters showed decreased activation of the insula over time (PFWE = .016), specifically during happy faces. Nonremitters displayed increased abnormalities in emotion recognition circuitry during the second scan compared to the first. No effect of selective serotonin reuptake inhibitor use was observed. Our results demonstrate that rostral ACC activation may predict changes in depressive state even at 2-year outcome. The association between change in depressed state and change in insula activation provides further evidence for the role of the insula in a network maintaining emotional and motivational states.

Drug effects on responses to emotional facial expressions: recent findings.

Many psychoactive drugs increase social behavior and enhance social interactions, which may, in turn, increase their attractiveness to users. Although the psychological mechanisms by which drugs affect social behavior are not fully understood, there is some evidence that drugs alter the perception of emotions in others. Drugs can affect the ability to detect, attend to, and respond to emotional facial expressions, which in turn may influence their use in social settings. Either increased reactivity to positive expressions or decreased response to negative expressions may facilitate social interaction. This article reviews evidence that psychoactive drugs alter the processing of emotional facial expressions using subjective, behavioral, and physiological measures. The findings lay the groundwork for better understanding how drugs alter social processing and social behavior more generally.

The time course of emotional picture processing: an event-related potential study using a rapid serial visual presentation paradigm.

The present study recorded event-related potentials using rapid serial visual presentation paradigm to explore the time course of emotionally charged pictures. Participants completed a dual-target task as quickly and accurately as possible, in which they were asked to judge the gender of the person depicted (task 1) and the valence (positive, neutral, or negative) of the given picture (task 2). The results showed that the amplitudes of the P2 component were larger for emotional pictures than they were for neutral pictures, and this finding represents brain processes that distinguish emotional stimuli from non-emotional stimuli. Furthermore, positive, neutral, and negative pictures elicited late positive potentials with different amplitudes, implying that the differences between emotions are recognized. Additionally, the time course for emotional picture processing was consistent with the latter two stages of a three-stage model derived from studies on emotional facial expression processing and emotional adjective processing. The results of the present study indicate that in the three-stage model of emotion processing, the middle and late stages are more universal and stable, and thus occur at similar time points when using different stimuli (faces, words, or scenes).

Independent effects of reward expectation and spatial orientation on the processing of emotional facial expressions.

The present study investigated the effect of reward expectation and spatial orientation on the processing of emotional facial expressions, using a spatial cue-target paradigm. A colored cue was presented at the left or right side of the central fixation point, with its color indicating the monetary reward stakes of a given trial (incentive vs. non-incentive), followed by the presentation of an emotional facial target (angry vs. neutral) at a cued or un-cued location. Participants were asked to discriminate the emotional expression of the target, with the cue-target stimulus onset asynchrony being 200-300 ms in Experiment 1 and 950-1250 ms in Experiment 2a (without a fixation cue) and Experiment 2b (with a fixation cue), producing a spatial facilitation effect and an inhibition of return effect, respectively. The results of all the experiments revealed faster reaction times in the monetary incentive condition than in the non-incentive condition, demonstrating the effect of reward to facilitate task performance. An interaction between reward expectation and the emotion of the target was evident in all the three experiments, with larger reward effects for angry faces than for neutral faces. This interaction was not affected by spatial orientation. These findings demonstrate that incentive motivation improves task performance and increases sensitivity to angry faces, irrespective of spatial orienting and reorienting processes.

Revue conceptuelle et empirique du traitement des expressions faciales émotionnelles chez l’enfant anxieux.

Anxiety disorders are known to disturb the processing of emotional facial expressions (EFE). Notably, attentional biases toward threatening EFE would play a role in the aetiology and the maintenance of anxious disorders. A large amount of studies has approached these questions in adults but studies on children and youth remain rare and their results are less consistent. This paper reviews the data concerning the features and the behavioural, neuroanatomical and neurophysiological correlates of biases in EFE processing in childhood anxiety. The recognition of EFE will also be discussed within the context of cognitive development. Finally, we will put a critical view on this field in order to outline proposals for future research.

Blunted brain activation in patients with schizophrenia in response to emotional cognitive inhibition: A functional near-infrared spectroscopy study

IntroductionPatients with schizophrenia (SZ) have deficits of facial emotion processing and cognitive inhibition, but the brain pathophysiology underlying these deficits and their interaction are not clearly understood. We tested brain activity during an emotional face go/no-go task that requires rapid executive control affected by emotional stimuli in patients with SZ using functional near-infrared spectroscopy (fNIRS). MethodsTwenty-five patients with SZ and 28 healthy control subjects were studied. We evaluated behavioral performance and used fNIRS to measure oxygenated hemoglobin concentration changes in fronto-temporal areas during the emotional go/no-go task with emotional and non-emotional blocks. ResultsPatients with SZ made more errors and had longer reaction times in both test blocks compared with healthy subjects. Significantly greater activation in the inferior, superior, middle, and orbital frontal regions were observed in healthy subjects during the emotional go/no-go block compared to the non-emotional go/no-go block, but this difference was not observed in patients with SZ. Relative to healthy subjects, patients with SZ showed less activation in the superior and orbital frontal and middle temporal regions during the emotional go/no-go block. DiscussionOur results suggest that fronto-temporal dysfunction in patients with SZ is due to an interaction between abnormal processing of emotional facial expressions with negative valence and cognitive inhibition, especially during the rapid selection of rule-based associations that override automatic emotional response tendencies. They indicate that fronto-temporal dysfunction is involved in the pathophysiology of emotional–cognitive deficits in patients with SZ.

Is empathy necessary to comprehend the emotional faces? The empathic effect on attentional mechanisms (eye movements), cortical correlates (N200 event-related potentials) and facial behaviour (electromyography) in face processing

The present research explored the effect of social empathy on processing emotional facial expressions. Previous evidence suggested a close relationship between emotional empathy and both the ability to detect facial emotions and the attentional mechanisms involved. A multi-measure approach was adopted: we investigated the association between trait empathy (Balanced Emotional Empathy Scale) and individuals' performance (response times; RTs), attentional mechanisms (eye movements; number and duration of fixations), correlates of cortical activation (event-related potential (ERP) N200 component), and facial responsiveness (facial zygomatic and corrugator activity). Trait empathy was found to affect face detection performance (reduced RTs), attentional processes (more scanning eye movements in specific areas of interest), ERP salience effect (increased N200 amplitude), and electromyographic activity (more facial responses). A second important result was the demonstration of strong, direct correlations among these measures. We suggest that empathy may function as a social facilitator of the processes underlying the detection of facial emotion, and a general “facial response effect” is proposed to explain these results. We assumed that empathy influences cognitive and the facial responsiveness, such that empathic individuals are more skilful in processing facial emotion.

Neural signatures of conscious and unconscious emotional face processing in human infants

Human adults can process emotional information both with and without conscious awareness, and it has been suggested that the two processes rely on partly distinct brain mechanisms. However, the developmental origins of these brain processes are unknown. In the present event-related brain potential (ERP) study, we examined the brain responses of 7-month-old infants in response to subliminally (50 and 100 msec) and supraliminally (500 msec) presented happy and fearful facial expressions. Our results revealed that infants' brain responses (Pb and Nc) over central electrodes distinguished between emotions irrespective of stimulus duration, whereas the discrimination between emotions at occipital electrodes (N290 and P400) only occurred when faces were presented supraliminally (above threshold). This suggests that early in development the human brain not only discriminates between happy and fearful facial expressions irrespective of conscious perception, but also that, similar to adults, supraliminal and subliminal emotion processing relies on distinct neural processes. Our data further suggest that the processing of emotional facial expressions differs across infants depending on their behaviorally shown perceptual sensitivity. The current ERP findings suggest that distinct brain processes underpinning conscious and unconscious emotion perception emerge early in ontogeny and can therefore be seen as a key feature of human social functioning.

Attentional Biases in Processing Emotional Facial Expressions: Effects of State Anxiety, Trait Anxiety and Awareness

The effect of state anxiety and trait anxiety on selective attention for threatening, neutral and happy schematic faces was investigated. A student sample was assigned to high trait anxious (HTA) or low trait anxious (LTA) groups using questionnaire scores and state anxiety was manipulated through the threat of electric shock. Stimulus materials were presented both outside (using a backward masking procedure) and within awareness. A novel version of a probe classification task was developed to assess performance when distracting information and the central task were spatially separated. For the masked trials, the LTA group were slower to identify the status of the probe on happy face trials relative to threat face trials in the shock safe condition, and slower on threat face trials relative to happy face trials in the shock threat condition. For the HTA group, performance on the probe status task was unaffected by shock condition status or item valence for the masked exposures. During the unmasked exposure trials neither trait anxiety status, item valence nor shock condition affected response latencies to the probes. Results are interpreted with respect to contemporary models of attention and anxiety.

The temporal unfolding of face processing in social anxiety disorder--a MEG study.

The current study is the first to use magnetoencephalography (MEG) to examine how individuals with social anxiety disorder (SAD) process emotional facial expressions (EFEs). We expected that, compared to healthy controls (HCs), participants with SAD will show an early (<200 ms post-stimulus) over-activation in the insula and the fusiform gyrus (FG, associated with the N170/M170 component), and later (>200 ms post-stimulus) over-activation in the dorsolateral prefrontal cortex (DLPFC). Individuals with SAD (n = 12) and healthy controls (HCs, n = 12) were presented with photographs of facial displays during MEG recording. As compared to the HC group, the SAD group showed a reduced M170 (right FG under-activation around 130–200 ms); early reduced activation in the right insula, and lower insular sensitivity to the type of EFE displayed. In addition, the SAD group showed a late over-activation in the right DLPFC. This unique EFE processing pattern in SAD suggests an early under-activation of cortical areas, possibly related to reduced emphasis on high spatial frequency information and greater early emphasis on low spatial frequency information. The late DLPFC over-activation in the SAD group may correlate to failures of cognitive control in this disorder. The importance of a temporal perspective for the understanding of facial processing in psychopathology is underlined.

Distinct facial processing related negative cognitive bias in first-episode and recurrent major depression: evidence from the N170 ERP component.

BackgroundStates of depression are associated with increased sensitivity to negative events. For this novel study, we have assessed the relationship between the number of depressive episodes and the dysfunctional processing of emotional facial expressions.Methodology/Principal FindingsWe used a visual emotional oddball paradigm to manipulate the processing of emotional information while event-related brain potentials were recorded in 45 patients with first episode major depression (F-MD), 40 patients with recurrent major depression (R-MD), and 46 healthy controls (HC). Compared with the HC group, F-MD patients had lower N170 amplitudes when identifying happy, neutral, and sad faces; R-MD patients had lower N170 amplitudes when identifying happy and neutral faces, but higher N170 amplitudes when identifying sad faces. F-MD patients had longer N170 latencies when identifying happy, neutral, and sad faces relative to the HC group, and R-MD patients had longer N170 latencies when identifying happy and neutral faces, but shorter N170 latencies when identifying sad faces compared with F-MD patients. Interestingly, a negative relationship was observed between N170 amplitude and the depressive severity score for identification of happy faces in R-MD patients while N170 amplitude was positively correlated with the depressive severity score for identification of sad faces in F-MD and R-MD patients. Additionally, the deficits of N170 amplitude for sad faces positively correlated with the number of depressive episodes in R-MD patients.Conclusion/SignificanceThese results provide new evidence that having more recurrent depressive episodes and serious depressive states are likely to aggravate the already abnormal processing of emotional facial expressions in patients with depression. Moreover, it further suggests that the impaired processing as indexed by N170 amplitude for positive face identification may be a potentially useful biomarker for predicting propagation of depression while N170 amplitude for negative face identification could be a potential biomarker for depression recurrence.