Facial Affect Recognition Research Articles

Emotion perception and quality of life in bipolar I disorder

BackgroundAcross two studies we examined the role of emotion perception as a correlate of quality of life and occupational functioning in bipolar I disorder. MethodIn Study 1, we tested a multifactorial model of quality of life and occupational functioning, including the role of emotion perception and other established correlates of functional outcomes, among 42 participants diagnosed with bipolar I disorder. In Study 2, participants diagnosed with bipolar I disorder and age- and gender-matched controls completed an affect recognition task and a quality of life measure. ResultsAcross both studies, emotion perception related to functional outcomes. In Study 1, self-rated emotion perception explained unique variance in subjective well-being after controlling for illness characteristics, education, and executive function. In Study 2, a behavioral measure of facial affect recognition accuracy was related to quality of life, even after controlling for illness severity. LimitationsLimitations include the use of a cross-sectional design, relatively small sample sizes, and the focus on only one aspect of social cognition. ConclusionsFindings indicate that emotion perception may protect quality of life in bipolar disorder. This dimension may help predict important outcomes and, with further research, could serve as a potential treatment target.

Dynamics of alpha oscillations elucidate facial affect recognition in schizophrenia

Impaired facial affect recognition is characteristic of schizophrenia and has been related to impaired social function, but the relevant neural mechanisms have not been fully identified. The present study sought to identify the role of oscillatory alpha activity in that deficit during the process of facial emotion recognition. Neuromagnetic brain activity was monitored while 44 schizophrenia patients and 44 healthy controls viewed 5-s videos showing human faces gradually changing from neutral to fearful or happy expressions or from the neutral face of one poser to the neutral face of another. Recognition performance was determined separately by self-report. Relative to prestimulus baseline, controls exhibited a 10- to 15-Hz power increase prior to full recognition and a 10- to 15-Hz power decrease during the postrecognition phase. These results support recent proposals about the function of alpha-band oscillations in normal stimulus evaluation. The patients failed to show this sequence of alpha power increase and decrease and also showed low 10- to 15-Hz power and high 10- to 15-Hz connectivity during the prestimulus baseline. In light of the proposal that a combination of alpha power increase and functional disconnection facilitates information intake and processing, the finding of an abnormal association of low baseline alpha power and high connectivity in schizophrenia suggests a state of impaired readiness that fosters abnormal dynamics during facial affect recognition.

The relationship between facial affect recognition and cognitive functioning after traumatic brain injury

Primary objective: There is considerable evidence suggesting facial affect recognition and cognitive functions are impaired in many people with moderate-to-severe traumatic brain injury (TBI). However, little is known about the relationship between these two domains in the TBI population.Research design: This study investigated the relationship between facial affect recognition and cognitive functioning in 75 adults with moderate-to-severe TBI.Methods and procedures: Participants were administered three facial affect recognition tests and a computerized cognitive test battery that assessed seven cognitive domains.Main outcomes and results: Deficits in facial affect recognition were significantly correlated with impairments in non-verbal memory, working memory, speed of processing, verbal memory and verbal delayed memory. No significant relationship was found between executive dysfunction and facial affect recognition impairments. Non-verbal memory, working memory and speed of processing significantly predicted overall facial affect recognition performance.Conclusions: It is concluded that impairment in several cognitive processes may contribute to facial affect recognition deficits in TBI, in particular non-verbal memory, working memory and speed of processing. Furthermore, executive functioning may not be a critical factor in facial affect recognition, but would most likely be important in deciding what to do once facial affect is perceived.Trial registration: ClinicalTrials.gov identifier: NCT00283153.

Deficits in Facial Emotion Recognition Indicate Behavioral Changes and Impaired Self-Awareness after Moderate to Severe Traumatic Brain Injury

Traumatic brain injury (TBI) is a leading cause of disability, specifically among younger adults. Behavioral changes are common after moderate to severe TBI and have adverse consequences for social and vocational functioning. It is hypothesized that deficits in social cognition, including facial affect recognition, might underlie these behavioral changes. Measurement of behavioral deficits is complicated, because the rating scales used rely on subjective judgement, often lack specificity and many patients provide unrealistically positive reports of their functioning due to impaired self-awareness. Accordingly, it is important to find performance based tests that allow objective and early identification of these problems. In the present study 51 moderate to severe TBI patients in the sub-acute and chronic stage were assessed with a test for emotion recognition (FEEST) and a questionnaire for behavioral problems (DEX) with a self and proxy rated version. Patients performed worse on the total score and on the negative emotion subscores of the FEEST than a matched group of 31 healthy controls. Patients also exhibited significantly more behavioral problems on both the DEX self and proxy rated version, but proxy ratings revealed more severe problems. No significant correlation was found between FEEST scores and DEX self ratings. However, impaired emotion recognition in the patients, and in particular of Sadness and Anger, was significantly correlated with behavioral problems as rated by proxies and with impaired self-awareness. This is the first study to find these associations, strengthening the proposed recognition of social signals as a condition for adequate social functioning. Hence, deficits in emotion recognition can be conceived as markers for behavioral problems and lack of insight in TBI patients. This finding is also of clinical importance since, unlike behavioral problems, emotion recognition can be objectively measured early after injury, allowing for early detection and treatment of these problems.

Affective facial expression processing in 15-month-old infants who have experienced maltreatment: an event-related potential study.

This study examined the neural correlates of facial affect processing in 15 month-old maltreated and nonmaltreated infants. Event-related potentials (ERPs) were elicited while infants passively viewed standardized pictures of female models posing angry, happy, and neutral facial expressions. Differences between maltreated (N = 25) and nonmaltreated (N = 20) infants were observed on three ERP components: P1, P260, and Nc. The results for the P260 waveform were consistent with previous ERP findings in older maltreated children, showing a hyperresponsivity to angry facial affect relative to happy in maltreated infants. However, the findings for the P1 and Nc indicated a hyperresponsivity to relative affective novelty, whereby the maltreated infants had greater amplitude in response to happy facial affect, whereas nonmaltreated infants had greater responsivity to angry faces. The results provided further support for the hypothesis that the experience of maltreatment and the predominantly negative emotional tone in maltreating families alters the functioning of neural systems associated with the processing of facial emotion. In particular, the findings suggested that at this early stage in the development of facial affect recognition, novelty of facial emotion is especially salient. These results exemplify the importance of early preventive interventions focused on emotion for children who have experienced maltreatment early in life.

The Impact of a Single Administration of Intranasal Oxytocin on the Recognition of Basic Emotions in Humans: A Meta-Analysis

Many studies have highlighted the potential of oxytocin (OT) to enhance facial affect recognition in healthy humans. However, inconsistencies have emerged with regard to the influence of OT on the recognition of specific emotional expressions (happy, angry, fear, surprise, disgust, and sadness). In this study, we conducted a meta-analysis of seven studies comprising 381 research participants (71 females) examining responses to the basic emotion types to assess whether OT enhances the recognition of emotion from human faces and whether this was influenced by the emotion expression and exposure time of the face. Results showed that intranasal OT administration enhances emotion recognition of faces overall, with a Hedges g effect size of 0.29. When analysis was restricted to facial expression types, significant effects of OT on recognition accuracy were specifically found for the recognition of happy and fear faces. We also found that effect sizes increased to moderate when exposure time of the photograph was restricted to early phase recognition (< 300 ms) for happy and angry faces, or later phase recognition for fear faces (> 300 ms). The results of the meta-analysis further suggest that OT has potential as a treatment to improve the recognition of emotion in faces, allowing individuals to improve their insight into the intentions, desires, and mental states of others.

Modulation of α Power and Functional Connectivity during Facial Affect Recognition

Research has linked oscillatory activity in the α frequency range, particularly in sensorimotor cortex, to processing of social actions. Results further suggest involvement of sensorimotor α in the processing of facial expressions, including affect. The sensorimotor face area may be critical for perception of emotional face expression, but the role it plays is unclear. The present study sought to clarify how oscillatory brain activity contributes to or reflects processing of facial affect during changes in facial expression. Neuromagnetic oscillatory brain activity was monitored while 30 volunteers viewed videos of human faces that changed their expression from neutral to fearful, neutral, or happy expressions. Induced changes in α power during the different morphs, source analysis, and graph-theoretic metrics served to identify the role of α power modulation and cross-regional coupling by means of phase synchrony during facial affect recognition. Changes from neutral to emotional faces were associated with a 10-15 Hz power increase localized in bilateral sensorimotor areas, together with occipital power decrease, preceding reported emotional expression recognition. Graph-theoretic analysis revealed that, in the course of a trial, the balance between sensorimotor power increase and decrease was associated with decreased and increased transregional connectedness as measured by node degree. Results suggest that modulations in α power facilitate early registration, with sensorimotor cortex including the sensorimotor face area largely functionally decoupled and thereby protected from additional, disruptive input and that subsequent α power decrease together with increased connectedness of sensorimotor areas facilitates successful facial affect recognition.

Facial emotion recognition in child psychiatry: A systematic review

This review focuses on facial affect (emotion) recognition in children and adolescents with psychiatric disorders other than autism. A systematic search, using PRISMA guidelines, was conducted to identify original articles published prior to October 2011 pertaining to face recognition tasks in case-control studies. Used in the qualitative synthesis were: 2 studies on schizophrenia, 18 on mood disorders, 16 on anxiety disorders, 4 on eating disorders, 14 on ADHD and 9 on conduct disorder. Our review suggests that there are abnormalities in facial emotion recognition in a wide range of child psychiatric disorders and that these are likely to have a negative effect on both family and peer relationships. Scope for further research has been identified.

Conduct Symptoms and Emotion Recognition in Adolescent Boys with Externalization Problems

Background. In adults with antisocial personality disorder, marked alterations in the recognition of facial affect were described. Less consistent data are available on the emotion recognition in adolescents with externalization problems. The aim of the present study was to assess the relation between the recognition of emotions and conduct symptoms in adolescent boys with externalization problems. Methods. Adolescent boys with externalization problems referred to Vadaskert Child Psychiatry Hospital participated in the study after informed consent (N = 114, 11–17 years, mean = 13.4). The conduct problems scale of the strengths and difficulties questionnaire (parent and self-report) was used. The performance in a facial emotion recognition test was assessed. Results. Conduct problems score (parent and self-report) was inversely correlated with the overall emotion recognition. In the self-report, conduct problems score was inversely correlated with the recognition of anger, fear, and sadness. Adolescents with high conduct problems scores were significantly worse in the recognition of fear, sadness, and overall recognition than adolescents with low conduct scores, irrespective of age and IQ. Conclusions. Our results suggest that impaired emotion recognition is dimensionally related to conduct problems and might have importance in the development of antisocial behavior.

Predicting the accuracy of facial affect recognition: The interaction of child maltreatment and intellectual functioning

Predicting the accuracy of facial affect recognition: The interaction of child maltreatment and intellectual functioning

Relationship between auditory processing and affective prosody in schizophrenia

Patients with schizophrenia have well-established deficits in their ability to identify emotion from facial expression and tone of voice. In the visual modality, there is strong evidence that basic processing deficits contribute to impaired facial affect recognition in schizophrenia. However, few studies have examined the auditory modality for mechanisms underlying affective prosody identification. In this study, we explored links between different stages of auditory processing, using event-related potentials (ERPs), and affective prosody detection in schizophrenia. Thirty-six schizophrenia patients and 18 healthy control subjects received tasks of affective prosody, facial emotion identification, and tone matching, as well as two auditory oddball paradigms, one passive for mismatch negativity (MMN) and one active for P300. Patients had significantly reduced MMN and P300 amplitudes, impaired auditory and visual emotion recognition, and poorer tone matching performance, relative to healthy controls. Correlations between ERP and behavioral measures within the patient group revealed significant associations between affective prosody recognition and both MMN and P300 amplitudes. These relationships were modality specific, as MMN and P300 did not correlate with facial emotion recognition. The two ERP waves accounted for 49% of the variance in affective prosody in a regression analysis. Our results support previous suggestions of a relationship between basic auditory processing abnormalities and affective prosody dysfunction in schizophrenia, and indicate that both relatively automatic pre-attentive processes (MMN) and later attention-dependent processes (P300) are involved with accurate auditory emotion identification. These findings provide support for bottom-up (e.g., perceptually based) cognitive remediation approaches.

A review of the role of empathy in violence risk in mental disorders

Despite an established link between certain mental disorders and violence, the origins of this are not always clear. Recent work has suggested a role for social cognition deficits in this relationship. We conducted a systematic literature search using EMBASE, SCOPUS, PsychINFO, Science Direct and Ovid Medline databases and search terms relating to empathy, violence and mental disorders. 15 studies were classified as assessing either theory of mind (ToM) (n = 6) or facial affect recognition (FAR) (n = 10). Better mentalizing ability may be linked with violence. Violent patients with schizophrenia perform worse than those with personality disorder, but outperform their non-violent counterparts on complex theory of mind tasks. Six studies examined facial affect recognition in violent psychopathy patients, three of which found impairments in high psychopathy patients. Four studies investigated FAR in violent schizophrenia patients, who again tended to outperform non-violent patients, though the evidence for specificity of emotion remains mixed. Empathy may play a mediating role in the relationship between violence and mental disorder. Current findings are limited by methodological inconsistencies. Future studies would benefit from more comprehensive assessments of violence and co-morbidities, and more standardized measures across studies.

Les endophénotypes émotionnels dans les troubles bipolaires et la schizophrénie

Because of its proximity to the vulnerability model hypotheses and its correlation to functional outcome, emotional processing has emerged as a major topic of research in bipolar as well as schizophrenia disorders. By experimental necessity, the somewhat vague notion of emotion has been parceled into several dimensions. Thus, the aptitude to perceive and decrypt emotional stimuli has been artificially differentiated between the emotional feelings reported by subjects and the concomitant physiological changes. A large literature has been built to characterize a singular emotional profile combining a deficit in facial affect recognition with preserved or even enhanced emotional experience of negative emotions. Even though emotional disturbances tend to be intuitively associated with bipolar disorders, this latter profile is far better documented in schizophrenia. Furthermore, several studies of high-risk individuals or of relatively healthy populations allow for selecting some of these emotional disturbances as endophenotypes. Conversely, functional imaging works have explored the cortico-limbic circuit underlying these functions in both the acute and stabilized phases of these illnesses. Here again, a fairly common pattern seems to emerge in both disorders with hyperactivity of the limbic system and failure to activate the modulating regions of the prefrontal cortex. However, inconsistencies in results need to be addressed, and neuroimaging works on healthy relatives or high-risk individuals are still very scarce. These results are discussed in light of the models of shared genetic vulnerability between schizophrenia and bipolar disorders.

Facial Affect Recognition in CADASIL Patients

We explored the capacity of Cerebral Autosomal-Dominant Arteriopathy with Subcortical Infarcts and Leukoencephalopathy (CADASIL) patients to recognize facial expressions. Twenty-three consecutive CADASIL patients and 23 age-matched, gender-matched, and education-matched controls were assessed with a semi-structured psychiatric interview, cognitive tests, and the Ekman and Friesen test. Cases and controls (5 males, 18 females) had a mean age (+SD) of 52.4 + 15.7 and 54.0 + 15.3 years, respectively, and a Mini-Mental State Examination (MMSE) mean score of 27.8 + 2.2 and 28.9 + 1.3 (p < .05). Eighteen out of the 23 (78.3%) CADASIL patients and 10 (43.5%) controls were diagnosed as affected by major depression according to DSM-IV criteria (p < .05). The CADASIL patients had an impaired ability of emotion recognition in comparison with controls, particularly for fear expression. This effect was not mediated by depression, cognitive impairment, and MMSE score. Facial affect recognition is reduced in the CADASIL patients and this impairment might represent an early manifestation of the disease.

Association of menstrual cycle phase with the core components of empathy

Evidence has accumulated that emotion recognition performance varies with menstrual cycle phase. However, according to some empathy models, facial affect recognition constitutes only one component of empathic behavior, besides emotional perspective taking and affective responsiveness. It remains unclear whether menstrual cycle phase and thus estradiol and progesterone levels are also associated with the two other empathy constructs.Therefore, we investigated 40 healthy right-handed females, 20 during their follicular phase and 20 during their midluteal phase and compared their performance in three tasks tapping the empathic components as well as self-report data. Salivary hormone levels were obtained and correlated with performance parameters. Subjects were matched for age and education and did not differ in neuropsychological function. Analysis of empathy performance revealed a significant effect of phase in emotion recognition, showing higher accuracy in the follicular group. Regarding affective responsiveness, we observed a significant difference in reaction times, with faster responses for sad and angry stimuli in the midluteal group. No significant group difference emerged for emotional perspective taking. Furthermore, significant correlations between progesterone levels and emotion recognition accuracy and affective responsiveness emerged only in the luteal group. However, groups did not differ in self-reported empathy.Our results indicate that menstrual cycle phase and thus ovarian hormone concentration are differentially related to empathic behavior, particularly emotion recognition and responsiveness to negative situations, with progesterone covarying with both in the luteal phase.

Effects of nicotine on social cognition, social competence and self-reported stress in schizophrenia patients and healthy controls

More than 80 % of patients diagnosed with schizophrenia are nicotine-dependent. Self-medication of cognitive deficits and an increased vulnerability to stress are discussed as promoting factors for the development of nicotine dependence. However, the effects of nicotine on social cognition and subjective stress responses in schizophrenia are largely unexplored. A 2 × 2-factorial design (drug × group) was used to investigate the effects of nicotine versus placebo in smoking schizophrenia patients and healthy controls after 24 h of abstinence from smoking. Participants performed a facial affect recognition task and a semi-standardized role-play task, after which social competence and self-reported stress during social interaction were assessed. Data analysis revealed no significant group differences in the facial affect recognition task. During social interaction, healthy controls showed more non-verbal expressions and a lower subjective stress level than schizophrenia patients. There were no significant effects of nicotine in terms of an enhanced recognition of facial affect, more expressive behaviour or reduced subjective stress during social interaction. While schizophrenia patients unexpectedly recognized facial affect not significantly worse than healthy controls, the observed group differences in subjective stress and non-verbal expression during social interaction in the role-play situation are in line with previous findings. Contrary to expectations derived from the self-medication hypothesis, nicotine showed no significant effects on the dependent variables, perhaps because of the dosage used and the delay between the administration of nicotine and the performance of the role-play.

The relationship between sub‐clinical obsessive‐compulsive symptoms and social cognition in chronic schizophrenia

Comorbid obsessive-compulsive (OC) symptoms in individuals with a primary diagnosis of schizophrenia are related to poorer cognitive performance and functional outcomes, but no study to date has assessed whether this comorbidity might also have implications for social cognition. The aim of the present study was to provide the first test of this possibility. Individuals with schizophrenia (n = 34) and demographically matched non-clinical controls (n = 44) were assessed on two of the most important aspects of social cognitive function (1) facial affect recognition and (2) theory of mind, alongside more standard measures of cognitive function. The presence of OC symptoms was related to poorer performance on some of the cognitive measures, as well as one of the social cognitive measures (facial affect recognition). However, these relationships disappeared after controlling for scores on more general indices of schizophrenia psychopathology. The presence of OC symptoms in schizophrenia is not only associated with increased cognitive impairment but also increased difficulties with at least some aspects of social cognitive function. However, these relationships appear to reflect the elevated levels of psychopathology seen in this cohort more generally, rather than being uniquely attributable to OC symptomatology.

Predicting the accuracy of facial affect recognition: The interaction of child maltreatment and intellectual functioning

Previous research demonstrates that both child maltreatment and intellectual performance contribute uniquely to the accurate identification of facial affect by children and adolescents. The purpose of this study was to extend this research by examining whether child maltreatment affects the accuracy of facial recognition differently at varying levels of intellectual functioning. A sample of maltreated (n=50) and nonmaltreated (n=56) adolescent females, 14 to 19years of age, was recruited to participate in this study. Participants completed demographic and study-related questionnaires and interviews to control for potential psychological and psychiatric confounds such as symptoms of posttraumatic stress disorder, negative affect, and difficulties in emotion regulation. Participants also completed an experimental paradigm that recorded responses to facial affect displays starting in a neutral expression and changing into a full expression of one of six emotions: happiness, sadness, anger, disgust, fear, or surprise. Hierarchical multiple regression assessed the incremental advantage of evaluating the interaction between child maltreatment and intellectual functioning. Results indicated that the interaction term accounted for a significant amount of additional variance in the accurate identification of facial affect after controlling for relevant covariates and main effects. Specifically, maltreated females with lower levels of intellectual functioning were least accurate in identifying facial affect displays, whereas those with higher levels of intellectual functioning performed as well as nonmaltreated females. These results suggest that maltreatment and intellectual functioning interact to predict the recognition of facial affect, with potential long-term consequences for the interpersonal functioning of maltreated females.

A Comparison of Social Cognitive Profiles in children with Autism Spectrum Disorders and Attention-Deficit/Hyperactivity Disorder: A Matter of Quantitative but not Qualitative Difference?

The aim of this study was to compare social cognitive profiles of children and adolescents with Autism Spectrum Disorders (ASD) and ADHD. Participants diagnosed with an ASD (n=137) were compared to participants with ADHD (n=436) on tests of facial and vocal affect recognition, social judgment and problem-solving, and parent- and teacher-report of social functioning. Both groups performed significantly worse than the normative sample on all measures. Although the ASD group had more severe deficits, the pattern of deficits was surprisingly similar between groups, suggesting that social cognitive deficit patterns may be more similar in ASD and ADHD than previously thought. Thus, like those with ASDs, individuals with ADHD may also need to be routinely considered for treatments targeting social skills.

Gamma activation in young people with autism spectrum disorders and typically-developing controls when viewing emotions on faces.

BackgroundBehavioural studies have highlighted irregularities in recognition of facial affect in children and young people with autism spectrum disorders (ASDs). Recent findings from studies utilising electroencephalography (EEG) and magnetoencephalography (MEG) have identified abnormal activation and irregular maintenance of gamma (>30 Hz) range oscillations when ASD individuals attempt basic visual and auditory tasks.Methodology/Principal FndingsThe pilot study reported here is the first study to use spatial filtering techniques in MEG to explore face processing in children with ASD. We set out to examine theoretical suggestions that gamma activation underlying face processing may be different in a group of children and young people with ASD (n = 13) compared to typically developing (TD) age, gender and IQ matched controls. Beamforming and virtual electrode techniques were used to assess spatially localised induced and evoked activity. While lower-band (3–30 Hz) responses to faces were similar between groups, the ASD gamma response in occipital areas was observed to be largely absent when viewing emotions on faces. Virtual electrode analysis indicated the presence of intact evoked responses but abnormal induced activity in ASD participants.Conclusions/SignificanceThese findings lend weight to previous suggestions that specific components of the early visual response to emotional faces is abnormal in ASD. Elucidation of the nature and specificity of these findings is worthy of further research.