Difficulties In Facial Emotion Recognition Research Articles

Facial emotion recognition and social-emotional problems in middle childhood: Assessment of directional effects

Research has consistently shown that difficulties in facial emotion recognition (FER) are associated with peer problems and internalizing symptoms during middle childhood. However, no longitudinal research has investigated the direction of effects, that is, how these constructs influence each other across time. In this preregistered three-wave panel study, we tested the directional effects between FER, peer problems, and internalizing symptoms among Finnish school-aged children (n = 3,607; Mage = 8.20, SDage = 0.86; 51% female). The results of random-intercept cross-lagged panel models showed that a low FER accuracy and high biases toward happiness and sadness correlated with higher levels of peer problems and internalizing symptoms at the between-person level. However, we found no evidence of directional effects at the within-person level. Overall, our findings suggest that these constructs might be associated because of shared underlying causes, rather than mutually influencing one another in middle childhood.

Facial emotion recognition based on improved ResNet

A common and difficult task in computer vision is the identification of facial expressions of emotion. Facial emotion recognition has shown great promise in many areas including healthcare, robotic communication and customer service. However, the variability of human appearance and muscle movement leads to difficulties in facial emotion recognition. Therefore, deeper convolutional neural networks are introduced to recognize facial emotions. The residual network (ResNet) can be built in a deep architecture that can solve the degradation problem when the depth of the network increases. In this paper, an improved ResNet50 is proposed to implement facial emotion recognition. Specifically, the proposed model appends two blocks consisting of fully connected layers to the ResnNet50. The layers are stacked with shortcut connections to solve the degradation problem and to make the training process smoother. The accuracy achieved by the improved model on the Facial Emotion Recognition 2013 dataset (FER-2013) is 13.31% higher than that of the ResNet50. Experimental data indicate that the improved model performs efficiently in facial emotion recognition due to shortcut connectivity and the addition of fully connected layers. Meanwhile, the degradation and gradient disappearance problems are improved.

Altered task induced functional brain networks and small-world properties in autism.

Facial emotion recognition (FER) requires the integration of multi-dimensional information across various brain regions. Autistic individuals commonly experience difficulties in FER, a phenomenon often attributed to differences in brain connectivity. The nature of task-induced functional brain networks could provide insight into the neuromechanisms underlying FER difficulties in autism, however, to date, these mechanisms remain poorly understood. In this study, the task induced functional brain networks of 19 autistic and 19 gender, age, and IQ matched non-autistic individuals were examined during a complex FER task. Electroencephalogram (EEG)-based functional brain networks were examined, including the investigation of differences in the time-varying whole-brain functional networks and the exploration of the task induced small-world properties. The results showed statistically significant differences in the task-induced functional networks between autistic and non-autistic adults. Autistic adults compared to non-autistic adults showed a significant shift in the connectivity-based FER processing from the lower to the higher EEG frequency bands. These findings may provide evidence at a neural level for the notion that autistic individuals have a preference for bottom-up lower-level processing, or alterations in top-down global processing, potentially contributing to the FER difficulties observed in this population. Results also suggest that functional brain networks in autism show significantly altered task-induced whole-brain small-world properties as compared to non-autistic individuals during complex FER. This study motivates further investigation of the underlying networks-basis of altered emotion processing in autism.

Difficulties in facial emotion recognition: taking psychopathic and alexithymic traits into account

BackgroundAlexithymic and psychopathic traits are closely associated, but distinct constructs. Both have been associated with facial emotion processing deficits reflecting empathy deficits, however the underlying mechanism contributing to these deficits is not well-understood.MethodsThis study investigated facial emotion recognition performance in a non-clinical sample (N = 110) including both male and female participants, with varying levels of psychopathic and alexithymic traits. Facial emotion recognition was assessed using a computerized task, that presented different expressions depicting five emotional states (pain, fear, sadness, anger, happiness) and neutral expressions.ResultsResults suggest that the high psychopathic traits group reported lower accuracy compared to the low psychopathic traits group, indicating a more generalized deficit in facial affect recognition, across all emotions. The alexithymic groups (high vs. low) on the other hand did not differ in their performance on the task for any of the emotions presented.ConclusionThese findings add to the current body of research regarding face processing categorization deficits in relation to psychopathic and alexithymic traits and can inform prevention and intervention efforts that aim to facilitate facial emotion recognition in individuals with these personality traits.

Facial emotion recognition difficulties may be specific to skin picking disorder, but could also be related to the presence of alexithymia in trichotillomania

Background and objectivesPrevious research has shown high rates of alexithymia and emotion dysregulation in trichotillomania (TTM) and skin picking disorder (SPD). Unfortunately, there are no data on facial emotion recognition (FER) in TTM and SPD. The present study aimed to compare patients with TTM and SPD and a healthy control group for the severity of alexithymia and rates of FER. MethodsForty patients with SPD, 30 patients with TTM, and 30 healthy controls were enrolled in this study. The Beck Depression Inventory (BDI), Beck Anxiety Inventory (BAI), Clinical Global Impression (CGI), Toronto Alexithymia Scale (TAS-20), and the Facial Emotion Recognition Test were applied to the participants. ResultsPatients with TTM and SPD had less FER accuracy and higher alexithymia scores compared with healthy controls. According to ANCOVA analysis, when anxiety, depression, and alexithymia were fixed as covariates, disgusted facial expressions and total facial emotion recognition were still significantly lower in patients with SPD compared with the control group, but there was no difference between the TTM and control groups and TTM and SPD groups. ConclusionAlexithymia rates were high in patients with TTM and SPD. Interestingly, difficulty in recognizing disgusted facial expressions may be a distinctive sign in SPD. Future neuroimaging studies are needed to support possible FER impairment in patients with TTM/SPD.

Recognition of emotional face expressions in patients with restless legs syndrome

Objective Restless legs syndrome (RLS) is one of the commonest neurologic diseases. Along with sensory and motor symptoms, cognitive impairment and psychiatric features can be seen with RLS. The present study, was planned to look for evidence of cognitive impairment by evaluating facial emotion recognition (FER) in patients with RLS. Methods In this study, 80 patients with RLS and 50 healthy controls (HCs) were included. Demographic data were recorded. All patients with RLS and HCs were tested with Beck anxiety inventory (BAI), Beck depression inventory (BDI) and with Ekman’s test for recognition of facial emotions. Results Sixty-three of the patients with RLS and 37 of the HCs were female. The mean age of the patients was 45.41 ± 8.24, and the mean age of HCs was 43.12 ± 10.35. The patients and HCs were similar regarding sex, age, educational status, and marital status. Patients with RLS had FER difficulties comparing HCs. There was a negative correlation between Ekman’s test scores and BDI (r = −0.311, p < 0.001) and BAI scores (r = −0.379, p < 0.001). Conclusion FER is an invaluable research topic regarding cognitive function in RLS, which may help us develop different perspectives in terms of revealing the pathophysiology and is very important for the well-being of the patients’ social interactions.

Impaired complex theory of mind and low emotional self-awareness in outpatients with borderline personality disorder compared to healthy controls: A cross-sectional study

Studies on the theory of mind (TOM) and alexithymia in borderline personality disorder (BPD) have yielded inconsistent results. Also, the relationship between TOM abilities and alexithymia facets as two domains of social cognition has not been studied in BPD. This study aimed to fill this gap. Participants were 50 outpatients with BPD and 50 age and gender-matched healthy controls. Assessments performed using Reading the Mind in Eyes Task (RMET), Toronto Alexithymia Scale (TAS-20), Faux Pas Task (FPT), and Digit Span subtest of Wechsler Adult Intelligence Scale. Results showed that BPD patients scored lower on overall FPT (p < .001) and its cognitive (p < .001) and affective TOM (p < .001) subtests but were comparable with healthy controls in emotion recognition ability assessed by RMET (p = .241). The BPD group also scored significantly lower in overall alexithymia (p < .001) and subscales of difficulty identifying feelings (DIF; p < .001) and difficulty describing emotions (DDF; p = .001). However, they performed similarly to the healthy control group in externally oriented thinking (EOT; p = .164). Correlation analysis revealed a significant negative correlation between EOT and RMET in the BPD group (r = −0.33, p < .05). No association, however, was found between FPT and RMET. This study suggests that BPD patients are impaired in the complex TOM abilities and have lower self-awareness of emotions, but their recognition of others' emotions is intact. Also, the results demonstrate that a heightened level of EOT is associated with difficulties in facial emotion recognition in BPD patients.

Pediatric anxiety associated with altered facial emotion recognition

Multiple psychiatric disorders are associated with difficulties in facial emotion recognition. However, generalized anxiety disorder may be associated with more accurate recognition of others’ emotional expressions, particularly expressions of happiness and fear, which index safety and threat. Children aged 9–14 from a community sample (N = 601) completed a facial emotion labeling task. Children’s symptoms of depressive and anxiety syndromes were assessed by self- and parent-report. Elevated symptoms of generalized anxiety disorder were associated with more accurate facial emotion recognition (β = 0.16, p = 0.007), specifically recognition of happiness (β = 0.17, p = 0.002) and fear (β = 0.15, p = 0.006). Elevated depressive symptoms were associated with less accurate facial emotion recognition (β = −0.12, p = 0.018), specifically happiness (β = −0.15, p = 0.002). Elevated symptoms of separation anxiety disorder were also associated with less accurate facial emotion recognition (β = −0.16, p = 0.003), specifically happiness (β = −0.15, p = 0.006) and fear (β = −0.15, p = 0.005), which highlights the importance of distinguishing between anxiety syndromes. Results held when adjusting for child age and sex. Evidence that symptoms of generalized anxiety disorder are associated with more accurate recognition of happiness and fear is consistent with theories of heightened social vigilance and support a transdiagnostic role of facial emotion recognition that may inform the psychosocial development of youth with anxiety and depressive symptoms.

Social cognition and executive functioning in multiple sclerosis: A cluster-analytic approach.

Multiple sclerosis (MS) is associated with deficits in social cognition, the process underlying social interaction and cognitive function. However, the relationships between executive impairment and social cognition remain unclear in MS. Previous studies exclusively focused on group comparisons between healthy controls and patients with MS, treating the latter as a homogeneous population. The variability of socio- and neurocognitive profiles in this pathology therefore remains underexplored. In the present study, we used a cluster analytic approach to explore the heterogeneity of executive and social cognition skills in MS. A total of 106 patients with MS were compared with 53 healthy matched controls on executive (e.g., working memory) and social cognition (facial emotion recognition and theory of mind) performances. A cluster analysis was then performed, focusing on the MS sample, to explore the presence of differential patterns of interaction between executive and social cognition difficulties and their links to sociodemographic, clinical and cognitive variables. We identified three distinct functional profiles: patients with no executive or social cognition deficits (Cluster 1); patients with difficulties in facial emotion recognition and theory of mind and, to a lesser extent, executive functioning (Cluster 2); and patients with executive functioning difficulties only (Cluster 3). Clinical characteristics (disease duration, disability, fatigue) did not differ between clusters. CONCLUSIONS: These results suggest that there are qualitative differences in the social cognition and executive difficulties that are commonly found among patients with MS. If replicated, the identification of these profiles in clinical practice could allow for more individualized rehabilitation.

Eye Tracking Methodology for Studying Emotional Competence in Children with Autism Spectrum Disorder (ASD) and Specific Language Impairment (SLI): a Comparative Research Review

Children with autism spectrum disorder (ASD) and specific language impairment (SLI) exhibit serious social-emotional difficulties from early infancy which hamper the differential diagnosis of these two conditions. This review aims at analysing differences between ASD and SLI disorders in children from 0 to 12 years regarding emotional competence abilities using eye tracking methodology. The findings show specific markers in the ASD population (e.g. difficulties in facial emotion recognition, atypical visual scanning patterns, or non-social attentional orientation) and a notable scarcity of studies involving SLI children. Comparative research points at potential differences in visual scanning patterns. The conclusions support the use of this methodology for comparative studies between clinical populations.

RETRACTED ARTICLE: Improving the measurement of alexithymia in autistic adults: a psychometric investigation and refinement of the twenty-item Toronto Alexithymia Scale

BackgroundAlexithymia, a personality trait characterized by difficulties interpreting one’s own emotional states, is commonly elevated in autistic adults, and a growing body of literature suggests that this trait underlies a number of cognitive and emotional differences previously attributed to autism, such as difficulties in facial emotion recognition and reduced empathy. Although questionnaires such as the twenty-item Toronto Alexithymia Scale (TAS-20) are frequently used to measure alexithymia in the autistic population, few studies have attempted to determine the psychometric properties of these questionnaires in autistic adults, including whether differential item functioning (I-DIF) exists between autistic and general population adults.MethodsWe conducted an in-depth psychometric analysis of the TAS-20 in a large sample of 743 verbal autistic adults recruited from the Simons Foundation SPARK participant pool and 721 general population controls enrolled in a large international psychological study (the Human Penguin Project). The factor structure of the TAS-20 was examined using confirmatory factor analysis, and item response theory was used to further refine the scale based on local model misfit and I-DIF between the groups. Correlations between alexithymia and other clinical outcomes such as autistic traits, anxiety, and quality-of-life were used to assess the nomological validity of the revised alexithymia scale in the SPARK sample.ResultsThe TAS-20 did not exhibit adequate global model fit in either the autistic or general population samples. Empirically driven item reduction was undertaken, resulting in an eight-item unidimensional scale (TAS-8) with sound psychometric properties and practically ignorable I-DIF between diagnostic groups. Correlational analyses indicated that TAS-8 scores meaningfully predict autistic trait levels, anxiety and depression symptoms, and quality of life, even after controlling for trait neuroticism.LimitationsLimitations of the current study include a sample of autistic adults that was overwhelmingly female, later-diagnosed, and well-educated; clinical and control groups drawn from different studies with variable measures; and an inability to test several other important psychometric characteristics of the TAS-8, including sensitivity to change and I-DIF across multiple administrations.ConclusionsThese results indicate the potential of the TAS-8 as a psychometrically robust tool to measure alexithymia in both autistic and non-autistic adults. A free online score calculator has been created to facilitate the use of norm-referenced TAS-8 latent trait scores in research applications (available at http://asdmeasures.shinyapps.io/TAS8_Score).

Facial emotion recognition in children with externalising behaviours: A systematic review.

Difficulties in facial emotion recognition (FER) are associated with a range of mental health and antisocial presentations in adolescents and adults. Externalising behaviours in children are often one of the earliest signs of risk for the development of such difficulties. This article systematically reviews the evidence (from both group and correlational studies) for whether there is a relationship between FER and externalising behaviours in pre-adolescent children (aged 12 and under), both across and within externalising behaviour domains (hyperactivity, conduct problems, callous-unemotional traits, and aggression). Four electronic databases were searched producing 1,296 articles. Articles were included if they used validated measures of FER and externalising behaviours. Sixteen articles met criteria for inclusion in the review. Overall, the results suggested FER problems are present in ADHD, CP and callous-unemotional presentations, and in samples of children with higher levels of externalising problems rather than in community samples. However, there was no consistent evidence for specific emotions being implicated in the studies reviewed. Clinically, the findings suggest that FER difficulties are commonly associated with externalising behaviours, and hence this review offers some support that FER deficits could be a relevant target of intervention for externalising behaviours. However, more longitudinal studies are required, that control for other variables that might underlie FER difficulties (e.g. IQ or basic Theory of Mind abilities), to inform our knowledge of whether FER difficulties are a causal factor in externalising behaviours.

Facial Landmark-Based Emotion Recognition via Directed Graph Neural Network

Facial emotion recognition (FER) has been an active research topic in the past several years. One of difficulties in FER is the effective capture of geometrical and temporary information from landmarks. In this paper, we propose a graph convolution neural network that utilizes landmark features for FER, which we called a directed graph neural network (DGNN). Nodes in the graph structure were defined by landmarks, and edges in the directed graph were built by the Delaunay method. By using graph neural networks, we could capture emotional information through faces’ inherent properties, like geometrical and temporary information. Also, in order to prevent the vanishing gradient problem, we further utilized a stable form of a temporal block in the graph framework. Our experimental results proved the effectiveness of the proposed method for datasets such as CK+ (96.02%), MMI (69.4%), and AFEW (32.64%). Also, a fusion network using image information as well as landmarks, is presented and investigated for the CK+ (98.47% performance) and AFEW (50.65% performance) datasets.

Affective cognition in bipolar disorder: A systematic review by the ISBD targeting cognition task force.

Impairments in affective cognition are part of the neurocognitive profile and possible treatment targets in bipolar disorder (BD), but the findings are heterogeneous. The International Society of Bipolar Disorder (ISBD) Targeting Cognition Task Force conducted a systematic review to (i) identify the most consistent findings in affective cognition in BD, and (ii) provide suggestions for affective cognitive domains for future study and meta-analyses. The review included original studies reporting behavioral measures of affective cognition in BD patients vs controls following the procedures of the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) statement. Searches were conducted on PubMed/MEDLINE, EMBASE, and PsychInfo from inception until November 2018. A total of 106 articles were included (of which nine included data for several affective domains); 41 studies assessed emotional face processing; 23 studies investigated reactivity to emotional words and images; 3 investigated explicit emotion regulation; 17 assessed implicit emotion regulation; 31 assessed reward processing and affective decisionmaking. In general, findings were inconsistent. The most consistent findings were trait-related difficulties in facial emotion recognition and implicit emotion regulation, and impairments in reward processing and affective decisionmaking during mood episodes. Studies using eye-tracking and facial emotion analysis revealed subtle trait-related abnormalities in emotional reactivity. The ISBD Task Force recommends facial expression recognition, implicit emotion regulation, and reward processing as domains for future research and meta-analyses. An important step to aid comparability between studies in the field would be to reach consensus on an affective cognition test battery for BD.

Altered Connectivity in Autistic Adults during Complex Facial Emotion Recognition: A Study of EEG Imaginary Coherence.

Difficulties in Facial Emotion Recognition (FER) are commonly associated with individuals diagnosed with Autism Spectrum Disorder (ASD). However, the mechanisms underlying these impairments remain inconclusive. While atypical cortical connectivity has been observed in autistic individuals, there is a paucity of investigation during cognitive tasks such as FER. It is possible that atypical cortical connectivity may underlie FER impairments in this population. Electroencephalography (EEG) Imaginary Coherence was examined in 22 autistic adults and 23 typically developing (TD) matched controls during a complex, dynamic FER task. Autistic adults demonstrated reduced coherence between both short and long range inter-hemispheric electrodes. By contrast, short range intra-hemispheric connectivity was increased in frontal and occipital regions during FER. These findings suggest altered network functioning in ASD.

Emotion recognition from the eye region in children with and without Autism Spectrum Disorder in Arab and Scandinavian countries.

Background:Difficulties in facial emotion recognition (ER) skills are linked to autism spectrum disorder (ASD) in studies performed in Western and Eastern Asian countries. However, there is a paucity of research examining ER skills in Arab countries, where face-covering veils are more common than in Western countries.Objective:Our aim was to examine basic ER and ER error patterns in Egyptian and Finnish children with and without ASD.Method:We employed the eye-submodule of the Frankfurt Test and Training of Facial Affect Recognition (FEFA) and the Autism Spectrum Screening Questionnaire (ASSQ).Results:Arab children with ASD (n = 34, M age = 8.6 years, FSIQ = 96.7) recognized correctly fewer emotions than did Scandinavian children with ASD (n = 32, M age = 12.5 years, FSIQ = 102.8) and Arab typically developing (TD) children (n = 34, M age = 10.3 years, FSIQ = 123.4) in general and specifically on surprise, disgust and neutral scales as well as on a blended emotion scale. Scandinavian children with ASD demonstrated a lower ability to recognize emotions in general and specifically happiness than did Scandinavian TD children. There were no differences between Arab and Scandinavian (n = 28, M age = 13.9 years) TD children in ER accuracy. We found country specific differences in ER error patterns in happiness, sadness and anger: Arab children interpreted these emotions more often as another emotion (happiness = sadness, sadness = anger, anger = sadness and surprise), whereas Scandinavian children interpreted happiness and sadness as neutral expression and anger as disgust. Arab children with ASD labeled sadness and anger in their ER error patterns more negatively than did Arab TD children, but there were no differences between Scandinavian children with ASD and TD in ER error patterns.Conclusions:The differences between the Arab and Scandinavian children may reflect cultural differences in ER and ER error patterns.

Impaired fear recognition and social anxiety symptoms in adolescence.

This study represents the first examination of adolescent anxiety in relation to peer emotion recognition, rather than adult emotion recognition. Additionally, we examine potential mechanisms for the development of Social Anxiety in females. Facial emotion recognition (FER) is important for accurate social cognition, which is impaired in individuals with various disorders, including anxiety disorders. Social anxiety often onsets during adolescence, is observed more commonly in females, and is often associated with FER difficulties. Given the importance of peer interaction during adolescence, and some evidence that FER may differ as a function of the stimuli (adolescent or adult faces), we sought to study FER in relation to social anxiety symptoms using stimuli portraying adolescent faces. Male and female adolescents (N=64) completed an online survey in which they rated 257 child and adolescent emotional faces and completed a self-report measure of social anxiety symptoms. We examined differences in emotion recognition (e.g., fear, anger, sadness) between individuals with high and low levels of social anxiety symptoms. Adolescents with high social anxiety symptoms were more likely to have problems correctly identifying fearful expressions (90.55% accuracy) compared to adolescents with low social anxiety symptoms (96.00% accuracy; t = 2.375, p = .021, d = 0.594), and this effect was observed exclusively in female adolescents. The observed sex difference in accurate identification of fearful faces in relation to social anxiety could suggest a potential mechanism for social anxiety development in adolescent females.

Alexithymia, empathy, emotion identification and social inference in anorexia nervosa: A case-control study

Alexithymia, difficulties in facial emotion recognition, poor socio-relational skills are typical of anorexia nervosa (AN). We assessed patients with AN and healthy controls (HCs) with mixed stimuli: questionnaires (Toronto Alexithymia Scale-TAS, Interpersonal Reactivity Index-IRI), photographs (Facial Emotion Identification Test-FEIT) and dynamic images (The Awareness of Social Inference Test-TASIT). TAS and IRI Personal Distress (PD) were higher in AN than HCs. Few or no differences emerged at the FEIT and TASIT, respectively. Larger effect sizes were found for the TAS results. Despite higher levels of alexithymia, patients with AN seem to properly acknowledge others' emotions while being inhibited in the expression of their own.

The association between childhood trauma and facial emotion recognition in adults with bipolar disorder

Many patients with bipolar disorder (BD) have difficulties in facial emotion recognition, which may also be impaired in maltreated children and in subjects who have a positive history of childhood traumatic experiences. Childhood trauma is reported with a high prevalence in BD and it is considered a risk factor for the disorder. As the relationship between facial emotion recognition and childhood trauma in BD has not yet been directly investigated, in this study we examined whether the presence of a childhood trauma in affectively stable BD patients was associated with poorer performance in emotion recognition. Seventy-five BD I and II participants completed the Childhood Trauma Questionnaire retrospectively assessing five types of childhood trauma (emotional, physical and sexual abuse, and emotional and physical neglect) and the Emotion Recognition Task evaluating the ability to correctly identify six basic facial emotions (happiness, sadness, anger, disgust, fear and surprise). Our results suggest that the presence of childhood trauma in participants with BD is associated with a more severe clinical presentation (earlier onset, longer duration of illness, and higher depressive symptom ratings) and that BD patients with a positive childhood history of emotional neglect perform worse than those without such a history in recognizing anger.

Cognitive contributions to theory of mind ability in children with a traumatic head injury

The objective of the current study is to examine the contribution of intellectual abilities, executive functions (EF), and facial emotion recognition to difficulties in Theory of Mind (ToM) abilities in children with a traumatic head injury. Israeli children with a traumatic head injury were compared with their non-injured counterparts. Each group included 18 children (12 males) ages 7–13. Measurements included reading the mind in the eyes, facial emotion recognition, reasoning the other’s characteristics based on motive and outcome, Raven’s Coloured Progressive Matrices, similarities and digit span (Wechsler Intelligence Scale for Children – Revised 95 subscales), verbal fluency, and the Behaviour Rating Inventory of Executive Functions. Non-injured children performed significantly better on ToM, abstract reasoning, and EF measures compared with children with a traumatic head injury. However, differences in ToM abilities between the groups were no longer significant after controlling for abstract reasoning, working memory, verbal fluency, or facial emotion recognition. Impaired ToM recognition and reasoning abilities after a head injury may result from other cognitive impairments. In children with mild and moderate head injury, poorer performance on ToM tasks may reflect poorer abstract reasoning, a general tendency to concretize stimuli, working memory and verbal fluency deficits, and difficulties in facial emotion recognition, rather than deficits in the ability to understand the other’s thoughts and emotions. ToM impairments may be secondary to a range of cognitive deficits in determining social outcomes in this population.