Face Processing In Individuals Research Articles

Ensemble coding of multiple facial expressions is not affected by attentional load.

Human observers can extract the mean emotion from multiple faces rapidly and precisely. However, whether attention is required in the ensemble coding of facial expressions remains debated. In this study, we examined the effect of attentional load on mean emotion processing with the dual-task paradigm. Individual emotion processing was also investigated as the control task. In the experiment, the letter string and a set of four happy or angry faces of various emotional intensities were shown. Participants had to complete the string task first, judging either the string color (low attention load) or the presence of the target letter (high attention load). Then a cue appeared indicating whether the secondary task was to evaluate the mean emotion of the faces or the emotion of the cued single face, and participants made their judgments on the visual analog scale. The results showed that compared with the color task, the letter task had a longer response time and lower accuracy, which verified the valid manipulation of the attention loads. More importantly, there was no significant difference in averaging performance between the low and high attention loads. By contrast, the individual face processing was impaired under the high attention load relative to the low attentional load. In addition, the advantage of extracting mean emotion over individual emotion was larger under the high attentional load. These results support the power of averaging and provide new evidence that a rather small amount of attention is needed in the ensemble coding of multiple facial expressions.

Atypical Face Process in Autism Spectrum Disorder and Relevant Interventions

The current study overviewed previous research on abnormalities in face processing in individuals with autism spectrum disorder (ASD) and concluded implications on development of relevant social skill interventions. Overall, autistic individuals exhibited deviated neural activity patterns during face processing across different ages, suggesting that atypical development of neural structures might be accountable for deficits in social functioning. Similarly, familial studies found no significant variations in neural activity patterns for high-risk family members, providing insufficient evidence for the inheritance of autism. Although neural activity indices might not be effective as biomarkers for early life diagnosis, researchers could use these indicators to predict the extent of social impairment for patients in later life stages. Social functioning programs based on facial processing schemes had a significant training effect on young patients, but further testing trials are required to estimate their impact on patients social behaviors in real life. This review can provide some guidance for the design of intervention programs at schools for children with ASD.

Behavioral and neurophysiological correlates of emotional face processing in borderline personality disorder: are there differences between men and women?

Emotional dysregulation is a core feature of borderline personality disorder (BPD); it is, for example, known to influence one’s ability to read other people’s facial expressions. We investigated behavioral and neurophysiological foundations of emotional face processing in individuals with BPD and in healthy controls, taking participants’ sex into account. 62 individuals with BPD (25 men, 37 women) and 49 healthy controls (20 men, 29 women) completed an emotion classification task with faces depicting blends of angry and happy expressions while the electroencephalogram was recorded. The cortical activity (late positive potential, P3/LPP) was evaluated using source modeling. Compared to healthy controls, individuals with BPD responded slower to happy but not to angry faces; further, they showed more anger ratings in happy but not in angry faces, especially in those with high ambiguity. Men had lower anger ratings than women and responded slower to angry but not happy faces. The P3/LPP was larger in healthy controls than in individuals with BPD, and larger in women than in men; moreover, women but not men produced enlarged P3/LPP responses to angry vs. happy faces. Sex did not interact with behavioral or P3/LPP-related differences between healthy controls and individuals with BPD. Together, BPD-related alterations in behavioral and P3/LPP correlates of emotional face processing exist in both men and women, supposedly without sex-related interactions. Results point to a general ‘negativity bias’ in women. Source modeling is well suited to investigate effects of participant and stimulus characteristics on the P3/LPP generators.

Neural correlates of face processing associated with development of social communication in 12-month infants with familial risk of autism spectrum disorder

BackgroundDifferences in face processing in individuals with ASD is hypothesized to impact the development of social communication skills. This study aimed to characterize the neural correlates of face processing in 12-month-old infants at familial risk of developing ASD by (1) comparing face-sensitive event-related potentials (ERP) (Nc, N290, P400) between high-familial-risk infants who develop ASD (HR-ASD), high-familial-risk infants without ASD (HR-NoASD), and low-familial-risk infants (LR), and (2) evaluating how face-sensitive ERP components are associated with development of social communication skills.Methods12-month-old infants participated in a study in which they were presented with alternating images of their mother’s face and the face of a stranger (LR = 45, HR-NoASD = 41, HR-ASD = 24) as EEG data were collected. Parent-reported and laboratory-observed social communication measures were obtained at 12 and 18 months. Group differences in ERP responses were evaluated using ANOVA, and multiple linear regressions were conducted with maternal education and outcome groups as covariates to assess relationships between ERP and behavioral measures.ResultsFor each of the ERP components (Nc [negative-central], N290, and P400), the amplitude difference between mother and stranger (Mother-Stranger) trials was not statistically different between the three outcome groups (Nc p = 0.72, N290 p = 0.88, P400 p = 0.91). Marginal effects analyses found that within the LR group, a greater Nc Mother-Stranger response was associated with better expressive language skills on the Mullen Scales of Early Learning, controlling for maternal education and outcome group effects (marginal effects dy/dx = 1.15; p < 0.01). No significant associations were observed between the Nc and language or social measures in HR-NoASD or HR-ASD groups. In contrast, specific to the HR-ASD group, amplitude difference between the Mother versus Stranger P400 response was positively associated with expressive (dy/dx = 2.1, p < 0.001) and receptive language skills at 12 months (dy/dx = 1.68, p < 0.005), and negatively associated with social affect scores on the Autism Diagnostic Observation Schedule (dy/dx = − 1.22, p < 0.001) at 18 months.ConclusionsIn 12-month-old infant siblings with subsequent ASD, increased P400 response to Mother over Stranger faces is positively associated with concurrent language and future social skills.

P.0820 Association of resilience with limbic activity during negative emotional face processing in individuals who experienced childhood maltreatment

In patients suffering from major depressive disorders (MDD), improvements in MDD are related to increased activation of brain-derived neurotrophic factor (BDNF), an endogenous protein that facilitates neural functioning. To treat patients suffering from severe MDD, electroconvulsive therapy (ECT) is considered an efficacious and safe intervention, though the impact of ECT on plasma BDNF levels has thus far barely been investigated. The aim of the present study was therefore to assess plasma BDNF levels and depression of patients suffering from severe MDD treated with additional ECT compared to patients treated with citalopram only.A total of 40 patients (mean age: M = 31.45 years; females 30%) suffering from MDD and all receiving 40 mg/d citalopram were assigned either to a control group (N = 20), or to a target group (N = 20) undergoing additional 12 sessions of ECT. Plasma BDNF and symptom severity were assessed at baseline and four weeks later.Plasma BDNF increased in both groups over time, though the significant Time by Group-interaction revealed an increase of 101% in the target group as compared to the control group. Symptom severity significantly decreased in both groups over time, though without being related to plasma BDNF levels.Data from the present study suggest that, in patients suffering from severe MDD, treatment with citalopram was associated both with an increase of plasma BDNF and amelioration of depression, while additional ECT was associated with even higher plasma BDNF levels. Further studies should focus on possible cognitive and behavioral consequences.

The recognition of dynamic-emotional faces in individuals with high and low social anxiety: An ERP study

Individuals with high social anxiety (HSA) show abnormal processing of emotional faces, which may increase their social anxiety. A growing number of event-related potential (ERP) studies have explored the neural mechanisms underlying the static-emotional face processing of HSA individuals. In view of the ecological validity of dynamic faces, this study will further explore the time course of dynamic-emotional face processing in individuals with HSA. To this end, 30 high and 30 low social anxiety (LSA) participants were asked to perform an identification task of dynamic-emotional faces while their brain responses were recorded using an ERP technique. The behavioral results showed the recognition accuracy of dynamic faces was higher than static faces when these faces were happy. For the P100 component, HSA participants showed higher P100 mean amplitudes of dynamic than static faces in the left hemisphere when they viewed happy, but not angry faces. In addition, increased N170 mean amplitudes of dynamic-happy faces were showed. Furthermore, the LPP mean amplitudes of dynamic faces were smaller than those of static faces. In sum, this study could provide a better understanding of the time course of dynamic-emotional face processing in HSA individuals.

High-definition transcranial direct current stimulation facilitates emotional face processing in individuals with high autistic traits: A sham-controlled study

The deficit in emotional face processing is a critical impairment for individuals with high autistic traits. The temporalparietal junction(TPJ) is considered to be closely related to emotional face processing. The aim of this study was to examine the effect of highdefinition transcranial direct current stimulation (HD-tDCS) over the right temporal-parietal junction (rTPJ) on facial emotion processing of individuals with high autistic traits using eye-tracking technology. Twenty-nine participants with high autistic traits completed an eyetracking task (including happy, fearful and neutral faces) before and after five consecutive days of stimulation (anodal or sham). Results showed that anodal HD-tDCS significantly increased fixation time and fixation count in the mouth area, but this effect was not found after the sham stimulation. Moreover, this increased effect of mouth recognition with anodal rTPJ HD-tDCS was shown in both happy and fearful faces, but no remarkable difference was found in neutral faces. These findings suggest that right TPJ anodal HD-tDCS can facilitate emotional face processing in individuals with high autistic traits.

Understanding emotional language through events and words in people with Williams syndrome

ABSTRACT Previous studies have mainly examined emotion recognition through face processing in individuals with Williams syndrome (WS). Contextual integration is an automatic and basic comprehension ability emerged from distinct modalities. This ability requires sensation to global configuration and local elements. However, neurodevelopmental disorders are characterized by local-focusing and global-ignoring in visuospatial perception. This causes cognitive atypicality as compared to typical development, including atypical face processing and emotion recognition. These impairments might result in deficits in theory of mind and social cognition. People with WS demonstrate impaired false-belief attribution, which was reported to be improved with emotional cues. Yet, no previous study has examined knowledge of emotional language in people with WS, which might be one of the factors affecting the development of the theory of mind in people with WS. In the present study, we examined knowledge of emotional language in people with WS by testing three emotions: positive, negative, and neutral. Participants were asked to press buttons indexing emotions in reaction to auditory targets. In the emotional event study, people with WS demonstrated responses to positive events in the normal range, delayed responses to negative events, and deviant responses to neutral events. In the emotion word study, people with WS showed the lowest accuracy and longest reaction times for neutral words. These findings indicated asymmetrical and atypical knowledge of emotional language in people with WS, confirming that knowledge of emotional expressions influences the development of the theory of mind and social cognition.

Hyperarousal Is Associated with Socioemotional Processing in Individuals with Insomnia Symptoms and Good Sleepers.

Despite complaints of difficulties in waking socioemotional functioning by individuals with insomnia, only a few studies have investigated emotion processing performance in this group. Additionally, the role of sleep in socioemotional processing has not been investigated extensively nor using quantitative measures of sleep. Individuals with insomnia symptoms (n = 14) and healthy good sleepers (n = 15) completed two nights of at-home polysomnography, followed by an afternoon of in-lab performance testing on tasks measuring the processing of emotional facial expressions. The insomnia group self-reported less total sleep time, but no other group differences in sleep or task performance were observed. Greater beta EEG power throughout the night was associated with higher intensity ratings of happy, fearful and sad faces for individuals with insomnia, yet blunted sensitivity and lower accuracy for good sleepers. Thus, the presence of hyperarousal differentially impacted socioemotional processing of faces in individuals with insomnia symptoms and good sleepers.

Multimodal evidence on shape and surface information in individual face processing

The significance of shape and surface information for face perception is well established, yet their relative contribution to recognition and their neural underpinnings await clarification. Here, we employ image reconstruction to retrieve, assess and visualize such information using behavioral, electroencephalography and functional magnetic resonance imaging data.Our results indicate that both shape and surface information can be successfully recovered from each modality but that the latter is better recovered than the former, consistent with its key role for face representations. Further, shape and surface information exhibit similar spatiotemporal profiles, rely on the extraction of specific visual features, such as eye shape or skin tone, and reveal a systematic representational structure, albeit with more cross-modal consistency for shape than surface. More generally, the present work illustrates a novel approach to relating and comparing different modalities in terms of perceptual information content.Thus, our results help elucidate the representational basis of individual face recognition while, methodologically, they showcase the utility of image reconstruction and clarify its reliance on diagnostic visual information.

Neurophysiological correlates of holistic face processing in adolescents with and without autism spectrum disorder

BackgroundFace processing has been found to be impaired in autism spectrum disorders (ASD). One hypothesis is that individuals with ASD engage in piecemeal compared to holistic face processing strategies. To investigate the role of possible impairments in holistic face processing in individuals with autism, the current study investigated behavioral and electroencephalography (EEG) correlates of face processing (P1/N170 and gamma-band activity) in adolescents with ASD and sex-, age-, and IQ-matched neurotypical controls.MethodsParticipants were presented with upright and inverted Mooney stimuli; black and white low information faces that are only perceived as faces when processed holistically. Participants indicated behaviorally the detection of a face. EEG was collected time-locked to the presentation of the stimuli.ResultsAdolescents with ASD perceived Mooney stimuli as faces suggesting ability to use holistic processing but displayed a lower face detection rate and slower response times. ERP components suggest slowed temporal processing of Mooney stimuli in the ASD compared to control group for P1 latency but no differences between groups for P1 amplitude and at the N170. Increases in gamma-band activity was similar during the perception of the Mooney images by group, but the ASD group showed prolonged temporal elevation in activity.ConclusionOverall, our results suggest that adolescents with ASD were able to utilize holistic processing to perceive a face within the Mooney stimuli. Delays in early processing, marked by the P1, and elongated elevation in gamma activity indicate that the neural systems supporting holistic processing are slightly altered suggesting a less automatic and less efficient facial processing system.Trial registrationNon-applicable.

Investigating the perception of face identity in adults on the autism spectrum using behavioural and electrophysiological measures

In the present study, we investigated face processing in individuals with self-reported Autism Spectrum Disorder (ASD, n = 16) and typically developing control participants (n = 16) using behavioural and electrophysiological measures. As a measure of their face memory, we administered the Cambridge Face Memory Test to participants in the ASD group. The results showed that the scores of the ASD participants were reliably below the age- and gender-matched norms of neurotypical individuals. To measure brain responses to faces, we used the fast periodic visual stimulation method, presenting photographs of a same-identity face (i.e., base face) at a constant frequency of 6 Hz (F) interleaved with different-identity faces (i.e., the oddball faces) presented at 1.2 Hz. The 6 Hz presentation of the base face and 1.2 Hz presentation of the oddball face elicited periodic brain responses corresponding to face detection and face individuation processes, respectively. Participants viewed four blocks of upright faces and four blocks of inverted faces. The results showed an enhanced EEG response to upright base faces at 6 Hz frequency and its harmonics compared to inverted faces, and the response was most focal over medial occipital channels. An enhanced response was found to upright oddball faces at 1.2 Hz and its harmonics compared to the inverted faces, and the response was centred over occipito-temporal channels in the right hemisphere. Critically, no differences or interactions were found between the ASD and typically developing groups in the responses to either the 6 Hz base faces or the 1.2 oddball faces. These results suggest that in individuals with ASD, the earlier stage of face perception, as measured by the fast periodic visual stimulation paradigm, can be dissociated from the later memory stage of face processing, as assessed by the Cambridge Face Memory Test.

Reward learning modulates the attentional processing of faces in children with and without autism spectrum disorder.

In our study, we tested whether the face processing of individuals with ASD could be changed when the faces were associated with different social meanings. We found no effect of social meanings on face recognition, but both groups responded faster in the visual search task when one of the distractor faces was associated with positive or negative values than when the neutral face. The findings suggest that children with ASD could efficiently process faces associated with different values like typical children.

Phasic alertness enhances processing of face and non-face stimuli in congenital prosopagnosia

Congenital prosopagnosia (CP) is a severe face processing impairment that occurs in the absence of any obvious brain damage and has often been associated with a more general deficit in deriving holistic relations between facial features or even between non-face shape dimensions. Here we further characterized this deficit and examined a potential way to ameliorate it. To this end we manipulated phasic alertness using alerting cues previously shown to modulate attention and enhance global processing of visual stimuli in normal observers. Specifically, we first examined whether individuals with CP, similarly to controls, would show greater global processing when exposed to an alerting cue in the context of a non-facial task (Navon global/local task). We then explored the effect of an alerting cue on face processing (upright/inverted face discrimination). Confirming previous findings, in the absence of alerting cues, controls showed a typical global bias in the Navon task and an inversion effect indexing holistic processing in the upright/inverted task, while CP failed to show these effects. Critically, when alerting cues preceded the experimental trials, both groups showed enhanced global interference and a larger inversion effect.These results suggest that phasic alertness may modulate visual processing and consequently, affect global/holistic perception. Hence, these findings further reinforce the notion that global/holistic processing may serve as a possible mechanism underlying the face processing deficit in CP.Moreover, they imply a possible route for enhancing face processing in individuals with CP and thus shed new light on potential amelioration of this disorder.

Adaptive coding of the value of social cues with oxytocin, an fMRI study in autism spectrum disorder

The neuropeptide oxytocin (OT) is one of the major targets of research in neuroscience, with respect to social functioning. Oxytocin promotes social skills and improves the quality of face processing in individuals with social dysfunctions such as autism spectrum disorder (ASD). Although one of OT's key functions is to promote social behavior during dynamic social interactions, the neural correlates of this function remain unknown. Here, we combined acute intranasal OT (IN-OT) administration (24 IU) and fMRI with an interactive ball game and a face-matching task in individuals with ASD (N = 20). We found that IN-OT selectively enhanced the brain activity of early visual areas in response to faces as compared to non-social stimuli. OT inhalation modulated the BOLD activity of amygdala and hippocampus in a context-dependent manner. Interestingly, IN-OT intake enhanced the activity of mid-orbitofrontal cortex in response to a fair partner, and insula region in response to an unfair partner. These OT-induced neural responses were accompanied by behavioral improvements in terms of allocating appropriate feelings of trust toward different partners' profiles. Our findings suggest that OT impacts the brain activity of key areas implicated in attention and emotion regulation in an adaptive manner, based on the value of social cues.

Functional connectivity for face processing in individuals with body dysmorphic disorder and anorexia nervosa.

Body dysmorphic disorder (BDD) and anorexia nervosa (AN) are both characterized by distorted perception of appearance. Previous studies in BDD suggest abnormalities in visual processing of own and others' faces, but no study has examined visual processing of faces in AN, nor directly compared the two disorders in this respect. We collected functional magnetic resonance imaging data on 60 individuals of equivalent age and gender in each of three groups--20 BDD, 20 weight-restored AN, and 20 healthy controls (HC)--while they viewed images of others' faces that contained only high or low spatial frequency information (HSF or LSF). We tested hypotheses about functional connectivity within specialized sub-networks for HSF and LSF visual processing, using psychophysiological interaction analyses. The BDD group demonstrated increased functional connectivity compared to HC between left anterior occipital face area and right fusiform face area (FFA) for LSF faces, which was associated with symptom severity. Both BDD and AN groups had increased connectivity compared to HC between FFA and precuneous/posterior cingulate gyrus for LSF faces, and decreased connectivity between FFA and insula. In addition, we found that LSF connectivity between FFA and posterior cingulate gyrus was significantly associated with thoughts about own appearance in AN. Results suggest similar abnormal functional connectivity within higher-order systems for face processing in BDD and AN, but distinct abnormal connectivity patterns within occipito-temporal visual networks. Findings may have implications for understanding relationships between these disorders, and the pathophysiology underlying perceptual distortions.

Norm-based coding of facial identity in adults with autism spectrum disorder

It is unclear whether reported deficits in face processing in individuals with autism spectrum disorders (ASD) can be explained by deficits in perceptual face coding mechanisms. In the current study, we examined whether adults with ASD showed evidence of norm-based opponent coding of facial identity, a perceptual process underlying the recognition of facial identity in typical adults. We began with an original face and an averaged face and then created an anti-face that differed from the averaged face in the opposite direction from the original face by a small amount (near adaptor) or a large amount (far adaptor). To test for norm-based coding, we adapted participants on different trials to the near versus far adaptor, then asked them to judge the identity of the averaged face. We varied the size of the test and adapting faces in order to reduce any contribution of low-level adaptation. Consistent with the predictions of norm-based coding, high functioning adults with ASD (n=27) and matched typical participants (n=28) showed identity aftereffects that were larger for the far than near adaptor. Unlike results with children with ASD, the strength of the aftereffects were similar in the two groups. This is the first study to demonstrate norm-based coding of facial identity in adults with ASD.

Neural bases of atypical emotional face processing in autism: A meta-analysis of fMRI studies

Objectives. We aim to outline the neural correlates of atypical emotional face processing in individuals with ASD. Methods. A comprehensive literature search was conducted through electronic databases to identify functional magnetic resonance imaging (fMRI) studies of whole brain analysis with emotional-face processing tasks in individuals with ASD. The Signed Differential Mapping with random effects model was used to conduct meta-analyses. Identified fMRI studies were further divided into sub-groups based on contrast (“emotional-face vs. non-emotional-face” or “emotional-face vs. non-face”) to confirm the results of a meta-analysis of the whole studies. Results. Thirteen studies with 226 individuals with ASD and 251 typically developing people were identified. We found ASD-related hyperactivation in subcortical structures, including bilateral thalamus, bilateral caudate, and right precuneus, and ASD-related hypoactivation in the hypothalamus during emotional-face processing. Sub-analyses with more homogeneous contrasts preserved the findings of the main analysis such as hyperactivation in sub-cortical structure. Jackknife analyses showed that hyperactivation of the left caudate was the most robust finding. Conclusions. Abnormalities in the subcortical structures, such as amygdala, hypothalamus and basal ganglia, are associated with atypical emotional-face processing in individuals with ASD.

Autistic children do not exhibit an own-race advantage as compared to typically developing children

The characteristics of aberrant face processing in individuals with autism spectrum disorder (ASD) have been extensively studied, but the aspect regarding sensitivity to race is relatively unexplored. The present study hypothesized that the magnitude of the other-race effect shall be reduced in individuals with ASD owing to their inattention to faces since infancy. Using a sequential face discrimination task, we tested the other-race effect of 18 ASD (mean age=7.5 years) and 13 age-matched typically developing (TD) children (mean age=7.6 years). The stimuli were cropped Asian and African faces, each with four levels of difficulty: easy (change identity), medium (replaced eyes), hard-eye (widen eye spacing), and hard-mouth (moved up mouth). The TD children showed a significant own-race advantage such that the best performance was found in the Asian easy condition. The ASD children did not exhibit such advantage at all. Moreover, ASD children showed the highest error rates in the hard-eye condition instead of the hard-mouth condition, indicating insensitivity to eyes region. In sum, our findings support the hypothesis that the other-race effect is reduced in ASD children, reflecting an incomplete development of an expert face system.

Altered automatic face processing in individuals with high-functioning autism spectrum disorders: Evidence from visual evoked potentials

Individuals with autism spectrum disorders (ASDs) have different automatic responses to faces than typically developing (TD) individuals. We recorded visual evoked potentials (VEPs) in 10 individuals with high-functioning ASD (HFASD) and 10 TD individuals. Visual stimuli consisted of upright and inverted faces (fearful and neutral) and objects presented subliminally in a backward-masking paradigm. In all participants, the occipital N1 (about 100ms) and P1 (about 120ms) peaks were major components of the evoked response. We calculated “subliminal face effect (SFE)” scores by subtracting the N1/P1 amplitudes and latencies of the object stimuli from those of the face stimuli. In the TD group, the SFE score for the N1 amplitude was significantly higher for upright fearful faces but not neutral faces, and this score was insignificant when the stimuli were inverted. In contrast, the N1 amplitude of the HFASD subjects did not show this SFE in the upright orientation. There were no significant group differences in SFE scores for P1 amplitude, latency, or N1 latency. Our findings suggest that individuals with HFASD have altered automatic visual processing for emotional faces within the lower level of the visual cortex. This impairment could be a neural component of the disrupted social cognition observed in individuals with HFASD.