Early Stages Of Face Processing Research Articles

Hierarchical status is rapidly assessed from behaviourally dominant faces

Recognition of social hierarchy is a key feature that helps us navigate through our complex social environment. Neuroimaging studies have identified brain structures involved in the processing of hierarchical stimuli, but the precise temporal dynamics of brain activity associated with such processing remains largely unknown. In this investigation, we used event-related potentials (ERPs) to examine the effect of social hierarchy on the neural responses elicited by dominant and nondominant faces. Participants played a game where they were led to believe that they were middle-rank players, responding alongside other alleged players, whom they perceived as higher or lower-ranking. ERPs were examined in response to dominant and nondominant faces, and low-resolution electromagnetic tomography (LORETA) was used to identify the implicated brain areas. The results revealed that the amplitude of the N170 component was enhanced for faces of dominant individuals, showing that hierarchy influences the early stages of face processing. A later component, the late positive potential (LPP) appearing between 350–700 ms, also was enhanced for faces of higher-ranking players. Source localisation suggested that the early modulation was due to an enhanced response in limbic regions. These findings provide electrophysiological evidence for enhanced early visual processing of socially dominant faces.

Early Influence of Emotional Scenes on the Encoding of Fearful Expressions With Different Intensities: An Event-Related Potential Study.

Contextual affective information influences the processing of facial expressions at the relatively early stages of face processing, but the effect of the context on the processing of facial expressions with varying intensities remains unclear. In this study, we investigated the influence of emotional scenes (fearful, happy, and neutral) on the processing of fear expressions at different levels of intensity (high, medium, and low) during the early stages of facial recognition using event-related potential (ERP) technology. EEG data were collected while participants performed a fearful facial expression recognition task. The results showed that (1) the recognition of high-intensity fear expression was higher than that of medium- and low-intensity fear expressions. Facial expression recognition was the highest when faces appeared in fearful scenes. (2) Emotional scenes modulated the amplitudes of N170 for fear expressions with different intensities. Specifically, the N170 amplitude, induced by high-intensity fear expressions, was significantly higher than that induced by low-intensity fear expressions when faces appeared in both neutral and fearful scenes. No significant differences were found between the N170 amplitudes induced by high-, medium-, and low-intensity fear expressions when faces appeared in happy scenes. These results suggest that individuals may tend to allocate their attention resources to the processing of face information when the valence between emotional context and expression conflicts i.e., when the conflict is absent (fear scene and fearful faces) or is low (neutral scene and fearful faces).

The Effect of Trustor Age and Trustee Age on Trustworthiness Judgments: An Event-Related Potential Study.

Perceived trustworthiness based on facial appearance plays an important role in interpersonal trust and cooperative behavior. Interpersonal trust behaviors involve both trustors and trustees. However, there is no clear conclusion on how the age of the two individuals affects interpersonal trust behaviors. Therefore, this study used the trust game task to explore the differences in trust behaviors between two different age groups in response to faces of different ages and analyzed whether such differences were apparent in the face processing stage. The behavioral results showed that only younger adults invested more money with older partners than younger ones; that is, younger adults trusted older faces more. The event-related potential (ERP) analyses showed that in the early stage of face processing, younger faces elicited more negative N170 than older faces; at the same time, older faces elicited more positive VPP than younger faces, and younger adults had more positive VPP than older adults. In the middle and late stages of face processing, younger faces elicited more negative FRN than older faces in younger adults but not in older adults. In addition, older faces elicited more positive LPP than younger faces in older adults but not in younger adults. The neural analyses suggested that age-related differences in facial trustworthiness judgments might occur in the later stages of face processing. Combining the behavioral and neural results, we found a dissociation between trustworthiness perceptions and trust behaviors in both younger and older adults, which may provide insight into how to prevent older adults from being deceived.

Lip color affects ERP components in temporal face perception processing.

This brief report investigates the relationship between the lip color of women's faces and the latency and amplitude of the P1, N170, and early posterior negativity of event-related potential components. To show different color lipsticks affect face perception processing, we used EEG to observe these event-related potential components in 19 participants exposed to visual stimuli under four conditions: red lips, yellow lips, blue lips, and no-makeup. The results indicate a significantly higher attractiveness score for red lips than the other three conditions and a significantly shorter P1 peak latency for red lips than blue lips or no-makeup. This may reflect that red lips attract attention more than blue or natural lips in the early stages of face processing. The results indicate that the peak of early posterior negativity for red lips occurred significantly longer than for yellow lips, blue lips, or no-makeup. Early posterior negativity amplitudes were significantly larger to red lips than blue lips or no-makeup. These results may indicate that, at later stages of face processing, the high attractiveness of red lips is associated with slower and careful processing. In contrast, blue lips, which have a low attractiveness score, are processed speedily and carelessly. These present results suggest a novel possibility that P1 and early posterior negativity can be used as a biomarker for temporal face perception processing of facial attractiveness in the human brain.

Spatiotemporal Dynamics of Covert Versus Overt Processing of Happy, Fearful and Sad Facial Expressions.

Behavioral and electrophysiological correlates of the influence of task demands on the processing of happy, sad, and fearful expressions were investigated in a within-subjects study that compared a perceptual distraction condition with task-irrelevant faces (e.g., covert emotion task) to an emotion task-relevant categorization condition (e.g., overt emotion task). A state-of-the-art non-parametric mass univariate analysis method was used to address the limitations of previous studies. Behaviorally, participants responded faster to overtly categorized happy faces and were slower and less accurate to categorize sad and fearful faces; there were no behavioral differences in the covert task. Event-related potential (ERP) responses to the emotional expressions included the N170 (140–180 ms), which was enhanced by emotion irrespective of task, with happy and sad expressions eliciting greater amplitudes than neutral expressions. EPN (200–400 ms) amplitude was modulated by task, with greater voltages in the overt condition, and by emotion, however, there was no interaction of emotion and task. ERP activity was modulated by emotion as a function of task only at a late processing stage, which included the LPP (500–800 ms), with fearful and sad faces showing greater amplitude enhancements than happy faces. This study reveals that affective content does not necessarily require attention in the early stages of face processing, supporting recent evidence that the core and extended parts of the face processing system act in parallel, rather than serially. The role of voluntary attention starts at an intermediate stage, and fully modulates the response to emotional content in the final stage of processing.

Socially induced negative affective knowledge modulates early face perception but not gaze cueing of attention.

Prior affective and social knowledge about other individuals has been shown to modulate perception of their faces and gaze‐related attentional processes. However, it remains unclear whether emotionally charged knowledge acquired through interactive social learning also modulates face processing and attentional control. Thus, the aim of this study was to test whether affective knowledge induced through social interactions in a naturalistic exchange game can influence early stages of face processing and attentional shifts in a subsequent gaze‐cueing task. As indicated by self‐reported ratings, the game was successful in inducing valenced affective knowledge towards positive and negative players. In the subsequent task, in which the locations of future targets were cued by the gaze of the game players, we observed enhanced early neural activity (larger amplitude of the P1 component) in response to a photograph of the negative player. This indicates that negative affective knowledge about an individual indeed modulates very early stages of the processing of this individual's face. Our study contributes to the existing literature by providing further evidence for the saliency of interactive social exchange paradigms that are used to induce affective knowledge. Moreover, it extends the previous research by presenting a very early modulation of perception by socially learned affective knowledge. Importantly, it also offers increased ecological validity of the findings due to the use of naturalistic social exchange in the study design.

Gender Word Semantic Satiation Inhibits Facial Gender Information Processing

Abstract. In order to explore the time course of the influence of gender words semantic satiation on facial gender information processing, the semantic satiation paradigm was used to induce semantic satiation by presenting Chinese gender words “男, 女 (Male, Female)” for a long duration (25 s), with conjunction words “及(And), 且(Moreover)” served as the baseline (the Chinese words and their English translations do not completely equal in terms of pronunciation, form, and sense). Participants were asked to judge whether the two simultaneously presented faces (Experiment 1) or two successively presented faces (Experiment 2) were of the same gender. The results of Experiment 1 showed that the response time in semantic satiation condition was significantly longer than that of the baseline condition. The event-related potential (ERP) results of Experiment 2 showed that the peak amplitude of P1 component in semantic satiation condition was significantly smaller than that of the baseline condition in the early stage of face processing; N170, a specific component of face perception, in semantic satiation condition was significantly larger than that of the baseline condition. The average amplitude of LPC in semantic satiation condition was significantly smaller than that of the baseline condition. This study shows that facial gender information processing is affected by its semantic contextual information. The inhibition effect of gender word semantic satiation on facial gender information processing starts at the attention orientation stage, then continues to the face structural encoding stage, and eventually ends at the advanced cognitive response stage.

Altering sensorimotor simulation impacts early stages of facial expression processing depending on individual differences in alexithymic traits

Simulation models of facial expressions suggest that posterior visual areas and brain areas underpinning sensorimotor simulations might interact to improve facial expression processing. According to these models, facial mimicry, a manifestation of sensorimotor simulation, may contribute to the visual processing of facial expressions by influencing early stages. The aim of this study was to assess whether and how sensorimotor simulation influences early stages of face processing, also investigating its relationship with alexithymic traits given that previous studies have suggested that individuals with high levels of alexithymic traits (vs. individuals with low levels of alexithymic traits) tend to use sensorimotor simulation to a lesser extent. We monitored P1 and N170 ERP components of the event-related potentials (ERP) in participants performing a fine discrimination task of facial expressions and animals, as a control condition. In half of the experiment, participants could freely use their facial mimicry whereas in the other half they had their facial mimicry blocked by a gel. Our results revealed that only individuals with lower compared to high alexithymic traits showed a larger modulation of the P1 amplitude as a function of the mimicry manipulation selectively for facial expressions (but not for animals), while we did not observe any modulation of the N170. Given the null results at the behavioural level, we interpreted the P1 modulation as compensative visual processing in individuals with low levels of alexithymia under conditions of interference on the sensorimotor processing, providing a preliminary evidence in favor of sensorimotor simulation models.

2:0 for the good guys: Character information influences emotion perception.

Previous research has demonstrated that facial social category cues influence emotion perception such that happy expressions are categorized faster than negative expressions on faces belonging to positively evaluated social groups. We examined whether character information that is experimentally manipulated can also influence emotion perception. Across two experiments, participants learned to associate individuals posing neutral expressions with positive or negative acts. In a subsequent task, participants categorized happy and angry expressions of these same individuals as quickly and accurately as possible. As predicted, a larger happy face advantage emerged for individuals associated with positive character information than for individuals associated with negative character information. These results demonstrate that experimentally manipulated evaluations of an individual's character are available quickly and affect early stages of face processing. Emotion perception is not only influenced by preexisting attitudes based on facial attributes, but also by information about a person that has been recently acquired. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The early stage of face detection in patients with major depressive disorder: an ERP study.

To investigate whether perceptual processes involved in early stages of face processing are influenced by depressive disorder, the face detection and configural analysis were assessed by recording the N170 component elicited by faces and objects (tables) presented under upright and inverted conditions. The N170 component elicited at occipital-temporal sites by faces was larger and peaked later than that elicited by tables, and inverted faces significantly enhanced and delayed the N170. The N170 in response to faces was enhanced in patients with major depressive disorder and the N170 face effect for upright condition was significantly larger in major depressive disorder patients than that in controls. However, the N170 inversion effect did not differ between two groups. These data indicate that, compared with normal controls, there is abnormal face perception at the early stage of processing faces in major depressive disorder patients but the major depressive disorder patients may have intact configural processing of faces.

Perception of an ambiguous figure is affected by own-age social biases

Although the perception of faces depends on low-level neuronal processes, it is also affected by high-level social processes. Faces from a social in-group, such as people of a similar age, receive more in-depth processing and are processed holistically. To explore whether own-age biases affect subconscious face perception, we presented participants with the young/old lady ambiguous figure. Mechanical Turk was used to sample participants of varying ages from the USA. Results demonstrated that younger and older participants estimated the age of the image as younger and older, respectively. This own-age effect ties in with socio-cultural practices, which are less inclusive towards the elderly. Participants were not aware the study was related to ageing and the stimulus was shown briefly. The results therefore demonstrate that high-level social group processes have a subconscious effect on the early stages of face processing. A neural feedback model is used to explain this interaction.

Brain Activity Related to the Judgment of Face-Likeness: Correlation between EEG and Face-Like Evaluation.

Faces represent important information for social communication, because social information, such as face-color, expression, and gender, is obtained from faces. Therefore, individuals' tend to find faces unconsciously, even in objects. Why is face-likeness perceived in non-face objects? Previous event-related potential (ERP) studies showed that the P1 component (early visual processing), the N170 component (face detection), and the N250 component (personal detection) reflect the neural processing of faces. Inverted faces were reported to enhance the amplitude and delay the latency of P1 and N170. To investigate face-likeness processing in the brain, we explored the face-related components of the ERP through a face-like evaluation task using natural faces, cars, insects, and Arcimboldo paintings presented upright or inverted. We found a significant correlation between the inversion effect index and face-like scores in P1 in both hemispheres and in N170 in the right hemisphere. These results suggest that judgment of face-likeness occurs in a relatively early stage of face processing.

Face Context Influences Local Part Processing: An ERP Study.

Perception of face parts on the basis of features is thought to be different from perception of whole faces, which is more based on configural information. Face context is also suggested to play an important role in face processing. To investigate how face context influences the early-stage perception of facial local parts, we used an oddball paradigm that tested perceptual stages of face processing rather than recognition. We recorded the event-related potentials (ERPs) elicited by whole faces and face parts presented in four conditions (upright-normal, upright-thatcherised, inverted-normal and inverted-thatcherised), as well as the ERPs elicited by non-face objects (whole houses and house parts) with corresponding conditions. The results showed that face context significantly affected the N170 with increased amplitudes and earlier peak latency for upright normal faces. Removing face context delayed the P1 latency but did not affect the P1 amplitude prominently for both upright and inverted normal faces. Across all conditions, neither the N170 nor the P1 was modulated by house context. The significant changes on the N170 and P1 components revealed that face context influences local part processing at the early stage of face processing and this context effect might be specific for face perception. We further suggested that perceptions of whole faces and face parts are functionally distinguished.

Dynamic Functional Brain Connectivity for Face Perception

Face perception is mediated by a distributed brain network comprised of the core system at occipito-temporal areas and the extended system at other relevant brain areas involving bilateral hemispheres. In this study we explored how the brain connectivity changes over the time for face-sensitive processing. We investigated the dynamic functional connectivity in face perception by analyzing time-dependent EEG phase synchronization in four different frequency bands: theta (4–7 Hz), alpha (8–14 Hz), beta (15–24 Hz), and gamma (25–45 Hz) bands in the early stages of face processing from 30 to 300 ms. High-density EEG were recorded from subjects who were passively viewing faces, buildings, and chairs. The dynamic connectivity within the core system and between the extended system were investigated. Significant differences between faces and non-faces mainly appear in theta band connectivity: (1) at the time segment of 90–120 ms between parietal area and occipito-temporal area in the right hemisphere, and (2) at the time segment of 150–180 ms between bilateral occipito-temporal areas. These results indicate (1) the importance of theta-band connectivity in the face-sensitive processing, and (2) that different parts of network are involved for the initial stage of face categorization and the stage of face structural encoding.

Mechanisms of hemispheric lateralization: Asymmetric interhemispheric recruitment in the face perception network

Perceiving human faces constitutes a fundamental ability of the human mind, integrating a wealth of information essential for social interactions in everyday life. Neuroimaging studies have unveiled a distributed neural network consisting of multiple brain regions in both hemispheres. Whereas the individual regions in the face perception network and the right-hemispheric dominance for face processing have been subject to intensive research, the functional integration among these regions and hemispheres has received considerably less attention. Using dynamic causal modeling (DCM) for fMRI, we analyzed the effective connectivity between the core regions in the face perception network of healthy humans to unveil the mechanisms underlying both intra- and interhemispheric integration. Our results suggest that the right-hemispheric lateralization of the network is due to an asymmetric face-specific interhemispheric recruitment at an early processing stage — that is, at the level of the occipital face area (OFA) but not the fusiform face area (FFA). As a structural correlate, we found that OFA gray matter volume was correlated with this asymmetric interhemispheric recruitment. Furthermore, exploratory analyses revealed that interhemispheric connection asymmetries were correlated with the strength of pupil constriction in response to faces, a measure with potential sensitivity to holistic (as opposed to feature-based) processing of faces. Overall, our findings thus provide a mechanistic description for lateralized processes in the core face perception network, point to a decisive role of interhemispheric integration at an early stage of face processing among bilateral OFA, and tentatively indicate a relation to individual variability in processing strategies for faces. These findings provide a promising avenue for systematic investigations of the potential role of interhemispheric integration in future studies.

Influence of spatial frequencies on early stages of face processing: Event-related potentials study

Influence of spatial frequencies on early stages of face processing: Event-related potentials study

Deficits in Early Stages of Face Processing in Schizophrenia: A Systematic Review of the P100 Component.

Schizophrenia is associated with deficits in face and affect recognition, which contribute to broader social functioning deficits. The present aim was to conduct a meta-analysis of early face processing in schizophrenia, as indexed by the P100 event-related potential component. Twelve studies (n = 328 patients with schizophrenia, n = 330 healthy controls) of the P100 component during face processing were evaluated by calculating Cohen's d for each study and overall weighted mean effect size (ES). In additional exploratory analyses, moderating influences of method and design were investigated, and the P100 component during face processing was evaluated based on valence: 5 studies (n = 225 patients, n = 225 controls) included neutral stimuli, 5 studies (n = 225 patients, n = 225 controls) included happy stimuli, and 4 studies (n = 209 patients, n = 209 controls) included fearful stimuli. The amplitude of the P100 to face stimuli was smaller in patients relative to controls (ES = .41, P < .01). Methodological or design differences did not account for heterogeneity in ES. When split by valence, results indicate smaller P100 in patients relative to control subjects in response to neutral (ES = .32, P < .001) and happy (ES = .21, P < .05) stimuli, whereas there was no difference in response to fearful faces (ES = .09, P > .05). The results indicate that P100 amplitude in response to faces is smaller in patients with schizophrenia, showing that socially relevant visual processing deficits begin earlier in processing than previously suggested. Additionally, the exploratory analyses suggest emotional specificity in these deficits. Ramifications for our understanding of face processing deficits and treatment development are discussed.

Attentional Modulation of the Emotional Expression Processing Studied with ERPs and sLORETA

Recent ERP studies demonstrate that the processing of facial emotional expression can be modulated by attention. The aim of the present study was to investigate the neural correlates of attentional influence on the emotional expression processing at early stages. We recorded ERP responses to facial stimuli containing neutral versus emotional expression in two different conditions. The first task was to discriminate facial expressions, while the second task was to categorize face gender. Enhanced positivity at occipital and occipito-temporal locations between 110 and 170 ms poststimulus was elicited by facial stimuli presented in the expression task when compared to the gender task. This effect temporally overlapped with the P1 and N170 components, which reflect the early stages of face processing. To localize the sources of the brain activity underlying observed attentional modulation, we used Standardized Low Resolution Electromagnetic Tomography. Enhanced activity within the extrastriate cortex for the expression task was obtained as the reflection of early ERP effect. Additionally, we found stronger activation within the superior temporal and the fusiform gyrus of the right hemisphere in the expression task when compared to the gender task. Our findings undoubtedly confirm that early stages of the emotional expression processing can be modified by top-down attention.

Faces in context: Modulation of expression processing by situational information

Numerous studies using the event-related potential (ERP) technique have found that emotional expressions modulate ERP components appearing at different post-stimulus onset times and are indicative of different stages of face processing. With the aim of studying the time course of integration of context and facial expression information, we investigated whether these modulations are sensitive to the situational context in which emotional expressions are perceived. Participants were asked to identify the expression of target faces that were presented immediately after reading short sentences that described happy or anger-inducing situations. The main manipulation was the congruency between the emotional content of the sentences and the target expression. Context-independent amplitude modulation of the N170 and N400 components by emotional expression was observed. On the other hand, context effects appeared on a later component (late positive potential, or LPP), with enhanced amplitudes on incongruent trials. These results show that the early stages of face processing where emotional expressions are coded are not sensitive to verbal information about the situation in which they appear. The timing of context congruency effects suggests that integration of facial expression with situational information occurs at a later stage, probably related to the detection of affective congruency.

Spatial and Temporal Attention Modulate the Early Stages of Face Processing: Behavioural Evidence from a Reaching Paradigm

A presently unresolved question within the face perception literature is whether attending to the location of a face modulates face processing (i.e. spatial attention). Opinions on this matter diverge along methodological lines – where neuroimaging studies have observed that the allocation of spatial attention serves to enhance the neural response to a face, findings from behavioural paradigms suggest face processing is carried out independently of spatial attention. In the present study, we reconcile this divide by using a continuous behavioural response measure that indexes face processing at a temporal resolution not available in discrete behavioural measures (e.g. button press). Using reaching trajectories as our response measure, we observed that although participants were able to process faces both when attended and unattended (as others have found), face processing was not impervious to attentional modulation. Attending to the face conferred clear benefits on sex-classification processes at less than 350ms of stimulus processing time. These findings constitute the first reliable demonstration of the modulatory effects of both spatial and temporal attention on face processing within a behavioural paradigm.