Face Cognition Research Articles

Structural encoding processes contribute to individual differences in face and object cognition: Inferences from psychometric test performance and event-related brain potentials

The enhanced N1 component in event-related potentials (ERP) to face stimuli, termed N170, is considered to indicate the structural encoding of faces. Previously, individual differences in the latency of the N170 have been related to face and object cognition abilities. By orthogonally manipulating content domain (faces vs objects) and task demands (easy/speed vs difficult/accuracy) in both psychometric and EEG tasks, we investigated the uniqueness of the processes underlying face cognition as compared with object cognition and the extent to which the N1/N170 component can explain individual differences in face and object cognition abilities. Data were recorded from N = 198 healthy young adults. Structural equation modeling (SEM) confirmed that the accuracies of face perception (FP) and memory are specific abilities above general object cognition; in contrast, the speed of face processing was not differentiable from the speed of object cognition. Although there was considerable domain-general variance in the N170 shared with the N1, there was significant face-specific variance in the N170. The brain–behavior relationship showed that faster face-specific processes for structural encoding of faces are associated with higher accuracy in both perceiving and memorizing faces. Moreover, in difficult task conditions, qualitatively different processes are additionally needed for recognizing face and object stimuli as compared with easy tasks. The difficulty-dependent variance components in the N170 amplitude were related with both face and object memory (OM) performance. We discuss implications for understanding individual differences in face cognition.

Are event-related potentials to dynamic facial expressions of emotion related to individual differences in the accuracy of processing facial expressions and identity?

Despite a wealth of knowledge about the neural mechanisms behind emotional facial expression processing, little is known about how they relate to individual differences in social cognition abilities. We studied individual differences in the event-related potentials (ERPs) elicited by dynamic facial expressions. First, we assessed the latent structure of the ERPs, reflecting structural face processing in the N170, and the allocation of processing resources and reflexive attention to emotionally salient stimuli, in the early posterior negativity (EPN) and the late positive complex (LPC). Then we estimated brain-behavior relationships between the ERP factors and behavioral indicators of facial identity and emotion-processing abilities. Structural models revealed that the participants who formed faster structural representations of neutral faces (i.e., shorter N170 latencies) performed better at face perception (r = -.51) and memory (r = -.42). The N170 amplitude was not related to individual differences in face cognition or emotion processing. The latent EPN factor correlated with emotion perception (r = .47) and memory (r = .32), and also with face perception abilities (r = .41). Interestingly, the latent factor representing the difference in EPN amplitudes between the two neutral control conditions (chewing and blinking movements) also correlated with emotion perception (r = .51), highlighting the importance of tracking facial changes in the perception of emotional facial expressions. The LPC factor for negative expressions correlated with the memory for emotional facial expressions. The links revealed between the latency and strength of activations of brain systems and individual differences in processing socio-emotional information provide new insights into the brain mechanisms involved in social communication.

Imprinting and flexibility in human face cognition.

Faces are an important cue to multiple physiological and psychological traits. Human preferences for exaggerated sex typicality (masculinity or femininity) in faces depend on multiple factors and show high inter-subject variability. To gain a deeper understanding of the mechanisms underlying facial femininity preferences in men, we tested the interactive effect of family structure (birth order, sibling sex-ratio and number of siblings) and parenthood status on these preferences. Based on a group of 1304 heterosexual men, we have found that preference for feminine faces was not only influenced by sibling age and sex, but also that fatherhood modulated this preference. Men with sisters had a weaker preference for femininity than men with brothers, highlighting a possible effect of a negative imprinting-like mechanism. What is more, fatherhood increased strongly the preference for facial femininity. Finally, for fathers with younger sisters only, the more the age difference increased between them, the more femininity preference increased. Overall our findings bring new insight into how early-acquired experience at the individual level may determine face preference in adulthood, and what is more, how these preferences are flexible and potentially dependent on parenthood status in adult men.

Perception and recognition of faces in adolescence.

Most studies on the development of face cognition abilities have focussed on childhood, with early maturation accounts contending that face cognition abilities are mature by 3–5 years. Late maturation accounts, in contrast, propose that some aspects of face cognition are not mature until at least 10 years. Here, we measured face memory and face perception, two core face cognition abilities, in 661 participants (397 females) in four age groups (younger adolescents (11.27–13.38 years); mid-adolescents (13.39–15.89 years); older adolescents (15.90–18.00 years); and adults (18.01–33.15 years)) while controlling for differences in general cognitive ability. We showed that both face cognition abilities mature relatively late, at around 16 years, with a female advantage in face memory, but not in face perception, both in adolescence and adulthood. Late maturation in the face perception task was driven mainly by protracted development in identity perception, while gaze perception abilities were already comparatively mature in early adolescence. These improvements in the ability to memorize, recognize and perceive faces during adolescence may be related to increasing exploratory behaviour and exposure to novel faces during this period of life.

Individual differences in face cognition: Within-person brain-behavior relationships and their between-person level correlates

Individual differences in face cognition: Within-person brain-behavior relationships and their between-person level correlates

Neurocognitive mechanisms underlying individual differences in speed and accuracy of face versus object cognition

Neurocognitive mechanisms underlying individual differences in speed and accuracy of face versus object cognition

Face and emotion expression processing and the serotonin transporter polymorphism 5-HTTLPR/rs22531.

Face cognition, including face identity and facial expression processing, is a crucial component of socio-emotional abilities, characterizing humans as highest developed social beings. However, for these trait domains molecular genetic studies investigating gene-behavior associations based on well-founded phenotype definitions are still rare. We examined the relationship between 5-HTTLPR/rs25531 polymorphisms-related to serotonin-reuptake-and the ability to perceive and recognize faces and emotional expressions in human faces. For this aim we conducted structural equation modeling on data from 230 young adults, obtained by using a comprehensive, multivariate task battery with maximal effort tasks. By additionally modeling fluid intelligence and immediate and delayed memory factors, we aimed to address the discriminant relationships of the 5-HTTLPR/rs25531 polymorphisms with socio-emotional abilities. We found a robust association between the 5-HTTLPR/rs25531 polymorphism and facial emotion perception. Carriers of two long (L) alleles outperformed carriers of one or two S alleles. Weaker associations were present for face identity perception and memory for emotional facial expressions. There was no association between the 5-HTTLPR/rs25531 polymorphism and non-social abilities, demonstrating discriminant validity of the relationships. We discuss the implications and possible neural mechanisms underlying these novel findings.

Face cognition in humans: Psychophysiological, developmental, and cross-cultural aspects

Investigators are finding increasing evidence for cross-cultural specificity in face cognition along with individual characteristics. The functions on which face cognition is based not only are types of general cognitive functions (perception, memory) but are elements of specific mental processes. Face perception, memorization, correct recognition of faces, and understanding the information that faces provide are essential skills for humans as a social species and can be considered as facets of social (cultural) intelligence. Face cognition is a difficult, multifaceted set of processes. The systems and processes involved in perceiving and recognizing faces are captured by several models focusing on the pertinent functions or including the presumably underlying neuroanatomical substrates. Thus, the study of face-cognition mechanisms is a cross-disciplinary topic. In Russia, Germany, and China there are plans to organize an interdisciplinary crosscultural study of face cognition. The first step of this scientific interaction is conducting psychological and psychophysiological studies of face cognition in multinational Russia within the frame of a grant supported by the Russian Science Foundation and devoted to “cross-cultural tolerance”. For that reason and in the presence of the huge diversity of data concerning face cognition, we suggest for discussion, specifically within the psychological scientific community, three aspects of face cognition: (1) psychophysiological (quantitative data), (2) developmental (qualitative data from developmental psychology), and (3) cross-cultural (qualitative data from cross-cultural studies). These three aspects reflect the different levels of investigations and constitute a comprehensive, multilateral approach to the problem. Unfortunately, as a rule, neuropsychological and psychological investigations are carried out independently of each other. However, for the purposes of our overview here, we assume that the main factors that could influence the developmental, individual psychophysiological, and cross-cultural differences in face cognition are not only biological but also social and cultural. One of the principal tasks of this article is to draw the attention of psychologists to the physiology of face processing and to draw the attention of neuroscientists to the psychology of face cognition. Thus, the main goal of the article is to instigate a discussion among social psychologists, psychophysiologists, and neuroscientists about the mechanisms of face cognition, which, as in a mirror, reflect the basic, fundamental “psychophysical” problem of psychophysiology.

Examining age-related shared variance between face cognition, vision, and self-reported physical health: a test of the common cause hypothesis for social cognition.

The shared decline in cognitive abilities, sensory functions (e.g., vision and hearing), and physical health with increasing age is well documented with some research attributing this shared age-related decline to a single common cause (e.g., aging brain). We evaluate the extent to which the common cause hypothesis predicts associations between vision and physical health with social cognition abilities specifically face perception and face memory. Based on a sample of 443 adults (17–88 years old), we test a series of structural equation models, including Multiple Indicator Multiple Cause (MIMIC) models, and estimate the extent to which vision and self-reported physical health are related to face perception and face memory through a common factor, before and after controlling for their fluid cognitive component and the linear effects of age. Results suggest significant shared variance amongst these constructs, with a common factor explaining some, but not all, of the shared age-related variance. Also, we found that the relations of face perception, but not face memory, with vision and physical health could be completely explained by fluid cognition. Overall, results suggest that a single common cause explains most, but not all age-related shared variance with domain specific aging mechanisms evident.

Holistic face perception in young and older adults: effects of feedback and attentional demand.

Evidence exists for age-related decline in face cognition ability. However, the extents to which attentional demand and flexibility to adapt viewing strategies contribute to age-related decline in face cognition tests is poorly understood. Here, we studied holistic face perception in older (age range 65–78 years, mean age 69.9) and young adults (age range 20–32 years, mean age 23.1) using the complete design for a sequential study-test composite face task (Richler et al., 2008b). Attentional demand was varied using trials that required participants to attend to both face halves and to redirect attention to one face half during the test (high attentional demand), and trials that allowed participants to keep a pre-adjusted focus (low attentional demand). We also varied viewing time and provided trial-by-trial feedback or no feedback. We observed strong composite effects, which were larger for the elderly in all conditions, independent of viewing time. Composite effects were smaller for low attentional demand, and larger for high attentional demand. No age-related differences were found in this respect. Feedback also reduced the composite effects in both age groups. Young adults could benefit from feedback in conditions with low and high attentional demands. Older adults performed better with feedback only in trials with low attentional demand. When attentional demand was high, older adults could no longer use the feedback signal, and performed worse with feedback than without. These findings suggest that older adults tend to use a global focus for faces, albeit piecemeal analysis is required for the task, and have difficulties adapting their viewing strategies when task demands are high. These results are consistent with the idea that elderly rely more on holistic strategies as a means to reduce perceptual and cognitive load when processing resources are limited (Konar et al., 2013).

The sex difference of smiling face cognition

The sex difference of smiling face cognition

Can Training Enhance Face Cognition Abilities in Middle-Aged Adults?

Face cognition is a crucial skill for social interaction and shows large individual differences in healthy adults, suggesting a possibility for improvement in some. We developed and tested specific training procedures for the accuracy of face memory and the speed of face cognition. Two groups each of 20 healthy middle-aged trainees practiced for 29 daily sessions of 15 minutes duration with different computerized home-based training procedures. In addition, 20 matched and 59 non-matched controls were included. Face cognition speed training enhanced performance during the training and transferred to the latent factor level as measured in a pre-post comparison. Persistence of the training effect was evidenced at the manifest level after three months. However, the training procedure influenced the speed of processing object stimuli to the same extent as face stimuli and therefore seems to have affected a more general ability of processing complex visual stimuli and not only faces. No effects of training on the accuracy of face memory were found. This study demonstrates that face-specific abilities may be hard to improve but also shows the plasticity of the speed of processing complex visual stimuli – for the first time in middle-aged, normal adults.

The Interaction between the Processing of Facial Gender and Emotional Expression

In face cognition, facial gender and emotional expression have different processing mechanisms. The models of face cognition from Bruce Young(1986) and Haxby, Hoffman Gobbini(2000) focused on expression processing. However, there was little interpretation about the facial gender processing, and the relationship between gender and expression processing was not illustrated in those models. Although several studies suggest that gender and expression processing may interact with each other, there is still no direct evidence. We proposed that the effect of facial familiarity might had been neglected in previous studies using the Garner's paradigm. Meanwhile, the face adaption paradigm might provide a new way to examine the relationship between the facial gender and expression processing. The mechanisms of the interaction would also be discussed in this review.

Neurocognitive mechanisms of individual differences in face cognition: A replication and extension

Face cognition performance is related to individual differences in cognitive subprocesses, as reflected in the amplitudes and latencies of event-related brain potentials (ERPs; Herzmann, Kunina, Sommer, & Wilhelm, 2010). In order to replicate and extend these findings, 110 participants were tested on a comprehensive task battery measuring face cognition abilities and established cognitive abilities, followed by ERP recordings in a face-learning-and-recognition task. We replicated the links of the ERP components indicating the speed of structural face encoding (N170 latency) and access to structural representations in memory (early repetition effect [ERE]/N250r) with the accuracy and speed of face cognition and with established cognitive abilities. As a novel result, we differentiated between the accuracy of face perception and face memory on the behavioral and electrophysiological levels and report a relationship between basic visual processes (P100 amplitude) and face memory. Moreover, the brain-behavior relationships for the ERE/N250r held true, even though we eliminated pictorial and perceptual structural codes from the priming effects by using backward masking of the primes with novel unfamiliar faces. On a methodological level, we demonstrated the utility of the latent difference score modeling technique to parameterize ERP difference components (e.g., ERE/N250r) on a latent level and link them to face cognition abilities.

On the genetic basis of face cognition and its relation to fluid cognitive abilities

The oxytocin and the dopaminergic systems have turned out to be highly relevant for social abilities and cognition. Therefore, we examined the association between two functional gene polymorphisms and face cognition (FC) in a multivariate study (N = 250) by applying structural equation modeling. The catechol-O-methyltransferase (COMT) val158met polymorphism influences the enzyme activity of COMT, which affects the prefrontal dopamine concentration. The rs226849 is a single-nucleotide polymorphism located in the promoter region of the oxytocin receptor (OXTR) gene, modulating the mRNA expression. By modeling a general fluid ability factor (defined by working memory and reasoning) and nested FC factors, we tested genetic contributions to FC, after controlling for variance in FC that was also associated with fluid abilities. In line with several previous studies, we found a significant association between the COMT genotype and fluid abilities (Gf) but not with FC. The association between the oxytocin polymorphism and Gf was opposite in direction for men and women. Women with the C(+) genotype performed better on Gf tasks than those with the C(-) genotype. Conversely, men with the C(-) genotype performed better than those with the C(+) genotype. There was no significant association between OXTR and the nested FC factor. Therefore, the relationship between the oxytocin polymorphism and FC can be fully accounted for by Gf. The sex specificity of this relationship is a novel finding and warrants a mechanistic explanation.

Face and object cognition across adult age.

We investigated the specificity of face compared with object cognition from an individual differences and aging perspective by determining the amount of overlap between these abilities at the level of latent constructs across age. Confirmatory factor analytic models tested the specificity of speed and accuracy measures for face and object cognition (N = 448; 18 to 88 years). Accuracy measures were distinguishable and slightly dedifferentiated across age, which was not due to loss of visual acuity and contrast sensitivity. There was no face specificity for speed measures. These results support the specificity of face cognition from differential and developmental perspective only for performance accuracy.

Face‐specificity is robust across diverse stimuli and individual people, even when interstimulus variance is zero

The N170 is a brain electrical potential proposed to index the earliest time of categorical perception of faces in occipitotemporal visual areas implicated in face cognition, being more negative for faces than nonface objects between 120 and 200 ms. The interstimulus variance (ISV) account instead explained N170 face-specificity as an artifact due to objects varying more visually than faces. Ganis, Smith, and Schendan (2012) tested this account directly, finding that N170 face-specificity remains even when ISV is eliminated. Here, N170 peak amplitude and face-specificity is quantified for individual stimuli and participants, revealing that the right hemisphere N170 is especially sensitive to stimulus variability. Further, ISV contributes 0 to 37% to N170 face-specificity. These findings provide evidence for optimizing face processing science. The paradigm can apply to any research in which ISV may be uncontrolled (e.g., category comparisons).

Supplemental Material for Face and Object Cognition Across Adult Age

Supplemental Material for Face and Object Cognition Across Adult Age

Sex differences in face cognition

Although there is abundant evidence for female superiority in Face Cognition (FC), a number of questions regarding sex differences remain to be addressed. Here we report a reanalysis of data on the level of latent factors, modeled on the basis of an extensive test battery applied to three samples of over 800 adults in all. In independent samples the measurement structure of FC was invariant for both sexes, indicating that the measurement of the construct does not depend on the context variable sex, and investigating mean performance differences will not be biased by measurement issues — a neglected aspect in previous studies. We confirmed female superiority for face perception (FP) and face memory (FM). For the first time we could show that these sex differences prevailed after accounting for sex differences in broadly measured general cognitive functioning and in object perception. Across adult age, sex differences in FM increased due to the rapid decline of this ability in men, whereas performance in women remained stable across adult age. Self-reported social involvement and things-oriented activities moderated sex-differences in FM. Results show that sex differences are salient at the level of specific FC constructs and that they can be partially explained by social involvement.

On the specificity of face cognition compared with general cognitive functioning across adult age.

Face cognition is considered a specific human ability, clearly differentiable from general cognitive functioning. Its specificity is primarily supported by cognitive-experimental and neuroimaging research, but recently also from an individual differences perspective. However, no comprehensive behavioral data are available, which would allow estimating lifespan changes of the covariance structure of face-cognition abilities and general cognitive functioning as well as age-differences in face cognition after accounting for interindividual variability in general cognition. The present study aimed to fill this gap. In an age-heterogeneous (18-82 years) sample of 448 adults, we found no factorial dedifferentiation between face cognition and general cognition. Age-related differences in face memory were still salient after taking into account changes in general cognitive functioning. Face cognition thus remains a specific human ability compared with general cognition, even until old age. We discuss implications for models of cognitive aging and suggest that it is necessary to include more explicitly special social abilities in those models.