Face Processing System Research Articles

Holistic Face Processing is Induced by Shape and Texture

There is increasing evidence that shape and texture are integral parts of face identity. However, it is less clear whether face-specific processing mechanisms are triggered by face shape alone, or if texture might play an important role. We address this question by studying mechanisms involved in holistic face processing. Face stimuli were either full-color pictures of real faces (shape and texture) or line drawings of the same faces (shape without texture). In a change detection task subjects judged whether eyes and eyebrows in two otherwise identical, sequentially presented faces were different in size or not. Afterwards, subjects had to identify the just presented face among two distractor faces (forced-choice identification task). The results obtained from the two tasks give rise to the conclusion that face identification and change detection tasks engage different processing strategies, which capture different aspects of holistic processing. Real faces were processed holistically, irrespective of task requirements, whereas line drawings were processed holistically only if face identification was required. On the basis of the data we conclude that face shape is relevant for the initial processing stage and feature binding, whereas face texture seems to be involved in processing of face configuration more specifically. Moreover, results demonstrate considerable flexibility of the face processing systems allowing for goal-directed and task-specific recall of face information.

An Island of Stability: Art Images and Natural Scenes – but Not Natural Faces – Show Consistent Esthetic Response in Alzheimer’s-Related Dementia

Alzheimer’s disease (AD) causes severe impairments in cognitive function but there is evidence that aspects of esthetic perception are somewhat spared, at least in early stages of the disease. People with early Alzheimer’s-related dementia have been found to show similar degrees of stability over time in esthetic judgment of paintings compared to controls, despite poor explicit memory for the images. Here we expand on this line of inquiry to investigate the types of perceptual judgments involved, and to test whether people in later stages of the disease also show evidence of preserved esthetic judgment. Our results confirm that, compared to healthy controls, there is similar esthetic stability in early stage AD in the absence of explicit memory, and we report here that people with later stages of the disease also show similar stability compared to controls. However, while we find that stability for portrait paintings, landscape paintings, and landscape photographs is not different compared to control group performance, stability for face photographs – which were matched for identity with the portrait paintings – was significantly impaired in the AD group. We suggest that partially spared face-processing systems interfere with esthetic processing of natural faces in ways that are not found for artistic images and landscape photographs. Thus, our work provides a novel form of evidence regarding face-processing in healthy and diseased aging. Our work also gives insights into general theories of esthetics, since people with AD are not encumbered by many of the semantic and emotional factors that otherwise color esthetic judgment. We conclude that, for people with AD, basic esthetic judgment of artistic images represents an “island of stability” in a condition that in most other respects causes profound cognitive disruption. As such, esthetic response could be a promising route to future therapies.

A U-shaped relation between sitting ability and upright face processing in infants.

A growing body of research indicates connections exist between action, perception, and cognition in infants. In this study, associated changes between sitting ability and upright face processing were tested in 111 infants. Using the visual habituation "switch" task (C. H. Cashon & L. B. Cohen, 2004; L. B. Cohen & C. H. Cashon, 2001), holistic processing of faces was assessed in same-aged non- and near sitters (22-25 weeks) and same-aged new and expert sitters (27-32 weeks). U-shaped relation was found between sitting stage and holistic face processing such that only nonsitters and expert sitters processed faces holistically. It is posited that the results are due to a reorganization of the upright face-processing system resulting from infants' learning to sit independently and trying to incorporate the meaning of upright faces.

The face-sensitive N170 component in developmental prosopagnosia

Individuals with developmental prosopagnosia (DP) show severe face recognition deficits in the absence of any history of neurological damage. To examine the time-course of face processing in DP, we measured the face-sensitive N170 component of the event-related brain potential (ERP) in a group of 16 participants with DP and 16 age-matched control participants. Reliable enhancements of N170 amplitudes in response to upright faces relative to houses were found for the DP group. This effect was equivalent in size to the effect observed for controls, demonstrating normal face-sensitivity of the N170 component in DP. Face inversion enhanced N170 amplitudes in the control group, but not for DPs, suggesting that many DPs do not differentiate between upright and inverted faces in the typical manner. These N170 face inversion effects were present for younger but not older controls, while they were absent for both younger and older DPs. Results suggest that the early face-sensitivity of visual processing is preserved in most individuals with DP, but that the face processing system in many DPs is not selectively tuned to the canonical upright orientation of faces.

Emotion unfolded by motion: a role for parietal lobe in decoding dynamic facial expressions

Facial expressions convey important emotional and social information and are frequently applied in investigations of human affective processing. Dynamic faces may provide higher ecological validity to examine perceptual and cognitive processing of facial expressions. Higher order processing of emotional faces was addressed by varying the task and virtual face models systematically. Blood oxygenation level-dependent activation was assessed using functional magnetic resonance imaging in 20 healthy volunteers while viewing and evaluating either emotion or gender intensity of dynamic face stimuli. A general linear model analysis revealed that high valence activated a network of motion-responsive areas, indicating that visual motion areas support perceptual coding for the motion-based intensity of facial expressions. The comparison of emotion with gender discrimination task revealed increased activation of inferior parietal lobule, which highlights the involvement of parietal areas in processing of high level features of faces. Dynamic emotional stimuli may help to emphasize functions of the hypothesized 'extended' over the 'core' system for face processing.

Extensive visual training in adulthood significantly reduces the face inversion effect

The poorer recognition performance for inverted as compared to upright faces is one of the most well-known and robust behavioral effects observed in the field of face perception. Here we investigated whether extensive training at individualizing a large set of inverted faces in adulthood could significantly reduce this inversion effect for novel faces. This issue is important because inverted faces are as complex as upright faces but they are not visually experienced during development. Moreover, inverted faces violate the biological constraints, present at birth, for preferential looking (i.e., a larger number of elements in the top part than the bottom part of the stimulus). Eight adult observers were trained for 2 weeks (16 hr) to individualize 30 inverted face identities presented under different depth-rotated views. Following training, all participants showed a significant reduction of their inversion effect for novel face identities presented in a challenging four-alternatives delayed matching task. This reduction of the face inversion effect was observed in comparison to the magnitude of the same observers' effect before training, and to the magnitude of the face inversion effect of a group of untrained participants. These observations indicate that extensive training in adulthood can lead to a significant reduction of the inversion effect that generalizes to novel faces, suggesting a larger degree of flexibility of the adult face processing system than previously thought.

Stimulation of Category-Selective Brain Areas Modulates ERP to Their Preferred Categories

Neural selectivity to specific object categories has been demonstrated in extrastriate cortex with both functional MRI [1-3] and event-related potential (ERP) [4, 5]. Here we tested for a causal relationship between the activation of category-selective areas and ERP to their preferred categories. Electroencephalogram (EEG) was recorded while participants observed faces and headless bodies. Concurrently with EEG recording, we delivered two pulses of transcranial magnetic stimulation (TMS) over the right occipital face area (OFA) or extrastriate body area (EBA) at 60 and 100 ms after stimulus onset. Results showed a clear dissociation between the stimulated site and the stimulus category on ERP modulation: stimulation of the OFA significantly increased the N1 amplitude to faces but not to bodies, whereas stimulation of the EBA significantly increased the N1 amplitude to bodies but not to faces. These findings provide the first evidence for a specific and causal link between activity in category-selective networks and scalp-recorded ERP to their preferred categories. This result also demonstrates that the face and body N1 reflects several nonoverlapping neural sources, rather than changes in face-selective mechanisms alone. Lastly, because early stimulation (60-100 ms) affected selectivity of a later ERP component (150-200 ms), the results could imply a feed-forward connection between occipital and temporal category-selective areas.

Developmental change in the ERP responses to familiar faces in toddlers with autism spectrum disorders versus typical development.

Individuals with autism spectrum disorder (ASD) show differences in face processing abilities from early in development. To examine whether these differences reflect an atypical versus delayed developmental trajectory, neural responses to familiar and unfamiliar faces in twenty-four 18- to 47-month-old children with ASD were compared with responses of thirty-two 12- to 30-month-old typically developing children. Results of 2 experiments revealed that neural responses to faces in children with ASD resembled those observed in younger typically developing children, suggesting delayed development. Electrophysiological responses to faces were also related to parent report of adaptive social behaviors for both children with ASD and typical development. Slower development of the face processing system in ASD may be related to reduced self-directed "expected" experience with faces in early development.

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.

Perceptual training prevents the emergence of the other race effect during infancy.

Experience plays a crucial role in the development of the face processing system. At 6 months of age infants can discriminate individual faces from their own and other races. By 9 months of age this ability to process other-race faces is typically lost, due to minimal experience with other-race faces, and vast exposure to own-race faces, for which infants come to manifest expertise [1]. This is known as the Other Race Effect. In the current study, we demonstrate that exposing Caucasian infants to Chinese faces through perceptual training via picture books for a total of one hour between 6 and 9 months allows Caucasian infants to maintain the ability to discriminate Chinese faces at 9 months of age. The development of the processing of face race can be modified by training, highlighting the importance of early experience in shaping the face representation.

Development of face processing.

This article reviews the development of the face-processing system from birth, during infancy and through childhood, until it becomes the sophisticated system observed in adults. We begin by discussing the following major theoretical issues concerning the development of face expertise: (1) nature versus nurture or the role of experience in face processing, (2) level of processing (i.e., global, basic, subordinate, individual) and expertise, and (3) type of processing (i.e., holistic, configural, featural). This general overview will be followed by a closer examination of individual studies that investigate the development of face processing. These studies will include a review of (1) development of differential processing of faces and objects, (2) development of differential processing of faces of different species, (3) developmental changes in processing facial identity, and (4) developmental changes in the categorization of faces. Our review of the developmental literature reveals early competence in face-processing abilities with infants presenting a preference for face stimuli and facial discrimination using featural, configural, and holistic cues. This early competence is then later refined as evidenced by age-related changes throughout childhood. Some of the refinements are likely due to the development of general cognitive abilities, whereas some others may be face-specific. WIREs Cogni Sci 2011 2 666-675 DOI: 10.1002/wcs.146 This article is categorized under: Psychology > Development and Aging.

Caucasian infants scan own- and other-race faces differently.

Young infants are known to prefer own-race faces to other race faces and recognize own-race faces better than other-race faces. However, it is entirely unclear as to whether infants also attend to different parts of own- and other-race faces differently, which may provide an important clue as to how and why the own-race face recognition advantage emerges so early. The present study used eye tracking methodology to investigate whether 6- to 10-month-old Caucasian infants (N = 37) have differential scanning patterns for dynamically displayed own- and other-race faces. We found that even though infants spent a similar amount of time looking at own- and other-race faces, with increased age, infants increasingly looked longer at the eyes of own-race faces and less at the mouths of own-race faces. These findings suggest experience-based tuning of the infant's face processing system to optimally process own-race faces that are different in physiognomy from other-race faces. In addition, the present results, taken together with recent own- and other-race eye tracking findings with infants and adults, provide strong support for an enculturation hypothesis that East Asians and Westerners may be socialized to scan faces differently due to each culture's conventions regarding mutual gaze during interpersonal communication.

Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System

Primates can recognize faces across a range of viewing conditions. Representations of individual identity should thus exist that are invariant to accidental image transformations like view direction. We targeted the recently discovered face-processing network of the macaque monkey that consists of six interconnected face-selective regions and recorded from the two middle patches (ML, middle lateral, and MF, middle fundus) and two anterior patches (AL, anterior lateral, and AM, anterior medial). We found that the anatomical position of a face patch was associated with a unique functional identity: Face patches differed qualitatively in how they represented identity across head orientations. Neurons in ML and MF were view-specific; neurons in AL were tuned to identity mirror-symmetrically across views, thus achieving partial view invariance; and neurons in AM, the most anterior face patch, achieved almost full view invariance.

The Relationship of Gamma Oscillations and Face-Specific ERPs Recorded Subdurally from Occipitotemporal Cortex

The perception of faces evokes characteristic electrophysiological responses at discrete loci in human fusiform gyrus and adjacent ventral occipitotemporal cortical sites. Prominent among these responses are a surface-negative potential at ∼200-ms postonset (face-N200) and face-induced spectral perturbations in the gamma band (face-γERSP). The degree to which these responses represent activity in the same cortical loci and the degree to which they are influenced by the same perceptual and task variables are unknown. We evaluated this anatomical colocalization and functional correlation in 2 experiments in which the electrocorticogram was recorded from subdural electrodes in 51 participants. Experiment 1 investigated the category specificity of the γERSP and its colocalization with the face-N200. Experiment 2 examined differences in face-N200 and face-γERSP to face stimuli that varied in featural complexity. We found that γERSP is a category-specific phenomenon with separate, though overlapping, category sensitivities as the N200. Further, the presence of face-γERSP at an electrode site significantly predicted the presence and amplitude of face-N200 at that site. However, the converse was not true in that face-N200 was evoked by impoverished face stimuli that did not induce face-γERSP. These results demonstrate that these electrophysiological responses reflect separate components of the brain's face processing system.

Reconnaissance des visages d’un autre groupe ethnique : éclairage d’une approche développementale

We are reviewing the recent findings on the Other Race Effect (ORE), which is the difficulty to recognize faces from other race compared to own race faces. Several hypotheses were proposed: negative attitude ( Brigham and Malpass, 1985), attentional mechanisms ( Chance and Goldstein, 1981), and the contact hypothesis ( Brigham et al., 1982) which postulates that the ORE is due to a lack of experience with other race's faces. The contact hypothesis being, of course, modulated by attention and attitude. Valentine ( 1991 ; Valentine and Endo, 1992) proposes a norm-based coding model in which faces are encoded as vectors according to their deviation from a prototypical average. The resulting dimensions will differ according to the input received with certain salient, individuating dimensions carrying more “weight” than others. Predominant exposure to faces of a specific species, gender, or race early in life will cause the dimensions of one's prototype to become “tuned” towards such faces. The evidence presented support Valentine's model but we are showing that the quality of the contact is crucial in the experience. We are arguing that a developmental approach is necessary to better understand the ORE. Infants are able to process and recognize faces from an early age and several recent studies have found that the ORE can be observed from 9–10 months of age. Experimental results indicate that 6- to 9-months of age represents an important time of transition in the face processing system. If a certain type of face (other races) is not experienced prior to this period, then we appear to lose our ability to discriminate between individual faces within those groups.

FMRI evidence of neural abnormalities in the subcortical face processing system in ASD

Recent evidence suggests that a rapid, automatic face detection system is supported by subcortical structures including the amygdala, pulvinar, and superior colliculus. Early-emerging abnormalities in these structures may be related to reduced social orienting in children with autism, and subsequently, to aberrant development of cortical circuits involved in face processing. Our objective was to determine whether functional abnormalities in the subcortical face processing system are present in adults with autism spectrum disorders (ASD) during supraliminal fearful face processing. Participants included twenty-eight individuals with ASD and 25 controls group-matched on age, IQ, and behavioral performance. The ASD group met diagnostic criteria on the ADI-R, ADOS-G, and DSM-IV. Both the ASD and control groups showed significant activation in bilateral fusiform gyri. The control group exhibited additional significant responses in the right amygdala, right pulvinar, and bilateral superior colliculi. In the direct group comparison, the controls showed significantly greater activation in the left amygdala, bilateral fusiform gyrus, right pulvinar, and bilateral superior colliculi. No brain region showed significantly greater activation in the ASD group compared to the controls. Thus, basic rapid face identification mechanisms appear to be functional in ASD. However, individuals with ASD failed to engage the subcortical brain regions involved in face detection and automatic emotional face processing, suggesting a core mechanism for impaired socioemotional processing in ASD. Neural abnormalities in this system may contribute to early-emerging deficits in social orienting and attention, the putative precursors to abnormalities in social cognition and cortical face processing specialization.

The role of experience during childhood in shaping the other-race effect

It is well known that adults' face recognition is characterized by an 'other-race effect' (ORE; see Meissner & Brigham, 2001), but few studies have investigated this ORE during the development of the face processing system. Here we examined the role of experience with other-race faces during childhood by testing a group of 6- to 14-year-old Asian children adopted between 2 and 26 months in Caucasian families living in Western Europe, as well as a group of age-matched Caucasian children. The latter group showed a strong ORE in favour of own-race faces that was stable from 6 to 14 years of age. The adopted participants did not show a significant reversal of the ORE, unlike a recently reported study (Sangrigoli et al., 2005), but rather comparable results with Asian and Caucasian faces. Their pattern of performance was neither influenced by their age of adoption, nor by the amount of experience they accumulated during childhood with other-race faces. These results indicate that the balance of performance with Asian and Caucasian faces can be modulated, but not completely reversed, in children whose exposure to own- and other-race faces changes drastically during the period of maturation of the face recognition system, depending on the length of exposure to the new face race. Overall, experience appears to be crucial during childhood to shape the face recognition system towards the most predominant morphologies of faces present in the environment.

A combinatorial study of pose effects in unfamiliar face recognition

The face inversion effect, evidence that humans possess a specialized system for face processing, and the ¾ view advantage, evidence that a canonical viewpoint exists from which faces may be optimally recognized, are two commonly cited findings in the face processing literature. In this paper, the interaction of these effects is examined in a sequential matching paradigm in which unfamiliar faces are combinatorially randomized in pose across two dimensions (roll and yaw). Using large numbers of poses, trials and face stimuli, two experiments were conducted in which pose was either jointly or independently randomized between intervals. Results include that performance was modulated in a continuous fashion as each dimension was manipulated, that an offset-specific ¾ advantage exists, that both specific study and test pose affect recognition, and that, for like offset, yaw rotation is more deleterious to performance than roll rotation. Response bias effects included that matched or reflective yaw led observers to employ a more liberal criterion.

Brain–behavior correlations: Relationships between mother–stranger face processing and infants' behavioral responses to a separation from mother.

Event-related potentials (ERPs) were recorded from 6-month-olds (N = 30) as they looked at pictures of their mother's face and a stranger's face. Negative component (Nc) and P400 component responses from the ERP portion of the study were correlated with behavioral responses of the infants during a separation from their mothers. We measured the mother-directed infant behaviors of distress and visual search for mother during separation in order to determine if they were predictive of infants' brain responses to pictures of the mother's face versus a stranger's face. These behavioral measures are important because they likely reflect the functioning of the emerging mother-child relationship and inform debates about interactions between social experience and face processing. Infant distress and visual search for mother during separation were predictive of face processing ERPs, and this relationship differed across mother and stranger face presentations. In particular, distress was associated with larger amplitude P400 and Nc responses to the mother's face, and visual search for mother was associated with longer P400 and Nc latencies to the stranger's face. Implications for the developing mother-child relationship and face processing system are discussed.

The role of experience during childhood in shaping the other‐race effect

It is well known that adults' face recognition is characterized by an 'other-race effect' (ORE; see Meissner & Brigham, 2001), but few studies have investigated this ORE during the development of the face processing system. Here we examined the role of experience with other-race faces during childhood by testing a group of 6- to 14-year-old Asian children adopted between 2 and 26 months in Caucasian families living in Western Europe, as well as a group of age-matched Caucasian children. The latter group showed a strong ORE in favour of own-race faces that was stable from 6 to 14 years of age. The adopted participants did not show a significant reversal of the ORE, unlike a recently reported study (Sangrigoli et al., 2005), but rather comparable results with Asian and Caucasian faces. Their pattern of performance was neither influenced by their age of adoption, nor by the amount of experience they accumulated during childhood with other-race faces. These results indicate that the balance of performance with Asian and Caucasian faces can be modulated, but not completely reversed, in children whose exposure to own- and other-race faces changes drastically during the period of maturation of the face recognition system, depending on the length of exposure to the new face race. Overall, experience appears to be crucial during childhood to shape the face recognition system towards the most predominant morphologies of faces present in the environment.