Identity Aftereffects Research Articles

The role of skin texture and facial shape in representations of age and identity

Faces have both shape and skin texture, but the relative importance of the two in face representations is unclear. Our goals were first, to determine the contribution of shape versus texture to aftereffects for facial age and identity and second, to assess whether adaptation transferred between shape and texture, suggesting integration in a single representation. In our first experiment we examined age aftereffects. We obtained young and old images of two celebrities and created hybrid images, one combining the structure of the old face with the skin texture of the young face, the other combining the young structure with the old skin texture. This allowed us to create adaptation contrasts where the two adapting faces had the same facial structure but different skin texture, and vice versa. In the second experiment, we performed a similar study but this time examining identity aftereffects between two people of a similar age. We found that both skin texture and facial shape generated significant age aftereffects, but the contribution was greater from texture than from shape. Both texture and shape also generated significant identity aftereffects, but the contribution was greater from shape than from texture. In the last experiment, we used the normal and hybrid images to determine if adaptation to one property (i.e., texture) could create aftereffects in the perception of age in the other property (i.e., shape). While there was significant within-component adaptation for texture and shape, there was no evidence of cross-component adaptation. We conclude that shape and texture contribute differently to different face representations, with texture dominating for age. The lack of cross-component adaptation transfer suggests independent encoding of shape and texture, at least for age representations.

Adaptive face space coding in congenital prosopagnosia: Typical figural aftereffects but abnormal identity aftereffects

People with congenital prosopagnosia (CP) report difficulty recognising faces in everyday life and perform poorly on face recognition tests. Here, we investigate whether impaired adaptive face space coding might contribute to poor face recognition in CP. To pinpoint how adaptation may affect face processing, a group of CPs and matched controls completed two complementary face adaptation tasks: the figural aftereffect, which reflects adaptation to general distortions of shape, and the identity aftereffect, which directly taps the mechanisms involved in the discrimination of different face identities. CPs displayed a typical figural aftereffect, consistent with evidence that they are able to process some shape-based information from faces, e.g., cues to discriminate sex. CPs also demonstrated a significant identity aftereffect. However, unlike controls, CPs impression of the identity of the neutral average face was not significantly shifted by adaptation, suggesting that adaptive coding of identity is abnormal in CP. In sum, CPs show reduced aftereffects but only when the task directly taps the use of face norms used to code individual identity. This finding of a reduced face identity aftereffect in individuals with severe face recognition problems is consistent with suggestions that adaptive coding may have a functional role in face recognition.

Jen or Sue? The influence of facial expressions on identity aftereffects in 8-year-old children

Jen or Sue? The influence of facial expressions on identity aftereffects in 8-year-old children

Neural correlates of adaptation to voice identity

Apart from speech content, the human voice also carries paralinguistic information about speaker identity. Voice identification and its neural correlates have received little scientific attention up to now. Here we use event-related potentials (ERPs) in an adaptation paradigm, in order to investigate the neural representation and the time course of vocal identity processing. Participants adapted to repeated utterances of vowel-consonant-vowel (VCV) of one personally familiar speaker (either A or B), before classifying a subsequent test voice varying on an identity continuum between these two speakers. Following adaptation to speaker A, test voices were more likely perceived as speaker B and vice versa, and these contrastive voice identity aftereffects (VIAEs) were much more pronounced when the same syllable, rather than a different syllable, was used as adaptor. Adaptation induced amplitude reductions of the frontocentral N1-P2 complex and a prominent reduction of the parietal P3 component, for test voices preceded by identity-corresponding adaptors. Importantly, only the P3 modulation remained clear for across-syllable combinations of adaptor and test stimuli. Our results suggest that voice identity is contrastively processed by specialized neurons in auditory cortex within ∼250 ms after stimulus onset, with identity processing becoming less dependent on speech content after ∼300 ms.

Enhanced attention amplifies face adaptation

Perceptual adaptation not only produces striking perceptual aftereffects, but also enhances coding efficiency and discrimination by calibrating coding mechanisms to prevailing inputs. Attention to simple stimuli increases adaptation, potentially enhancing its functional benefits. Here we show that attention also increases adaptation to faces. In Experiment 1, face identity aftereffects increased when attention to adapting faces was increased using a change detection task. In Experiment 2, figural (distortion) face aftereffects increased when attention was increased using a snap game (detecting immediate repeats) during adaptation. Both were large effects. Contributions of low-level adaptation were reduced using free viewing (both experiments) and a size change between adapt and test faces (Experiment 2). We suggest that attention may enhance adaptation throughout the entire cortical visual pathway, with functional benefits well beyond the immediate advantages of selective processing of potentially important stimuli. These results highlight the potential to facilitate adaptive updating of face-coding mechanisms by strategic deployment of attentional resources.

Effect of adaptor duration on 8-year-olds’ facial identity aftereffects suggests adult-like plasticity of the face norm

Adapting to a face shifts the perceived identity of a subsequent face in the direction opposite to the adapting face, a phenomenon known as a face identity aftereffect. In the present study, we examined the temporal dynamics of such aftereffects in children at an age when face processing abilities are not yet adult-like. We hypothesized that children’s difficulties in face processing may stem from an unstable mental representation of facial identity, which may be especially prone to adaptation aftereffects. Using a novel procedure designed especially for children, we show that both 8-year-olds and adults demonstrate identity aftereffects of similarly small size after just one second of viewing the adapting face, and that the strength of the aftereffect increases logarithmically and similarly with longer adapting durations for both age groups. The findings suggest that the mental representation of facial identity in 8-year-olds is no more malleable than that of adults, at least in response to short-term adaptation.

Sex-specific norms code face identity

Face identity aftereffects suggest that an average face, which is continuously updated by experience, functions as a norm for coding identity. Sex-contingent figural face aftereffects indicate that different norms are maintained for male and female faces but do not directly implicate them in coding identity. Here, we investigated whether sex-specific norms are used to code the identities of male and female faces or whether a generic, androgynous norm is used for all faces. We measured identity aftereffects for adapt-test pairs that were opposite relative to a sex-specific average and pairs that were opposite relative to an androgynous average. Identity aftereffects are generally larger for adapt-test pairs that lie opposite an average face, which functions as a norm for coding identity, than those that do not. Therefore, we reasoned that whichever average gives the larger aftereffect would be closer to the true psychological norm. Aftereffects were substantially and significantly larger for pairs that lie opposite a sex-specific than an androgynous average. This difference remained significant after correcting for differences in test trajectory length. These results indicate that, despite the common structure shared by all faces, identity is coded using sex-specific norms. We suggest that the use of category-specific norms may increase coding efficiency and help us discriminate thousands of faces despite their similarity as patterns.

Identity Aftereffects, but Not Composite Effects, are Contingent on Contrast Polarity

People are very good at discriminating faces despite their gross similarity. Our ability to capitalize on the variance that exists between faces has been attributed to an adaptive face-coding system. Evidence from psychophysical adaptation paradigms has generally supported this view, although results from other paradigms have suggested alternative accounts. The composite face-effect (CFE), for example, has been used to argue that holistic processing supports face discrimination. The question addressed here is whether the notion of holistic processing can be integrated with the notion of an adaptive face-coding system. Experiment 1 clearly demonstrates that the CFE acts on contrast-reversed faces while experiment 2 reveals that face-space adaptation depends on contrast polarity, consistent with previous observations of contrast-reversal impairing discrimination performance. Our results suggest that two popular theoretical frameworks in the face-recognition literature can be integrated, with holistic processing occurring at an earlier stage than face discrimination.

Distinguishing norm-based from exemplar-based coding of identity in children: Evidence from face identity aftereffects.

Children's performance on face identification tests improves dramatically between age 4 and adolescence, yet the source of this improvement is controversial. We used face identity aftereffects to examine whether changes in the organization of face-space during childhood could be a source of this improvement. Specifically we tested whether 7- to 9-year-old children, like adults, show patterns of aftereffects predicted by coding facial identity relative to a norm or the patterns predicted by exemplar-based coding. Consistent with use of norm-based coding children's aftereffects were larger (a) for opposite than non-opposite adapt-test pairs equated for perceptual similarity, and (b) for adaptors far from the average than for adaptors closer to the average. In addition, face identity aftereffects were present by age 5, suggesting adult-like face-space properties by 5, though we did not conduct specific tests to distinguish norm-based from exemplar-based coding in this age group. We conclude that children's poor face identification skills cannot be attributed to a failure to use norm-based coding.

Children's Face Coding is Norm-Based rather than Exemplar-based: Evidence From Face Identity Aftereffects

Children's Face Coding is Norm-Based rather than Exemplar-based: Evidence From Face Identity Aftereffects

Gender aftereffects in the perception of silhouetted face profiles

Recent studies have shown figural aftereffects in the perception of faces, including gender, race, and identity aftereffects (e.g., Leopold et al., 2001; Webster et al., 2004; Witthoft & Winawer, 2005). In such studies, prolonged exposure to a face with a particular characteristic (e.g., female) temporarily biases subsequent perception of faces in the opposite direction in face-space (e.g., male). Here we report such adaptation in a brief, implicit adaptation paradigm using parameterized silhouetted face profiles that rely on 18 landmark points to specify each face (Davidenko, 2004). We constructed a set of 8 male and 8 female face silhouettes, and a gender-neutral silhouette produced by averaging 20 male and 20 female silhouettes. Subjects were unaware that there were separate adaptation and test conditions; they simply rated each of 9 silhouettes on one of four dimensions: age, race, attractiveness, or gender. The first 8 silhouettes were either all female (Condition 1) or all male (Condition 2), and the 9th face was gender-neutral. Gender was only rated on the 9th face. We report a dramatic gender aftereffect with face silhouettes: 97% of subjects in Condition 1 (57 of 59) labeled the neutral silhouette as male, compared to 39% in Condition 2 (24 of 62). To our knowledge, this is the first report of face adaptation using profiles. In addition, these effects further validate Davidenko's silhouette face-space.

The Influence of a Low-Level Color or Figure Adaptation on a High-Level Face Perception

Visual adaptation is a universal phenomenon associated with human visual system. This adaptation affects not only the perception of low-level visual systems processing color, motion, and orientation, but also the perception of high-level visual systems processing complex visual patterns, such as facial identity and expression. Although it remains unclear for the mutual interaction mechanism between systems at different levels, this issue is the key to understand the hierarchical neural coding and computation mechanism. Thus, we examined whether the low-level adaptation influences on the high-level aftereffect by means of cross-level adaptation paradigm (i.e. color, figure adaptation versus facial identity adaptation). We measured the identity aftereffects within the real face test images on real face, color chip and figure adapting conditions. The cross-level mutual influence was evaluated by the aftereffect size among different adapting conditions. The results suggest that the adaptation to color and figure contributes to the high-level facial identity aftereffect. Besides, the real face adaptation obtained the significantly stronger aftereffect than the color chip or the figure adaptation. Our results reveal the possibility of cross-level adaptation propagation and implicitly indicate a high-level holistic facial neural representation. Based on these results, we discussed the theoretical implication of cross-level adaptation propagation for understanding the hierarchical sensory neural systems.

Cross-modal face identity aftereffects and their relation to priming.

We tested the magnitude of the face identity aftereffect following adaptation to different modes of adaptors in four experiments. The perceptual midpoint between two morphed famous faces was measured pre- and post-adaptation. Significant aftereffects were observed for visual (faces) and nonvisual adaptors (voices and names) but not nonspecific semantic information (e.g., occupations). Aftereffects were also observed following imagination and adaptation to an associated person. The strongest aftereffects were found adapting to facial caricatures. These results are discussed in terms of cross-modal adaptation occurring at various loci within the face-recognition system analogous to priming.

Horizontal information drives the behavioral signatures of face processing

Recent psychophysical evidence indicates that the vertical arrangement of horizontal information is particularly important for encoding facial identity. In this paper we extend this notion to examine the role that information at different (particularly cardinal) orientations might play in a number of established phenomena each a behavioral “signature” of face processing. In particular we consider (a) the face inversion effect (FIE), (b) the facial identity after-effect, (c) face-matching across viewpoint, and (d) interactive, so-called holistic, processing of face parts. We report that filtering faces to remove all but the horizontal information largely preserves these effects but conversely, retaining vertical information generally diminishes or abolishes them. We conclude that preferential processing of horizontal information is a central feature of human face processing that supports many of the behavioral signatures of this critical visual operation.

Orientation-sensitivity of face identity aftereffects

Our ability to recognize faces despite their similarity as visual patterns depends on high-level face-coding mechanisms that are strongly tuned to upright faces. If face aftereffects reflect adaptation of these mechanisms, as widely assumed, then they should be sensitive to face orientation. Previous studies have not supported this hypothesis, but have generally used a figural aftereffect paradigm, which may not optimally engage expert face-coding mechanisms. Here, we used an identity aftereffect paradigm, which requires identification of target faces, to provide a stronger test of the hypothesis. We measured identity aftereffects for upright and inverted faces, with and without eliminating low-level retinotopic adaptation. Baseline identification performance was substantially better for upright than inverted faces, confirming that our task tapped orientation-selective face expertise. With orientation varied between participants, aftereffects were almost twice as large for upright as inverted faces, on three different aftereffect measures (change in threshold, change in overall proportion correct, change in perceived identity of the average face). With orientation varied within participants, the results were less clear. We suggest that adaptation of expert face-coding mechanisms can contribute to face identity aftereffects, although the effect may not be very robust.

The role of higher level adaptive coding mechanisms in the development of face recognition

Developmental improvements in face identity recognition ability are widely documented, but the source of children’s immaturity in face recognition remains unclear. Differences in the way in which children and adults visually represent faces might underlie immaturities in face recognition. Recent evidence of a face identity aftereffect (FIAE), in which adaptation (exposure) to a particular identity causes a previously neutral face to take on the computationally opposite identity, suggests that adults code faces in an opponent fashion relative to an average face. One previous study showed comparable FIAEs in 8-year-olds and adults but did not demonstrate that adaptation was selective for high-level representations in both groups. Using a developmentally appropriate FIAE task, we investigated whether children show adult-like adaptation for facial identity when adapting and test images differ in size. Both age groups showed an equivalent FIAE, suggesting that qualitative changes in the use of higher level adaptive coding mechanisms do not drive the developmental improvements in face recognition ability, at least from 8 years of age.

Three-Dimensional Information in Face Representations Revealed by Identity Aftereffects

Representations of individual faces evolve with experience to support progressively more robust recognition. Knowledge of three-dimensional face structure is required to predict an image of a face as illumination and viewpoint change. Robust recognition across such transformations can be achieved with representations based on multiple two-dimensional views, three-dimensional structure, or both. We used face-identity adaptation in a familiarization paradigm to address a long-standing controversy concerning the role of two-dimensional versus three-dimensional information in face representations. We reasoned that if three-dimensional information is coded in the representations of familiar faces, then learning a new face using images generated by one three-dimensional transformation should enhance the robustness of the representation to another type of three-dimensional transformation. Familiarization with multiple views of faces enhanced the transfer of face-identity adaptation effects across changes in illumination by compensating for a generalization cost at a novel test viewpoint. This finding demonstrates a role for three-dimensional information in representations of familiar faces.

The direction of measured face aftereffects

Prolonged viewing of a face can result in a change of our perception of subsequent faces. This process of adaptation is believed to be functional and to reflect optimization-driven changes in the neural encoding. Because it is believed to target the neural systems underlying face processing, the measurement of face aftereffects is seen as a powerful behavioral technique that can provide deep insights into our facial encoding. Face identity aftereffects have typically been measured by assessing the way in which adaptation changes the perception of images from a test sequence, the latter commonly derived from morphing between two base images. The current study asks to what extent such face aftereffects are driven by the test sequence used to measure them. Using subjects trained to respond either to identity of expression, we examined the effects of identity and expression adaptation on test stimuli that varied in both identity and expression. We found that face adaptation produced measured aftereffects that were congruent with the adaptation stimulus; the composition of the test sequences did not affect the measured direction of the face aftereffects. Our results support the view that face adaptation studies can meaningfully tap into the intrinsically multidimensional nature of our representation of facial identity.

Fitting the child's mind to the world: adaptive norm‐based coding of facial identity in 8‐year‐olds

In adults, facial identity is coded by opponent processes relative to an average face or norm, as evidenced by the face identity aftereffect: adapting to a face biases perception towards the opposite identity, so that a previously neutral face (e.g. the average) resembles the identity of the computationally opposite face. We investigated whether children as young as 8 use adaptive norm-based coding to represent faces, a question of interest because 8-year-olds are less accurate than adults at recognizing faces and do not show the adult neural markers of face expertise. We found comparable face identity aftereffects in 8-year-olds and adults: perception of identity in both groups shifted in the direction predicted by norm-based coding. This finding suggests that, by 8 years of age, the adaptive computational mechanisms used to code facial identity are like those of adults and hence that children's immaturities in face processing arise from another source.

Imagine Jane and Identify John: Face Identity Aftereffects Induced by Imagined Faces

It is not known whether prolonged exposure to perceived and imagined complex visual images produces similar shifts in subsequent perception through selective adaptation. This question is important because a positive finding would suggest that perception and imagery of visual stimuli are mediated by shared neural networks. In this study, we used a selective adaptation procedure designed to induce high-level face-identity aftereffects—a phenomenon in which extended exposure to a particular face facilitates recognition of subsequent faces with opposite features while impairing recognition of all other faces. We report here that adaptation to either real or imagined faces produces a similar shift in perception and that identity boundaries represented in real and imagined faces are equivalent. Together, our results show that identity information contained in imagined and real faces produce similar behavioral outcomes. Our findings of high-level visual aftereffects induced by imagined stimuli can be taken as evidence for the involvement of shared neural networks that mediate perception and imagery of complex visual stimuli.