Identity Aftereffects Research Articles

What happens to our representation of identity as familiar faces age? Evidence from priming and identity aftereffects.

Matching identity in images of unfamiliar faces is error prone, but we can easily recognize highly variable images of familiar faces – even images taken decades apart. Recent theoretical development based on computational modelling can account for how we recognize extremely variable instances of the same identity. We provide complementary behavioural data by examining older adults’ representation of older celebrities who were also famous when young. In Experiment 1, participants completed a long‐lag repetition priming task in which primes and test stimuli were the same age or different ages. In Experiment 2, participants completed an identity after effects task in which the adapting stimulus was an older or young photograph of one celebrity and the test stimulus was a morph between the adapting identity and a different celebrity; the adapting stimulus was the same age as the test stimulus on some trials (e.g., both old) or a different age (e.g., adapter young, test stimulus old). The magnitude of priming and identity after effects were not influenced by whether the prime and adapting stimulus were the same age or different age as the test face. Collectively, our findings suggest that humans have one common mental representation for a familiar face (e.g., Paul McCartney) that incorporates visual changes across decades, rather than multiple age‐specific representations. These findings make novel predictions for state‐of‐the‐art algorithms (e.g., Deep Convolutional Neural Networks).

Visual adaptation and 7T fMRI reveal facial identity processing in the human brain under shallow interocular suppression

Face identity is represented at a high level of the visual hierarchy. Whether the human brain can process facial identity information in the absence of visual awareness remains unclear. In this study, we investigated potential face identity representation through face-identity adaptation with the adapting faces interocularly suppressed by Continuous Flash Suppression (CFS) noise, a modified binocular rivalry paradigm. The strength of interocular suppression was manipulated by varying the contrast of CFS noise. While obeservers reported the face images subjectively unperceived and the face identity objectively unrecognizable, a significant face identity aftereffect was observed under low but not high contrast CFS noise. In addition, the identity of face images under shallow interocular suppression can be decoded from multi-voxel patterns in the right fusiform face area (FFA) obtained with high-resolution 7T fMRI. Thus the comined evidence from visual adaptation and 7T fMRI suggest that face identity can be represented in the human brain without explicit perceptual recognition. The processing of interocularly suppressed faces could occur at different levels depending on how “deep” the information is suppressed.

A proportionally suppressed and prolonged LPP acts as a neurophysiological correlate of face identity aftereffect

The recognition of facial identity is fundamentally important in daily life and social interactions. Here, we asked how the perception of facial identity is influenced by the set of preceding faces that observers are exposed to. We morphed the faces of Adam and Bob to generate a continuum of face images, and asked subjects to judge the identity of those face images to be Adam or Bob after they were exposed to a face image within the continuum. We found that after adaptation to Bob, the subjects were apt to identify a subsequently presented ambiguous face to be Adam, and vice versa, i.e., the face identity aftereffect (FIAE). We simultaneously recorded EEG during the task and analyzed the event-related potentials in response to the test faces, and found that adapting to a face identity (e.g., Bob) suppressed the amplitude, and prolonged the latency, of the late positive potential (LPP) in response to subsequent faces of the same identity (e.g., Bob). Further analyses of the LPP in response to each test face within the continuum revealed a proportional changing trend, i.e., the strongest LPP suppression happened when the adaptor and the test face were the most similar, while the similarity declined, the LPP gradually recovered from suppression. The modulations of LPP amplitude and latency by the identity similarity between the adaptor and test face strongly indicate that the proportionally suppressed and prolonged LPP activity acts as a neurophysiological correlate of FIAE.

Individual Differences in Serial Dependence of Facial Identity are Associated with Face Recognition Abilities

Serial dependence is a perceptual bias where current perception is biased towards prior visual input. This bias occurs when perceiving visual attributes, such as facial identity, and has been argued to play an important functional role in vision, stabilising the perception of objects through integration. In face identity recognition, this bias could assist in building stable representations of facial identity. If so, then individual variation in serial dependence could contribute to face recognition ability. To investigate this possibility, we measured both the strength of serial dependence and the range over which individuals showed this bias (the tuning) in 219 adults, using a new measure of serial dependence of facial identity. We found that better face recognition was associated with stronger serial dependence and narrower tuning, that is, showing serial dependence primarily when sequential faces were highly similar. Serial dependence tuning was further found to be a significant predictor of face recognition abilities independently of both object recognition and face identity aftereffects. These findings suggest that the extent to which serial dependence is used selectively for similar faces is important to face recognition. Our results are consistent with the view that serial dependence plays a functional role in face recognition.

Beyond opponent coding of facial identity: Evidence for an additional channel tuned to the average face.

Face identity can be represented in a multidimensional space centered on the average. It has been argued that the average acts as a perceptual norm, with the norm coded implicitly by balanced activation in pairs of channels that respond to opposite extremes of face dimensions (two-channel model). In Experiment 1 we used face identity aftereffects to distinguish this model from a narrow-band multichannel model with no norm. We show that as adaptors become more extreme, aftereffects initially increase sharply and then plateau. Crucially there is no decrease, ruling out narrow-band multichannel coding, but consistent with a two-channel norm-based model. However, these results leave open the possibility that there may be a third channel, tuned explicitly to the norm (three-channel model). In Experiment 2 we show that alternating adaptation widens the range identified as the average whereas adaptation to the average narrows the range, consistent with the three-channel model. Explicit modeling confirmed the three-channel model as the best fit for the combined data from both experiments. However, a two-channel model with decision criteria allowed to vary between adapting conditions, also provided a very good fit. These results support opponent, norm-based coding of face identity with additional explicit coding of the norm. (PsycINFO Database Record

Aftereffects support opponent coding of expression.

We used aftereffects to investigate the coding mechanisms underlying perception of facial expression. Recent evidence that some dimensions are common to the coding of both expression and identity suggests that the same type of coding system could be used for both attributes. Identity is adaptively opponent coded by pairs of neural populations tuned to opposite extremes of relevant dimensions. Therefore, the authors hypothesized that expression would also be opponent coded. An important line of support for opponent coding is that aftereffects increase with adaptor extremity (distance from an average test face) over the full natural range of possible faces. Previous studies have reported that expression aftereffects increase with adaptor extremity. Critically, however, they did not establish the extent of the natural range and so have not ruled out a decrease within that range that could indicate narrowband, multichannel coding. Here the authors show that expression aftereffects, like identity aftereffects, increase linearly over the full natural range of possible faces and remain high even for impossibly distorted adaptors. These results suggest that facial expression, like face identity, is opponent coded. (PsycINFO Database Record

Attitudes about race predict individual differences in face adaptation aftereffects

This study examined whether category boundaries between Black and White faces relate to individual attitudes about race. Fifty-seven (20 Black, 37 White) participants completed measures of explicit racism, implicit racism, collective self-esteem (CSE), and racial centrality. Category boundaries between Black and White faces were measured in three separate conditions: following adaptation to (1) a neutral gray background, a sequence of (2) Black or (3) White faces. Two additional conditions measured category boundaries for facial distortion to investigate whether attitudes relate to mechanisms of racial identity alone, or to more global mechanisms of face perception. Using a two-alternative forced-choice staircase procedure, participants indicated whether a test image appeared to be Black or White (or contracted or expanded). Following neutral adaptation, participants with higher CSE showed category boundaries shifted toward faces with a higher percentage of Black features. In addition, the strength of short-term sensitivity shifts following adaptation to Black and White faces was related to explicit and implicit attitudes about race. Sensitivity shifts were weaker when participants scored higher on explicit racism, but were stronger when participants scored higher on implicit but lower on explicit racism. The results of this study indicate that attitudes about race account for some individual differences in natural category boundaries between races as well as the strength of identity aftereffects following face adaptation.

Individual differences in adaptive norm-based coding and holistic coding are associated yet each contributes uniquely to unfamiliar face recognition ability.

We can discriminate and recognize many faces, despite their visual similarity. Individual differences in this ability have been linked to 2 face coding mechanisms: adaptive norm-based coding of identity and holistic coding. However, it is not yet known whether these mechanisms are distinct. Nor is it known whether they make unique contributions to face recognition ability because no studies have measured the operation of both these mechanisms in the same individuals. We measured individual differences in both the strength of adaptive norm-based coding (with a face identity aftereffect task) and holistic coding (with a composite face task). For the first time, we show that these 2 mechanisms are positively and moderately associated and that each makes significant unique contributions to unfamiliar face recognition ability (Cambridge Face Memory Test [CMFT]). Importantly, these relationships were face-specific. We also show that the combined contribution of these mechanisms to face recognition performance is significantly larger than the contribution of nonface recognition memory, consistent with the view that face recognition relies on the operation of face-sensitive mechanisms. Overall, our results raise intriguing questions regarding what these mechanisms may have in common, and what other mechanisms support face recognition performance. (PsycINFO Database Record

Coding facial identity: Evidence for a channel tuned to the average (norm) face

Face identity can be represented in a multi-dimensional space with the average at the center. Considerable evidence suggests that this average acts as a perceptual norm, yet it is not clear how this norm is neurally coded. It has been proposed that each dimension of face space is coded by only two, oppositely-tuned, channels, each responding most strongly to one end of the dimension. On this view the average is coded implicitly by equal activation of both pools. An alternative account posits a third channel, tuned explicitly to the average (i.e., center of a dimension). We used two face identity aftereffect paradigms to distinguish between these two possibilities and to rule out a third possibility, narrow-band multichannel coding, in which there is no norm. In Experiment 1 we show that as adaptors become more extreme along a dimension aftereffects initially increase sharply and then plateau. Crucially there is no decrease, even for very extreme adaptors, ruling out a narrow-band multichannel account but consistent with both two-channel and three-channel accounts. In Experiment 2 we distinguish between these latter two models. To do so we measured how the range of faces identified as the average was affected by two adapting conditions - adapting to alternating images from opposite ends of an identity trajectory (e.g., Dan, AntiDan) and adapting to the average (i.e. the center of the trajectory). A two-channel model predicts similar effects for both adapting conditions, whereas a three-channel model predicts opposite effects for the two conditions. We found opposite effects: Alternating adaptation widened the range of faces identified as the average whereas adaptation to the average narrowed the range. These data provide evidence for explicit coding of the norm. Meeting abstract presented at VSS 2016

The Influence of Averageness on Adults' Perceptions of Attractiveness: The Effect of Early Visual Deprivation.

Adults who missed early visual input because of congenital cataracts later have deficits in many aspects of face processing. Here we investigated whether they make normal judgments of facial attractiveness. In particular, we studied whether their perceptions are affected normally by a face's proximity to the population mean, as is true of typically developing adults, who find average faces to be more attractive than most other faces. We compared the judgments of facial attractiveness of 12 cataract-reversal patients to norms established from 36 adults with normal vision. Participants viewed pairs of adult male and adult female faces that had been transformed 50% toward and 50% away from their respective group averages, and selected which face was more attractive. Averageness influenced patients' judgments of attractiveness, but to a lesser extent than controls. The results suggest that cataract-reversal patients are able to develop a system for representing faces with a privileged position for an average face, consistent with evidence from identity aftereffects. However, early visual experience is necessary to set up the neural architecture necessary for averageness to influence perceptions of attractiveness with its normal potency.

Are face representations depth cue invariant?

The visual system can process three-dimensional depth cues defining surfaces of objects, but it is unclear whether such information contributes to complex object recognition, including face recognition. The processing of different depth cues involves both dorsal and ventral visual pathways. We investigated whether facial surfaces defined by individual depth cues resulted in meaningful face representations-representations that maintain the relationship between the population of faces as defined in a multidimensional face space. We measured face identity aftereffects for facial surfaces defined by individual depth cues (Experiments 1 and 2) and tested whether the aftereffect transfers across depth cues (Experiments 3 and 4). Facial surfaces and their morphs to the average face were defined purely by one of shading, texture, motion, or binocular disparity. We obtained identification thresholds for matched (matched identity between adapting and test stimuli), non-matched (non-matched identity between adapting and test stimuli), and no-adaptation (showing only the test stimuli) conditions for each cue and across different depth cues. We found robust face identity aftereffect in both experiments. Our results suggest that depth cues do contribute to forming meaningful face representations that are depth cue invariant. Depth cue invariance would require integration of information across different areas and different pathways for object recognition, and this in turn has important implications for cortical models of visual object recognition.

Perception and imagery of faces generate similar gender aftereffects

ABSTRACTVisual adaptation is known to bias perception away from the properties of the adapting stimuli, toward opposite properties, resulting in perceptual aftereffects. For example, prolonged exposure to a face has been shown to produce an identity aftereffect, biasing perception of a subsequent face toward the opposite identity. Such repulsive aftereffects have been observed for both visually perceived and visually imagined faces, suggesting that both perception and imagery yield typical aftereffects. However, recent studies have reported opposite patterns of aftereffects for perception and imagery of face gender. In these studies, visually perceived faces produced typical effects in which perception of androgynous faces was biased away from the gender of the adaptor, whereas imagery of the same stimuli produced atypical aftereffects, biasing the perceived gender of androgynous faces toward the gender of the adaptor. These findings are highly unusual and warrant further research. The present study aimed to gather new evidence on the direction of gender aftereffects following perception and imagery of faces. Experiment 1 had participants view and imagine female and male faces of famous and non-famous individuals. To determine the effect of concomitant visual stimulation on imagery and adaptation, participants visualized faces both in the presence and in the absence of a visual input. In Experiment 2, participants were adapted to perceived and imagined faces of famous and non-famous actors matched on gender typicality. This manipulation allowed us to determine the effect of face familiarity on the magnitude of gender aftereffects. Contrary to evidence from previous studies, our results demonstrated that both perception and imagery produced typical aftereffects, biasing the perceived gender of androgynous faces in the opposite direction to the gender of the adaptor. Famous faces yielded largest adaptation effects across tasks. Experiment 2 confirmed that these effects depended on familiarity rather than on sexual dimorphism. In both experiments, this effect was greater for perception than imagery. Additionally, imagery of famous faces produced strongest aftereffects when it was performed in the absence of visual stimulation. The implications of these findings are discussed.

Reduced adaptability, but no fundamental disruption, of norm‐based face coding following early visual deprivation from congenital cataracts

Faces are adaptively coded relative to visual norms that are updated by experience, and this adaptive coding is linked to face recognition ability. Here we investigated whether adaptive coding of faces is disrupted in individuals (adolescents and adults) who experience face recognition difficulties following visual deprivation from congenital cataracts in infancy. We measured adaptive coding using face identity aftereffects, where smaller aftereffects indicate less adaptive updating of face-coding mechanisms by experience. We also examined whether the aftereffects increase with adaptor identity strength, consistent with norm-based coding of identity, as in typical populations, or whether they show a different pattern indicating some more fundamental disruption of face-coding mechanisms. Cataract-reversal patients showed significantly smaller face identity aftereffects than did controls (Experiments 1 and 2). However, their aftereffects increased significantly with adaptor strength, consistent with norm-based coding (Experiment 2). Thus we found reduced adaptability but no fundamental disruption of norm-based face-coding mechanisms in cataract-reversal patients. Our results suggest that early visual experience is important for the normal development of adaptive face-coding mechanisms.

Adaptor gaze direction affects the magnitude of face identity aftereffects

Adaptor gaze direction affects the magnitude of face identity aftereffects

Faces are repulsive: Gender and identity aftereffects involve local repulsion, not re-normalisation

Faces are repulsive: Gender and identity aftereffects involve local repulsion, not re-normalisation

How distinct is the coding of face identity and expression? Evidence for some common dimensions in face space

Traditional models of face perception emphasize distinct routes for processing face identity and expression. These models have been highly influential in guiding neural and behavioural research on the mechanisms of face perception. However, it is becoming clear that specialised brain areas for coding identity and expression may respond to both attributes and that identity and expression perception can interact. Here we use perceptual aftereffects to demonstrate the existence of dimensions in perceptual face space that code both identity and expression, further challenging the traditional view. Specifically, we find a significant positive association between face identity aftereffects and expression aftereffects, which dissociates from other face (gaze) and non-face (tilt) aftereffects. Importantly, individual variation in the adaptive calibration of these common dimensions significantly predicts ability to recognize both identity and expression. These results highlight the role of common dimensions in our ability to recognize identity and expression, and show why the high-level visual processing of these attributes is not entirely distinct.

Gaze direction affects the magnitude of face identity aftereffects.

The face perception system partly owes its efficiency to adaptive mechanisms that constantly recalibrate face coding to our current diet of faces. Moreover, faces that are better attended produce more adaptation. Here, we investigated whether the social cues conveyed by a face can influence the amount of adaptation that face induces. We compared the magnitude of face identity aftereffects induced by adaptors with direct and averted gazes. We reasoned that faces conveying direct gaze may be more engaging and better attended and thus produce larger aftereffects than those with averted gaze. Using an adaptation duration of 5 s, we found that aftereffects for adaptors with direct and averted gazes did not differ (Experiment 1). However, when processing demands were increased by reducing adaptation duration to 1 s, we found that gaze direction did affect the magnitude of the aftereffect, but in an unexpected direction: Aftereffects were larger for adaptors with averted rather than direct gaze (Experiment 2). Eye tracking revealed that differences in looking time to the faces between the two gaze directions could not account for these findings. Subsequent ratings of the stimuli (Experiment 3) showed that adaptors with averted gaze were actually perceived as more expressive and interesting than adaptors with direct gaze. Therefore it appears that the averted-gaze faces were more engaging and better attended, leading to larger aftereffects. Overall, our results suggest that naturally occurring facial signals can modulate the adaptive impact a face exerts on our perceptual system. Specifically, the faces that we perceive as most interesting also appear to calibrate the organization of our perceptual system most strongly.

Norm-based coding of facial identity in adults with autism spectrum disorder

It is unclear whether reported deficits in face processing in individuals with autism spectrum disorders (ASD) can be explained by deficits in perceptual face coding mechanisms. In the current study, we examined whether adults with ASD showed evidence of norm-based opponent coding of facial identity, a perceptual process underlying the recognition of facial identity in typical adults. We began with an original face and an averaged face and then created an anti-face that differed from the averaged face in the opposite direction from the original face by a small amount (near adaptor) or a large amount (far adaptor). To test for norm-based coding, we adapted participants on different trials to the near versus far adaptor, then asked them to judge the identity of the averaged face. We varied the size of the test and adapting faces in order to reduce any contribution of low-level adaptation. Consistent with the predictions of norm-based coding, high functioning adults with ASD (n=27) and matched typical participants (n=28) showed identity aftereffects that were larger for the far than near adaptor. Unlike results with children with ASD, the strength of the aftereffects were similar in the two groups. This is the first study to demonstrate norm-based coding of facial identity in adults with ASD.

Lecturers' faces fatigue their students: Face identity aftereffects for dynamic and static faces

Face adaptation has been used as a tool to probe our representations for facial identity. It has also been claimed to play a functional role in face processing, perhaps calibrating the visual system towards encountered faces. However, for this to be so, face aftereffects must be observable following adaptation to ecologically valid moving stimuli, not just after prolonged viewing of static images. We adapted our participants to videos, static image sequences or single images of the faces of lecturers who were personally familiar to them. All three stimulus types produced significant, and equivalent, face identity aftereffects, demonstrating that aftereffects are not confined to static images but can occur after exposure to more naturalistic stimuli. It is also further evidence against explanations of face adaptation effects solely in terms of low-level visual processing.

Erasing the face after-effect

Perceptual after-effects decay over time at a rate that depends on several factors, such as the duration of adaptation and the duration of the test stimuli. Whether this decay is accelerated by exposure to other faces after adaptation is not known. Our goal was to determine if the appearance of other faces during a delay period after adaptation affected the face identity after-effect. In the first experiment we investigated whether, in the perception of ambiguous stimuli created by morphing between two faces, the repulsive after-effects from adaptation to one face were reduced by brief presentation of the second face in a delay period. We found no effect; however, this may have been confounded by a small attractive after-effect from the interference face. In the second experiment, the interference stimuli were faces unrelated to those used as adaptation stimuli, and we examined after-effects at three different delay periods. This showed a decline in after-effects as the time since adaptation increased, and an enhancement of this decline by the presentation of intervening faces. An exponential model estimated that the intervening faces caused an 85% reduction in the time constant of the after-effect decay. In conclusion, we confirm that face after-effects decline rapidly after adaptation and that exposure to other faces hastens the re-setting of the system.