Unfamiliar Face Processing Research Articles

FamFac - A Database of Famous Faces for Psychology Experiments.

High variation in the low-level proprieties of visual stimuli and varying degrees of familiarity with famous faces may have caused a bias in the results of investigations that tried to disentangle the processes involved in familiar and unfamiliar face processing (e.g., temporal differences in the detection of the first event-related potentials specialized in face processing may have been caused by different methods of controlling variance in the low-level proprieties of visual stimuli). To address these problems, we developed a freely available database of 183 famous faces whose low-level proprieties (brightness, size, resolution) have been homogenized and the level of familiarity established. The brightness of the stimuli was standardized by a custom-developed algorithm. The size and the resolution of the pictures were homogenized in Gimp. The familiarity level of the famous faces was established by a group of 48 Portuguese college students. Our results suggest that the brightness of each image did not differ significantly from the mean brightness value of the stimuli set, confirming the standardizing ability of the algorithm. Forty-one famous faces were classified as highly familiar. This study provides two important resources, as both the algorithm and the database are freely available for research purposes. The homogenization of the low-level features and the control of the level of familiarity of the famous faces included in our database should ensure that they do not elicit confounding effects such as the ones verified in past studies.

Orientation effects support specialist processing of upright unfamiliar faces in children and adults.

It is considerably harder to generalize identity across different pictures of unfamiliar faces, compared with familiar faces. This finding hints strongly at qualitatively distinct processing of unfamiliar face stimuli-for which we have less expertise. Yet, the extent to which face selective versus generic visual processes drive outcomes during this task has yet to be determined. To explore the relative contributions of each, we contrasted performance on a version of the popular Telling Faces Together unfamiliar face matching task, implemented in both upright and inverted orientations. Furthermore, we included different age groups (132 British children ages 6 to 11 years [69.7% White], plus 37 British White adults) to investigate how participants' experience with faces as a category influences their selective utilization of specialized processes for unfamiliar faces. Results revealed that unfamiliar face matching is highly orientation-selective. Accuracy was higher for upright compared with inverted faces from 6 years of age, which is consistent with selective utilization of specialized processes for upright versus inverted unfamiliar faces during this task. The effect of stimulus orientation did not interact significantly with age, and there was no graded increase in the magnitude of inversion effects observed across childhood. Still, a numerically larger inversion effect in adults compared to children provides a degree of support for developmental changes in these specialized face abilities with increasing age/experience. Differences in the pattern of errors across age groups are also consistent with a qualitative shift in unfamiliar face processing that occurs some time after 11 years of age. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The neural dynamics of familiarity-dependent face identity representation.

Recognizing a face as belonging to a given identity is essential in our everyday life. Clearly, the correct identification of a face is only possible for familiar people, but 'familiarity' covers a wide range-from people we see every day to those we barely know. Although several studies have shown that the processing of familiar and unfamiliar faces is substantially different, little is known about how the degree of familiarity affects the neural dynamics of face identity processing. Here, we report the results of a multivariate EEG analysis, examining the representational dynamics of face identity across several familiarity levels. Participants viewed highly variable face images of 20 identities, including the participants' own face, personally familiar (PF), celebrity and unfamiliar faces. Linear discriminant classifiers were trained and tested on EEG patterns to discriminate pairs of identities of the same familiarity level. Time-resolved classification revealed that the neural representations of identity discrimination emerge around 100 ms post-stimulus onset, relatively independently of familiarity level. In contrast, identity decoding between 200 and 400 ms is determined to a large extent by familiarity: it can be recovered with higher accuracy and for a longer duration in the case of more familiar faces. In addition, we found no increased discriminability for faces of PF persons compared to those of highly familiar celebrities. One's own face benefits from processing advantages only in a relatively late time-window. Our findings provide new insights into how the brain represents face identity with various degrees of familiarity and show that the degree of familiarity modulates the available identity-specific information at a relatively early time window.

Unfamiliar faces might as well be another species: Evidence from a face matching task with human and monkey faces

ABSTRACT Humans are good at recognizing familiar faces, but are more error-prone at recognizing an unfamiliar person across different images. It has been suggested that familiar and unfamiliar faces are processed qualitatively differently. But are unfamiliar faces at least processed differently from monkey faces? Here we tested 366 volunteers on a face matching test – two images presented side-by-side with participants judging whether the images show the same identity or two different identities – comparing performance with familiar and unfamiliar human faces, and monkey faces. The results showed that performance was most accurate for familiar faces, and was above chance for monkey faces. Although accuracy was higher for unfamiliar humans than monkeys on different identity trials, there was no unfamiliar human advantage over monkeys on same identity trials. The results give new insights into unfamiliar face processing, showing that in some ways unfamiliar faces might as well be another species.

Inhibition of the occipital face area modulates the electrophysiological signals of face familiarity: A combined cTBS-EEG study

The occipital face area (OFA) is hierarchically one of the first stages of the face processing network. It has originally been thought to be involved in early, structural processing steps, but currently more and more studies challenge this view and propose that it also takes part in higher level face processing, such as identification and recognition. Here we tested whether the OFA is involved in the initial steps of recognition memory and plays a causal role in the differential processing of familiar and unfamiliar faces. We used an offline, inhibitory continuous theta-burst stimulation (cTBS) protocol over the right OFA and the vertex as control site. Electroencephalographic (EEG) recording of event-related potentials (ERPs), elicited by visually presented familiar (famous) and unfamiliar faces was performed before and after stimulation. We observed a difference in ERPs for famous and unfamiliar faces in a time-window corresponding to the N250 component. Importantly, this difference was significantly increased by cTBS of the right OFA, suggesting its causal role in the differential processing of familiar and unfamiliar faces. The enhancement occurred focally, at electrodes close to the right hemispheric cTBS site, as well as over similar occipito-temporal sites of the contralateral hemisphere. To the best of our knowledge, this is the first study showing the causal role of the rOFA in the differential processing of familiar and unfamiliar faces, using combined cTBS and EEG recording methods. These results are discussed with respect to the nature of familiar face representations, supported by an extensive, bilateral network.

The constancy of the holistic processing of unfamiliar faces: Evidence from the study-test consistency effect and the within-person motion and viewpoint invariance

It has been well documented that static face processing is holistic. Faces contain variant (e.g., motion, viewpoint) and invariant (race, sex) features. However, little research has focused on whether holistic face representations are tolerant of within-person variations. The present study thus investigated whether holistic face representations of faces are tolerant of within-person motion and viewpoint variations by manipulating study-test consistency using a complete composite paradigm. Participants were shown two faces sequentially and were asked to judge whether the faces' top halves were identical or different. The first face was a static face or a dynamic face rotated in depth at 30°, 60°, and 90°. The second face was either a different front-view static face (Experiment 1a, study-test inconsistent) or identical to the first face (Experiment 1b, study-test consistent). In Experiment 2, study-test consistency was manipulated within subjects, and inverted faces were included. Our results show that study-test consistency significantly enhanced the holistic processing of upright and inverted faces; this study-test consistency effect and holistic processing were not modulated by motion and viewpoint changes via depth rotation. Interestingly, we found holistic processing for moving study-test consistent inverted faces, but not for static inverted faces. What these results tell us about the nature of holistic face representation is discussed in depth with respect to earlier and current theories on face processing.

Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain.

In our everyday life, we continuously get to know people, dominantly through their faces. Several neuroscientific experiments showed that familiarization changes the behavioral processing and underlying neural representation of faces of others. Here, we propose a model of the process of how we actually get to know someone. First, the purely visual familiarization of unfamiliar faces occurs. Second, the accumulation of associated, nonsensory information refines person representation, and finally, one reaches a stage where the effortless identification of very well-known persons occurs. We offer here an overview of neuroimaging studies, first evaluating how and in what ways the processing of unfamiliar and familiar faces differs and, second, by analyzing the fMRI adaptation and multivariate pattern analysis results we estimate where identity-specific representation is found in the brain. The available neuroimaging data suggest that different aspects of the information emerge gradually as one gets more and more familiar with a person within the same network. We propose a novel model of familiarity and identity processing, where the differential activation of long-term memory and emotion processing areas is essential for correct identification.

Different and common brain signals of altered neurocognitive mechanisms for unfamiliar face processing in acquired and developmental prosopagnosia

Neuropsychological studies have shown that prosopagnosic individuals perceive face structure in an atypical way. This might preclude the formation of appropriate face representations and, consequently, hamper effective recognition. The present ERP study, in combination with Bayesian source reconstruction, investigates how information related to both external (E) and internal (I) features was processed by E.C. and I.P., suffering from acquired and developmental prosopagnosia, respectively. They carried out a face-feature matching task with new faces. E.C. showed poor performance and remarkable lack of early face-sensitive P1, N170 and P2 responses on right (damaged) posterior cortex. Although she presented the expected mismatch effect to target faces in the E-I sequence, it was of shorter duration than in Controls, and involved left parietal, right frontocentral and dorsofrontal regions, suggestive of reduced neural circuitry to process face configurations. In turn, I.P. performed efficiently but with a remarkable bias to give “match” responses. His face-sensitive potentials P1–N170 were comparable to those from Controls, however, he showed no subsequent P2 response and a mismatch effect only in the I-E sequence, reflecting activation confined to those regions that sustain typically the initial stages of face processing. Relevantly, neither of the prosopagnosics exhibited conspicuous P3 responses to features acting as primes, indicating that diagnostic information for constructing face representations could not be sufficiently attended nor deeply encoded. Our findings suggest a different locus for altered neurocognitive mechanisms in the face network in participants with different types of prosopagnosia, but common indicators of a deficient allocation of attentional resources for further recognition.

Normative data for two challenging tests of face matching under ecological conditions

BackgroundUnfamiliar face processing is an ability that varies considerably between individuals. Numerous studies have aimed to identify its underlying determinants using controlled experimental procedures. While such tests can isolate variables that influence face processing, they usually involve somewhat unrealistic situations and optimized face images as stimulus material. As a consequence, the extent to which the performance observed under laboratory settings is informative for predicting real-life proficiency remains unclear.ResultsWe present normative data for two ecologically valid but underused tests of face matching: the Yearbook Test (YBT) and the Facial Identity Card Sorting Test (FICST). The YBT (n = 252) measures identity matching across substantial age-related changes in facial appearance, while the FICST (n = 218) assesses the ability to process unfamiliar facial identity despite superficial image variations. To determine the predictive value of both tests, a subsample of our cohort (n = 181) also completed a commonly used test of face recognition and two tests of face perception (the long form of the Cambridge Face Memory Test (CFMT+), the Expertise in Facial Comparison Test (EFCT) and the Person Identification Challenge Test (PICT)).ConclusionsFocusing on the top performers identified independently per test, we made two important observations: 1) YBT and FICST performance can predict CFMT+ scores and vice versa; and 2) EFCT and PICT scores neither reliably predict superior performance in ecologically meaningful and challenging tests of face matching, nor in the most commonly used test of face recognition. These findings emphasize the necessity for using challenging and ecologically relevant, and thus highly sensitive, tasks of unfamiliar face processing to identify high-performing individuals in the normal population.

Social Evaluation of Faces Across Gender and Familiarity.

Models of social evaluation aim to capture the information people use to form first impressions of unfamiliar others. However, little is currently known about the relationship between perceived traits across gender. In Study 1, we asked viewers to provide ratings of key social dimensions (dominance, trustworthiness, etc.) for multiple images of 40 unfamiliar identities. We observed clear sex differences in the perception of dominance-with negative evaluations of high dominance in unfamiliar females but not males. In Study 2, we used the social evaluation context to investigate the key predictions about the importance of pictorial information in familiar and unfamiliar face processing. We compared the consistency of ratings attributed to different images of the same identities and demonstrated that ratings of images depicting the same familiar identity are more tightly clustered than those of unfamiliar identities. Such results imply a shift from image rating to person rating with increased familiarity, a finding which generalises results previously observed in studies of identification.

Distinct neural processes for the perception of familiar versus unfamiliar faces along the visual hierarchy revealed by EEG

Humans recognize faces with ease, despite the complexity of the task and of the visual system which underlies it. Different spatial regions, including both the core and extended face processing networks, and distinct temporal stages of processing have been implicated in face recognition, but there is ongoing controversy regarding the extent to which the mechanisms for recognizing a familiar face differ from those for an unfamiliar face. Here, we used electroencephalogram (EEG) and flicker SSVEP, a high signal-to-noise approach, and searchlight decoding methods to elucidate the mechanisms mediating the processing of familiar and unfamiliar faces in the time domain. Familiar and unfamiliar faces were presented periodically at 15 Hz, 6 Hz and 3.75 Hz either upright or inverted in separate blocks, with the rationale that faster frequencies require shorter processing times per image and tap into fundamentally different levels of visual processing. The 15 Hz trials, likely to reflect early visual processing, exhibited enhanced neural responses for familiar over unfamiliar face trials, but only when the faces were upright. In contrast, decoding methods revealed similar classification accuracies for upright and inverted faces for both familiar and unfamiliar faces. For the 6 Hz frequency, familiar faces had lower amplitude responses than unfamiliar faces, and decoding familiarity was more accurate for upright compared with inverted faces. Finally, the 3.75 Hz frequency revealed no main effects of familiarity, but decoding showed significant correlations with behavioral ratings of face familiarity, suggesting that activity evoked by this slow presentation frequency reflected higher-level, cognitive aspects of familiarity processing. This three-way dissociation between frequencies reveals that fundamentally different stages of the visual hierarchy are modulated by face familiarity. The combination of experimental and analytical approaches used here represent a novel method for elucidating spatio-temporal characteristics within the visual system.

Skin conductance response patterns of face processing in children with autism spectrum disorder

PurposeThe purpose of this paper is to investigate the face processing responses of children with autism spectrum disorder (ASD) using skin conductance response (SCR) patterns and to compare it with typically developed (TD) children.Design/methodology/approachTwo experiments have been designed to analyze the effect of face processing. In the first experiment, learned non-face (objects) vs unknown face stimuli have been shown and in the second experiment, familiar vs unfamiliar face stimuli have been shown to ten ASD and ten TD children and SCR patterns have been recorded, analyzed and compared for both the groups.FindingsIt has been observed that children with ASD were able to differentiate faces out of learned non-face stimuli and their SCR patterns were similar as TD children in the first experiment. In the second experiment, children with ASD were unable to recognize familiar faces from unfamiliar faces but TD children could easily discriminate between familiar and unfamiliar faces as their SCR patterns were different from children with ASD.Research limitations/implicationsThe present study advocates that impairment in face identification exists in children with ASD. Hence, it can be concluded that in children with ASD face processing is present but they do not recognize familiar faces or it can be said that face familiarization effect is absent in children with ASD.Originality/valueThere are very few findings that used SCR signal as main analysis parameter for face processing in children with ASD, in most of the studies; Electroencephalography signal has been used as analysis parameter. Moreover, familiar and unfamiliar face processing with multiple stimuli used in present work adds novelty to the literature.

Electrophysiological evidence for women superiority on unfamiliar face processing

Previous research has reported that women superiority on face recognition tasks, taking sex difference in accuracy rates as major evidence. By appropriately modifying experimental tasks and examining reaction time as behavioral measure, it was possible to explore which stage of face processing contributes to womens’ superiority. We used a modified delayed matching-to-sample task to investigate the time course characteristics of face recognition by ERP, for both men and women. In each trial, participants matched successively presented faces to samples (target faces) by key pressing. It was revealed that women were more accurate and faster than men on the task. ERP results showed that compared to men, women had shorter peak latencies of early components P100 and N170, as well as larger mean amplitude of the late positive component P300. Correlations between P300 mean amplitudes and RTs were found for both sexes. Besides, reaction times of women but not men were positively correlated with N170 latencies. In general, we provided further evidence for women superiority on face recognition in both behavioral and neural aspects.

Is the Thatcher Illusion Modulated by Face Familiarity? Evidence from an Eye Tracking Study.

Thompson (1980) first detected and described the Thatcher Illusion, where participants instantly perceive an upright face with inverted eyes and mouth as grotesque, but fail to do so when the same face is inverted. One prominent but controversial explanation is that the processing of configural information is disrupted in inverted faces. Studies investigating the Thatcher Illusion either used famous faces or non-famous faces. Highly familiar faces were often thought to be processed in a pronounced configural mode, so they seem ideal candidates to be tested in one Thatcher study against unfamiliar faces–but this has never been addressed so far. In our study, participants evaluated 16 famous and 16 non-famous faces for their grotesqueness. We tested whether familiarity (famous/non-famous faces) modulates reaction times, correctness of grotesqueness assessments (accuracy), and eye movement patterns for the factors orientation (upright/inverted) and Thatcherisation (Thatcherised/non-Thatcherised). On a behavioural level, familiarity effects were only observable via face inversion (higher accuracy and sensitivity for famous compared to non-famous faces) but not via Thatcherisation. Regarding eye movements, however, Thatcherisation influenced the scanning of famous and non-famous faces, for instance, in scanning the mouth region of the presented faces (higher number, duration and dwell time of fixations for famous compared to non-famous faces if Thatcherised). Altogether, famous faces seem to be processed in a more elaborate, more expertise-based way than non-famous faces, whereas non-famous, inverted faces seem to cause difficulties in accurate and sensitive processing. Results are further discussed in the face of existing studies of familiar vs. unfamiliar face processing.

All new kids on the block? Impaired holistic processing of personally familiar faces in a kindergarten teacher with acquired prosopagnosia

ABSTRACTAcquired prosopagnosia is primarily defined as a defect in recognizing familiar faces. Nonetheless, for practical and methodological reasons, studies of such rare patients typically use pictures of unfamiliar faces. Here, we report an extensive investigation (17 behavioural tasks grouped in nine experiments) with a homogenous set of personally familiar faces in patient PS (Rossion et al., 2003. A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing.), a well-documented case of acquired prosopagnosia with intact object recognition. PS’s recognition of the face pictures of 3–4-year-old children of her kindergarten is severely impaired—both in terms of accuracy and speed of recognition—and differs qualitatively from her colleagues’ performance. Relative to these typical individuals, PS relies more on external features, colour and local details of faces. She is also specifically impaired at processing the eye region in two-alternative face matching tasks, as well as in a familiar face recognition task performed both with pre-defined isolated parts and with randomly placed apertures revealing selective parts (“Bubbles”, >20.000 trials) of the personally familiar faces. These observations indicate that the same impairment observed previously with unfamiliar faces for PS and other cases of acquired prosopagnosia is associated with a deficient long-term representation of the eye region. Various manipulations that differentially affect the processing of the eye region suggest that this impairment is a consequence of the inability to represent the multiple parts of the eye region, and of the whole familiar face, as a single unit. This impairment in holistic processing is further evidenced here across different paradigms with composite faces, wholes and parts, and configurally distorted faces, mirroring and strengthening previous observations made with unfamiliar faces in PS and other cases of acquired prosopagnosia. Altogether, these observations suggest that prosopagnosia following brain damage affects unfamiliar and familiar face processing in a qualitatively similar way.

A familiarity disadvantage for remembering specific images of faces.

Familiar faces are remembered better than unfamiliar faces. Furthermore, it is much easier to match images of familiar than unfamiliar faces. These findings could be accounted for by quantitative differences in the ease with which faces are encoded. However, it has been argued that there are also some qualitative differences in familiar and unfamiliar face processing. Unfamiliar faces are held to rely on superficial, pictorial representations, whereas familiar faces invoke more abstract representations. Here we present 2 studies that show, for 1 task, an advantage for unfamiliar faces. In recognition memory, viewers are better able to reject a new picture, if it depicts an unfamiliar face. This rare advantage for unfamiliar faces supports the notion that familiarity brings about some representational changes, and further emphasizes the idea that theoretical accounts of face processing should incorporate familiarity. (PsycINFO Database Record

Effects of Caricaturing in Shape or Color on Familiarity Decisions for Familiar and Unfamiliar Faces.

Recent evidence suggests that while reflectance information (including color) may be more diagnostic for familiar face recognition, shape may be more diagnostic for unfamiliar face identity processing. Moreover, event-related potential (ERP) findings suggest an earlier onset for neural processing of facial shape compared to reflectance. In the current study, we aimed to explore specifically the roles of facial shape and color in a familiarity decision task using pre-experimentally familiar (famous) and unfamiliar faces that were caricatured either in shape-only, color-only, or both (full; shape + color) by 15%, 30%, or 45%. We recorded accuracies, mean reaction times, and face-sensitive ERPs. Performance data revealed that shape caricaturing facilitated identity processing for unfamiliar faces only. In the ERP data, such effects of shape caricaturing emerged earlier than those of color caricaturing. Unsurprisingly, ERP effects were accentuated for larger levels of caricaturing. Overall, our findings corroborate the importance of shape for identity processing of unfamiliar faces and demonstrate an earlier onset of neural processing for facial shape compared to color.

Real-life experience with personally familiar faces enhances discrimination based on global information.

Despite the agreement that experience with faces leads to more efficient processing, the underlying mechanisms remain largely unknown. Building on empirical evidence from unfamiliar face processing in healthy populations and neuropsychological patients, the present experiment tested the hypothesis that personal familiarity is associated with superior discrimination when identity information is derived based on global, as opposed to local facial information. Diagnosticity and availability of local and global information was manipulated through varied physical similarity and spatial resolution of morph faces created from personally familiar or unfamiliar faces. We found that discrimination of subtle changes between highly similar morph faces was unaffected by familiarity. Contrariwise, relatively more pronounced physical (i.e., identity) differences were more efficiently discriminated for personally familiar faces, indicating more efficient processing of global, as opposed to local facial information through real-life experience.

Face learning with multiple images leads to fast acquisition of familiarity for specific individuals.

Matching unfamiliar faces is a difficult task. Here we ask whether it is possible to improve performance by providing multiple images to support matching. In two experiments we observe that accuracy improves as viewers are provided with additional images on which to base their match. This technique leads to fast learning of an individual, but the effect is identity-specific: Despite large improvements in viewers' ability to match a particular person's face, these improvements do not generalize to other faces. Experiment 2 demonstrated that trial-by-trial feedback provided no additional benefits over the provision of multiple images. We discuss these results in terms of familiar and unfamiliar face processing and draw out some implications for training regimes.

Facial misidentifications arise from the erroneous activation of visual face memory

Misidentifications are a common phenomenon in unfamiliar face processing, but little is known about the underlying cognitive and neural mechanisms. We used the face identity-sensitive N250r component of the event-related brain potential as a measure of identity-sensitive face matching process in visual working memory. Two face images were presented in rapid succession, and participants had to judge whether they showed the same or two different individuals. Identity match and mismatch trials were presented in random sequence. On similar mismatch trials, perceptually similar faces of two different individuals were shown, while two physically distinct faces were presented on dissimilar mismatch trials. Misidentification errors occurred on 40% of all similar mismatch trials. N250r components were elicited not only in response to an identity match, but also on trials with misidentification errors. This misidentification N250r was smaller and emerged later than the N250r to correctly detected identity repetitions. Importantly, N250r components were entirely eliminated on similar mismatch trials where participants correctly reported two different facial identities. Results show that misidentification errors are not primarily a post-perceptual decision-related phenomenon, but are generated during early visual stages of identity-related face processing. Misidentification errors occur when stored representations of a particular individual face in visual working memory are incorrectly activated by a perceptual match with a different face.