Facial Identity Recognition Research Articles

Face Identity Recognition and the Social Difficulties Component of the Autism-Like Phenotype: Evidence for Phenotypic and Genetic Links

Autism spectrum disorder (ASD) and autism-like traits are associated with deficits in face memory ability, although it is not yet clear whether this deficit reflects a specific aspect of the ASD/autism-like phenotype. We addressed this issue using a neurotypical sample of adolescent twins (Ncomplete pairs = 782) drawn from the Twins Early Development Study who were assessed on face and object memory performance alongside two core aspects of autism-like traits: (i) difficulties with social behavior/interactions, and (ii) attention to detail. We observed a negative association between face memory ability and difficulties with social behavior/interactions. This association reflected an overlapping genetic etiology: heritable influences acting on face memory ability are associated with the social difficulties aspects of autism-like traits.

Facial processing abilities and social functioning in pediatric brain tumor survivors, children with autism spectrum disorder, and typically developing children.

157 Background: Pediatric brain tumor survivors (PBTS) often experience late effects in social functioning that mirror those seen in children with autism spectrum disorder (ASD). This study evaluated group differences in facial processing abilities and social functioning between school-aged PBTS, children with ASD, and typically developing children (TDC). Methods: PBTS(n=40;65% male; mean age=13.9 years; mean age at diagnosis=5.8 years)were at least 5 years from tumor diagnosis,2 years from end of tumor-directed therapy and absent a multi-system genetic disorder or developmental delay before tumor diagnosis. Participants completed measures of IQ, facial affect/identity recognition(Victoria/Yale Face Processing Battery), and social functioning(Children’s Communication Checklist-2, Vineland Adaptive Behavior Scales,2nd Ed. and Social Responsiveness Scale, 2nd Ed.).PBTS data were compared to a previously collected sample of age, gender, and IQ-matched children with ASD(n=41)and TDC (n=39).One-way ANOVA evaluated differences between groups with Tukey post-hoc tests.Results: IQ for PBTS(m=100.9; SD=16.27),ASD(m=100.17; SD=17.09),and TDC(m=104.72; SD=14.0)were all in the average range.One-way ANOVA revealed group differences for facial identity recognition[ F (2,114)=4.8 η²=.09 , p=.01],facial affect recognition[ F (2, 114)=3.8 , η²=.07, p=.024],and all social functioning measures[ p=.000].Tukey tests revealed PBTS facial affect recognition to be significantly worse than TDC(p < .05)and more comparable to youth with ASD for both facial affect and identity recognition.PBTS also showed worse social functioning than TDC and better than ASD youth across social measures( p’s < .01).Conclusions: Findings suggest PBTS demonstrate impairments in facial affect and identity recognition and social functioning compared to TDC.PBTS facial processing abilities appear similar to those of youth with ASD.PBTS may benefit from multi-disciplinary interventions similar to those used in ASD to improve social functioning. Screening facial processing abilities may identify those at higher risk for social functioning deficits.

Sad people are more accurate at expression identification with a smaller own-ethnicity bias than happy people.

Sad individuals are more accurate at face identity recognition, possibly because they scan more of the face during encoding. During expression identification tasks, sad individuals do not fixate on the eyes as much as happier individuals. Fixating on features other than the eyes leads to a reduced own-ethnicity bias. This background indicates that sad individuals would not view the eyes as much as happy individuals, and this would result in improved expression recognition and reduced own-ethnicity bias. This prediction was tested using an expression identification task with eye tracking. We demonstrate that sad-induced participants show enhanced expression recognition and a reduced own-ethnicity bias than happy-induced participants due to scanning more facial features. We conclude that mood affects eye movements and face encoding by causing a wider sampling strategy and deeper encoding of facial features diagnostic for expression identification.

Obligatory and facultative brain regions for voice-identity recognition.

Recognizing the identity of others by their voice is an important skill for social interactions. To date, it remains controversial which parts of the brain are critical structures for this skill. Based on neuroimaging findings, standard models of person-identity recognition suggest that the right temporal lobe is the hub for voice-identity recognition. Neuropsychological case studies, however, reported selective deficits of voice-identity recognition in patients predominantly with right inferior parietal lobe lesions. Here, our aim was to work towards resolving the discrepancy between neuroimaging studies and neuropsychological case studies to find out which brain structures are critical for voice-identity recognition in humans. We performed a voxel-based lesion-behaviour mapping study in a cohort of patients (n = 58) with unilateral focal brain lesions. The study included a comprehensive behavioural test battery on voice-identity recognition of newly learned (voice-name, voice-face association learning) and familiar voices (famous voice recognition) as well as visual (face-identity recognition) and acoustic control tests (vocal-pitch and vocal-timbre discrimination). The study also comprised clinically established tests (neuropsychological assessment, audiometry) and high-resolution structural brain images. The three key findings were: (i) a strong association between voice-identity recognition performance and right posterior/mid temporal and right inferior parietal lobe lesions; (ii) a selective association between right posterior/mid temporal lobe lesions and voice-identity recognition performance when face-identity recognition performance was factored out; and (iii) an association of right inferior parietal lobe lesions with tasks requiring the association between voices and faces but not voices and names. The results imply that the right posterior/mid temporal lobe is an obligatory structure for voice-identity recognition, while the inferior parietal lobe is only a facultative component of voice-identity recognition in situations where additional face-identity processing is required.

Effects of sodium nitroprusside in the prevention of schizophrenia-like symptoms induced by ketamine – A translational double-blind study

Abstract Background: Recent evidence has shown improvements in schizophrenia symptoms after the infusion of sodium nitroprusside (SNP), a nitric oxide (NO) donor. In the rat model of schizophrenia using ketamine injection, pretreatment with SNP seems to prevent behavioral changes associated with positive symptoms for up to one week. Objective: We investigated whether SNP would have preventative effects on psychogenic symptoms induced by ketamine in healthy subjects. Methods: Healthy subjects (N = 38) were assigned to distinct groups that received SNP in different doses (0.15, 0.25, and 0.5 mcg/kg/min). First, participants received an infusion of SNP or placebo over 75 minutes. After 10 minutes, they were injected for 1 minute with a bolus of 0.26 mg/kg of ketamine and a maintenance dose was started 5 minutes later, with 0.25 mg/kg/h of ketamine for 50 minutes. Results: Ketamine-induced psychopathological alterations induced were reduced by SNP, as assessed with the Brief Psychological Rating Scale. Scores in the objective subscale of the Clinician-Administered Dissociative States Scale were also lower in SNP sessions compared to placebo. SNP had protective effects against deterioration in facial emotion and identity recognition tasks induced by ketamine. Discussion: Our findings support the view that SNP has preventative properties against psychotic manifestations.

Facial Identity Memory Is Enhanced When Sender's Expression Is Congruent to Perceiver's Experienced Emotion.

The role of the social context in facial identity recognition and expression recall was investigated by manipulating the sender's emotional expression and the perceiver's experienced emotion during encoding. A mixed-design with one manipulated between-subjects factor (perceiver's experienced emotion) and two within-subjects factors (change in experienced emotion and sender's emotional expression) was used. Senders' positive and negative expressions were implicitly encoded while perceivers experienced their baseline emotion and then either a positive or a negative emotion. Facial identity recognition was then tested using senders' neutral expressions. Memory for senders previously seen expressing positive or negative emotion was facilitated if the perceiver initially encoded the expression while experiencing a positive or a negative emotion, respectively. Furthermore, perceivers were confident of their decisions. This research provides a more detailed understanding of the social context by exploring how the sender-perceiver interaction affects the memory for the sender.

The role of the upper and lower face in the recognition of facial identity in dynamic stimuli.

The role of the upper and lower face in the recognition of facial identity in dynamic stimuli.

THE IMPORTANCE OF IMAGE PROPERTIES IN THE NEURAL REPRESENTATION OF FAMILIAR FACES

A full understanding of face recognition must involve identifying the visual information that is used to discriminate different identities and how this is represented in the brain. Previous behavioural studies have shown that the recognition of familiar faces is primarily based on differences in surface properties of the image. Our aim was to explore the importance of surface properties and also shape properties in the neural representation of familiar faces. We took a set of face images and measured variance in the shape and surface properties using principal component analysis (PCA). Face-selective regions (FFA, OFA and STS) were defined in an independent localizer scan. We then showed participants a subset of the face images and measured the resulting patterns of neural response using fMRI. Patterns of response to pairs of images were compared to generate a similarity matrix across all faces in each ROI. Corresponding similarity matrices for shape and surface properties were then created by correlating the PCA vectors across pairs of images. The similarity matrices for shape and surface properties were then used to predict the patterns of neural response in each ROI. Patterns of response in the OFA could be predicted by both the shape and surface properties of the face images. However, patterns of response in the FFA and STS could only be predicted by the shape of the face image. The dissociation between the selectivity for shape in the FFA and previous behavioural findings revealing a preeminent role of surface properties in face recognition suggests that, although the FFA may play a role in the recognition of facial identity, this region is not solely responsible for this process. Meeting abstract presented at VSS 2017

Is face perception preserved in pure alexia? Evaluating complementary contribution of the left fusiform gyrus to face processing

Face recognition and reading are two expert forms of human visual processing. Recent evidence show that they involve overlapping cerebral networks in the right and left hemispheres, leading the many-to-many hypothesis to predict that a lesion to the left fusiform gyrus that causes pure alexia will also be associated with mild impairments in face processing. Our goal was to determine if alexic subjects showed face identity processing deficits similar but milder to those seen in prosopagnosia following right fusiform lesions, or if they had different, complementary face processing deficits, which would be predicted if there were hemispheric lateralization of different face perceptual functions. We tested three patients with pure alexia from left fusiform lesions and one prosopagnosic subject with a right fusiform lesion. First, they had standard neuropsychologic tests of face identity recognition. Second, we atested their ability to discriminate faces in images reduced to high-contrast linear contours, similar to letters. Third, we assessed their ability to detect and discriminate facial speech patterns, and to identify these and integrate them with speech sounds in the McGurk effect (Campbell et al, 1986). Alexic subjects had normal familiarity for face identity on the Cambridge Face Memory Test. However, they were impaired in matching faces for identity across viewpoint, which was worse with line-contour faces. The prosopagnosic patient was also impaired in matching faces across viewpoints, but did well with line-contour faces. Alexic patients could detect facial speech patterns but had trouble identifying them and integrating them with speech sounds, whereas identification and integration was intact in the prosopagnosic subject. We conclude that, in addition to visual word processing, the left fusiform gyrus is involved in processing linear contour information and speech patterns in faces, a contribution complementary to the face identity processing of the right fusiform gyrus. Meeting abstract presented at VSS 2017

Memory and Perception-based Facial Image Reconstruction

Visual memory for faces has been extensively researched, especially regarding the main factors that influence face memorability. However, what we remember exactly about a face, namely, the pictorial content of visual memory, remains largely unclear. The current work aims to elucidate this issue by reconstructing face images from both perceptual and memory-based behavioural data. Specifically, our work builds upon and further validates the hypothesis that visual memory and perception share a common representational basis underlying facial identity recognition. To this end, we derived facial features directly from perceptual data and then used such features for image reconstruction separately from perception and memory data. Successful levels of reconstruction were achieved in both cases for newly-learned faces as well as for familiar faces retrieved from long-term memory. Theoretically, this work provides insights into the content of memory-based representations while, practically, it may open the path to novel applications, such as computer-based ‘sketch artists’.

Face identity recognition in simulated prosthetic vision is poorer than previously reported and can be improved by caricaturing

The visual prosthesis (or “bionic eye”) has become a reality but provides a low resolution view of the world. Simulating prosthetic vision in normal-vision observers, previous studies report good face recognition ability using tasks that allow recognition to be achieved on the basis of information that survives low resolution well, including basic category (sex, age) and extra-face information (hairstyle, glasses). Here, we test within-category individuation for face-only information (e.g., distinguishing between multiple Caucasian young men with hair covered). Under these conditions, recognition was poor (although above chance) even for a simulated 40×40 array with all phosphene elements assumed functional, a resolution above the upper end of current-generation prosthetic implants. This indicates that a significant challenge is to develop methods to improve face identity recognition. Inspired by “bionic ear” improvements achieved by altering signal input to match high-level perceptual (speech) requirements, we test a high-level perceptual enhancement of face images, namely face caricaturing (exaggerating identity information away from an average face). Results show caricaturing improved identity recognition in memory and/or perception (degree by which two faces look dissimilar) down to a resolution of 32×32 with 30% phosphene dropout. Findings imply caricaturing may offer benefits for patients at resolutions realistic for some current-generation or in-development implants.

Impaired processing of facial happiness, with or without awareness, in developmental prosopagnosia.

Developmental prosopagnosia (DP) is associated with severe, lifelong deficits in face recognition, with such cases often cited as support for a dissociation between the processing of facial identity and emotion. Here we examine the evidence against this dissociation and propose that the processing of facial happiness, either with or without awareness, is actually integrated within the same neural network involved in facial identity recognition. We also test this hypothesis on a group of DP cases and neurotypical controls (NT) by adapting them to expressionless neutral faces, intact happy faces and hybrid faces. Despite these hybrid faces being explicitly identified as expressionless due to their higher spatial frequencies taken from a neutral face, their low spatial frequencies convey happy facial expressions that participants are unaware of. After adaptation, participants were asked to judge the facial expressions of face stimuli that were morphed incrementally in varying degrees of sad through to happy. Both groups exhibited emotion adaptation aftereffects to the intact happy faces, although this effect was smaller in DP. Whereas NT produced emotion adaptation aftereffects without awareness of the happy emotion in the hybrid faces; as a group, those with DP did not. Furthermore, our DP cases also exhibited deficits in judging the emotion of the happiest morphed test faces. Our results indicate that the processing of happy facial expressions, with or without awareness, is likely integrated within the face recognition network. We hypothesise that the previously identified abnormalities in the fusiform gyrus in those with DP is the most likely structure responsible for these deficits.

Integration of identity and emotion information in faces: fMRI evidence

Separate neural systems have been implicated in the recognition of facial identity and emotional expression. A growing number of studies now provide evidence against this modular view by demonstrating that integration of identity and emotion information enhances face processing. Yet, the neural mechanisms that shape this integration remain largely unknown. We hypothesize that the presence of both personal and emotional expression target information triggers changes in functional connectivity between frontal and extrastriate areas in the brain. We report and discuss three important findings. First, the presence of target identity and emotional expression in the same face was associated with super capacity and violations of the independent processing of identity and expression cues. Second, activity in the orbitofrontal cortex (OFC) was associated with the presence of redundant targets and changes in functional connectivity between a particular region of the right OFC (BA11/47) and bilateral visual brain regions (the inferior occipital gyrus (IOG)). Third, these changes in connectivity showed a strong link to behavioural measures of capacity processing. We suggest that the changes in functional connectivity between the right OFC and IOG reduce variability of BOLD responses in the IOG, enhancing integration of identity and emotional expression cues in faces.

The memorability of people: Intrinsic memorability across transformations of a person's face.

When encountering new people for a brief instant, some seem to last in our memories while others are quickly forgotten. Memorability-whether a stimulus is likely to be later remembered-is highly consistent across different group of observers; people tend to remember and forget the same face images. However, is memorability intrinsic to just the picture of a face, or to a person's identity, generalizable across views and emotions? Thousands of participants completed an online experiment testing face identity recognition over five different emotional and viewpoint transformations (neutral, happy, angry, 3/4 view, and profile view). Memorability was found to be highly consistent within each image, as well as across transformations-if a face was remembered in one image, it was also likely to be remembered in another. Most other face attributes, including what participants thought would be memorable, did not show consistency within an identity. Overall, these results support the existence of memorability as a uniquely intrinsic, core attribute to a person, stable across images. (PsycINFO Database Record

FIRST: Face Identity Recognition in SmarT Bank

The rapid development of information era has influenced to realize the notion of Smart Bank via approaches like paperless services and interactive self-service systems. Since the traditional methods of identity verification are insecure and cumbersome for supporting these services, Smart Bank has been questioned. To overcome the limitations of current identity verification, it is imperative to explore an effective recognition strategy considering the trade-off between security and customer experience, which can conveniently collect identity information and accurately distinguish people. However, few research and existing systems have been reported for an integrated solution of identity verification satisfying convenient and secure banking environment. In this paper, we propose, implement, and deploy an integrated system named FIRST (Face Identity Recognition in SmarT Bank), which is a customized platform for the identity verification via face recognition in Smart Bank. FIRST uses Gabor surface feature and Fisherfaces, which can provide accurate face recognition within acceptable training time. For information acquisition, our system employs the patch-based face quality assessment, which efficiently extracts valuable faces (i.e. front face) from video streams. Furthermore, FIRST provides a distributed environment to effectively manage recognition tasks and massive data. Since March 2015, FIRST has been successfully deployed on 1800 self-service terminals in Jiangsu Province by ABC (Agriculture Bank of China), and is under deployment by State Grid in China.

Face-selective regions show invariance to linear, but not to non-linear, changes in facial images

Familiar face recognition is remarkably invariant across huge image differences, yet little is understood concerning how image-invariant recognition is achieved. To investigate the neural correlates of invariance, we localized the core face-responsive regions and then compared the pattern of fMR-adaptation to different stimulus transformations in each region to behavioural data demonstrating the impact of the same transformations on familiar face recognition. In Experiment 1, we compared linear transformations of size and aspect ratio to a non-linear transformation affecting only part of the face. We found that adaptation to facial identity in face-selective regions showed invariance to linear changes, but there was no invariance to non-linear changes. In Experiment 2, we measured the sensitivity to non-linear changes that fell within the normal range of variation across face images. We found no adaptation to facial identity for any of the non-linear changes in the image, including to faces that varied in different levels of caricature. These results show a compelling difference in the sensitivity to linear compared to non-linear image changes in face-selective regions of the human brain that is only partially consistent with their effect on behavioural judgements of identity. We conclude that while regions such as the FFA may well be involved in the recognition of face identity, they are more likely to contribute to some form of normalisation that underpins subsequent recognition than to form the neural substrate of recognition per se.

Contributions of feature shapes and surface cues to the recognition and neural representation of facial identity

A full understanding of face recognition will involve identifying the visual information that is used to discriminate different identities and how this is represented in the brain. The aim of this study was to explore the importance of shape and surface properties in the recognition and neural representation of familiar faces. We used image morphing techniques to generate hybrid faces that mixed shape properties (more specifically, second order spatial configural information as defined by feature positions in the 2D-image) from one identity and surface properties from a different identity. Behavioural responses showed that recognition and matching of these hybrid faces was primarily based on their surface properties. These behavioural findings contrasted with neural responses recorded using a block design fMRI adaptation paradigm to test the sensitivity of Haxby et al.'s (2000) core face-selective regions in the human brain to the shape or surface properties of the face. The fusiform face area (FFA) and occipital face area (OFA) showed a lower response (adaptation) to repeated images of the same face (same shape, same surface) compared to different faces (different shapes, different surfaces). From the behavioural data indicating the critical contribution of surface properties to the recognition of identity, we predicted that brain regions responsible for familiar face recognition should continue to adapt to faces that vary in shape but not surface properties, but show a release from adaptation to faces that vary in surface properties but not shape. However, we found that the FFA and OFA showed an equivalent release from adaptation to changes in both shape and surface properties. The dissociation between the neural and perceptual responses suggests that, although they may play a role in the process, these core face regions are not solely responsible for the recognition of facial identity.

Visual perception and processing in children with 22q11.2 deletion syndrome: associations with social cognition measures of face identity and emotion recognition.

BackgroundPeople with 22q11.2 deletion syndrome (22q11DS) have difficulty processing social information including facial identity and emotion processing. However, difficulties with visual and attentional processes may play a role in difficulties observed with these social cognitive skills.MethodsA cross-sectional study investigated visual perception and processing as well as facial processing abilities in a group of 49 children and adolescents with 22q11DS and 30 age and socio-economic status-matched healthy sibling controls using the Birmingham Object Recognition Battery and face processing sub-tests from the MRC face processing skills battery.ResultsThe 22q11DS group demonstrated poorer performance on all measures of visual perception and processing, with greatest impairment on perceptual processes relating to form perception as well as object recognition and memory. In addition, form perception was found to make a significant and unique contribution to higher order social-perceptual processing (face identity) in the 22q11DS group.ConclusionsThe findings indicate evidence for impaired visual perception and processing capabilities in 22q11DS. In turn, these were found to influence cognitive skills needed for social processes such as facial identity recognition in the children with 22q11DS.

Optical-imaging-based neurofeedback to enhance therapeutic intervention in adolescents with autism: methodology and initial data

Impaired facial processing may contribute to social dysfunction in certain individuals with autism spectrum disorder (ASD). Prior studies show that electroencephalogram-based and functional magnetic resonance imaging-based neurofeedback might help some individuals with ASD learn to modulate regional brain activity and thus reduce symptoms. Here, we report for the first time the feasibility of employing functional near-infrared spectroscopy (fNIRS)-based neurofeedback training in children with ASD. We developed a method to study physiological self-regulation of oxy-hemoglobin using real-time feedback. The paradigm is illustrated with initial data from four subjects who engaged in a facial-identity recognition training program during which an implicit reinforcement was given based on the participant's brain activity and behavioral performance. Two participants had a confirmed diagnosis of ASD, and the other two were typically developing (TD). One participant with ASD and one TD participant received real-feedback (real-FB) during the training, whereas the other two received sham-feedback (sham-FB). After five training sessions, the subjects who received real-FB showed more improvement in facial recognition performance compared with those receiving sham-FB, particularly in the participant with ASD. These results suggest fNIRS-based neurofeedback could enhance therapeutic intervention in children with ASD.

Cross-cultural differences and similarities underlying other-race effects for facial identity and expression.

Perceptual advantages for own-race compared to other-race faces have been demonstrated for the recognition of facial identity and expression. However, these effects have not been investigated in the same study with measures that can determine the extent of cross-cultural agreement as well as differences. To address this issue, we used a photo sorting task in which Chinese and Caucasian participants were asked to sort photographs of Chinese or Caucasian faces by identity or by expression. This paradigm matched the task demands of identity and expression recognition and avoided constrained forced-choice or verbal labelling requirements. Other-race effects of comparable magnitude were found across the identity and expression tasks. Caucasian participants made more confusion errors for the identities and expressions of Chinese than Caucasian faces, while Chinese participants made more confusion errors for the identities and expressions of Caucasian than Chinese faces. However, analyses of the patterns of responses across groups of participants revealed a considerable amount of underlying cross-cultural agreement. These findings suggest that widely repeated claims that members of other cultures "all look the same" overstate the cultural differences.