Upright Faces Research Articles

The Face Inversion Effect: Roles of First- and Second-Order Configural Information.

The face inversion effect (FIE) is a reduction in recognition performance for inverted faces compared with upright faces. Several studies have proposed that a type of configural information, called second-order relational information, becomes more important with increasing expertise and gives rise to the FIE. However, recently it has been demonstrated that it is possible to obtain an FIE with facial features presented in isolation, showing that configural information is not necessary for this effect to occur. In this article we test whether there is a role for configural information in producing the FIE and whether second- or first-order relational information is particularly important. In Experiment 1, we investigated the role of configural information and local feature orientation by using a new type of "Thatcherizing" transformation on our set of faces, aiming to disrupt second-order and local feature orientation information but keeping all first-order properties unaltered. The results showed a significant reduction in the FIE for these "new" Thatcherized faces, but it did not entirely disappear. Experiment 2 confirmed the FIE for new Thatcherized faces, and Experiment 3 establishes that both local feature orientation and first-order relational information have a role in determining the FIE.

Implicit Processing of the Eyes and Mouth: Evidence from Human Electrophysiology.

The current study examined the time course of implicit processing of distinct facial features and the associate event-related potential (ERP) components. To this end, we used a masked priming paradigm to investigate implicit processing of the eyes and mouth in upright and inverted faces, using a prime duration of 33 ms. Two types of prime-target pairs were used: 1. congruent (e.g., open eyes only in both prime and target or open mouth only in both prime and target); 2. incongruent (e.g., open mouth only in prime and open eyes only in target or open eyes only in prime and open mouth only in target). The identity of the faces changed between prime and target. Participants pressed a button when the target face had the eyes open and another button when the target face had the mouth open. The behavioral results showed faster RTs for the eyes in upright faces than the eyes in inverted faces, the mouth in upright and inverted faces. Moreover they also revealed a congruent priming effect for the mouth in upright faces. The ERP findings showed a face orientation effect across all ERP components studied (P1, N1, N170, P2, N2, P3) starting at about 80 ms, and a congruency/priming effect on late components (P2, N2, P3), starting at about 150 ms. Crucially, the results showed that the orientation effect was driven by the eye region (N170, P2) and that the congruency effect started earlier (P2) for the eyes than for the mouth (N2). These findings mark the time course of the processing of internal facial features and provide further evidence that the eyes are automatically processed and that they are very salient facial features that strongly affect the amplitude, latency, and distribution of neural responses to faces.

The influence of natural contour and face size on the spatial frequency tuning for identifying upright and inverted faces.

It has previously been proposed that holistic face processing is based on low spatial frequencies (SFs) whereas featural processing relies on higher SFs, a hypothesis still widespread in the face processing literature today (e.g. Peters et al. in Eur J Neurosci 37(9):1448-1457, 2013). Since upright faces are supposedly recognized through holistic processing and inverted faces, using features, it is easy to take the leap to suggest a qualitatively different SF tuning for the identification of upright and vs. inverted faces. However, two independent studies (e.g. Gaspar et al. in Vision Res 48(28):2817-2826, 2008; Willenbockel et al. in J Exp Psychol Human 36(1):122-135, 2010a) found the same SF tuning for both stimulus presentations. Since these authors used relatively small faces hiding the natural facial contour, it is possible that differences in the SF tuning for identifying upright and inverted faces were missed. The present study thus revisits the SF tuning for upright and inverted faces face identification using the SF Bubbles technique. Our results still indicate that the same SFs are involved in both upright and inverted face recognition regardless of these additional parameters (contour and size), thus contrasting with previous data obtained using different methods (e.g. Oruc and Barton in J Vis 10(12):20, 1-12, 2010). The possible reasons subtending this divergence are discussed.

Horizontal tuning for faces originates in high-level Fusiform Face Area

Recent work indicates that the specialization of face visual perception relies on the privileged processing of horizontal angles of facial information. This suggests that stimulus properties assumed to be fully resolved in primary visual cortex (V1; e.g., orientation) in fact determine human vision until high-level stages of processing. To address this hypothesis, the present fMRI study explored the orientation sensitivity of V1 and high-level face-specialized ventral regions such as the Occipital Face Area (OFA) and Fusiform Face Area (FFA) to different angles of face information.Participants viewed face images filtered to retain information at horizontal, vertical or oblique angles. Filtered images were viewed upright, inverted and (phase-)scrambled. FFA responded most strongly to the horizontal range of upright face information; its activation pattern reliably separated horizontal from oblique ranges, but only when faces were upright. Moreover, activation patterns induced in the right FFA and the OFA by upright and inverted faces could only be separated based on horizontal information. This indicates that the specialized processing of upright face information in the OFA and FFA essentially relies on the encoding of horizontal facial cues.This pattern was not passively inherited from V1, which was found to respond less strongly to horizontal than other orientations likely due to adaptive whitening. Moreover, we found that orientation decoding accuracy in V1 was impaired for stimuli containing no meaningful shape.By showing that primary coding in V1 is influenced by high-order stimulus structure and that high-level processing is tuned to selective ranges of primary information, the present work suggests that primary and high-level levels of the visual system interact in order to modulate the processing of certain ranges of primary information depending on their relevance with respect to the stimulus and task at hand.

Perceptual face processing in developmental prosopagnosia is not sensitive to the canonical location of face parts

Individuals with developmental prosopagnosia (DP) are strongly impaired in recognizing faces, but it is controversial whether this deficit is linked to atypical visual-perceptual face processing mechanisms. Previous behavioural studies have suggested that face perception in DP might be less sensitive to the canonical spatial configuration of face parts in upright faces. To test this prediction, we recorded event-related brain potentials (ERPs) to intact upright faces and to faces with spatially scrambled parts (eyes, nose, and mouth) in a group of ten participants with DP and a group of ten age-matched control participants with normal face recognition abilities. The face-sensitive N170 component and the vertex positive potential (VPP) were both enhanced and delayed for scrambled as compared to intact faces in the control group. In contrast, N170 and VPP amplitude enhancements to scrambled faces were absent in the DP group. For control participants, the N170 to scrambled faces was also sensitive to feature locations, with larger and delayed N170 components contralateral to the side where all features appeared in a non-canonical position. No such differences were present in the DP group. These findings suggest that spatial templates of the prototypical feature locations within an upright face are selectively impaired in DP.

Precise glasses detection algorithm for face with in-plane rotation

This paper proposes an accurate glasses detection algorithm for in-plane rotated faces. Firstly, to normalize the face with in-plane rotation to be an upright one, this paper proposes a new set of ±26.565° haar-like features which can be calculated quickly to represent the features of rotated faces. With these new features, we address to build different rotated detectors by rotating upright face detector directly so as to achieve in-plane rotated face detection. Secondly, according to the rule that the objects with fixed and complex structure in a simple background are much easily to be detected, as the eyes have much complex structure in the face, we propose to detect the eyes for minimizing the glasses searching region. Because the nosepiece region of the glasses has much fixed structure and simple background, we use this part to train a new detector with the haar-like features and AdaBoost algorithm for precise glasses detection. This approach accomplishes glasses detection for in-plane rotated face with high speed and precision. The experimental results on the CMU-MIT, BioID, and CAS-PEAL-R1 face databases demonstrate that the algorithms for face, eye and glasses detection yield accurate results and maintain the speed advantage.

Many faces, one rule: the role of perceptual expertise in infants' sequential rule learning.

Rule learning is a mechanism that allows infants to recognize and generalize rule-like patterns, such as ABB or ABA. Although infants are better at learning rules from speech vs. non-speech, rule learning can be applied also to frequently experienced visual stimuli, suggesting that perceptual expertise with material to be learned is critical in enhancing rule learning abilities. Yet infants’ rule learning has never been investigated using one of the most commonly experienced visual stimulus category available in infants’ environment, i.e., faces. Here, we investigate 7-month-olds’ ability to extract rule-like patterns from sequences composed of upright faces and compared their results to those of infants who viewed inverted faces, which presumably are encountered far less frequently than upright faces. Infants were habituated with face triads in either an ABA or ABB condition followed by a test phase with ABA and ABB triads composed of faces that differed from those showed during habituation. When upright faces were used, infants generalized the pattern presented during habituation to include the new face identities showed during testing, but when inverted faces were presented, infants failed to extract the rule. This finding supports the idea that perceptual expertise can modulate 7-month-olds’ abilities to detect rule-like patterns.

Autism diagnosis differentiates neurophysiological responses to faces in adults with tuberous sclerosis complex.

BackgroundAutism spectrum disorder (ASD) is a common and highly heritable neurodevelopmental disorder that is likely to be the outcome of complex aetiological mechanisms. One strategy to provide insight is to study ASD within tuberous sclerosis complex (TSC), a rare disorder with a high incidence of ASD, but for which the genetic cause is determined. Individuals with ASD consistently demonstrate face processing impairments, but these have not been examined in adults with TSC using event-related potentials (ERPs) that are able to capture distinct temporal stages of processing.MethodsFor adults with TSC (n = 14), 6 of which had a diagnosis of ASD, and control adults (n = 13) passively viewed upright and inverted human faces with direct or averted gaze, with concurrent EEG recording. Amplitude and latency of the P1 and N170 ERPs were measured.ResultsIndividuals with TSC + ASD exhibited longer N170 latencies to faces compared to typical adults. Typical adults and adults with TSC-only exhibited longer N170 latency to inverted versus upright faces, whereas individuals with TSC + ASD did not show latency differences according to face orientation. In addition, individuals with TSC + ASD showed increased N170 latency to averted compared to direct gaze, which was not demonstrated in typical adults. A reduced lateralization was shown for the TSC + ASD groups on P1 and N170 amplitude.ConclusionsThe findings suggest that individuals with TSC + ASD may have similar electrophysiological abnormalities to idiopathic ASD and are suggestive of developmental delay. Identifying brain-based markers of ASD that are similar in TSC and idiopathic cases is likely to help elucidate the risk pathways to ASD.Electronic supplementary materialThe online version of this article (doi:10.1186/s11689-015-9129-2) contains supplementary material, which is available to authorized users.

Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old).

Face recognition in young human adults preferentially relies on the processing of horizontally-oriented visual information. We addressed whether the horizontal tuning of face perception is modulated by the extensive experience humans acquire with faces over the lifespan, or whether it reflects an invariable processing bias for this visual category. We tested 296 subjects aged from 6 to 74 years in a face matching task. Stimuli were upright and inverted faces filtered to preserve information in the horizontal or vertical orientation, or both (HV) ranges. The reliance on face-specific processing was inferred based on the face inversion effect (FIE). FIE size increased linearly until young adulthood in the horizontal but not the vertical orientation range of face information. These findings indicate that the protracted specialization of the face processing system relies on the extensive experience humans acquire at encoding the horizontal information conveyed by upright faces.

Neural correlates of cognitive aging during the perception of facial age: the role of relatively distant and local texture information.

Previous event-related potential (ERP) research revealed that older relative to younger adults show reduced inversion effects in the N170 (with more negative amplitudes for inverted than upright faces), suggestive of impairments in face perception. However, as these studies used young to middle-aged faces only, this finding may reflect preferential processing of own- relative to other-age faces rather than age-related decline. We conducted an ERP study in which young and older participants categorized young and old upright or inverted faces by age. Stimuli were presented either unfiltered or low-pass filtered at 30, 20, or 10 cycles per image (CPI). Response times revealed larger inversion effects, with slower responses for inverted faces, for young faces in young participants. Older participants did not show a corresponding effect. ERPs yielded a trend toward reduced N170 inversion effects in older relative to younger adults independent of face age. Moreover, larger inversion effects for young relative to old faces were detected, and filtering resulted in smaller N170 amplitudes. The reduced N170 inversion effect in older adults may reflect age-related changes in neural correlates of face perception. A smaller N170 inversion effect for old faces may indicate that facial changes with age hamper early face perception stages.

Face inversion does not affect the information content coded during the N170

Abstract Face inversion dramatically disrupts our ability to process faces, which is known as the face inversion effect. Previous electrophysiological studies have indicated that the N170 ERP component is delayed and sometimes larger in response to inverted compared to upright faces. However, the nature of these effects remains elusive because we do not yet understand the information coding function of the N170 in upright and inverted faces. Here, we assessed what facial information the N170 codes and when it does so for upright and inverted faces. To this aim, we used one of the simplest socially relevant tasks: face detection. In this task, 10 healthy adults (5 females, median age=23, 20-29) saw pictures of faces and noise textures revealed through ten small Gaussian apertures (bubbles). Participants performed two sessions of trials with upright faces, and two sessions with inverted faces, for a total of 4400 trials. We applied reverse-correlation methods coupled with information theory to reveal the image pixels statistically associated with behaviour and neural responses. In both upright and inverted faces, we found that presence of the left eye modulated the reaction times (RTs) of all participants. In upright faces, the eye contralateral to the left and right posterior lateral electrodes strongly modulated early face ERPs. In particular, the N170 latency and amplitude coded the presence of the contralateral eye (Rousselet et al. Journal of Vision 2014, 14(13): 7, 1-24). This association was about 35% weaker in inverted faces, and delayed by about 30 ms, compared to upright face. In conclusion, our results suggest that, in a face detection task, the N170 mostly code the presence of a single feature: the contralateral eye. Inversion leads to an inefficient coding of the same feature, which is reflected in weaker and delayed feature sensitivity. Meeting abstract presented at VSS 2015.

A holistic advantage in face drawing: higher accuracy when drawing upright faces

This study looks into the conception that drawing or copying a face that is vertically inverted will improve the accuracy of the drawing by preventing holistic interference. We had participants draw parameterized face profiles (both upright and inverted) that were sampled from face space (see Davidenko, 2007). In each trial, participants were shown a face on the left side of the screen and asked to copy it on the right side. We then recorded the location of 66 landmark points on each face drawing, allowing us to compute a distance metric between each drawing and its corresponding original face. This distance metric served as a measure of accuracy, with higher distances corresponding to greater errors. Contrary to common belief, people’s drawings were significantly more accurate for upright versus inverted faces (t(15) = 4.9; p=0.0002). Our results suggest that holistic processing improves, rather than impairs, the accuracy of face drawing.

Face processing among twins with and without autism: social correlates and twin concordance.

Autism spectrum disorder (ASD) has a strong heritable basis, as evidenced by twin concordance rates. Within ASD, symptom domains may arise via independent genetic contributions, with varying heritabilities and genetic mechanisms. In this article, we explore social functioning in the form of (i) electrophysiological and behavioral measures of face processing (P1 and N170) and (ii) social behavior among child and adolescent twins with (N = 52) and without ASD (N = 66). Twins without ASD had better holistic face processing and face memory, faster P1 responses and greater sensitivity to the effects of facial inversion on P1. In contrast, N170 responses to faces were similar across diagnosis, with more negative amplitudes for faces vs non-face images. Across the sample, stronger social skills and fewer social difficulties were associated with faster P1 and N170 responses to upright faces, and better face memory. Twins were highly correlated within pairs across most measures, but correlations were significantly stronger for monozygotic vs dizygotic pairs on N170 latency and social problems. We suggest common developmental influences across twins for face processing and social behavior, but highlight (i) neural speed of face processing and (ii) social difficulties as important avenues in the search for genetic underpinnings in ASD.

In-plane face orientation estimation in still images

This paper addresses a fine in-plane (roll) face orientation estimation for a perspective face analysis algorithm that requires normalized frontal faces. As most of the face analysers (e.g., gender, expression, and recognition) need frontal up-right faces, there is a clear need for the precise roll estimation, as precise face normalization has an important role in classification methods. The in-plane orientation estimation algorithm is constructed on top of regular Viola-Jones frontal face detector. When a face is detected for the first time, it is rotated with respect to the face origin to find the boundaries of the detection. Mean value of these angles is said to be the measurement of the in-plane rotation of the face. Since we only need a face detection algorithm, the proposed method can work effectively on very small sized faces where traditional landmark (eye, mouth) or planar detection based estimations fail. Experiments on controlled and unconstrained large-scale datasets (CMU Rotated, YouTube, Boston University Face Tracking, Caltech, FG-NET Aging, BioID and Manchester Talking-Face) showed that the proposed method is robust to various settings for in-plane face orientation estimation in terms of RMSE and MAE. We achieved less than ±3.5 ∘ mean absolute error for roll estimation which proves that the accuracy of the proposed method is comparable to that of the state-of-the-art tracking based approaches for the roll estimation.

Differential age-related changes in N170 responses to upright faces, inverted faces, and eyes in Japanese children.

The main objectives of this study were to investigate the development of face perception in Japanese children, focusing on the changes in face processing strategies (holistic and/or configural vs. feature-based) that occur during childhood. To achieve this, we analyzed the face-related N170 component, evoked by upright face, inverted face, and eyes stimuli in 82 Japanese children aged between 8- and 13-years-old. During the experiment, the children were asked to perform a target detection task in which they were told to press a button when they saw images of faces or kettles with mustaches, glasses, and fake noses; i.e., an implicit face perception task. The N170 signals observed after the presentation of the upright face stimuli were longer in duration and/or had at least two peaks in the 8–11-year-old children, whereas those seen in the 12–13-year-old children were sharp and only had a single peak. N170 latency was significantly longer after the presentation of the eyes stimuli than after the presentation of the upright face stimuli in the 10- and 12-year-old children. In addition, significant differences in N170 latency were observed among all three stimulus types in the 13-year-old children. N170 amplitude was significantly greater after the presentation of the eyes stimuli than after the presentation of the upright face stimuli in the 8–10- and 12-year-old children. The results of the present study indicate that the upright face stimuli were processed using holistic and/or configural processing by the 13-year-old children.

Dynamic composite faces are processed holistically

Holistic processing is considered one of the hallmarks of face recognition. Recent studies using the composite task claim to show a lack of holistic processing for dynamic faces, however they only presented moving faces in the learning phase and tested with static composite images. So while previous research has addressed the question of whether moving faces influence the processing of subsequently viewed static faces, the question of whether moving faces are processed holistically remains unanswered. We address that question here. In our study participants learned faces in motion and were tested on moving composite faces, or learned static faces and were tested on static composite faces. We found a clear composite effect for both upright static and dynamic faces, with no significant difference in the magnitude of those effects. Further, there was no evidence of composite or motion effects in inverted conditions, ruling out low level or other motion signal properties as explanations of performance in upright faces. Together, these results show that upright moving faces are processed holistically, in a similar manner to static faces, extending decades of research with static faces and confirming the importance of holistic processing to familiar face recognition.

Neural substrates of species-dependent visual processing of faces: use of morphed faces.

Face identification and categorization are essential for social communication. The N170 event-related potential (ERP) is considered to be a biomarker of face perception. To elucidate the neural basis of species-dependent face processing, we recorded 128-ch high-density ERPs in 14 healthy adults while they viewed the images of morphed faces. The morphed stimuli contained different proportions of human and monkey faces, and the species boundary was shifted away from the center of the morph continuum. Three experiments were performed to determine how task requirement, facial orientation, and spatial frequency (SF) of visual stimuli affected ERPs. In an equal SF condition, the latency, and amplitude of the occipital P100 for upright faces were modulated in a monotonic-like fashion by the level of morphing. In contrast, the N170 latency for upright faces was modulated in a step-like fashion, showing a flexion point that may reflect species discrimination. Although N170 amplitudes for upright faces were not modulated by morph level, they were modulated in a monotonic-like fashion by inverted faces. The late positive (LP) component (350–550 msec) in the parietal region was modulated in a U-shaped function by morph level during a categorization task, but not in a simple reaction task. These results suggest that P100 reflects changes in the physical properties of faces and that N170 is involved in own-species selectivity. The LP component seems to represent species categorization that occurs 350 msec after stimulus onset.

Gaze constancy in upright and inverted faces.

The dual-route model (Otsuka, Mareschal, Calder, & Clifford, 2014) posits that constancy in the perception of gaze direction across lateral head rotation depends on the integration of information from the eye region and information about head rotation. Incorporation of information about head rotation serves to compensate for the change in eye-region information when viewing a rotated head. We tested the ability of this model to predict the magnitude of Wollaston's effect: When eyes from a frontal pose are inserted into an angled face, the perceived direction of gaze appears attracted towards the direction of the head. The framework of the dual-route model explains Wollaston's effect as a result of the misapplication of this same integration operation without any change in eye-region information. To test this explanation, we compared the magnitude of the integration occurring for Wollaston's effect to that for normal faces. Here, participants performed categorical judgment of gaze direction across head rotation poses in three image conditions: normal face, eyes-only, and Wollaston. Integration of eye and head information was inferred by comparing the effect of pose between the eyes-only condition and the normal face condition, and by examining the effect of pose in the Wollaston condition. Consistent with the dual-route model, the magnitude of integration was similar between the normal face condition and the Wollaston condition. Further, upright and inverted faces yielded similar levels of gaze constancy, showing that the dual-route model applies to the perception of gaze direction in inverted faces as well as in upright faces.

Upright face-preferential high-gamma responses in lower-order visual areas: Evidence from intracranial recordings in children

Behavioral studies demonstrate that a face presented in the upright orientation attracts attention more rapidly than an inverted face. Saccades toward an upright face take place in 100–140ms following presentation. The present study using electrocorticography determined whether upright face-preferential neural activation, as reflected by augmentation of high-gamma activity at 80–150Hz, involved the lower-order visual cortex within the first 100ms post-stimulus presentation. Sampled lower-order visual areas were verified by the induction of phosphenes upon electrical stimulation. These areas resided in the lateral-occipital, lingual, and cuneus gyri along the calcarine sulcus, roughly corresponding to V1 and V2. Measurement of high-gamma augmentation during central (circular) and peripheral (annular) checkerboard reversal pattern stimulation indicated that central-field stimuli were processed by the more polar surface whereas peripheral-field stimuli by the more anterior medial surface. Upright face stimuli, compared to inverted ones, elicited up to 23% larger augmentation of high-gamma activity in the lower-order visual regions at 40–90ms. Upright face-preferential high-gamma augmentation was more highly correlated with high-gamma augmentation for central than peripheral stimuli. Our observations are consistent with the hypothesis that lower-order visual regions, especially those for the central field, are involved in visual cues for rapid detection of upright face stimuli.

Face inversion and acquired prosopagnosia reduce the size of the perceptual field of view

Using a gaze-contingent morphing approach, we asked human observers to choose one of two faces that best matched the identity of a target face: one face corresponded to the reference face’s fixated part only (e.g., one eye), the other corresponded to the unfixated area of the reference face. The face corresponding to the fixated part was selected significantly more frequently in the inverted than in the upright orientation. This observation provides evidence that face inversion reduces an observer’s perceptual field of view, even when both upright and inverted faces are displayed at full view and there is no performance difference between these conditions. It rules out an account of the drop of performance for inverted faces – one of the most robust effects in experimental psychology – in terms of a mere difference in local processing efficiency. A brain-damaged patient with pure prosopagnosia, viewing only upright faces, systematically selected the face corresponding to the fixated part, as if her perceptual field was reduced relative to normal observers. Altogether, these observations indicate that the absence of visual knowledge reduces the perceptual field of view, supporting an indirect view of visual perception.