Upright Faces Research Articles

Modulation of the composite face effect by unintended emotion cues.

When upper and lower regions from different emotionless faces are aligned to form a facial composite, observers ‘fuse’ the two halves together, perceptually. The illusory distortion induced by task-irrelevant (‘distractor’) halves hinders participants' judgements about task-relevant (‘target’) halves. This composite-face effect reveals a tendency to integrate feature information from disparate regions of intact upright faces, consistent with theories of holistic face processing. However, observers frequently perceive emotion in ostensibly neutral faces, contrary to the intentions of experimenters. This study sought to determine whether this ‘perceived emotion’ influences the composite-face effect. In our first experiment, we confirmed that the composite effect grows stronger as the strength of distractor emotion increased. Critically, effects of distractor emotion were induced by weak emotion intensities, and were incidental insofar as emotion cues hindered image matching, not emotion labelling per se. In Experiment 2, we found a correlation between the presence of perceived emotion in a set of ostensibly neutral distractor regions sourced from commonly used face databases, and the strength of illusory distortion they induced. In Experiment 3, participants completed a sequential matching composite task in which half of the distractor regions were rated high and low for perceived emotion, respectively. Significantly stronger composite effects were induced by the high-emotion distractor halves. These convergent results suggest that perceived emotion increases the strength of the composite-face effect induced by supposedly emotionless faces. These findings have important implications for the study of holistic face processing in typical and atypical populations.

Between-Subject Variability in the Breaking Continuous Flash Suppression Paradigm: Potential Causes, Consequences, and Solutions.

A recent focus in the field of consciousness research involves investigating the propensity of initially non-conscious visual information to gain access to consciousness. A critical tool for measuring conscious access is the so-called breaking continuous flash suppression paradigm (b-CFS). In this paradigm, a high contrast dynamic pattern is presented to one eye, thereby temporarily suppressing a target stimulus that is presented to the other eye. The time it takes for observers to report (e.g., the location of) the initially suppressed stimulus provides a measure of conscious access. Typical observations in b-CFS studies include the finding that upright faces are released from suppression faster than inverted faces, and the finding that stimuli that match the current content of visual working memory are released from suppression faster than mismatching stimuli. Interestingly, the extent to which observers exhibit these effects varies extensively (in the range of hundreds of milliseconds). By re-analyzing existing datasets and a new dataset we establish that the difference in RTs between conditions in b-CFS tasks (i.e., the effect of interest) is highly correlated with participants' overall suppression durations, and with their trial-to-trial variability in RTs. We advocate the usage of a simple latency- normalization method, which (1) removes the between-subject variability in suppression duration from the effect of interest, while (2) providing distributions of RT differences that are better suited for parametric testing. We next compare this latency-normalization method to two other transformations that are widely applied on within-subject RT data (z-transformations and log-transformations). Finally, we tentatively discuss how trial-to-trial variability and overall suppression duration might relate to prolonged phases of shallow suppression that are more prone to modulations of conscious access.

The categories, frequencies, and stability of idiosyncratic eye-movement patterns to faces

The spatial pattern of eye-movements to faces considered typical for neurologically healthy individuals is a roughly T-shaped distribution over the internal facial features with peak fixation density tending toward the left eye (observer’s perspective). However, recent studies indicate that striking deviations from this classic pattern are common within the population and are highly stable over time. The classic pattern actually reflects the average of these various idiosyncratic eye-movement patterns across individuals. The natural categories and respective frequencies of different types of idiosyncratic eye-movement patterns have not been specifically investigated before, so here we analyzed the spatial patterns of eye-movements for 48 participants to estimate the frequency of different kinds of individual eye-movement patterns to faces in the normal healthy population. Four natural clusters were discovered such that approximately 25% of our participants’ fixation density peaks clustered over the left eye region (observer’s perspective), 23% over the right eye-region, 31% over the nasion/bridge region of the nose, and 20% over the region spanning the nose, philthrum, and upper lips. We did not find any relationship between particular idiosyncratic eye-movement patterns and recognition performance. Individuals’ eye-movement patterns early in a trial were more stereotyped than later ones and idiosyncratic fixation patterns evolved with time into a trial. Finally, while face inversion strongly modulated eye-movement patterns, individual patterns did not become less distinct for inverted compared to upright faces. Group-averaged fixation patterns do not represent individual patterns well, so exploration of such individual patterns is of value for future studies of visual cognition.

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

ABSTRACTFace perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.

Typical visual search performance and atypical gaze behaviors in response to faces in Williams syndrome.

BackgroundEvidence indicates that individuals with Williams syndrome (WS) exhibit atypical attentional characteristics when viewing faces. However, the dynamics of visual attention captured by faces remain unclear, especially when explicit attentional forces are present. To clarify this, we introduced a visual search paradigm and assessed how the relative strength of visual attention captured by a face and explicit attentional control changes as search progresses.MethodsParticipants (WS and controls) searched for a target (butterfly) within an array of distractors, which sometimes contained an upright face. We analyzed reaction time and location of the first fixation—which reflect the attentional profile at the initial stage—and fixation durations. These features represent aspects of attention at later stages of visual search. The strength of visual attention captured by faces and explicit attentional control (toward the butterfly) was characterized by the frequency of first fixations on a face or butterfly and on the duration of face or butterfly fixations.ResultsAlthough reaction time was longer in all groups when faces were present, and visual attention was not dominated by faces in any group during the initial stages of the search, when faces were present, attention to faces dominated in the WS group during the later search stages. Furthermore, for the WS group, reaction time correlated with eye-movement measures at different stages of searching such that longer reaction times were associated with longer face-fixations, specifically at the initial stage of searching. Moreover, longer reaction times were associated with longer face-fixations at the later stages of searching, while shorter reaction times were associated with longer butterfly fixations.ConclusionsThe relative strength of attention captured by faces in people with WS is not observed at the initial stage of searching but becomes dominant as the search progresses. Furthermore, although behavioral responses are associated with some aspects of eye movements, they are not as sensitive as eye-movement measurements themselves at detecting atypical attentional characteristics in people with WS.

Is the Thatcher Illusion Modulated by Face Familiarity? Evidence from an Eye Tracking Study.

Thompson (1980) first detected and described the Thatcher Illusion, where participants instantly perceive an upright face with inverted eyes and mouth as grotesque, but fail to do so when the same face is inverted. One prominent but controversial explanation is that the processing of configural information is disrupted in inverted faces. Studies investigating the Thatcher Illusion either used famous faces or non-famous faces. Highly familiar faces were often thought to be processed in a pronounced configural mode, so they seem ideal candidates to be tested in one Thatcher study against unfamiliar faces–but this has never been addressed so far. In our study, participants evaluated 16 famous and 16 non-famous faces for their grotesqueness. We tested whether familiarity (famous/non-famous faces) modulates reaction times, correctness of grotesqueness assessments (accuracy), and eye movement patterns for the factors orientation (upright/inverted) and Thatcherisation (Thatcherised/non-Thatcherised). On a behavioural level, familiarity effects were only observable via face inversion (higher accuracy and sensitivity for famous compared to non-famous faces) but not via Thatcherisation. Regarding eye movements, however, Thatcherisation influenced the scanning of famous and non-famous faces, for instance, in scanning the mouth region of the presented faces (higher number, duration and dwell time of fixations for famous compared to non-famous faces if Thatcherised). Altogether, famous faces seem to be processed in a more elaborate, more expertise-based way than non-famous faces, whereas non-famous, inverted faces seem to cause difficulties in accurate and sensitive processing. Results are further discussed in the face of existing studies of familiar vs. unfamiliar face processing.

Category selectivity of the N170 and the role of expertise in deaf signers

Deafness is known to affect processing of visual motion and information in the visual periphery, as well as the neural substrates for these domains. This study was designed to characterize the effects of early deafness and lifelong sign language use on visual category sensitivity of the N170 event-related potential. Images from nine categories of visual forms including upright faces, inverted faces, and hands were presented to twelve typically hearing adults and twelve adult congenitally deaf signers. Classic N170 category sensitivity was observed in both participant groups, whereby faces elicited larger amplitudes than all other visual categories, and inverted faces elicited larger amplitudes and slower latencies than upright faces. In hearing adults, hands elicited a right hemispheric asymmetry while in deaf signers this category elicited a left hemispheric asymmetry. Pilot data from five hearing native signers suggests that this effect is due to lifelong use of American Sign Language rather than auditory deprivation itself.

Testing Differential Holistic Processing Within a Face: No Evidence of Asymmetry from the Complete Composite Task.

The composite face task is one of the most popular research paradigms for measuring holistic processing of upright faces. The exact mechanism underlying holistic processing remains elusive and controversial, and some studies have suggested that holistic processing may not be evenly distributed, in that the top-half of a face might induce stronger holistic processing than its bottom-half counterpart. In two experiments, we further examined the possibility of asymmetric holistic processing. Prior to Experiment 1, we confirmed that perceptual discriminability was equated between top and bottom face halves; we found no differences in performance between top and bottom face halves when they were presented individually. Then, in Experiment 1, using the composite face task with the complete design to reduce response bias, we failed to obtain evidence that would support the notion of asymmetric holistic processing between top and bottom face halves. To further reduce performance variability and to remove lingering holistic effects observed in the misaligned condition in Experiment 1, we doubled the number of trials and increased misalignment between top and bottom face halves to make misalignment more salient in Experiment 2. Even with these additional manipulations, we were unable to find evidence indicative of asymmetric holistic processing. Taken together, these findings suggest that holistic processing is distributed homogenously within an upright face.

Holistic processing of face configurations and components.

Although many researchers agree that faces are processed holistically, we know relatively little about what information holistic processing captures from a face. Most studies that assess the nature of holistic processing do so with changes to the face affecting many different aspects of face information (e.g., different identities). Does holistic processing affect every aspect of a face? We used the composite task, a common means of examining the strength of holistic processing, with participants making same-different judgments about configuration changes or component changes to 1 portion of a face. Configuration changes involved changes in spatial position of the eyes, whereas component changes involved lightening or darkening the eyebrows. Composites were either aligned or misaligned, and were presented either upright or inverted. Both configuration judgments and component judgments showed evidence of holistic processing, and in both cases it was strongest for upright face composites. These results suggest that holistic processing captures a broad range of information about the face, including both configuration-based and component-based information. (PsycINFO Database Record

The orientation selectivity of face identification.

Recent work demonstrates that human face identification is most efficient when based on horizontal, rather than vertical, image structure. Because it is unclear how this specialization for upright (compared to inverted) face processing emerges in the visual system, the present study aimed to systematically characterize the orientation sensitivity profile for face identification. With upright faces, identification performance in a delayed match-to-sample task was highest for horizontally filtered images and declined sharply with oblique and vertically filtered images. Performance was well described by a Gaussian function with a bandwidth around 25°. Face inversion reshaped this sensitivity profile dramatically, with a downward shift of the entire tuning curve as well as a reduction in the amplitude of the horizontal peak and a doubling in bandwidth. The use of naturalistic outer contours (vs. a common outline mask) was also found to reshape this sensitivity profile by increasing sensitivity to oblique information in the near-horizontal range. Altogether, although face identification is sharply tuned to horizontal angles, both inversion and outline masking can profoundly reshape this orientation sensitivity profile. This combination of image- and observer-driven effects provides an insight into the functional relationship between orientation-selective processes within primary and high-level stages of the human brain.

Does shrinking the perceptual field of view affect horizontal tuning in upright face identification?

Does shrinking the perceptual field of view affect horizontal tuning in upright face identification?

Reduced saccadic inhibition of return to moving eyes in autism spectrum disorders

Inhibition of Return (IOR) refers to slower reaction time to a target presented at the same location as a preceding stimulus. Here, we examine reflexive attention orienting via the saccadic IOR using a shift in gaze direction (i.e. from averted to direct) in faces presented as a peripheral cue, in upright and inverted orientations, in adults with Autism Spectrum Disorder (ASD) and typically developed comparison participants. While both groups showed an IOR in the inverted face condition, this effect was reduced in participants with ASD in the upright face condition, as compared to comparison participants, suggesting that moving eyes do not trigger reflexive exogenous orienting in individuals with ASD. Impaired reflexive orienting to eye gaze might severely compromise the later development of social functions in ASD, such as joint attention, face emotion recognition and mindreading.

Electrophysiological evidence for parts and wholes in visual face memory

It is often assumed that upright faces are represented in a holistic fashion, while representations of inverted faces are essentially part-based. To assess this hypothesis, we recorded event-related potentials (ERPs) during a sequential face identity matching task where successively presented pairs of upright or inverted faces were either identical or differed with respect to their internal features, their external features, or both. Participants' task was to report on each trial whether the face pair was identical or different. To track the activation of visual face memory representations, we measured N250r components that emerge over posterior face-selective regions during the activation of visual face memory representations by a successful identity match. N250r components to full identity repetitions were smaller and emerged later for inverted as compared to upright faces, demonstrating that image inversion impairs face identity matching processes. For upright faces, N250r components were also elicited by partial repetitions of external or internal features, which suggest that the underlying identity matching processes are not exclusively based on non-decomposable holistic representations. However, the N250r to full identity repetitions was super-additive (i.e., larger than the sum of the two N250r components to partial repetitions of external or internal features) for upright faces, demonstrating that holistic representations were involved in identity matching processes. For inverted faces, N250r components to full and partial identity repetitions were strictly additive, indicating that the identity matching of external and internal features operated in an entirely part-based fashion. These results provide new electrophysiological evidence for qualitative differences between representations of upright and inverted faces in the occipital-temporal face processing system.

The role of holistic face processing in acquired prosopagnosia: evidence from the composite face effect

ABSTRACTFaces are processed more holistically than other objects, and it has been suggested that the loss of holistic face processing causes acquired prosopagnosia. Support for this hypothesis comes from several cases who failed to show holistic face effects as well as the absence of reports of prosopagnosics with unequivocally normal holistic face perception. The current study examines the relationship between holistic face processing and prosopagnosia by testing seven acquired prosopagnosics with the face composite task, a classic measure of holistic face processing. To enhance the robustness of the findings, each prosopagnosic was tested with two versions of the composite task showing upright faces. We also tested an inverted condition to exclude the possibility that more general factors account for composite effects for upright faces. Four of the seven acquired prosopagnosic participants showed consistent upright face composite effects with minimal inverted face composite effects. We conclude that severe face processing deficits can co-occur with intact holistic face processing and that factors other than a loss of holistic processing contribute to the perceptual and recognition deficits in acquired prosopagnosia.

A global attentional scope setting prioritizes faces for conscious detection.

The scope of visual attention is known to affect conscious object perception, with recent studies showing that a global attentional scope boosts holistic face processing, relative to a local scope. Here we show that attentional scope settings can also modulate the availability of information for conscious visual awareness. In an initial experiment, we show that adopting a global attentional scope accelerates conscious detection of initially invisible faces, presented under continuous flash suppression (CFS). Furthermore, face detection time was not modulated by attentional scope in a nonrivalrous control condition, which emulated the experience of CFS without inducing binocular rivalry. In a follow-up experiment, we report an exact replication of the original effect, as well as data suggesting that this effect is specific to upright faces, and is abolished when using both inverted faces and images of houses in an otherwise identical task. Thus, attentional scope settings can modulate the availability of information to conscious awareness, fundamentally altering the contents of our subjective visual experience.

A Qualitative Impairment in Face Perception in Alzheimer's Disease: Evidence from a Reduced Face Inversion Effect.

Prevalent face recognition difficulties in Alzheimer's disease (AD) have typically been attributed to the underlying episodic and semantic memory impairment. The aim of the current study was to determine if AD patients are also impaired at the perceptual level for faces, more specifically at extracting a visual representation of an individual face. To address this question, we investigated the matching of simultaneously presented individual faces and of other nonface familiar shapes (cars), at both upright and inverted orientation, in a group of mild AD patients and in a group of healthy older controls matched for age and education. AD patients showed a reduced inversion effect (i.e., larger performance for upright than inverted stimuli) for faces, but not for cars, both in terms of error rates and response times. While healthy participants showed a much larger decrease in performance for faces than for cars with inversion, the inversion effect did not differ significantly for faces and cars in AD. This abnormal inversion effect for faces was observed in a large subset of individual patients with AD. These results suggest that AD patients have deficits in higher-level visual processes, more specifically at perceiving individual faces, a function that relies on holistic representations specific to upright face stimuli. These deficits, combined with their memory impairment, may contribute to the difficulties in recognizing familiar people that are often reported in patients suffering from the disease and by their caregivers.

Face Inversion Impairs the Ability to Draw Long-Range, but Not Short-Range, Spatial Relationships Between Features

Art instructors have promoted the idea that reproducing upside-down models facilitates drawing accuracy. However, perceptual research has demonstrated that face inversion impairs the perception of long-range and, to a lesser extent, short-range spatial relationships between features. This suggests that drawing an upside-down face model might impair, rather than facilitate, drawing performance with respect to the accuracy of depicting the spatial relationships between features. In this study, participants drew an upright and upside-down face. Participants were less accurate in drawing the long-range spatial relationship between the eyes and mouth when drawing the upside-down face than when drawing the upright face. In contrast, they were equally accurate in drawing the short-range spatial relationships between the (a) eyes and eyebrows, (b) nose and mouth, and (c) two eyes when drawing the upright and upside-down models. This result fails to empirically validate the effectiveness of drawing models upside-down for the purposes of facilitating drawing accuracy.

Holistic processing for bodies and body parts: New evidence from stereoscopic depth manipulations.

Although holistic processing has been documented extensively for upright faces, it is unclear whether it occurs for other visual categories with more extensive substructure, such as body postures. Like faces, body postures have high social relevance, but they differ in having fine-grain organization not only of basic parts (e.g., arm) but also subparts (e.g., elbow, wrist, hand). To compare holistic processing for whole bodies and body parts, we employed a novel stereoscopic depth manipulation that creates either the percept of a whole body occluded by a set of bars, or of segments of a body floating in front of a background. Despite sharing low-level visual properties, only the stimulus perceived as being behind bars should be holistically "filled in" via amodal completion. In two experiments, we tested for better identification of individual body parts within the context of a body versus in isolation. Consistent with previous findings, recognition of body parts was better in the context of a whole body when the body was amodally completed behind occluders. However, when the same bodies were perceived as floating in strips, performance was significantly worse, and not significantly different, from that for amodally completed parts, supporting holistic processing of body postures. Intriguingly, performance was worst for parts in the frontal depth condition, suggesting that these effects may extend from gross body organization to a more local level. These results provide suggestive evidence that holistic representations may not be "all-or-none," but rather also operate on body regions of more limited spatial extent.

The Neural Basis of Individual Face and Object Perception.

We routinely need to process the identity of many faces around us, and how the brain achieves this is still the subject of much research in cognitive neuroscience. To date, insights on face identity processing have come from both healthy and clinical populations. However, in order to directly compare results across and within participant groups, and across different studies, it is crucial that a standard task is utilized which includes different exemplars (for example, non-face stimuli along with faces), is memory-neutral, and taps into identity matching across orientation and across viewpoint change. The goal of this study was to test a previously behaviourally tested face and object identity matching design in a healthy control sample whilst being scanned using fMRI. Specifically, we investigated categorical, orientation, and category-specific orientation effects while participants were focused on identity matching of simultaneously presented exemplar stimuli. Alongside observing category and orientation specific effects in a distributed set of brain regions, we also saw an interaction between stimulus category and orientation in the bilateral fusiform gyrus and bilateral middle occipital gyrus. Generally these clusters showed the pattern of a heightened response to inverted versus upright faces, and to upright, as compared to inverted shoes. These results are discussed in relation to previous studies and to potential future research within prosopagnosic individuals.

Three-month-old infants' sensitivity to horizontal information within faces.

Horizontal information is crucial to face processing in adults. Yet the ontogeny of this preferential type of processing remains unknown. To clarify this issue, we tested 3-month-old infants' sensitivity to horizontal information within faces. Specifically, infants were exposed to the simultaneous presentation of a face and a car presented in upright or inverted orientation while their looking behavior was recorded. Face and car images were either broadband (UNF) or filtered to only reveal horizontal (H), vertical (V) or this combined information (HV). As expected, infants looked longer at upright faces than at upright cars, but critically, only when horizontal information was preserved in the stimulus (UNF, HV, H). These results first indicate that horizontal information already drives upright face processing at 3 months of age. They also recall the importance, for infants, of some facial features, arranged in a top-heavy configuration, particularly revealed by this band of information. © 2016 Wiley Periodicals, Inc. Dev Psychobiol 58: 536-542, 2016.