Pairs Of Faces Research Articles

Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection

Face presentation attack detection (PAD) is essential to secure face recognition systems primarily from high-fidelity mask attacks. Most existing 3D mask PAD benchmarks suffer from several drawbacks: 1) a limited number of mask identities, types of sensors, and a total number of videos; 2) low-fidelity quality of facial masks. Basic deep models and remote photoplethysmography (rPPG) methods achieved acceptable performance on these benchmarks but still far from the needs of practical scenarios. To bridge the gap to real-world applications, we introduce a large-scale High-Fidelity Mask dataset, namely HiFiMask. Specifically, a total amount of 54,600 videos are recorded from 75 subjects with 225 realistic masks by 7 new kinds of sensors. Along with the dataset, we propose a novel Contrastive Context-aware Learning (CCL) framework. CCL is a new training methodology for supervised PAD tasks, which is able to learn by leveraging rich contexts accurately (e.g., subjects, mask material and lighting) among pairs of live faces and high-fidelity mask attacks. Extensive experimental evaluations on HiFiMask and three additional 3D mask datasets demonstrate the effectiveness of our method. The codes and dataset will be released soon.

The involvement of monocular channels in the face pareidolia effect.

Studies examining the neural mechanisms of face perception in humans have mainly focused on cortical networks of face-selective regions. However, subcortical regions are known to play a significant role in face perception as well. For instance, upon presenting pairs of faces sequentially to the same eye or to different eyes, superior performance is observed in the former condition. This superiority was explained by monocular, pre-striate processing of face stimuli. One of the intriguing face-related effects is the face pareidolia phenomenon, wherein observers perceive faces in inanimate objects. In this study, we examined whether face pareidolia involves similar low-level neural substrates to those that are involved in face perception. We presented participants with pairs of houses or face-like houses using a stereoscope to manipulate the information presented to each eye and asked them to determine whether the stimuli were similar or different. We managed to examine the contribution of monocular channels (mostly subcortical) in processing face-like stimuli. We hypothesized that besides their involvement in actual face perception, subcortical structures are engaged in face pareidolia as well. To test our hypothesis, we conducted three experiments to replicate and strengthen the reliability of our results and rule out alternative explanations. We demonstrated a perceptual benefit when presenting similar face-like houses to the same eye in comparison to their presentation to different eyes. This finding matches previous results found for images of real faces and indicates subcortical involvement not only in face perception but also in processing face-like objects.

Effect of Cognitive Control on Age-Related Positivity Effects in Attentional Processing - Evidence From an Event-Related Brain Potential Study.

Studies investigating age-related positivity effects during facial emotion processing have yielded contradictory results. The present study aimed to elucidate the mechanisms of cognitive control during attentional processing of emotional faces among older adults. We used go/no-go detection tasks combined with event-related potentials and source localization to examine the effects of response inhibition on age-related positivity effects. Data were obtained from 23 older and 23 younger healthy participants. Behavioral results showed that the discriminability index (d') of older adults on fear trials was significantly greater than that of younger adults [t(44)=2.37, p=0.024, Cohen’s d=0.70], whereas an opposite pattern was found in happy trials [t(44)=2.56, p=0.014, Cohen’s d=0.75]. The electroencephalography results on the amplitude of the N170 at the left electrode positions showed that the fear-neutral face pairs were larger than the happy-neutral ones for the younger adults [t(22)=2.32, p=0.030, Cohen’s d=0.48]; the older group’s right hemisphere presented similar tendency, although the results were not statistically significant [t(22)=1.97, p=0.061, Cohen’s d=0.41]. Further, the brain activity of the two hemispheres in older adults showed asymmetrical decrement. Our study demonstrated that the age-related “positivity effect” was not observed owing to the depletion of available cognitive resources at the early attentional stage. Moreover, bilateral activation of the two hemispheres may be important signals of normal aging.

How facial aging affects perceived gender: Insights from maximum likelihood conjoint measurement.

Conjoint measurement was used to investigate the joint influence of facial gender and facial age on perceived gender (Experiment 1) and perceived age (Experiment 2). A set of 25 faces was created, covarying independently five levels of gender (from feminine to masculine) and five levels of age (from young to old). Two independent groups of observers were presented with all possible pairs of faces from this set and compared which member of the pair appeared as more masculine (Experiment 1) or older (Experiment 2). Three nested models of the contribution of gender and age to judgment (i.e., independent, additive, and saturated) were fit to the data using maximum likelihood. The results showed that both gender and age contributed to the perceived gender and age of the faces according to a saturated observer model. In judgments of gender (Experiment 1), female faces were perceived as more masculine as they became older. In judgments of age (Experiment 2), young faces (age 20 and 30) were perceived as older as they became more masculine. Taken together, the results entail that: (a) observers integrate facial gender and age information when judging either of the dimensions, and that (b) cues for femininity and cues for aging are negatively correlated. This correlation exerts stronger influence on female faces, and can explain the success of cosmetics in concealing signs of aging and exaggerating sexually dimorphic features.

Electrophysiological correlates of perceptual prediction error are attenuated in dyslexia

A perceptual adaptation deficit often accompanies reading difficulty in dyslexia, manifesting in poor perceptual learning of consistent stimuli and reduced neurophysiological adaptation to stimulus repetition. However, it is not known how adaptation deficits relate to differences in feedforward or feedback processes in the brain. Here we used electroencephalography (EEG) to interrogate the feedforward and feedback contributions to neural adaptation as adults with and without dyslexia viewed pairs of faces and words in a paradigm that manipulated whether there was a high probability of stimulus repetition versus a high probability of stimulus change. We measured three neural dependent variables: expectation (the difference between prestimulus EEG power with and without the expectation of stimulus repetition), feedforward repetition (the difference between event-related potentials (ERPs) evoked by an expected change and an unexpected repetition), and feedback-mediated prediction error (the difference between ERPs evoked by an unexpected change and an expected repetition). Expectation significantly modulated prestimulus theta- and alpha-band EEG in both groups. Unexpected repetitions of words, but not faces, also led to significant feedforward repetition effects in the ERPs of both groups. However, neural prediction error when an unexpected change occurred instead of an expected repetition was significantly weaker in dyslexia than the control group for both faces and words. These results suggest that the neural and perceptual adaptation deficits observed in dyslexia reflect the failure to effectively integrate perceptual predictions with feedforward sensory processing. In addition to reducing perceptual efficiency, the attenuation of neural prediction error signals would also be deleterious to the wide range of perceptual and procedural learning abilities that are critical for developing accurate and fluent reading skills.

Misaligned dynamic faces are processed holistically

It was recently proposed that both experience-driven and object-based perceptual grouping contribute to holistic face processing. We investigated whether motion—as a common fate perceptual grouping cue—could enhance the holistic processing of misaligned faces. We manipulated alignment and motion (dynamic and static) of study and test faces in a modified complete composite task in which the congruency effect was regarded as an indicator of holistic processing. Participants made same-different judgments about the top halves of two sequentially presented composite faces. We observed that when the study faces were dynamic, regardless of whether the test faces were dynamic or static, misaligned-misaligned face pairs were processed holistically. When the study faces were static, misaligned-misaligned face pairs showed no holistic processing, and neither did inverted faces. These results indicate that motion can promote the holistic processing of misaligned faces. Our findings provide important insights into different types of holistic face processing, and we discuss these types as well as their relationships with each other in depth.

Contrast Adaptation in Face Perception Revealed Through EEG and Behavior.

Exposure to a face can produce biases in the perception of subsequent faces. Typically, these face aftereffects are studied by adapting to an individual face or category (e.g., faces of a given gender) and can result in renormalization of perceptions such that the adapting face appears more neutral. These shifts are analogous to chromatic adaptation, where a renormalization for the average adapting color occurs. However, in color vision, adaptation can also adjust to the variance or range of colors in the distribution. We examined whether this variance or contrast adaptation also occurs for faces, using an objective EEG measure to assess response changes following adaptation. An average female face was contracted or expanded along the horizontal or vertical axis to form four images. Observers viewed a 20 s sequence of the four images presented in a fixed order at a rate of 6 Hz, while responses to the faces were recorded with EEG. A 6 Hz signal was observed over right occipito-temporal channels, indicating symmetric responses to the four images. This test sequence was repeated after 20 s adaptation to alternations between two of the faces (e.g., horizontal contracted and expanded). This adaptation resulted in an additional signal at 3 Hz, consistent with asymmetric responses to adapted and non-adapted test faces. Adapting pairs have the same mean (undistorted) as the test sequence and thus should not bias responses driven only by the mean. Instead, the results are consistent with selective adaptation to the distortion axis. A 3 Hz signal was also observed after adapting to face pairs selected to induce a mean bias (e.g., expanded vertical and expanded horizontal), and this signal was not significantly different from that observed following adaption to a single image that did not form part of the test sequence (e.g., a single image expanded both vertically and horizontally). In a further experiment, we found that this variance adaptation can also be observed behaviorally. Our results suggest that adaptation calibrates face perception not only for the average characteristics of the faces we experience but also for the gamut of faces to which we are exposed.

Sectoral and growth rate control on elemental uptake by individual calcite crystals

Heterogeneous distribution of trace elements (impurities) within individual calcite crystals is a phenomenon commonly observed in natural and laboratory systems. Changes in thermodynamic intensive parameters (mostly chemical potential and temperature) cannot always explain the inhomogeneous impurity patterns in calcite crystals and it has been suggested that growth rate and crystallographic orientation may exert strong effects on elemental incorporation into calcite. In addition, there are a number of experimental studies on micro-scale element (E) distribution between non-equivalent pairs of calcite vicinal faces (known as sectoral zoning); however, the variability of partition coefficients (e.g., KE = (E/Ca)calcite/(E/Ca)fluid) within individual crystals remains undetermined.In this study, we have extended the work on elemental distribution between crystal sectors to evaluation of partition coefficients of trace and minor elements (Li, B, Mg, and Sr) in calcite crystal faces (10–14) and (01−12), whose growth rates were assessed. Growth entrapment model (GEM) and lattice strain theory were applied to explain KE heterogeneity by varying near-surface diffusivity of Mg and Sr and by varying surface enrichment factor for Li, B, Mg, and Sr. Decoupling of sectoral and growth rate effects reveals that sectoral zoning plays a key role in elemental distribution. More specifically, KLi and KB vary by more than one order of magnitude and KMg varies by a factor of two within individual crystal faces. Strontium sectoral distribution is different from those of Li, B, and Mg and KSr varies by up to a factor of two. These behaviors likely reflect different mechanisms of incorporation of Li, B, Mg, and Sr into calcite.

Mask exposure during COVID-19 changes emotional face processing.

Faces are one of the key ways that we obtain social information about others. They allow people to identify individuals, understand conversational cues, and make judgements about others’ mental states. When the COVID-19 pandemic hit the United States, widespread mask-wearing practices were implemented, causing a shift in the way Americans typically interact. This introduction of masks into social exchanges posed a potential challenge—how would people make these important inferences about others when a large source of information was no longer available? We conducted two studies that investigated the impact of mask exposure on emotion perception. In particular, we measured how participants used facial landmarks (visual cues) and the expressed valence and arousal (affective cues), to make similarity judgements about pairs of emotion faces. Study 1 found that in August 2020, participants with higher levels of mask exposure used cues from the eyes to a greater extent when judging emotion similarity than participants with less mask exposure. Study 2 measured participants’ emotion perception in both April and September 2020 –before and after widespread mask adoption—in the same group of participants to examine changes in the use of facial cues over time. Results revealed an overall increase in the use of visual cues from April to September. Further, as mask exposure increased, people with the most social interaction showed the largest increase in the use of visual facial cues. These results provide evidence that a shift has occurred in how people process faces such that the more people are interacting with others that are wearing masks, the more they have learned to focus on visual cues from the eye area of the face.

The Role of Emotional Content and Perceptual Saliency During the Programming of Saccades Toward Faces

Previous studies have shown that the human visual system can detect a face and elicit a saccadic eye movement toward it very efficiently compared to other categories of visual stimuli. In the first experiment, we tested the influence of facial expressions on fast face detection using a saccadic choice task. Face-vehicle pairs were simultaneously presented and participants were asked to saccade toward the target (the face or the vehicle). We observed that saccades toward faces were initiated faster, and more often in the correct direction, than saccades toward vehicles, regardless of the facial expressions (happy, fearful, or neutral). We also observed that saccade endpoints on face images were lower when the face was happy and higher when it was neutral. In the second experiment, we explicitly tested the detection of facial expressions. We used a saccadic choice task with emotional-neutral pairs of faces and participants were asked to saccade toward the emotional (happy or fearful) or the neutral face. Participants were faster when they were asked to saccade toward the emotional face. They also made fewer errors, especially when the emotional face was happy. Using computational modeling, we showed that this happy face advantage can, at least partly, be explained by perceptual factors. Also, saccade endpoints were lower when the target was happy than when it was fearful. Overall, we suggest that there is no automatic prioritization of emotional faces, at least for saccades with short latencies, but that salient local face features can automatically attract attention.

Stability of neural encoding moderates the contribution of sleep and repeated testing to memory consolidation

There is evidence suggesting that online consolidation during retrieval-mediated learning interacts with offline consolidation during subsequent sleep to transform memory. Here we investigate whether this interaction persists when retrieval-mediated learning follows post-training sleep and whether the direction of this interaction is conditioned by the quality of encoding resulting from manipulation of the amount of sleep on the previous night. The quality of encoding was determined by computing the degree of similarity between EEG-activity patterns across restudy of face pairs in two groups of young participants, one who slept the last 4 h of the pre-training night, and another who slept 8 h. The offline consolidation was assessed by computing the degree of coupling between slow oscillations (SOs) and spindles (SPs) during post-training sleep, while the online consolidation was evaluated by determining the degree of similarity between EEG-activity patterns recorded during the study phase and during repeated recognition of either the same face pair (i.e., specific similarity) or face pairs sharing sex and profession (i.e., categorical similarity) to evaluate differentiation and generalization, respectively. The study and recognition phases were separated by a night of normal sleep duration. Mixed-effects models revealed that the stability of neural encoding moderated the relationship between sleep- and retrieval-mediated consolidation processes over left frontal regions. For memories showing lower encoding stability, the enhanced SO-SP coupling was associated with increased reinstatement of category-specific encoding-related activity at the expense of content-specific activity, whilst the opposite occurred for memories showing greater encoding stability. Overall, these results suggest that offline consolidation during post-training sleep interacts with online consolidation during retrieval the next day to favor the reorganization of memory contents, by increasing specificity of stronger memories and generalization of the weaker ones.

Testing Mate Choice Hypotheses in a Transitional Small Scale Population

ObjectiveTests of theories of mate choice often rely on data gathered in White, industrialised samples and this is especially the case for studies of facial attraction. Our understanding of preferences for sexual dimorphism is currently in flux and a number of hypotheses require testing in more diverse participant samples. The current study uses opportunistically gathered facial dimorphism preference data from 271 participants in rural Nicaragua, and 40 from the national capital Managua. We assess pre-registered hypotheses drawn from sexual selection theory, and from more recent approaches which consider the impacts of economic development and cultural ‘modernisation’ on mate preferences.MethodsParticipants verbally reported demographic data, and indicated preferences for five male and five female pairs of faces manipulated to differ in sexually dimorphic facial structure based on a sample of Salvadoran individuals.ResultsWhile urban participants showed a preference for more feminine female faces, this preference was not evident in the rural participants. Neither urban nor rural participants showed any directional preference for masculinised/feminised male faces. Furthermore, there was no support for any other pre-registered hypothesis.ConclusionsOur results are consistent with previous studies showing no interest in facial dimorphism in less globally-acculturated, or market integrated, populations. Together, this suggests that while facial dimorphism may be subject to systematically varying preferences amongst some low-fertility, industrialised populations, it is not a feature which is likely to have been important in ancestral populations. We call for further work attempting to replicate well known mate choice phenomena in more diverse samples.

Oxytocin Modulates Neural Individuation/Categorization Processing of Faces in Early Face-Selective Areas.

Oxytocin (OT) is known as a neuropeptide that promotes social adaptation. Individuating racial in-group members and viewing racial out-groups in categories is an adaptive strategy that evolved to aid effective social interaction. Nevertheless, whether OT modulates the neural individuation/categorization processing of racial in-group and out-group faces remain unknown. After intranasal OT or placebo administration, 46 male participants (OT: 24, placebo: 22) were presented with face pairs with the same or different identities or races in rapid succession. The neural repetition suppression (RS) effects to identity and race were measured using functional magnetic resonance imaging (fMRI) as indices of individuation/categorization face-processing. The results showed that while OT increased the RS effect to race, it decreased the RS effect to identity in the right fusiform face area. As for the left occipital face area, OT enlarged the differential RS effects to identities of in-group and out-group faces. Additionally, OT modulated the association of interdependence self-construal and the RS effects on identity and race. These findings bring to light preliminary evidence that OT can regulate neuronal specificity of identity and race in early face-selective regions and benefit adaptive individuation/categorization face-processing.

Aging, pattern separation, and categorical perception of faces

Categorical perception (CP) is the phenomenon by which observers view linear changes that occur across a continuum as distinct categories. Although categorical perception is a perceptual phenomenon, it may be subserved by mnemonic processes such as pattern separation. To examine this hypothesis, following standard CP tasks, we assessed younger and older participants’ abilities to identify and discriminate between members of pairs of famous or non-famous faces. We hypothesized that if CP is dependent upon neural pattern separation, which declines with aging, discrimination ability as indexed by CP would be compromised in older adults, as was found in our study. Since familiarity promotes pattern separation, CP should be enhanced for famous, as compared to non-famous faces, even in older adults. We found that all participants benefited from familiarity, but younger adults outperformed older adults overall. We next examined the effects of face inversion on CP for both famous and non-famous faces. If pattern separation, and CP, is determined solely by the similarity across physical features, then CP should be similar for upright and inverted faces since these features are perceptually invariant across orientation. If, however, pattern separation, and CP, depends on how stimuli are represented, then orientation may matter as upright and inverted faces are represented holistically or part-based, respectively. We found that inversion disrupted CP in younger adults whereas older adults performed similarly across both conditions, suggesting that face-representation is more part-based in older adults.

Component-based metric learning for fully automatic kinship verification

This paper introduces a fully automatic method for kinship verification from facial images. Recently, a number of methods have been proposed to verify kinship from facial images, however, most of these methods are needed to exactly align face images before feature extraction in a manual manner. Unlike these methods, our method does not depend on face alignment. Firstly, we localize several facial feature points by utilizing a facial feature detector to extract SIFT descriptor around each feature point of a face image. Lastly, two ways, feature combination and distance metric learning, are used to verify the kinship of a pair of face images. For feature combination, three simple strategies of feature combination and support vector machine classifier are used for kinship verification. For metric learning, we propose a component-based metric learning (CML) method to measure the distance of each face pair, which jointly learns multiple local distance metrics, and one specific distance metric for each facial feature point. Experimental results show the effectiveness of our proposed approach on two popular kinship datasets.

On the topology of the groups of type [formula omitted

A group G admitting a cyclic presentation P=Pn(w) determines E=G⋊θCn called the shift extension of G. A spherical picture over a presentation for E lifts to one over P, and here it is shown how this picture determines a Heegaard diagram for a 3-manifold inducing P analogous to how spherical diagrams are associated with face pairings. The method is demonstrated with the groups of type Z, an infinite family of cyclically presented groups whose shift extensions split over centrally extended triangle groups. The resulting manifolds are examples of Dunwoody manifolds and break down into two subfamilies, one of which includes and extends earlier results of Cavicchioli, Repovs, and Spaggiari [12], for example containing certain Brieskorn [26] and all Sieradski manifolds [31]. Topological consequences of the solution to the finiteness and fixed point problems for groups of type Z are also considered.

Electrophysiological correlates of unconscious processes of race

The study aimed to examine the neural mechanisms underlying implicit other-race face processing by the use of the masked and unmasked priming manipulation. Two types of prime-target pairs were presented while recording Event-related potentials (ERPs): Same face pairs (prime-target were identical faces), and Different face pairs (prime-target were different faces). Prime-target pairs were half Asian (other-race) and half Caucasian (own-race) faces. The face stimuli on each pair were of the same gender and race. Participants (all Caucasians) had to decide whether the target was a male or a female face (gender task). The prime face could be unmasked or masked. On the behavioral side, our findings showed a race effect, that is slower reaction times (RTs) for other-race than own-race face stimuli, regardless of masking. On the ERPs side, our data showed a race effect across all components analyzed (P100, N100, N200, P300), under both the unmasked and masked manipulations. Besides, we found, in the unmasked condition, a priming effect as a function of race on the N100, N200, and P300 components; but, interestingly, in the masked condition, only on the P300. Overall, our findings provide evidence that race information is available very early in the brain and can strongly activate and influence people’s behaviors even without conscious awareness.

Multi-scale features based interpersonal relation recognition using higher-order graph neural network

Interpersonal relation plays an essential role to gain understandings on how people interact with each other. In computer vision, interpersonal relations provide vital information to interpret people’s behaviors. However, the existing research has either omitted the interaction information between subjects or the structural information in the images. In this paper, we propose a new architecture to reason interpersonal relations based on higher-order graph networks and multi-scale features. First, we extract features of the whole images, the facial features, and the union region of face pairs. Apart from the pixel-wise features, we also consider the positional features of face-to-face pairs and the spatial scene cues. Higher-order Graph Neural Networks (GNNs) were employed to map out the interpersonal relations based on the feature extracted. Experimental results show that the proposed Higher-order Graph Neural Networks with multi-scale features can effectively recognize the social relations in images with over 5% improvement in absolute balanced accuracy compared with the state-of-the-art work.

Ring-Regularized Cosine Similarity Learning for Fine-Grained Face Verification

Face verification aims to determine whether a pair of face images belong to the same person. Different from the traditional face verification, the negative sample pairs in fine-grained face verification are composed of similar face images, e.g., facial images of twins, which makes it still very challenging. In this paper, we investigate the fine-grained face verification problem via metric learning techniques, and propose a ring-regularized cosine similarity learning (RRCSL) method to distinguish the negative face pairs. The proposed RRCSL method seeks a linear transformation to enlarge the cosine similarity of intra-class and reduce the cosine similarity of inter-class as much as possible, and adaptively learns the norm of samples to the scaled circle by exploiting the ring regularization term simultaneously. Experimental results on three face datasets demonstrate the effectiveness of RRCSL for fine-grained face verification.

A note on polychromatic colorings of plane graphs

Let [Formula: see text] be a plane graph with a set of faces [Formula: see text] and [Formula: see text] be a (not necessarily proper) vertex [Formula: see text]-coloring. [Formula: see text] is called polychromatic if all [Formula: see text] colors appear on the vertices of its boundary for each face (also the outer-face) [Formula: see text]. The polychromatic number of [Formula: see text] is the largest number of colors [Formula: see text] such that [Formula: see text] admits a polychromatic [Formula: see text]-coloring. In the paper, we consider a class of plane graphs [Formula: see text] with minimum face size [Formula: see text], in each of which every pair of faces have at most [Formula: see text] common incident vertices, and show that the polychromatic number for each [Formula: see text] is at least [Formula: see text]. When [Formula: see text], the result improves a known lower bound.