Face Stimuli Research Articles

Determinants of shared and idiosyncratic contributions to judgments of faces.

Recent work has shown that the idiosyncrasies of the observer can contribute more to the variance of social judgments of faces than the features of the faces. However, it is unclear what conditions determine the relative contributions of shared and idiosyncratic variance. Here, we examine two conditions: type of judgment and diversity of face stimuli. First, we show that for simpler, directly observable judgments that are consistent across observers (e.g., masculinity) shared exceeds idiosyncratic variance, whereas for more complex and less directly observable judgments (e.g., trustworthiness), idiosyncratic exceeds shared variance. Second, we show that judgments of more diverse face images increase the amount of shared variance. Finally, using machine-learning methods, we examine how stimulus (e.g., incidental emotion resemblance, skin luminosity) and observer variables (e.g., race, age) contribute to shared and idiosyncratic variance of judgments. Overall, our results indicate that an observer's age is the most consistent and best predictor of idiosyncratic variance contributions to face judgments measured in the current research. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A Possible Neural Basis for Attentional Capture of Faces Revealed by Functional Magnetic Resonance Imaging and Causal Pharmacological Inactivation in Macaques

Abstract In primates, the presence of a face in a visual scene captures attention and rapidly directs the observer's gaze to the face, even when the face is not relevant to the task at hand. Here, we explored a neural circuit that might potentially play a causal role in this powerful behavior. In our previous research, two monkeys received microinfusions of muscimol, a γ-aminobutyric acid type A (GABAA)-receptor agonist, or saline (as a control condition) in separate sessions into individual or pairs of four inferotemporal face patches (middle and anterior lateral and fundal), as identified by an initial localizer experiment. Then, using fMRI, we measured the impact of each inactivation condition on responses in the other face patches relative to the control condition. In this study, we used the same method and measured the impact of each inactivation condition on responses in the FEF and the lateral intraparietal area, two regions associated with attentional processing, while face and nonface object stimuli were viewed. Our results revealed potential relationships between inferotemporal face patches and these two attention-related regions: The inactivation of the middle lateral and anterior fundal face patches had a pronounced impact on FEF, whereas the inactivation of the middle and anterior lateral face patches had a noticeable influence on LIP. Together, these initial exploratory findings document a circuit that potentially underlies the attentional capture of faces. Confirmation of the role of this circuit remains to be accomplished in the context of a paradigm that explicitly tests the attentional capture of faces.

Association of neuroimaging measures with facial emotional processing in healthy adults: a task fMRI study.

Investigating the neural processing of emotion-related neural circuits underlying emotional facial processing may help in understanding mental disorders. We used two subscales of the Toronto Alexithymia Scale to assess the emotional cognitive of 25 healthy participants. A higher score indicates greater difficulty in emotional perception. In addition, participants completed a n-back task during functional magnetic resonance imaging. Psychophysiological interaction analysis was used to explore the functional connectivity (FC) of neural circuits. Next, we used elastic-net regression analysis for feature selection and conducted correlation analysis between the neuroimaging measures and questionnaire scores. Following a 3-fold cross-validation, 5 neuroimaging measures emerged as significant features. Results of correlation analysis demonstrated that participants with higher TAS scores exhibited increased FC between the amygdala and occipital face area (OFA) during facial stimulus processing, but decreased connectivity during emotional processing. These findings suggested that individuals with poor emotional recognition exhibited increased connectivity among face-related brain regions during facial processing. However, during emotional processing, decreasing neural synchronization among neural circuits involved in emotional processing affects facial expression processing. These findings suggest potential neural marker related to subjective emotional perception, which may contribute to the diagnosis and treatment of emotional dysregulation in individuals with psychiatric conditions.

Gesture Imitation Performance and Visual Exploration in Young Children with Autism Spectrum Disorder.

Most studies in children with autism spectrum disorder (ASD) support a decrement in imitation performance. Factors related to visual attention and motor execution have been proposed to explain this phenomenon in ASD. However, studies investigated imitation with various methods, leading to inconsistent findings. Here, we examine imitation performance related to visual attention and motor execution. We focused on the imitation of meaningful and meaningless gestures, consistently reported as more affected than imitation of actions with objects in ASD. The imitation eye-tracking task consisted of a video of an actor demonstrating gestures and prompting children to imitate them. The demonstrations comprised meaningful and meaningless hand gestures, and meaningless facial gestures. We measured the fixation duration to the actor' face during child-directed speech and gesture demonstrations. We video-recorded children to assess their performance. Our sample comprised 100 participants (3.55 ± 1.11years old), including 84 children with ASD. The ASD and typically developing groups displayed the same visual attention toward gesture demonstrations, although children with ASD spent less time looking at the face during facial stimuli. Visual exploration of actors' gestures did not influence imitation performance. Imitation of meaningful gestures was associated with less severe autistic symptoms, whereas imitation of meaningless gestures was correlated with higher non-verbal cognitive and fine-motor skills. These findings contribute to a better understanding of the complexity of imitation. We delineated the distinct nature of imitation of meaningful and meaningless gestures in children with ASD. We discuss clinical implications in relation to assessment and intervention programs.

Oxytocin moderates fMRI connectivity and response to implicit threat processing in cocaine use disorder

Stressful social experiences play an important role in increasing vulnerability to substance use, including cocaine. Oxytocin (OXT), known for its anxiolytic properties and involvement in social functioning, has been suggested as a potential therapeutic for cocaine use disorder (CUD). However, limited research has explored OXT’s influence on social stress in CUD, and no study has examined its effects on neural response to subconscious (implicit) social threat cues in this population. To address this gap, the present study administered intranasal OXT (24 IU) or placebo (PBO) to participants with CUD (CUD+, N = 76) or without CUD (CUD-, N = 61) in a randomized parallel design. Participants then completed a functional magnetic resonance imaging (fMRI) task involving briefly presented facial fear and anger (i.e., threat) cues, followed by neutral face stimuli. Whole-brain activation and amygdala functional connectivity (using psychophysiological interaction modeling) were examined in response to the facial threat cues. OXT reduced activation in the thalamus and pontine reticular formation in response to fear cues, and in the supplementary motor area for both fear and anger cues, regardless of CUD status. Additionally, under PBO, amygdala-medial prefrontal cortex connectivity to fear stimuli was negative for the CUD+ group, but under OXT, this coupling was positive, similar to the positive coupling observed for the CUD- group under both PBO and OXT administration. The finding of OXT-mediated reversal of amygdala-prefrontal coupling was specific to CUD+ and suggests that OXT alters circuitry related to threat surveillance and implicit emotion regulation in CUD. However, additional research is needed to determine whether these alterations due to OXT have clinical significance in CUD.

Distinct visual processing networks for foveal and peripheral visual fields

Foveal and peripheral vision are two distinct modes of visual processing essential for navigating the world. However, it remains unclear if they engage different neural mechanisms and circuits within the visual attentional system. Here, we trained macaques to perform a free-gaze visual search task using natural face and object stimuli and recorded a large number of 14588 visually responsive units from a broadly distributed network of brain regions involved in visual attentional processing. Foveal and peripheral units had substantially different proportions across brain regions and exhibited systematic differences in encoding visual information and visual attention. The spike-local field potential (LFP) coherence of foveal units was more extensively modulated by both attention and visual selectivity, thus indicating differential engagement of the attention and visual coding network compared to peripheral units. Furthermore, we delineated the interaction and coordination between foveal and peripheral processing for spatial attention and saccade selection. Together, the systematic differences between foveal and peripheral processing provide valuable insights into how the brain processes and integrates visual information from different regions of the visual field.

Decoding the temporal structures and interactions of multiple face dimensions using optically pumped magnetometer magnetoencephalography (OPM-MEG).

Humans possess a remarkable ability to rapidly access diverse information from others' faces with just a brief glance, which is crucial for intricate social interactions. While previous studies using event-related potentials/fields have explored various face dimensions during this process, the interplay between these dimensions remains unclear. Here, by applying multivariate decoding analysis to neural signals recorded with optically pumped magnetometer magnetoencephalography (OPM-MEG), we systematically investigated the temporal interactions between invariant and variable aspects of face stimuli, including race, gender, age and expression. First, our analysis revealed unique temporal structures for each face dimension with high test-retest reliability. Notably, expression and race exhibited a dominant and stably maintained temporal structure according to temporal generalization analysis. Further exploration into the mutual interactions among face dimensions uncovered age effects on gender and race, as well as expression effects on race, during the early stage (around 200-300 ms post face presentation). Additionally, we observed a relatively late effect of race on gender representation, peaking around 350 ms after stimulus onset. Taken together, our findings provide novel insights into the neural dynamics underlying the multi-dimensional aspects of face perception and illuminate the promising future of utilizing OPM-MEG for exploring higher-level human cognition.Significance statement In everyday social activities, people can quickly interpret a wide range of information from others' faces. Although converging evidence has shed light upon the neural substrates underpinning the perception of invariant and variable aspects of faces, such as race, gender, age and expression, it is still not fully understood how the information of one face dimension alters the perception of another. In this study, we utilized multivariate decoding analysis on neural activity captured through OPM-MEG during face perception. Our approach enabled a comprehensive exploration of the temporal interactions among different face dimensions, providing an improved understanding of the temporally structured neural dynamics that support the multi-dimensional face perception in the human brain.

Neural Representations of Emotions in Visual, Auditory, and Modality-Independent Regions Reflect Idiosyncratic Conceptual Knowledge.

Growing evidence suggests that conceptual knowledge influences emotion perception, yet the neural mechanisms underlying this effect are not fully understood. Recent studies have shown that brain representations of facial emotion categories in visual-perceptual areas are predicted by conceptual knowledge, but it remains to be seen if auditory regions are similarly affected. Moreover, it is not fully clear whether these conceptual influences operate at a modality-independent level. To address these questions, we conducted a functional magnetic resonance imaging study presenting participants with both facial and vocal emotional stimuli. This dual-modality approach allowed us to investigate effects on both modality-specific and modality-independent brain regions. Using univariate and representational similarity analyses, we found that brain representations in both visual (middle and lateral occipital cortices) and auditory (superior temporal gyrus) regions were predicted by conceptual understanding of emotions for faces and voices, respectively. Additionally, we discovered that conceptual knowledge also influenced supra-modal representations in the superior temporal sulcus. Dynamic causal modeling revealed a brain network showing both bottom-up and top-down flows, suggesting a complex interplay of modality-specific and modality-independent regions in emotional processing. These findings collectively indicate that the neural representations of emotions in both sensory-perceptual and modality-independent regions are likely shaped by each individual's conceptual knowledge.

Facial basis of stereotypes: Judgements of warmth and competence based on cross-group typicality/distinctiveness of faces.

Human migration is an increasingly common phenomenon and migrants are at risk of disadvantageous treatment. We reasoned that migrants may receive differential treatment by locals based on the closeness of their facial features to the host average. Residents of Türkiye, the country with the largest number of refugees currently, served as participants. Because many of these refugees are of Arabic origin, we created target facial stimuli varying along the axis connecting Turkish and Arabic morphological prototypes (excluding skin colour) computed using geometric morphometrics and available databases. Participants made judgements of two universal dimensions of social perception-warmth and competence-on these faces. We predicted that participants judging faces manipulated towards the Turkish average would provide higher warmth and competence ratings compared to judging the same faces manipulated towards the Arabic average. Bayesian statistical tools were employed to estimate parameter values in multilevel models with intercorrelated varying effects. The findings did not support the prediction and revealed raters (as well as target faces) to be an important source of variation in social judgements. In the absence of simple cues (e.g. skin colour, group labels), the effect of facial morphology on social judgements may be much more complex than previously assumed.

Infant sensitivity to mismatches between same/other-race faces and native/non-native speech

Perceptual narrowing typically occurs around 6 months of age, and drastically changes an infant’s perception of stimuli such as faces or spoken language according to the frequency with which the infant encounters them. It has already been well established that perceptual narrowing improves the sensitivity of infants to frequently encountered stimuli such as same-race faces and their native language while reducing their sensitivity to other-race faces and non-native languages. However, the effect of perceptual narrowing on the combined perception of face and language stimuli is not well understood. Therefore, to investigate the changes in the sensitivity of infants to matches and mismatches between faces and speech which might occur in the course of perceptual narrowing, we tested 3- and 9-month-old German infants using German faces and German spoken sentences which would be familiar to the infants, as well as completely unfamiliar Chinese faces and French spoken sentences. The infants were tested using an intermodal association paradigm, whereby each infant saw sequences of German or Chinese faces, interspersed with German or French spoken sentences. We analyzed the total looking time of infants in conditions where the faces and spoken sentences were congruent (either both familiar, or both unfamiliar), versus incongruent conditions where only the faces or only the sentences were familiar. We found that while the 9-month-olds looked for similar durations in congruent versus incongruent conditions, the 3-month-olds looked significantly longer during congruent conditions versus incongruent conditions, indicating a greater attentiveness to face-speech matches and mismatches prior to the onset of perceptual narrowing.

The self can be associated with novel faces of in-group and out-group members: A cross-cultural study

The self can be associated with arbitrary images, such as geometric figures or unknown faces. By adopting a cross-cultural perspective, we explored in two experiments whether the self can be associated with faces of unknown people from different ethnic groups. In Experiment 1, Asian Japanese participants completed a perceptual matching task, associating Asian or White faces with themselves. The same task was used in Experiment 2 with White Italians. Both experiments showed a reliable association between the self and facial stimuli. Importantly, this association was similar for both Asian and White faces. Additionally, no correlations were found between the strength of this association and an index of implicit bias towards Asian and White individuals. These results suggest that the self is malleable and can incorporate social stimuli from different groups.

Generative neural networks for experimental manipulation: Examining dominance‐trustworthiness face impressions with data‐efficient models

AbstractAn important development in the study of face impressions was the introduction of dominance and trustworthiness as the primary and potentially orthogonal traits judged from faces. We test competing predictions of recent accounts that address evidence against the independence of these judgements. To this end we develop a version of recent ‘deep models of face impressions’ better suited for data‐efficient experimental manipulation. In Study 1 (N = 128) we build impression models using 15 times less ratings per dimension than previously assumed necessary. In Study 2 (N = 234) we show how our method can precisely manipulate dominance and trustworthiness impressions of face photographs and observe how the effects' pattern of the cues of one trait on impressions of the other differs from previous accounts. We propose an altered account that stresses how a successful execution of the two judgements' functional roles requires impressions of trustworthiness and dominance to be based on cues of both traits. Finally we show our manipulation resulted in larger effect sizes using a broader array of features than previous methods. Our approach lets researchers manipulate face stimuli for various face perception studies and investigate new dimensions with minimal data collection.

Spike Count Analysis for MultiPlexing Inference (SCAMPI).

Understanding how neurons encode multiple simultaneous stimuli is a fundamental question in neuroscience. We have previously introduced a novel theory of stochastic encoding patterns wherein a neuron's spiking activity dynamically switches among its constituent single-stimulus activity patterns when presented with multiple stimuli (Groh et al., 2024). Here, we present an enhanced, comprehensive statistical testing framework for such " multiplexing " or " code juggling ". Our new approach evaluates whether dual-stimulus responses can be accounted for as mixtures of Poissons either anchored to or bounded by single-stimulus benchmarks. Our enhanced framework improves upon previous methods in two key ways. First, it introduces a stronger set of foils for multiplexing, including an "overreaching" category that captures overdispersed activity patterns unrelated to the single-stimulus benchmarks, reducing false detection of multiplexing/code-juggling. Second, it detects faster fluctuations - i.e. at sub-trial timescales - that would have been overlooked before. We utilize a Bayesian inference framework, considering the hypothesis with the highest posterior probability as the winner, and employ predictive recursion marginal likelihood method for the involving nonparametric density estimation. Reanalysis of previous findings confirms the general observation of "code juggling" and indicates that such juggling may well occur on faster timescales than previously suggested. We further confirm that juggling is more prevalent in (a) the inferotemporal face patch system for combinations of face stimuli than for faces and non-face objects; and (b) the primary visual cortex for distinct vs fused objects.

Social anxiety prediction based on ERP features: A deep learning approach

BackgroundSocial Anxiety Disorder is traditionally diagnosed using subjective scales that may lack accuracy. Recently, EEG technology has gained importance for anxiety detection due to its ability to capture stable and objective neurophysiological activities. However, existing methods mainly focus on extracting EEG features during resting states, with limited use of psychologically features like Event-Related Potential (ERP) in task-related states for anxiety detection in deep learning frameworks. MethodsWe collected EEG data from 63 participants exposed to four facial expressions and extracted task-relevant features. Using the EEGNet model, we predicted social anxiety and evaluated its performance using metrics such as accuracy, F1 score, sensitivity, and specificity. We compared EEGNet's performance with Deep Convolutional Neural Network (DeepConvNet), ShallowConvNet, Bi-directional Long Short-Term Memory (BiLSTM), and SVM. To assess the generalizability of the results, we carried out the same procedure on our prior dataset. ResultsEEGNet outperformed other models, achieving 99.16 % accuracy with Late Positive Potential (LPP). ERP components yielded higher accuracy than time-domain and frequency-domain features for social anxiety recognition. Accuracy was better for neutral and negative facial stimuli. Consistency across two datasets indicates stability of findings. LimitationsDue to limited publicly available task-state datasets, only our own were used. Future studies could assess generalizability on larger datasets from different sources. ConclusionsWe conducted the first test of ERP features in anxiety recognition tasks. Results show ERP features have greater potential in social anxiety recognition, with LPP exhibiting high stability and accuracy. Outcomes indicate recognizing social anxiety with negative or neutral facial stimuli is more useful.

Age differences in functional connectivity track dedifferentiation of category representations.

With advancing age, the distinctiveness of neural representations of information declines. While the finding of this so-called 'age-related neural dedifferentiation' in category-selective neural regions is well-described, the contribution of age-related changes in network organization to dedifferentiation is unknown. Here, we asked whether age differences in a) whole-brain network segregation (i.e., network dedifferentiation) and b) functional connectivity to category-selective neural regions are related to regional dedifferentiation of categorical representations. Younger and older adults viewed blocks of face and house stimuli in the fMRI scanner. We found an age-related decline in neural distinctiveness for faces in the fusiform gyrus (FG) and for houses in the parahippocampal gyrus (PHG). Functional connectivity analyses revealed age-related dedifferentiation of global network structure as well as age differences in connectivity between the FG and early visual cortices. Interindividual correlations demonstrated that regional distinctiveness was related to network segregation. Together, our findings suggest that dedifferentiation of categorical representations may be linked to age-related reorganization of functional networks.

Olfactory facilitation of visual categorization in the 4-month-old brain depends on visual demand.

To navigate their environment, infants rely on intersensory facilitation when unisensory perceptual demand is high, a principle known as inverse effectiveness. Given that this principle was mainly documented in the context of audiovisual stimulations, here we aim to determine whether it applies to olfactory-to-visual facilitation. We build on previous evidence that the mother's body odor facilitates face categorization in the 4-month-old brain, and investigate whether this effect depends on visual demand. Scalp electroencephalogram (EEG) was recorded in two groups of 4-month-old infants while they watched 6-Hz streams of visual stimuli with faces displayed every 6th stimulus to tag a face-selective response at 1Hz. We used variable natural stimuli in one group (Nat Group), while stimuli were simplified in the other group (Simp Group) to reduce perceptual categorization demand. During visual stimulation, infants were alternatively exposed to their mother's versus a baseline odor. For both groups, we found an occipito-temporal face-selective response, but with a larger amplitude for the simplified stimuli, reflecting less demanding visual categorization. Importantly, the mother's body odor enhances the response to natural, but not to simplified, face stimuli, indicating that maternal odor improves face categorization when it is most demanding for the 4-month-old brain. Overall, this study demonstrates that the inverse effectiveness of intersensory facilitation applies to the sense of smell during early perceptual development. RESEARCH HIGHLIGHTS: Intersensory facilitation is a function of unisensory perceptual demand in infants (inverse effectiveness). This inverse relation between multisensory and unisensory perception has been mainly documented using audiovisual stimulations. Here we show that olfactory-to-visual facilitation depends on visual demand in 4-month-old infants. The inverse effectiveness of intersensory facilitation during early perceptual development applies to the sense of smell.

Social face processing in chronic severe traumatic brain injury: Altered decoding of emotions and mental states but preserved gaze cueing of attention

The processing of social information transmitted by facial stimuli is altered in individuals with traumatic brain injury (TBI). This study investigated whether these alterations also affect the mechanisms underlying the orienting of visual attention in response to eye-gaze signals. TBI patients and a control group of healthy individuals matched on relevant criteria completed a spatial cueing task. In this task, a lateral visual target was presented along with a task-irrelevant face, with the gaze averted to the left or right. Arrows pointing towards the left or right were also used as non-social control stimuli. Social cognition abilities were further investigated through tests based on decoding emotional expressions and mental states conveyed by facial stimuli. The decoding of emotions and mental states was worse in the TBI group than in the control group. However, both groups demonstrated reliable and comparable orienting of attention to both eye-gaze and arrow stimuli. Despite impairments in certain aspects of social face processing among TBI patients, gaze cueing of attention appears to be preserved in this neuropsychological population.

Pupil contagion variation with gaze, arousal, and autistic traits

Pupillary contagion occurs when one’s pupil size unconsciously adapts to the pupil size of an observed individual and is presumed to reflect the transfer of arousal. Importantly, when estimating pupil contagion, low level stimuli properties need to be controlled for, to ensure that observations of pupillary changes are due to internal change in arousal rather than the external differences between stimuli. Here, naturalistic images of children’s faces depicting either small or large pupils were presented to a group of children and adolescents with a wide range of autistic traits, a third of whom had been diagnosed with autism. We examined the extent to which pupillary contagion reflects autonomic nervous system reaction through pupil size change, heart rate and skin conductance response. Our second aim was to determine the association between arousal reaction to stimuli and degree of autistic traits. Results show that pupil contagion and concomitant heart rate change, but not skin conductance change, was evident when gaze was restricted to the eye region of face stimuli. A positive association was also observed between pupillary contagion and autistic traits when participants’ gaze was constrained to the eye region. Findings add to a broader understanding of the mechanisms underlying pupillary contagion and its association with autism.

Saccadic "inhibition" unveils the late influence of image content on oculomotor programming.

Image content is prioritized in the visual system. Faces are a paradigmatic example, receiving preferential processing along the visual pathway compared to other visual stimuli. Moreover, face prioritization manifests also in behavior. People tend to look at faces more frequently and for longer periods, and saccadic reaction times can be faster when targeting a face as opposed to a phase-scrambled control. However, it is currently not clear at which stage image content affects oculomotor planning and execution. It can be hypothesized that image content directly influences oculomotor signal generation. Alternatively, the image content could exert its influence on oculomotor planning and execution at a later stage, after the image has been processed. Here we aim to disentangle these two alternative hypotheses by measuring the frequency of saccades toward a visual target when the latter is followed by a visual transient in the central visual field. Behaviorally, this paradigm leads to a reduction in saccade frequency that happens about 90 ms after any visual transient event, also known as saccadic "inhibition". In two experiments, we measured occurrence of saccades in visually guided saccades as well as microsaccades during fixation, using face and noise-matched visual stimuli. We observed that while the reduction in saccade occurrence was similar for both stimulus types, face stimuli lead to a prolonged reduction in eye movements. Moreover, saccade kinematics were altered by both stimulus types, showing an amplitude reduction without change in peak velocity for the earliest saccades. Taken together, our experiments imply that face stimuli primarily affect the later stages of the behavioral phenomenon of saccadic "inhibition". We propose that while some stimulus features are processed at an early stage and can quickly influence eye movements, a delayed signal conveying image content information is necessary to further inhibit/delay activity in the oculomotor system to trigger eye movements.

Down-modulation of functional ventral striatum activation for emotional face stimuli in patients with insula damage.

Insula damage results in substantial impairments in facial emotion recognition. In particular, left hemispheric damage appears to be associated with poorer recognition of aversively rated facial expressions. Functional imaging can provide information on differences in the processing of these stimuli in patients with insula lesions when compared to healthy matched controls (HCs). We therefore investigated 17 patients with insula lesions in the chronic stage following stroke and 13 HCs using a passive-viewing task with pictures of facial expressions testing the blood oxygenation dependent (BOLD) effect in predefined regions of interest (ROIs). We expected a decrease in functional activation in an area modulating emotional response (left ventral striatum) but not in the facial recognition areas in the left inferior fusiform gyrus. Quantification of BOLD-response in ROIs but also voxel-based statistics confirmed this hypothesis. The voxel-based analysis demonstrated that the decrease in BOLD in the left ventral striatum was driven by left hemispheric damaged patients (n = 10). In our patient group, insula activation was strongly associated with the intensity rating of facial expressions. In conclusion, the combination of performance testing and functional imaging in patients following circumscribed brain damage is a challenging method for understanding emotion processing in the human brain.