Subtle Social Cues Research Articles

Adolescents with autism spectrum disorder exhibit intact physical causal inference but weak intention inference.

Individuals with autism spectrum disorder (ASD) show impaired mentalizing skills, specifically in understanding intentions. They have difficulty understanding social situations with multiple cues due to their limited ability to perceive subtle social contextual cues. Studies that used comic strips and the strange stories as intention attribution tests found that individuals with ASD exhibit a reduced ability in attributing intentions compared to inferring causal consequences. This study aims to use static photographs of social scenes taken in everyday settings to investigate the ability of adolescents with ASD to infer intentions in social contexts, and to explore how intention inference relates to working memory and basic attention, including sustained attention, selective attention, and divided attention. The results show that the physical causal inference ability of adolescents with ASD is comparable to typically developing adolescents, whereas intention inference is notably weaker. Furthermore, working memory predicts physical causal inference and divided attention predicts intention inference in ASD.

Microexpressions in digital humans: perceived affect, sincerity, and trustworthiness

Digital agents with human-like characteristics have become ubiquitous in our society and are increasingly relevant in commercial applications. While some of them closely resemble humans in appearance (e.g., digital humans), they still lack many subtle social cues that are important for interacting with humans. Among them are the so-called microexpressions— facial expressions that are short, subtle, and involuntary. We investigate to what extent microexpressions in digital humans influence people's perceptions and decision-making in order to inform the practices of digital human's design. Our two experiments applied four types of microexpressions based on emotion type (happiness and anger) and intensity (normal and extreme). This paper is among the first to design and evaluate microexpressions with different intensity levels in digital humans. In particular, we leverage the possibilities of digitally (re)designing humans and human perception. These possibilities are feasible only in a digital environment, where it is possible to explore various microexpressions beyond real human beings' physical capabilities.

Grounding behaviours with conversational interfaces: effects of embodiment and failures

Conversational interfaces that interact with humans need to continuously establish, maintain and repair common ground in task-oriented dialogues. Uncertainty, repairs and acknowledgements are expressed in user behaviour in the continuous efforts of the conversational partners to maintain mutual understanding. Users change their behaviour when interacting with systems in different forms of embodiment, which affects the abilities of these interfaces to observe users’ recurrent social signals. Additionally, humans are intellectually biased towards social activity when facing anthropomorphic agents or when presented with subtle social cues. Two studies are presented in this paper examining how humans interact in a referential communication task with wizarded interfaces in different forms of embodiment. In study 1 (N = 30), we test whether humans respond the same way to agents, in different forms of embodiment and social behaviour. In study 2 (N = 44), we replicate the same task and agents but introduce conversational failures disrupting the process of grounding. Findings indicate that it is not always favourable for agents to be anthropomorphised or to communicate with non-verbal cues, as human grounding behaviours change when embodiment and failures are manipulated.

Does Social Exclusion Improve Detection of Real and Fake Smiles? A Replication Study.

Research on social exclusion suggests an increased attention of excluded persons to subtle social cues. In one study (N = 32), published in Psychological Science, Bernstein et al. (2008) provided evidence for this idea by showing that participants in the social exclusion condition were better in correctly categorizing a target person’s smile as real or fake. Although highly cited, this finding has never been directly replicated. The present study aimed to fill that gap. 201 participants (79.1% female) were randomly assigned to a social exclusion, social inclusion or control condition. Next, participants watched 20 videos of smiling persons and rated whether they show a real or a fake smile. In line with the original study, results showed that participants in the exclusion condition performed better than in the control condition. However, the performance did not differ between the exclusion and inclusion condition—although the pattern was in the predicted direction. In sum, the findings of our study increase rather than decrease confidence in the validity of the investigated idea, but results point to a substantially smaller effect.

Eye contact enhances interpersonal motor resonance: comparing video stimuli to a live two-person action context.

Previous research has shown a link between eye contact and interpersonal motor resonance, indicating that the mirroring of observed movements is enhanced when accompanied with mutual eye contact between actor and observer. Here, we further explored the role of eye contact within a naturalistic two-person action context. Twenty-two participants observed simple hand movements combined with direct or averted gaze presented via a live model in a two-person setting or via video recordings, while transcranial magnetic stimulation was applied over the primary motor cortex (M1) to measure changes in M1 excitability. Skin conductance responses and gaze behavior were also measured to investigate the role of arousal and visual attention herein. Eye contact significantly enhanced excitability of the observer’s M1 during movement observation within a two-person setting. Notably, participants with higher social responsiveness (Social Communication subscale of the Social Responsiveness Scale) displayed a more pronounced modulation of M1 excitability by eye gaze. Gaze-related modulations in M1 excitability were, however, not associated with differences in visual attention or autonomic arousal. In summary, the current study highlights the effectiveness and feasibility of adopting paradigms with high ecological validity for studying the modulation of mirror system processes by subtle social cues, such as eye gaze.

Subtle social cues: Does another person’s body orientation direct our attention?

Subtle social cues: Does another person’s body orientation direct our attention?

Teachers’ nonverbal behaviors influence children’s stereotypic beliefs

The current research tested whether differences in teachers’ nonverbal behaviors influence children’s intergroup attitudes and stereotypic beliefs. In this study, 5- to 8-year-old participants (N = 96) were assigned to novel groups (marked by T-shirt color) and then viewed interactions between teachers and pairs of students who were also members of the novel groups. Across four interactions, the teacher directed positive nonverbal behaviors toward students from one group and directed negative nonverbal behaviors toward students from another group. After viewing the interactions, participants were presented with pairs of new students from the two novel groups and were asked three types of test questions. When participants were asked who was smarter, they selected new students from the group that had received positive nonverbal behaviors regardless of their own group membership. However, when asked who they would like to befriend, only participants who were assigned to the group that received positive behaviors selected ingroup members. On trials where participants were asked to select a partner on an academic task, participants’ selections did not differ from chance. This study shows that teachers’ nonverbal behaviors may be one source of children’s academic stereotypes, including negative stereotypes about groups to which they belong. Moreover, these findings highlight the importance of subtle social cues in guiding children’s beliefs about social groups.

Comparing the broad socio-cognitive profile of youth with Williams syndrome and 22q11.2 deletion syndrome.

Numerous studies have assessed the socio-cognitive profile in Williams syndrome (WS) and, independently, in 22q11.2 deletion syndrome (22q11.2DS). Yet, a cross-syndrome comparison of these abilities between individuals with these two syndromes with known social deficits has not been conducted. Eighty-two children participated in four study groups: WS (n=18), 22q112.DS (n=24), age-matched individuals with idiopathic developmental disability (IDD; n=20) and typically developing (TD) controls (n=20). Participants completed four socio-cognitive tests: facial emotion recognition, mental state attribution, differentiating real from apparent emotions and trait inference based on motives and actions-outcomes. The current findings demonstrate that children with WS were better in labelling happy faces compared with children with 22q11.2DS, partially reflecting their exaggerated social drive. In the false belief task, however, the WS and IDD groups performed poorly compared with the 22q11.2DS group, possibly due to their difficulty to interpret subtle social cues. When asked to identify the gap between real-negative vs. apparent-positive emotions, the 22q11.2DS group performed similarly to TD children but better than the WS group, possibly due to their anxious personality and their innate bias towards negatively valence cues. Finally, individuals with WS were more willing to become friends with a story character even when the character's motives were negative, reflecting their difficulty to avoid potentially harmful real-life situations. Overall, our multi-facet socio-cognitive battery uncovered strengths and weaknesses in social cognition that are syndrome-specific, shared among the genetic syndromes, or common to the three clinical groups compared with healthy controls. Our findings underscore the need to devise age-specific and condition-specific assessment tools and intervention programs towards improving these children's socio-cognitive deficits.

Detection of text-based social cues in adults with traumatic brain injury

ABSTRACTObjectives: Written text contains verbal immediacy cues—word form or grammatical cues that indicate positive attitude or liking towards an object, action, or person. We asked if adults with moderate-severe traumatic brain injury (TBI) would respond to these cues, given evidence of TBI-related social communication impairments.Methods: Sixty-nine adults with TBI and 74 healthy comparison (HC) peers read pairs of sentences containing different types of immediacy cues (e.g., speaker A said “these Canadians” vs. B said “those Canadians.”) and identified which speaker (A or B) had a more positive attitude towards the underlined entity (Task 1); and pairs of sentences comprised of a context sentence (e.g., Fred is asked, “Did you visit Joan and Sue?”) and a statement sentence (Fred says, “I visited Sue and Joan.”) and were asked to indicate how much Fred liked or disliked the underlined words (Task 2).Results: HC group scores were significantly higher on Task 1, indicating more sensitivity to cues. On Task 2, TBI and HC group ratings differed across cue types and immediacy types, and the TBI group appeared to have less sensitivity to these cues.Conclusions: Findings suggest that TBI-related impairments may reduce sensitivity to subtle social cues in text.

Do You Always Choose What You Like? Subtle Social Cues Increase Preference-Choice Consistency among Japanese But Not among Americans.

Previous research has suggested that stability of self-concept differs across cultures: in North American cultural contexts, people’s self-concept is stable across social contexts, whereas in Japan, different self-concepts are activated within specific social contexts. We examined the implications of this cultural difference for preference-choice consistency, which is people’s tendency to make choices that are consistent with their preferences. We found that Japanese were less likely than Americans to choose items that they liked the most, showing preference-choice inconsistency. We also investigated the conditions in which Japanese might exhibit greater preference-choice consistency. Consistent with research showing that in Japanese culture, the self is primarily conceptualized and activated by social contexts, we found that subtle social cues (e.g., schematic representations of human faces) increased preference-choice consistency among Japanese, but not among Americans. These findings highlight that choices do not reveal preferences to the same extent in all cultures, and that the extent to which choices reveal preferences depends on the social context.

Attention Orienting in Response to Non-conscious Hierarchical Arrows: Individuals with Higher Autistic Traits Differ in Their Global/Local Bias.

One aspect of the social communication impairments that characterize autism spectrum disorder (ASD) include reduced use of often subtle non-verbal social cues. People with ASD, and those with self-reported sub-threshold autistic traits, also show impairments in rapid visual processing of stimuli unrelated to social or emotional properties. Hence, this study sought to investigate whether perceptually non-conscious visual processing is related to autistic traits. A neurotypical sample of thirty young adults completed the Subthreshold Autism Trait Questionnaire and a Posner-like attention cueing task. Continuous Flash Suppression (CFS) was employed to render incongruous hierarchical arrow cues perceptually invisible prior to consciously presented targets. This was achieved via a 10 Hz masking stimulus presented to the dominant eye that suppressed information presented to the non-dominant eye. Non-conscious arrows consisted of local arrow elements pointing in one direction, and forming a global arrow shape pointing in the opposite direction. On each trial, the cue provided either a valid or invalid cue for the spatial location of the subsequent target, depending on which level (global or local) received privileged attention. A significant autism-trait group by global cue validity interaction indicated a difference in the extent of non-conscious local/global cueing between groups. Simple effect analyses revealed that whilst participants with lower autistic traits showed a global arrow cueing effect, those with higher autistic traits demonstrated a small local arrow cueing effect. These results suggest that non-conscious processing biases in local/global attention may be related to individual differences in autistic traits.

Conformity to implicit social pressure: the role of political identity

Although studies have shown that implicit social cues, such as images of watchful eyes, can elicit prosocial behavior, little research to date has examined individual differences in people’s susceptibility to such subtle social cues. For example, individuals with a conservative ideology typically value social conformity, obedience, and adherence to social norms more than liberals. To examine partisan heterogeneity, we analyze data from two large randomized field experiments on voting behavior. Results suggest that the impact of eyespots on voter mobilization is indeed likely driven by political identity, with a significant effect for Republicans but not Independents or Democrats. These findings are consistent with an emerging line of research revealing individual differences in how susceptible humans are to implicit social cues.

Distinct neural processes are engaged in the modulation of mimicry by social group-membership and emotional expressions

People often spontaneously engage in copying each other's postures and mannerisms, a phenomenon referred to as behavioral mimicry. Social psychology experiments indicate that mimicry denotes an implicit affiliative signal flexibly regulated in response to social requirements. Yet, the mediating processes and neural underpinnings of such regulation are largely unexplored. The present functional magnetic resonance imaging (fMRI) study examined mimicry regulation by combining an automatic imitation task with facial stimuli, varied on two social-affective dimensions: emotional expression (angry vs happy) and ethnic group membership (in- vs out-group). Behavioral data revealed increased mimicry when happy and when out-group faces were shown. Imaging results revealed that mimicry regulation in response to happy faces was associated with increased activation in the right temporo-parietal junction (TPJ), right dorsal premotor cortex (dPMC), and right superior parietal lobule (SPL). Mimicry regulation in response to out-group faces was related to increased activation in the left ventral premotor cortex (vPMC) and inferior parietal lobule (IPL), bilateral anterior insula, and mid-cingulate cortex (MCC). We suggest that mimicry in response to happy and to out-group faces is driven by distinct affiliative goals, and that mimicry regulation to attain these goals is mediated by distinct neuro-cognitive processes. Higher mimicry in response to happy faces seems to denote reciprocation of an affiliative signal. Higher mimicry in response to out-group faces, reflects an appeasement attempt towards an interaction partner perceived as threatening (an interpretation supported by implicit measures showing that out-group members are more strongly associated with threat). Our findings show that subtle social cues can result in the implicit regulation of mimicry. This regulation serves to achieve distinct affiliative goals, is mediated by different regulatory processes, and relies on distinct parts of an overarching network of task-related brain areas. Our findings shed new light on the neural mechanisms underlying the interplay between implicit action control and social cognition.

Understanding the Psycho-Physiological Implications of Interaction With a Virtual Reality-Based System in Adolescents With Autism: A Feasibility Study.

Individuals with Autism are characterized by deficits in socialization and communication. In recent years several assistive technologies, e.g., Virtual Reality (VR), have been investigated to address the socialization deficits in these individuals. Presently available VR-based systems address various aspects of social communication in an isolated manner and without monitoring one's affective state such as, anxiety. However, in conventional observation-based therapy, a therapist adjusts the intervention paradigm by monitoring one's anxiety level. But, often these individuals have an inherent inability to explicitly express their anxiety thereby inducing limitations on conventional techniques. Physiological signals being continuously available and not directly impacted by these communication difficulties can be alternatively used as markers of one's anxiety level. In our research we aim at designing a Virtual-reality bAsed Social-communication Task (VAST) system that can address the various aspects of social communication, e.g., social context, subtle social cues, emotional expression, etc., in a cumulative and structured way. In addition, we augment this with a capability to use one's physiological signals as markers of one's anxiety level. In our preliminary feasibility study we investigate the potential of VAST to cause variations in one's performance and anxiety level that can be mapped from one's physiological indices.

Perception of Social Cues of Danger in Autism Spectrum Disorders

Intuitive grasping of the meaning of subtle social cues is particularly affected in autism spectrum disorders (ASD). Despite their relevance in social communication, the effect of averted gaze in fearful faces in conveying a signal of environmental threat has not been investigated using real face stimuli in adults with ASD. Here, using functional MRI, we show that briefly presented fearful faces with averted gaze, previously shown to be a strong communicative signal of environmental danger, produce different patterns of brain activation than fearful faces with direct gaze in a group of 26 normally intelligent adults with ASD compared with 26 matched controls. While implicit cue of threat produces brain activation in attention, emotion processing and mental state attribution networks in controls, this effect is absent in individuals with ASD. Instead, individuals with ASD show activation in the subcortical face-processing system in response to direct eye contact. An effect of differences in looking behavior was excluded in a separate eye tracking experiment. Our data suggest that individuals with ASD are more sensitive to direct eye contact than to social signals of danger conveyed by averted fearful gaze.

What affects social attention? Social presence, eye contact and autistic traits.

Social understanding is facilitated by effectively attending to other people and the subtle social cues they generate. In order to more fully appreciate the nature of social attention and what drives people to attend to social aspects of the world, one must investigate the factors that influence social attention. This is especially important when attempting to create models of disordered social attention, e.g. a model of social attention in autism. Here we analysed participants' viewing behaviour during one-to-one social interactions with an experimenter. Interactions were conducted either live or via video (social presence manipulation). The participant was asked and then required to answer questions. Experimenter eye-contact was either direct or averted. Additionally, the influence of participant self-reported autistic traits was also investigated. We found that regardless of whether the interaction was conducted live or via a video, participants frequently looked at the experimenter's face, and they did this more often when being asked a question than when answering. Critical differences in social attention between the live and video interactions were also observed. Modifications of experimenter eye contact influenced participants' eye movements in the live interaction only; and increased autistic traits were associated with less looking at the experimenter for video interactions only. We conclude that analysing patterns of eye-movements in response to strictly controlled video stimuli and natural real-world stimuli furthers the field's understanding of the factors that influence social attention.

Designing awareness systems for social connectedness

Experiencing social connectedness is important for people’s well-being. Hence, people have an intrinsic drive to maintain social connections with their friends and relatives. Computing and communication technology have an increasingly important role in facilitating people in their sense of connectedness over a distance. Telephone, E-mail, and chat technologies have been available to people for more than two decades now, supporting them in actively having conversations amongst each other without physically being together. Modern communication and information technology makes it possible to communicate more subtle social cues between people. Such social cues are pieces of information that do not contain rich content, such as experiences, thoughts, or ideas. They rather provide a general awareness of presence or action of another person, similar to social cues observed in every day life. For instance, seeing a car parked in front of someone’s house, indicating that person is home, or a neighbor waving to say ‘hi’ without engaging in further conversation. When created unintentionally, these cues are referred to as awareness cues; when created with intention, the cues are called phatic cues. Both types of cues have the potential to support people in having a pervasive sense of social connectedness over a distance, in an addition to communication systems they are already using. Subtle social cues may be created and displayed through a variety of forms and modalities. This research to explore how interactive everyday products may be used to communicate these cues, and how their presence and use support the user’s experience of social connectedness. This ties in to visions on future developments of technology, such as The Invisible Computer, Ambient Intelligence and The Internet of Things, which have described technology to become more and more an integrated part in the fabric of people’s everyday lives. Systems primarily designed to support people in communicating subtle cues are referred to as social awareness systems. Although having been studied before, it has remained unclear whether, and how the features of such systems actually contribute to social connectedness, making it problematic for designers to design effective social awareness systems. The primary goal underlying the research of this dissertation is to generate an increased understanding of how social awareness system should leverage awareness and phatic social cues to support social connectedness for people. The research primarily focuses on the use of tangible forms and modalities, as these are considered to be both more meaningful and better integrated in people’s home environment.

A positive effect of flowers rather than eye images in a large-scale, cross-cultural dictator game

People often consider how their behaviour will be viewed by others, and may cooperate to avoid gaining a bad reputation. Sensitivity to reputation may be elicited by subtle social cues of being watched: previous studies have shown that people behave more cooperatively when they see images of eyes rather than control images. Here, we tested whether eye images enhance cooperation in a dictator game, using the online labour market Amazon Mechanical Turk (AMT). In contrast to our predictions and the results of most previous studies, dictators gave away more money when they saw images of flowers rather than eye images. Donations in response to eye images were not significantly different to donations under control treatments. Dictator donations varied significantly across cultures but there was no systematic variation in responses to different image types across cultures. Unlike most previous studies, players interacting via AMT may feel truly anonymous when making decisions and, as such, may not respond to subtle social cues of being watched. Nevertheless, dictators gave away similar amounts as in previous studies, so anonymity did not erase helpfulness. We suggest that eye images might only promote cooperative behaviour in relatively public settings and that people may ignore these cues when they know their behaviour is truly anonymous.

Do watching eyes affect charitable giving? Evidence from a field experiment

The presence of implicit observation cues, such as picture of eyes, has been shown to increase generosity in dictator games, and cooperative behavior in field settings. I combine these approaches, by testing if a picture of watching eyes affects unconditional giving in a natural environment, where the recipient is a charity organization. Taken together, this study reduces the influence of three potential confounding factors in previous experiments: (i) experimenter demand effects, (ii) that the facial cue reminds subjects of a human counterpart, and (iii) a social multiplier effect. Specifically, the paper reports results from an experiment, conducted in a Swedish supermarket chain, where customers face a naturally occurring decision problem. People who recycle cans and bottles have to choose whether to keep the recycled amount or donate it to a charity organization. By posting a picture of human eyes on recycling machines, I am able to test whether this causes an increase in donations to the charity. Based on a sample covering a 12-day period, 38 stores and 16775 individual choices, I find no general effect. However, when controlling for store and day fixed effects, and using a proxy for store attendance, the picture of eyes increased donated amount by 30 percent during days when relatively few other people visited the store. This result gives further support to the conclusion that subtle social cues can invoke reputation concerns in humans, although the relatively small effect suggests that previous estimates could be biased upward, or at least that the influence of observational cues is context dependent.

For love or money? What motivates people to know the minds of others?

Mood affects social cognition and “theory of mind”, such that people in a persistent negative mood (i.e., dysphoria) have enhanced abilities at making subtle judgements about others’ mental states. Theorists have argued that this hypersensitivity to subtle social cues may have adaptive significance in terms of solving interpersonal problems and/or minimising social risk. We tested whether increasing the social salience of a theory of mind task would preferentially increase dyspshoric individuals’ performance on the task. Forty-four dysphoric and 51 non-dysphoric undergraduate women participated in a theory of mind decoding task following one of three motivational manipulations: (i) social motivation (ii) monetary motivation, or (iii) no motivation. Social motivation was associated with the greatest accuracy of mental state decoding for the dysphoric group, whereas the non-dysphoric group showed the highest accuracy in the monetary motivation condition. These results suggest that dysphoric individuals may be especially, and preferentially, motivated to understand the mental states of others.