Gaze Cues Research Articles

Differential responses to con- and allospecific visual cues in juvenile ravens (Corvus corax): the ontogeny of gaze following and social predictions

Gaze following refers to the ability to co-orient with others’ gaze directions. Ontogenetic studies on gaze following in animals have predominantly used human experimenters as demonstrators. It is, however, likely that developing animals are initially more attuned to individuals from their own species, which might result in differences in the ontogenetic onset of gaze following with human and conspecific demonstrators. “Checking back” is a signature behaviour in the gaze following repertoires of humans, apes, and some Old world monkeys. It is commonly interpreted as a representation of the referentiality of gaze and is thus diagnostic of social predictions. Recently, “checking back” has been discovered in four avian species, suggesting a shared skill among birds. To investigate effects of con- and allospecific demonstrators on gaze following responses, we studied visual co-orientations of four hand-raised juvenile common ravens (Corvus corax) with human and conspecific gaze cues. Moreover, we for the first time investigated “checking back” in ravens and compared the effects of con- and allospecific demonstrators on this behaviour. Ravens followed human and conspecific gaze with no apparent differences in ontogenetic onset, but after significantly longer latencies with human demonstrators. Subjects moreover already checked back at 30 days old and did so significantly more often with conspecific demonstrators. Our findings suggest differences in processing speed and social predictions of human and conspecific gazes, indicating an underlying neurocognitive mechanism attuned to social information gathering from conspecifics. We propose more studies using conspecific demonstrators to reveal the full gaze following potential of a species.

When a look is enough: Neurophysiological correlates of referential speaker gaze in situated comprehension

Behavioral studies have shown that speaker gaze to objects in a co-present scene can influence listeners’ expectations about how the utterance will unfold. These findings have recently been supported by ERP studies that linked the underlying mechanisms of the integration of speaker gaze with an utterance meaning representation to multiple ERP components. This leads to the question, however, as to whether speaker gaze should be considered part of the communicative signal itself, such that the referential information conveyed by gaze can help listeners not only form expectations but also to confirm referential expectations induced by the prior linguistic context. In the current study, we investigated this question by conducting an ERP experiment (N=24, Age:[19,31]), in which referential expectations were established by linguistic context together with several depicted objects in the scene. Those expectations then could be confirmed by subsequent speaker gaze that preceded the referential expression. Participants were presented with a centrally positioned face performing gaze actions aligned to utterances comparing two out of three displayed objects, with the task to judge whether the sentence was true given the provided scene. We manipulated the gaze cue to be either Present (toward the subsequently named object) or Absent preceding contextually Expected or Unexpected referring nouns. The results provided strong evidence for gaze as being treated as an integral part of the communicative signal: While in the absence of gaze, effects of phonological verification (PMN), word meaning retrieval (N400) and sentence meaning integration/evaluation (P600) were found on the unexpected noun, in the presence of gaze effects of retrieval (N400) and integration/evaluation (P300) were solely found in response to the pre-referent gaze cue when it was directed toward the unexpected referent with attenuated effects on the following referring noun.

A frontoparietal network for volitional control of gaze following.

Gaze following is a major element of non-verbal communication and important for successful social interactions. Human gaze following is a fast and almost reflex-like behavior, yet, it can be volitionally controlled and suppressed to some extent if inappropriate or unnecessary, given the social context. In order to identify the neural basis of the cognitive control of gaze following, we carried out an event-related fMRI experiment, in which human subjects' eye movements were tracked while they were exposed to gaze cues in two distinct contexts: a baseline gaze following condition in which subjects were instructed to use gaze cues to shift their attention to a gazed-at spatial target and a control condition in which the subjects were required to ignore the gaze cue and instead to shift their attention to a distinct spatial target to be selected based on a color mapping rule, requiring the suppression of gaze following. We could identify a suppression-related BOLD response in a frontoparietal network comprising dorsolateral prefrontal cortex (dlPFC), orbitofrontal cortex (OFC), the anterior insula, precuneus and posterior parietal cortex (PPC). These findings suggest that over excitation of frontoparietal circuits in turn suppressing the gaze following patch might be a potential cause of gaze following deficits in clinical populations.

Social gaze cueing elicits facilitatory and inhibitory effects on movement execution when the model might act on an object.

Social cues, such as eye gaze and pointing fingers, can increase the prioritisation of specific locations for cognitive processing. A previous study using a manual reaching task showed that, although both gaze and pointing cues altered target prioritisation (reaction times [RTs]), only pointing cues affected action execution (trajectory deviations). These differential effects of gaze and pointing cues on action execution could be because the gaze cue was conveyed through a disembodied head; hence, the model lacked the potential for a body part (i.e., hands) to interact with the target. In the present study, the image of a male gaze model, whose gaze direction coincided with two potential target locations, was centrally presented. The model either had his arms and hands extended underneath the potential target locations, indicating the potential to act on the targets (Experiment 1), or had his arms crossed in front of his chest, indicating the absence of potential to act (Experiment 2). Participants reached to a target that followed a nonpredictive gaze cue at one of three stimulus onset asynchronies. RTs and reach trajectories of the movements to cued and uncued targets were analysed. RTs showed a facilitation effect for both experiments, whereas trajectory analysis revealed facilitatory and inhibitory effects, but only in Experiment 1 when the model could potentially act on the targets. The results of this study suggested that when the gaze model had the potential to interact with the cued target location, the model's gaze affected not only target prioritisation but also movement execution.

Neural correlates of attentional orienting with neutral and fearful gaze cues in 12-month-olds

ABSTRACT Infants use information on gaze direction and facial expressions for social referencing when encountering various objects in their environment. However, it remains unclear how these social cues influence attentional orienting in infants. Using event-related potentials (ERPs), we investigated the neural correlates of attentional orienting cued by an averted gaze with neutral and fearful expressions in 12-month-olds. We focused on the ERPs in response to a face (N290, P400, and Nc) as well as a saccade toward the target (the presaccadic spike potential: SP) and found that the amplitudes of the face-sensitive ERPs (N290 and P400) were larger for directed than averted gaze direction irrespective of facial expression. Furthermore, the amplitude of the SP involved in overt orienting was larger for fearful expressions than for neutral expressions, irrespective of gaze congruency. These results suggest that information on gaze direction and facial expression, specifically neutral and fearful expressions, may be processed independently, and that fearful expressions dominantly influence the neural correlates of attentional orienting in infants around 12 months of age.

Combining social cues in attention: Looking at gaze, head, and pointing cues

Social cues bias covert spatial attention. In most previous work the impact of different social cues, such as the gaze, head, and pointing cue, has been investigated using separated cues or making one cue explicitly task relevant in response-interference tasks. In the present study we created a novel cartoon figure in which unpredictive gaze and head and pointing cues could be combined to study their impact on spatial attention. In Experiment 1, gaze and pointing cues were either presented alone or together. When both cues were present, they were always directed to the same location. In Experiment 2, gaze and pointing cues were either directed to the same location (aligned) or directed to different locations (conflicted). Experiment 3 was like Experiment 2, except that the pointing cue was tested alongside a head-direction cue. The results of Experiment 1 showed that the effect of the gaze cue was reliably smaller than the pointing cue, and an aligned gaze cue did not have an additive benefit for performance. In Experiments 2 and 3, performance was determined by the pointing cue, regardless of where they eyes were looking, or the head was directed. The present results demonstrated a strong dominance of the pointing cue over the other cues. The child-friendly stimuli present a versatile way to study the impact of the combination of social cues, which may further benefit developmental research in social attention, and research in populations whose members might have atypical social attention.

Investigating the effect of cardio-visual synchrony on prosocial behavior towards a social robot

Background: Robots are being designed to alleviate the burden of social isolation and loneliness, particularly among older adults for whom these issues are more widespread. While good intentions underpin these developments, the reality is that many of these robots are abandoned within a short period of time. To encourage the longer-term use and utility of such robots, researchers are exploring ways to increase robot likeability and facilitate attachment. Results from experimental psychology suggest that interpersonal synchrony (the overlap of movement/sensation between two agents) increases the extent to which people like one another. Methods: To investigate the possibility that synchrony could facilitate people’s liking towards a robot, we undertook a between-subjects experiment in which participants interacted with a robot programmed to illuminate at the same rate, or 20% slower, than their heart rate. To quantify the impact of cardio-visual synchrony on prosocial attitudes and behaviors toward this robot, participants completed self-report questionnaires, a gaze-cueing task, and were asked to strike the robot with a mallet. Results: Contrary to pre-registered hypotheses, results revealed no differences in self-reported liking of the robot, gaze cueing effects, or the extent to which participants hesitated to hit the robot between the synchronous and asynchronous groups. Conclusions: The quantitative data described above, as well as qualitative data collected in semi-structured interviews, provided rich insights into people’s behaviours and thoughts when socially engaging with a humanoid social robot, and call into question the use of the broad “Likeability” measurement, and the appropriateness of the ‘hesitance to hit’ paradigm as a measure of attachment to a robotic system.

Social context modulates autonomic responses to direct eye contact

Eye contact with another person (social gaze) can evoke emotions, produce autonomic arousal, and influence behavior. Gaze cues can be evocative even when presented in static pictures of faces suggesting that responses depend on low-level visual features of gaze stimuli. The current study examined whether emotional gaze responses depend on the physical stimulus properties of an eye contact experience versus the cognitive evaluation of the social context of gaze. This was done by comparing skin conductance responses (SCR), an index of emotional arousal, during episodes of social gaze and 'self-gaze' (gazing at one's own eyes in a mirror), keeping other aspects of the viewing conditions constant. We compared SCRs during social gaze and self-gaze in forty participant pairs. Each participant engaged in ten, 20 second eye contact trials, alternating between social and self-gaze. Self-gaze episodes produced significant SCRs but social gaze SCR's were larger and occurred more reliably. SCRs decreased across trials (habituation effect) in both conditions. We speculated that social gaze between opposite sex partners might yield larger SCRs but this was not found. Overall, these results conceptually replicate previous findings of (likely top-town) cognitive regulation of autonomic gaze responses based on evaluation of the social context.

Eye-Gaze direction triggers a more specific attentional orienting compared to arrows.

Numerous studies have shown that eye-gaze and arrows automatically shift visuospatial attention. Nonetheless, it remains unclear whether the attentional shifts triggered by these two types of stimuli differ in some important aspects. It has been suggested that an important difference may reside in how people select objects in response to these two types of cues, eye-gaze eliciting a more specific attentional orienting than arrows. To assess this hypothesis, we examined whether the allocation of the attentional orienting triggered by eye-gaze and arrows is modulated by the presence and the distribution of reference objects (i.e., placeholders) on the scene. Following central cues, targets were presented either in an empty visual field or within one of six placeholders on each trial. In Experiment 2, placeholder-objects were grouped following the gestalt's law of proximity, whereas in Experiment 1, they were not perceptually grouped. Results showed that cueing one of the grouped placeholders spreads attention across the whole group of placeholder-objects when arrow cues were used, while it restricted attention to the specific cued placeholder when eye-gaze cues were used. No differences between the two types of cues were observed when placeholder-objects were not grouped within the cued hemifield, or no placeholders were displayed on the scene. These findings are consistent with the idea that socially relevant gaze cues encourage a more specific attentional orienting than arrow cues and provide new insight into the boundary conditions necessary to observe this dissociation.

Role of Social Gaze on Visual Search in an Eye-Tracking Paradigm

Gaze cueing refers to the natural inclination to direct one’s gaze in the direction of another’s gaze. This can be used in visual search tasks to facilitate or interfere with the search. Here, we examined the interaction between 3 gaze cue conditions (congruent, incongruent, and neutral) and a search task using letter arrays. Congruent cues had a gaze cue looking at the target, incongruent cues had a gaze cue looking away from the target, and neutral cues had a gaze cue looking straight ahead. An eye tracker was used to measure search task completion times (CTs). For all conditions, participants fixated on a target stimulus in the middle of the screen to begin the trial. The target disappeared. Then the gaze cue appeared, followed by the search array. Participants then had to locate the target. We expected CTs to be shortest for congruent cues and longest for incongruent cues, with neutral cues somewhere in the middle. Trials were randomized between our 3 conditions. A 1-way ANOVA found a significant impact of gaze cueing on this search task, F(2) = 10.15, p < .001, ηp2 = .28. Pairwise comparisons found significant differences between congruent and incongruent conditions, p < .001, and between neutral and congruent conditions, p = .006. Together, these results supported our hypothesis; congruent gaze cueing facilitated visual search whereas incongruent gaze and neutral gaze failed to assist visual search. These findings provide a firmer understanding of the interactions between gaze cueing and visual search paradigms.

Selective responding to human ostensive communication is an early developing capacity of domestic dogs.

Ostensive communication, communication motivated not only by an informative intention, but also by an intention to make this informative intention overt, is thought to be restricted to human signalers and to rely on metacognitive skills. On the receiver side, human infants and dogs have been found to selectively respond to human ostensive communication, even if it remains unclear whether they are able to discern the underlying intentions. At present only animals with extensive experiences with humans have demonstrated a response to human attention calling, suggesting that this sensitivity may be an exaptation of communicative skills allowing for context-specific responding to intraspecific signals. We investigated whether dogs could respond to subtle cues of ostension without clear attention-calling and how this skill varies across age and with different human-given signals. Using a two-way object choice task, we evaluated whether dogs of different ages followed, with their gaze and with their choices, ostensive human pointing and gaze more than a formally similar but non-ostensive gesture and a directional gaze cue. Dogs followed pointing more than gaze, and older dogs followed the directional cues more accurately than younger dogs. Independent of cue type, we found that dogs of all ages responded to human ostensive signals more than similar directional cues motivated by no communicative intention. Given that dogs are sensitive to subtle cues of ostensive communication from an early age, and that this does not appear to change with age, we suggest that living close to humans may have selected for this skill. RESEARCH HIGHLIGHTS: Like human infants, dogs followed human ostensive cues more than non-ostensive cues both by their approach behavior and their differential looking behavior. Dogs differentiated between ostensive and non-ostensive human cues from an early age on, without their attention having been called explicitly in advance. Dogs followed human-given pointing cues more than human-given gaze cues, independent of age or intention (ostensive or non-ostensive). The early developing sensitivity of dogs to human ostension suggests that living close to humans may have selected for this skill.

Supplemental Material for When “Looking at Nothing” Imparts Something: Retrospective Gaze Cues Flexibly Direct Prioritization in Visual Working Memory

Supplemental Material for When “Looking at Nothing” Imparts Something: Retrospective Gaze Cues Flexibly Direct Prioritization in Visual Working Memory

Age Differences in Gaze Following: Older Adults Follow Gaze More than Younger Adults When free-viewing Scenes

ABSTRACT Previous research investigated age differences in gaze following with an attentional cueing paradigm where participants view a face with averted gaze, and then respond to a target appearing in a location congruent or incongruent with the gaze cue. However, this paradigm is far removed from the way we use gaze cues in everyday settings. Here we recorded the eye movements of younger and older adults while they freely viewed naturalistic scenes where a person looked at an object or location. Older adults were more likely to fixate and made more fixations to the gazed-at location, compared to younger adults. Our findings suggest that, contrary to what was observed in the traditional gaze-cueing paradigm, in a non-constrained task that uses contextualized stimuli older adults follow gaze as much as or even more than younger adults.

Focused attention: its key role in gaze and arrow cues for determining where attention is directed.

Others' gaze direction and traffic arrow signal lights play significant roles in guiding observers' attention in daily life. Previous studies have shown that gaze and arrow cues can direct attention to the cued location. However, it is ambiguous where gaze and arrow cues guide attention: the cued location or a broader cued region. Therefore, the present study adopted a primary cue-target task and manipulated possible target locations to explore this issue. The results revealed that due to the different physical characteristics of non-predictive gaze and arrow cues, physically unfocused-pointing gaze cues guided attention to a broader cued region, whereas focused-pointing arrow cues guided attention to the exact cued location. Furthermore, gaze cues could also direct attention to the exact cued location when observers' attention was focused in a top-down manner (with highly predictive probability). These findings suggest that where gaze and arrow cues direct attention depends on whether observers' attention is focused by the cues, either in a bottom-up or top-down manner. Accordingly, a preliminary framework called the "Focused-Diffused Attentional Orienting Model" is proposed to explain how gaze and arrow cues direct humans' attention. The present study enhances our understanding of human attentional orienting systems from a behavioral perspective.

Associations between emotion recognition and autistic and callous-unemotional traits: differential effects of cueing to the eyes.

Although autism and callous-unemotional (CU) traits are distinct conditions, both are associated with difficulties in emotion recognition. However, it is unknown whether the emotion recognition difficulties characteristic of autism and CU traits are driven by comparable underpinning mechanisms. We tested whether cueing to the eyes improved emotion recognition in relation to autistic and CU traits in a heterogeneous sample of children enhanced for social, emotional and behavioural difficulties. Participants were 171 (n=75 male) children aged 10-16 years with and without a diagnosis of autism (n=99 autistic), who completed assessments of emotion recognition with and without cueing to the eyes. Parents completed the assessment of autistic and CU traits. Associations between autistic and CU traits and emotion recognition accuracy were dependent upon gaze cueing. CU traits were associated with an overall decrease in emotion recognition in the uncued condition, but better fear recognition when cued to the eyes. Conversely, autistic traits were associated with decreased emotion recognition in the cued condition only, and no interactions between autistic traits and emotion were found. The differential effect of cueing to the eyes in autistic and CU traits suggests different mechanisms underpin emotion recognition abilities. Results suggest interventions designed to promote looking to the eyes may be beneficial for children with CU traits, but not for children with autistic characteristics. Future developmental studies of autism and CU characteristics are required to better understand how different pathways lead to overlapping socio-cognitive profiles.

Are you paying attention to me? The effect of social presence on spatial attention to gaze and arrows.

Prior research has shown that the presence of another individual and type of attention cue (social gaze vs. nonsocial arrow) can modulate attention, with little done to integrate the two. We thus investigate the role of two social presence factors when completing a joint cueing task with either social (gaze) or nonsocial (arrow) cues. Familiarity was operationalized as participants engaged in a prompted conversation either before (n = 60 dyads) or after (n = 59 dyads) the task. To determine the effect of previous responder identity on attention, we contrasted trials where participants responded twice in a row (same responder) with switch trials (different responder), along with whether the previous target was in the same or a different location. Although familiarity only affected global speed and not magnitudes of cueing, we did find that attention to gaze and arrows was differentially affected by previous responder and previous target location. Specifically, for gaze cues muted cueing effects occurred for trials where the previous responder was different, while for arrow cues there was less muting of the cueing effect regardless of previous responder. Taken together, previous responder and previous target location both modulated attention, with the effect on attention dependent on the type of cue, gaze, or arrow.

Tuning social modulations of gaze cueing via contextual factors

Gaze cueing reflects the tendency to shift attention toward a location cued by the averted gaze of others. This effect does not fulfill criteria for strong automaticity because its magnitude is sensitive to the manipulation of different social features. Recent theoretical perspectives suggest that social modulations of gaze cueing could further critically depend on contextual factors. In this study, we tested this idea, relying on previous evidence showing that Chinese participants are more sensitive to gazes on White than on Asian faces, likely as a consequence of differences in perceived social status. We replicated this effect when we made group membership salient by presenting faces belonging to the different ethnicities in the same block. In contrast, when faces belonging to different ethnicities were presented in separate blocks, a similar gaze-cueing effect was noted, likely because no social comparison processes were activated. These findings are consistent with the idea that social modulations are not rigid but are tuned by contextual factors.

Gaze cues vs. arrow cues at short vs. long durations

ABSTRACT Information processing is more efficient at cued relative to non-cued locations. A number of studies have examined whether non-predictive gaze cues are special due to their biological relevance. While most studies indicate that cueing effects of gaze cues and arrow cues are similar, one aspect remains to be examined – cue duration. Contrary to early findings, a number of studies have observed cueing effects at short durations for arrow cues. For gaze cues however, the evidence is more mixed. The present study therefore aims to directly compare the cueing effects of arrow and gaze cues at short and long durations. Participants (N = 30) performed a discrimination task and were presented with arrow and gaze cues for short or long durations. Cueing effects were measured at each duration for each cue type. Significant cueing effects were observed for both cue types at both short and long duration. Moreover, for both cue types, no difference was observed in the magnitude of cueing effects at short and long duration. The results suggest that both cue types cues can efficiently orient attention even at short cue durations, and that the biological relevance of gaze direction cues do not provide any advantage over arrows.

Influences of eye gaze cues on memory and its mechanisms: The function and evolution of social attention.

During evolution, humans have formed a priority perceptual preference for others’ gazes. The gaze direction of others is called the gaze cue, conveying environmental information, a critical non-verbal communication in early humans. Recently, empirical evidence has indicated that gaze cues can affect high-level cognitive processes, such as memory. Unlike non-social cues (e.g., arrows), gaze cues elicit special social attention. Research determining the underlying mechanisms suggests that social intention influences observers’ visual attention and influences their memory. This article provides a brief review of the current state of research on the relationship between gaze cues and memory. Future studies should focus on multiple gaze cues, the social nature of gaze cues, and clinical research.

Attractiveness modulates attention, but does not enhance gaze cueing.

Tom S. Roth, Xuejing Du, Iliana Samara, & Mariska E. Kret (2021) Evolutionary Behavorial Sciences