Mutual Eye Research Articles

Children in sync: exploring how interpersonal synchrony experience induces cooperation between child peers.

Synchronous interpersonal movements induce positive prosocial behaviors in adults and children. The processes that underlie this are debated. Here, we investigate the extent to which visual cues available during synchrony experience-particularly shared facial expressions and mutual eye contact-are necessary. Pairs of same-sex 4-year-olds (N = 216 children; 50% girls; 81% white) from the US were randomly assigned to synchronized versus asynchronized swinging experience. Access to visual information was experimentally manipulated by using a transparent versus translucent barrier between the children. The translucent barrier acted as a visual filter preventing children from monitoring facial cues while still enabling them to see whether the partner was swinging in synchrony. After the swinging experience, all pairs of children were administered the same tests of cooperation. The children administered synchronous movement performed better on the cooperation tasks, and there was no significant difference as a function of barrier transparency. This suggests that the positive effects of synchrony do not require visual resolution of the partner's social-emotional facial cues. These findings advance our understanding about factors contributing to synchrony-induced cooperation between children.

Mutual eye gaze and vocal pitch in relation to social anxiety and depression: A virtual interaction task

BackgroundIndividuals with high social interaction anxiety (SIA) and depression often behave submissively in social settings. Few studies have simultaneously examined the associations between objectively assessed submissive behaviors and SIA or depression, despite their high comorbidity and unknown mechanisms regarding submissiveness. MethodsA sample of 45 young adults self-reported trait SIA and depression, state positive/negative affect (PA/NA) before and after a virtual social interaction. Participants engaged in a four-minute conversation with a confederate who was trained to behave neutrally. Mutual eye gaze, via eye-tracking, and vocal pitch were assessed throughout the interaction. ResultsDepression and SIA were positively correlated with NA, poorer self-rated performance, and vocal pitch. Highly socially anxious women engaged in less mutual eye gaze than highly socially anxious men. Also, vocal pitch was inversely associated with mutual eye gaze and positively related to NA and (nonsignificantly) to self-ratings of poor performance. Finally, our data partially replicated past research on the use of vocal pitch during social stress to detect social anxiety disorder. LimitationsThe current sample is relatively homogenous in educational attainment, age, and race. All research confederates were women. Future research should examine whether these archival data replicate with the latest telecommunication technologies. ConclusionOur findings highlight nuanced relationships among SIA, depression, emotions, self-perceptions, and biobehavioral indicators of submissive behavior—in response to an ambiguously negative/positive social interaction. Sex/gender may interact with these effects, emphasizing considerations for research method designs.

Gazing Heads: Investigating Gaze Perception in Video-Mediated Communication

Videoconferencing has become a ubiquitous medium for collaborative work. It does suffer however from various drawbacks such as zoom fatigue. This paper addresses the quality of user experience by exploring an enhanced system concept with the capability of conveying gaze and attention. Gazing Heads is a round-table virtual meeting concept that uses only a single screen per participant. It enables direct eye contact, and signals gaze via controlled head rotation. The technology to realise this novel concept is not quite mature though, so we built a camera-based simulation for four simultaneous videoconference users. We conducted a user study comparing Gazing Heads with a conventional “Tiled View” video conferencing system, for 20 groups of 4 people, on each of two tasks. The study found that head rotation clearly conveys gaze and strongly enhances the perception of attention. Measurements of turn-taking behaviour did not differ decisively between the two systems (though there were significant differences between the two tasks). A novel insight in comparison to prior studies is that there was a significant increase in mutual eye contact with Gazing Heads, and that users clearly felt more engaged, encouraged to participate and more socially present. Overall, participants expressed a clear preference for Gazing Heads. These results suggest that fully implementing the Gazing Heads concept, using modern computer vision technology as it matures, could significantly enhance the experience of videoconferencing.

Off-camera gaze decreases evaluation scores in a simulated online job interview

During the pandemic, digital communication became paramount. Due to the discrepancy between the placement of the camera and the screen in typical smartphones, tablets and laptops, mutual eye contact cannot be made in standard video communication. Although the positive effect of eye contact in traditional communication has been well-documented, its role in virtual contexts remains less explored. In this study, we conducted experiments to gauge the impact of gaze direction during a simulated online job interview. Twelve university students were recruited as interviewees. The interview consisted of two recording sessions where they delivered the same prepared speech: in the first session, they faced the camera, and in the second, they directed their gaze towards the screen. Based on the recorded videos, we created three stimuli: one where the interviewee’s gaze was directed at the camera (CAM), one where the interviewee’s gaze was skewed downward (SKW), and a voice-only stimulus without camera recordings (VO). Thirty-eight full-time workers participated in the study and evaluated the stimuli. The results revealed that the SKW condition garnered significantly less favorable evaluations than the CAM condition and the VO condition. Moreover, a secondary analysis indicated a potential gender bias in evaluations: the female evaluators evaluated the interviewees of SKW condition more harshly than the male evaluators did, and the difference in some evaluation criteria between the CAM and SKW conditions was larger for the female interviewees than for the male interviewees. Our findings emphasize the significance of gaze direction and potential gender biases in online interactions.

Influence of autistic traits and communication role on eye contact behavior during face-to-face interaction

Eye contact is a central component in face-to-face interactions. It is important in structuring communicative exchanges and offers critical insights into others' interests and intentions. To better understand eye contact in face-to-face interactions, we applied a novel, non-intrusive deep-learning-based dual-camera system and investigated associations between eye contact and autistic traits as well as self-reported eye contact discomfort during a referential communication task, where participants and the experimenter had to guess, in turn, a word known by the other individual. Corroborating previous research, we found that participants’ eye gaze and mutual eye contact were inversely related to autistic traits. In addition, our findings revealed different behaviors depending on the role in the dyad: listening and guessing were associated with increased eye contact compared with describing words. In the listening and guessing condition, only a subgroup who reported eye contact discomfort had a lower amount of eye gaze and eye contact. When describing words, higher autistic traits were associated with reduced eye gaze and eye contact. Our data indicate that eye contact is inversely associated with autistic traits when describing words, and that eye gaze is modulated by the communicative role in a conversation.

The effects of early rearing experiences on mutual eye gaze among captive olive baboons (Papio anubis).

Among human and nonhuman primates, mutual eye gaze (MEG) and gaze following are believed to be important for social cognition and communicative signaling. The goals of this study were to examine how early rearing experiences contribute to individual variation in MEG and to examine the potential role of genetic factors underlying this variation. Subjects included 93 female and 23 male baboons (Papio anubis) ranging from 3 to 20 years of age. Within the sample, there were 55 mother-reared (MR) and 61 nursery-reared (NR) baboons. MEG was assessed in four 60-s test sessions. For each session, the duration, frequency, and bout length were recorded. Mean values were then calculated for each individual from the four sessions. A multivariate analysis of covariance revealed an overall significant main effect for rearing. Subsequent univariate analyses revealed significant rearing effects on mean bout length, but not mean duration or meanfrequency, with MR baboons having longer bout lengths compared to NR baboons. Furthermore, mean bout length was found to be significantly heritable. These results indicate that rearing experiences, and to a small extent, genetic factors, affect patternsof mutual eye gaze - in particular, bout length. These results differ from previous findings in MR and NR chimpanzees, further suggesting that rearing may impact MEG in a species-specific manner that reflects the function of gaze in different primate species.

Understanding the effect of a virtual moderator on people’s perception in remote discussion using social VR

Social VR enables people to join a remote discussion by keeping a high social presence and physical proximity using embodied avatars. However, the missing nonverbal cues, such as mutual eye contact and nuanced facial expression, make it challenging for distributed members to manage turn-taking, which could lead to unequal participation and affect trust building. Therefore, we propose a virtual moderator to make distributed members feel included by seeing their nonverbal behavior. The virtual moderator was designed with a “prompt Q&A″ feature to enable users to share feedback and an “attention guidance” feature to encourage participation. The preliminary result of a controlled experiment in social VR with 30 participants showed that seeing the virtual moderator’s body orientation enhanced participants’ psychological safety. In contrast, the prompt Q&A feature enhanced the perceived co-presence of their remote counterparts. We discussed how nonverbal behavior could be designed using a virtual moderator to shape human perception of the group discussion in social VR. We also pointed out challenges when providing multiple supports simultaneously in social VR.

Hedonic and autonomic responses in promoting affective touch

Interpersonal touch is intrinsically reciprocal since it entails a person promoting and another receiving the touch. While several studies have investigated the beneficial effects of receiving affective touch, the affective experience of caressing another individual remains largely unknown. Here, we investigated the hedonic and autonomic responses (skin conductance and heart rate) in the person promoting affective touch. We also examined whether interpersonal relationship, gender, and eye contact modulate these responses. As expected, caressing the partner was perceived as more pleasant than caressing a stranger, especially if the affective touch occurred together with mutual eye contact. Promoting affective touch to the partner also resulted in a decrease of both autonomic responses and anxiety levels, suggesting the occurrence of a calming effect. Additionally, these effects were more pronounced in females compared to males, indicating that hedonic and autonomic aspects of affective touch are modulated by both social relationship and gender. These findings show for the first time that caressing a beloved one is not only pleasant but also reduces autonomic responses and anxiety in the person promoting the touch. This might suggest that affective touch has an instrumental role for romantic partners in promoting and reinforcing their affective bonding.

Improving Surgical Excellence: Can Coaching Surgeons Improve Patient Engagement?

Non-technical skills complement technical skills in surgeons to provide best possible care for patients. The former is essential to promote patient engagement. Coaching has been introduced to surgeons as a method to improve non-technical skills. We aimed to investigate the impact of coaching for surgeons on patient engagement in the outpatient consultation setting. This was a single-centre cohort study conducted in South Australia. Consultant surgeons, suitable coaches, and patients were recruited. Coaches underwent further training by a human factors psychologist on being an effective coach. Outpatient consultations were recorded in an audio-visual format and analysed by investigators. Patient talking time, mutual eye gaze between surgeon and patient, and number of questions asked by the patient were measured as outcomes for patient engagement. 182 patients, 12 surgeons, and 4 coaches participated in the study. Each surgeon underwent 3 coaching sessions, 5 to 6weeks apart. There were 62 pre-coaching patient consultations, 63 patient consultations after one coaching session, and 57 patient consultations after two coaching sessions. The mean talking time of the patient increased significantly after a single coaching session (P < 0.05) without making significant difference to the total consultation time (p = 0.76). Coaching sessions did not have a significant effect on mutual eye gaze or mean number of questions asked by the patient. Coaching of non-technical skills for surgeons appears to objectively improve patient engagement during the outpatient consultation. This would suggest that tailored coaching programs should be developed and delivered to surgeons to improve care delivery.

Widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks

Social gaze interaction powerfully shapes interpersonal communication. However, compared with social perception, very little is known about the neuronal underpinnings of real-life social gaze interaction. Here, we studied a large number of neurons spanning four regions in primate prefrontal-amygdala networks and demonstrate robust single-cell foundations of interactive social gaze in the orbitofrontal, dorsomedial prefrontal, and anterior cingulate cortices, in addition to the amygdala. Many neurons in these areas exhibited high temporal heterogeneity for social discriminability, with a selectivity bias for looking at a conspecific compared with an object. Notably, a large proportion of neurons in each brain region parametrically tracked the gaze of self or other, providing substrates for social gaze monitoring. Furthermore, several neurons displayed selective encoding of mutual eye contact in an agent-specific manner. These findings provide evidence of widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks during social gaze interaction.

VirtualCube: An Immersive 3D Video Communication System.

The VirtualCube system is a 3D video conference system that attempts to overcome some limitations of conventional technologies. The key ingredient is VirtualCube, an abstract representation of a real-world cubicle instrumented with RGBD cameras for capturing the user's 3D geometry and texture. We design VirtualCube so that the task of data capturing is standardized and significantly simplified, and everything can be built using off-the-shelf hardware. We use VirtualCubes as the basic building blocks of a virtual conferencing environment, and we provide each VirtualCube user with a surrounding display showing life-size videos of remote participants. To achieve real-time rendering of remote participants, we develop the V-Cube View algorithm, which uses multi-view stereo for more accurate depth estimation and Lumi-Net rendering for better rendering quality. The VirtualCube system correctly preserves the mutual eye gaze between participants, allowing them to establish eye contact and be aware of who is visually paying attention to them. The system also allows a participant to have side discussions with remote participants as if they were in the same room. Finally, the system sheds lights on how to support the shared space of work items (e.g., documents and applications) and track participants' visual attention to work items.

The doctor will see you now: eye gaze, conversation and patient engagement in the surgical outpatient clinic. An Australian observational cross-sectional study.

Surgical outpatient consultations are demanding for the surgeon and patients without a definite formula for success. Various factors have been identified regarding factors that influence patient satisfaction and engagement. We aimed to examine the modern-day surgical outpatient consultation and report on these factors. An observational cross-sectional study was performed by reviewing video recordings of 182 surgical consultations by 12 surgeons at The Queen Elizabeth Hospital, South Australia, Australia. The mean consultation time was 12.3min, with pre-surgical consultations being the longest. There were 107 consultations for benign conditions (58%). Proportionally, the consultant spoke most (51.9% of total consultation time), followed by the patient (19.5%) and then companion (8.2%). Forty-eight (26.4%) patients brought a companion to the clinic but monopolisation of the consultation by the companion was rare. When a companion was present, there was more mutual eye gaze between the consultant and the patient. Interruptions were present in 23.6% of consultations and were associated with a significant increase of the length of the consultation. Table positioning did not seem to affect the dynamics of the outpatient consultation. Companions are highly valuable for promoting patient engagement and their presence should be encouraged in surgical outpatients. Interruptions should be kept to a minimum to avoid unnecessary delays. Further studies should be conducted to investigate the effect of companions, interruptions and table positioning during a consultation on patient outcomes.

Making sense of human interaction benefits from communicative cues

We investigated whether communicative cues help observers to make sense of human interaction. We recorded EEG from an observer monitoring two individuals who were occasionally communicating with each other via either mutual eye contact and/or pointing gestures, and then jointly attending to the same object or attending to different objects that were placed on a table in front of them. The analyses were focussed on the processing of the interaction outcome (i.e. presence or absence of joint attention) and showed that its interpretation is a two-stage process, as reflected in the N300 and the N400 potentials. The N300 amplitude was reduced when the two individuals shared their focus of attention, which indicates the operation of a cognitive process that involves the relatively fast identification and evaluation of actor–object relationships. On the other hand, the N400 was insensitive to the sharing or distribution of the two individuals’ attentional focus. Interestingly, the N400 was reduced when the interaction outcome was preceded either by mutual eye contact or by a perceived pointing gesture. This shows that observation of communication “opens up” the mind to a wider range of action possibilities and thereby helps to interpret unusual outcomes of social interactions.

Evaluation of users' experience and posture in a rotated swivel seating configuration

Objective This study aims to evaluate a car passenger’s experience and actions in a rotated seat in terms of interaction with an adjacent passenger. Methods A static user study was conducted, using a stationary test vehicle with two front row seats facing rearwards. The seats were mounted on a swivel plate which allowed inboard rotation. Thirty-two participants in 16 test pairs were grouped based on stature; short or tall. The participants within each pair knew each other. Three seating configurations were evaluated; 0° and 10° and 20° inboard rotated position of both seats. The participants were seated in each seating configuration for 10 min; 5 min they engaged in a conversation with each other and 5 min they were watching media on an Ipad mounted in front of them. Subjective data from each participant on their experiences and preferences were collected through questionnaires, and objective data on sitting postures and eye gaze were collected through video recording. Results Ninety-two percent of the short participants preferred to sit in the 20° rotated seating configuration when watching media and 75% preferred the 20° seating configuration when engaged in conversation. Compared to short participants, the tall participants showed a relative larger spread in seating configuration preference; 15% and 30% of them preferred the reference position for media and conversation, respectively. Leg interference was common for tall participants when 20° inboard rotated. They perceived it uncomfortable and used various strategies to avoid contact, including crossing legs or feet. Time spent with mutual eye contact did not vary by seating configuration. Conclusions This static user study shows that rotated seats could be a desired seating configuration in future autonomous vehicles for individuals who know each other. It reveals the reasons behind the preferences and the extent of desired seat rotation, showing differences between tall and short individuals. By understanding how occupant position and posture can be influenced by offering various seating configurations, the occupant can choose a comfortable position that is also safe. The leg and feet positions are raised as the body region with most variations and for which an increased understanding of influence in a crash is encouraged.

Differences in the mutual eye gaze of bonobos (Pan paniscus) and chimpanzees (Pan troglodytes).

Eye gaze is widespread in nonhuman primate taxa and important for social cognition and communicative signaling. Bonobos and chimpanzees, two closely related primate species, differ in social organization, behavior, and cognition. Chimpanzees' eye gaze and gaze following has been studied extensively, whereas less is known about bonobos' eye gaze. To examine species differences using a more ecologically relevant measure than videos or pictures, the current study compared bonobo and chimpanzee mutual eye gaze with a human observer. A multivariate analysis of variance revealed significant species differences in frequency and total duration, but not bout length, of mutual eye gaze (p < .001). Specifically, bonobos engage in mutual eye gaze more frequently and for longer total duration than chimpanzees. These results are likely related to species differences in social behavior and temperament and are consistent with eye-tracking studies in which bonobos looked at the eye region of conspecifics (in pictures and videos) longer than chimpanzees. Future research should examine the relationship between mutual eye gaze and gaze following, as well as examine its genetic and neurological correlates. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact.

Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated. Here, we investigate this question using a novel two-person joint attention task. Participants were not instructed regarding the use of eye contacts; thus all mutual eye contact events between interacting partners that occurred during the joint attention task were spontaneous and varied with respect to frequency. We predicted that joint attention systems would be modulated by differences in the social behavior across participant pairs, which could be measured by the frequency of eye contact behavior. We used functional near-infrared spectroscopy (fNIRS) hyperscanning and eye-tracking to measure the neural signals associated with joint attention in interacting dyads and to record the number of eye contact events between them. Participants engaged in a social joint attention task in which real partners used eye gaze to direct each other’s attention to specific targets. Findings were compared to a non-social joint attention task in which an LED cue directed both partners’ attention to the same target. The social joint attention condition showed greater activity in right temporoparietal junction than the non-social condition, replicating prior joint attention results. Eye-contact frequency modulated the joint attention activity, revealing bilateral activity in social and high level visual areas associated with partners who made more eye contact. Additionally, when the number of mutual eye contact events was used to classify each pair as either “high eye contact” or “low eye contact” dyads, cross-brain coherence analysis revealed greater coherence between high eye contact dyads than low eye contact dyads in these same areas. Together, findings suggest that variation in social behavior as measured by eye contact modulates activity in a subunit of the network associated with joint attention.

The role of early social rearing, neurological, and genetic factors on individual differences in mutual eye gaze among captive chimpanzees

Mutual eye gaze plays an important role in primate social development and communication. In the current study, we examined the underlying experiential, genetic, and neuroanatomical basis of mutual eye gaze variation in adult captive chimpanzees. A multivariate analysis of variance revealed a significant rearing effect on bout length, with human-reared chimpanzees engaging in longer bouts of mutual gaze compared to mother-reared and wild-born individuals. Next, we utilized source-based morphometry (SBM) to examine gray matter covariation in magnetic resonance imaging scans and determine the relationship between the resulting gray matter covariation components and mutual eye gaze. One SBM component was negatively correlated with gaze duration (nucleus accumbens and anterior insular cortex), while two components were positively correlated with bout length (posterior cingulate cortex, inferior occipital cortex, middle temporal cortex, hippocampus, and the precentral sulcus). Finally, heritability analyses revealed mutual eye gaze to be modestly heritable and significant genetic correlations between bout length and two gray matter covariation components. This study reveals that non-genetic factors, and to a lesser extent, genetic factors appear to influence mutual eye gaze in adult chimpanzees, and is the first to report neuroanatomical correlates of mutual eye gaze variation in chimpanzees.

Supplemental Material for Differences in the Mutual Eye Gaze of Bonobos (Pan paniscus) and Chimpanzees (Pan troglodytes)

Supplemental Material for Differences in the Mutual Eye Gaze of Bonobos (Pan paniscus) and Chimpanzees (Pan troglodytes)

Eye contact enhances interpersonal motor resonance: comparing video stimuli to a live two-person action context.

Previous research has shown a link between eye contact and interpersonal motor resonance, indicating that the mirroring of observed movements is enhanced when accompanied with mutual eye contact between actor and observer. Here, we further explored the role of eye contact within a naturalistic two-person action context. Twenty-two participants observed simple hand movements combined with direct or averted gaze presented via a live model in a two-person setting or via video recordings, while transcranial magnetic stimulation was applied over the primary motor cortex (M1) to measure changes in M1 excitability. Skin conductance responses and gaze behavior were also measured to investigate the role of arousal and visual attention herein. Eye contact significantly enhanced excitability of the observer’s M1 during movement observation within a two-person setting. Notably, participants with higher social responsiveness (Social Communication subscale of the Social Responsiveness Scale) displayed a more pronounced modulation of M1 excitability by eye gaze. Gaze-related modulations in M1 excitability were, however, not associated with differences in visual attention or autonomic arousal. In summary, the current study highlights the effectiveness and feasibility of adopting paradigms with high ecological validity for studying the modulation of mirror system processes by subtle social cues, such as eye gaze.

Eye gaze and L2 speakers’ responses to recasts: A systematic replication study of McDonough, Crowther, Kielstra and Trofimovich (2015)

To confirm the role of social factors in mediating cognitive processes, this systematic replication study seeks to extend the generalizability of an exploratory study (McDonough, Crowther, Kielstra &amp; Trofimovich 2015) that reported a positive association between eye gaze and second language (L2) speakers’ responses to recasts. For this replication, L2 English speakers (N = 74) carried out communicative tasks with research assistants who provided recasts in response to non-targetlike forms while both interlocutors’ eye gaze behavior was tracked. Transcripts were analyzed for the occurrence of recasts in response to different error types, recast length, and L2 speaker responses. Eye gaze length for the research assistants (RAs) when producing the recast move and the L2 speaker when responding to the recast were obtained in seconds, and mutual gaze (i.e., simultaneous looking) was included as a binary eye gaze variable. A logistic regression model confirmed the findings of McDonough et al. (2015), with both L2 speaker and mutual eye gaze predictive of targetlike responses; however, the effect of L2 speaker's eye gaze duration was in the opposite direction as compared to the initial study. The implications are discussed in terms of understanding the role of eye gaze in face to face interaction.