Eye Gaze Research Articles

Tasks Reflected in the Eyes: Egocentric Gaze-Aware Visual Task Type Recognition in Virtual Reality.

With eye tracking finding widespread utility in augmented reality and virtual reality headsets, eye gaze has the potential to recognize users' visual tasks and adaptively adjust virtual content displays, thereby enhancing the intelligence of these headsets. However, current studies on visual task recognition often focus on scene-specific tasks, like copying tasks for office environments, which lack applicability to new scenarios, e.g., museums. In this paper, we propose four scene-agnostic task types for facilitating task type recognition across a broader range of scenarios. We present a new dataset that includes eye and head movement data recorded from 20 participants while they engaged in four task types across 15 360-degree VR videos. Using this dataset, we propose an egocentric gaze-aware task type recognition method, TRCLP, which achieves promising results. Additionally, we illustrate the practical applications of task type recognition with three examples. Our work offers valuable insights for content developers in designing task-aware intelligent applications. Our dataset and source code are available at zhimin-wang.github.io/TaskTypeRecognition.html.

Lack of Eye Gaze and its Effects on Spoken Interaction in Synchronous Online Communication

The importance of oral interaction in language learning is well recognised, and this paper examines the factors that hinder English as a Foreign Language (EFL) learners’ active participation in online discussions during Synchronous Online Communication. Using focus groups with 51 Cypriot Greek-speaking students from three tertiary institutions in Cyprus, thematic analysis revealed that the perceived prominent factor inhibiting oral interaction in the online environment was the absence of eye gaze and its associated social functions. Specifically, eye gaze was identified as a signal for turn-taking, turn-yielding, and turn-denying, whose absence hindered learners’ ability to interpret their peers’ and teachers’ intentions and expectations. The paper concludes with pedagogical implications for technologists, software developers, students, language teachers, and language teacher educators.

Is It Possible to Recognize a Speaker Without Listening? Unraveling Conversation Dynamics in Multi-Party Interactions Using Continuous Eye Gaze

Is It Possible to Recognize a Speaker Without Listening? Unraveling Conversation Dynamics in Multi-Party Interactions Using Continuous Eye Gaze

Multi-stage gaze-controlled virtual keyboard using eye tracking.

This study presents a novel multi-stage hierarchical approach to optimize key selection on virtual keyboards using eye gaze. Existing single-stage selection algorithms have difficulty with distant keys on large interfaces. The proposed technique divides the standard QWERTY keyboard into progressively smaller regions guided by eye movements, with boundary fixations first selecting halves and quarters to sequentially narrow the search area. Within each region, keys are highlighted one by one for selection. An experiment compared the multi-stage approach to single-step techniques, having participants copy text using eye gaze alone under both conditions. Metrics on selection speed, words per minute, and usability ratings were significantly improved with the hierarchical technique. Half and quarter selection times decreased over 30% on average while maintaining accuracy, with overall task completion 20% faster. Users also rated the multi-stage approach as more comfortable and easier to use. The multi-level refinement of the selection area optimized interaction efficiency for gaze-based text entry.

The Influence of Eye Gaze Direction on Consumers

Abstract: There are now static ads where the model looks at the product, as well as static ads where the model doesn't look at the product. The study's goal was to investigate how models' eye gaze directions affect consumers. This paper uses a questionnaire survey as a case study to conduct a detailed analysis. It collects data on consumers' perceived attractiveness of the product, their evaluation of the product, and their intention to purchase the product. Additionally, it discusses the impact of the model's eye gaze direction on these consumers. The model's eye gaze direction has the first influence on consumers' perceived attraction to the product. Consumers will be more attracted to the product when the model's gaze remains fixed on it. In light of this influence, this paper proposes adding dynamic elements to the advertisement to make consumers more attracted to the product. Consumers' evaluation of the product is the second influence of the model's eye gaze direction on consumers is consumers' evaluation of the product. Fixing the model's eye gaze on the product improves consumers' evaluation of it. This paper suggests that the advertisement should truly reflect the product's characteristics and advantages in light of this influence. The third effect of the model's direction of gaze on consumers is their intention to purchase the product. Focusing the model's gaze on the product enhances consumers' purchase intentions. Given this influence, this paper recommends allowing stars or models that align with the product's characteristics to represent it.

Second Language Listeners’ Emotion and Eye Gaze: A Web-Based Eye-Tracking Study

ABSTRACT While previous studies have shown that L2 listeners tend to focus more on videos with additional information, like presentation slides, the amount of eye gaze did not necessarily translate to higher listening test scores . Unlike previous research focusing on the benefits of additional visual cues, this study explores how emotions impact L2 listeners’ viewing behavior. Sixty-four adults completed the Foreign Language Listening Anxiety Scale (FLLAS), watched three academic lectures with their eye movements tracked, and answered comprehension questions. According to the results, listening anxiety was not a significant predictor of viewing videos. The relationship between viewing time and comprehension scores was non-significant. Interviews and survey responses highlighted diverse attitudes toward the videos. The findings suggest that individual differences in listening anxiety may not significantly influence how much participants look at the videos. Furthermore, adding context videos to listening tests to increase authenticity does not seem to affect comprehension scores, consistent with previous studies. The implications for developing video-based listening tests are discussed.

Communicative Skills in Medical Students

Positive interaction between the doctor and the patient affects the treatment outcome, as well as the level of satisfaction with healthcare services. Many young doctors experience communicative issues that can lead to negative consequences for all stakeholders. The research featured various problems in shaping communicative skills in medical students. It involved a review of scientific publications, a survey of first-year medical students (n = 20), and an analysis of 40 negative feedbacks from patients. The communicative issues included: lack of eye contact / active listening, misleading mimics, inappropriate intonation / voice volume, violation of private space, insufficient or excessive amount of information, lack of bedside manners / respect for patients. The list of communication skills to be mastered by medical students in order to improve the quality of medical care included: eye contact, self-presentation, active listening, conflict management, strategies of delivering bad news, and conclusion phrases. The data obtained make it possible to identify key aspects that affect the formation of communicative skills in future doctors, as well as to propose methods for its improvement at university level. The authors emphasize the importance of developing communicative skills in future doctors to provide high-quality medical care and prevent emotional burnout in young professionals.

Early gesture development as a predictor of autism spectrum disorder in elevated-likelihood infants of ASD

BackgroundGesture difficulties have been reported in later-born siblings of children with autism spectrum disorder (ASD). Careful observation of gesture development during the first two years of children at elevated likelihood (EL) of developing ASD may identify behavioral indicators that facilitate early diagnosis.MethodsThis study enrolled 47 EL infants and 27 low-likelihood (LL) infants to explore gesture developmental trajectories and the predictive value of gesture to expedite the early detection of core characteristics of ASD. Gesture frequency, communication function, and integration ability were observed and coded from a semi-structured assessment administered longitudinally across 9–19 months of age. We conducted the Autism Diagnostic Observation Schedule assessment at 18–19 months for ASD’s core characteristics.ResultsThe development of joint attention (JA) gestures was slower in the EL than in the LL group. The trajectories of the two groups began to diverge at 14–18 months. Children who reached the diagnostic cutoff point for ASD showed reductions in social interaction gestures at 12–13 months, in gestures integrated with any two communication skills (G-M) at 15–16 months; and in gestures integrated with eye contact (G-E) at 18–19 months. Overall gesture and G-M integration were associated with an overall ADOS communication and social interaction score.ConclusionsThe developmental trajectories of JA gestures of EL and LL children differed. G-M gestures represent early indicators that may be a predictor of ASD.

Telehealth to increase healthcare access; perspectives of people who use drugs.

People who use drugs (PWUD) often face restricted healthcare access despite their heightened healthcare needs. Factors such as stigma, mistrust of the healthcare system, competing priorities, and geographical barriers pose significant healthcare access challenges. Telehealth offers an innovative solution to expand healthcare access for better inclusion of underserved populations in healthcare. We aimed to explore PWUDs' perceptions of telehealth as a healthcare delivery modality. We utilized purposive sampling to recruit participants (N = 57) for nine focus group discussions (FGDs) in Athens, Greece. Eligibility criteria required participants to be at least 18years, with current or prior injection drug use, and current internet access. The FGDs followed a semi-structured interview guide, were audio recorded, transcribed verbatim, translated into English, and de-identified. We applied thematic analysis to analyze FGD transcripts. Participants' mean (standard deviation) age was 47.9 (8.9) years, 89.5% (51/57) were male, 91.2% (52/57) were of Greek origin, and 61.4% (35/57) had attended at least 10years of school. Three main themes emerged from the FGDs: (1) high internet utilization for healthcare-related purposes among PWUD, (2) highlighting telehealth benefits despite access obstacles and PWUDs' concerns about diagnostic accuracy, and (3) approaches to overcome access obstacles and build digital trust. Participants extensively used the internet for healthcare-related processes, such as accessing healthcare information and scheduling provider appointments. Despite being telehealth-inexperienced, most participants expressed a strong willingness to embrace telehealth due to its perceived convenience, time-saving nature, and trusted digital environment. Some participants recognized that the inability to conduct physical examinations through telehealth reduces its diagnostic accuracy, while others expressed concerns about digital literacy and technological infrastructure accessibility. Most participants expressed a preference for video-based telehealth encounters over audio-only encounters. To build trust in telehealth and promote patient-centeredness, participants recommended an initial in-person visit, virtual eye contact during telehealth encounters, patient education, and partnerships with PWUD-supportive community organizations equipped with appropriate infrastructure. PWUD frequently use the internet for health-related purposes and suggested several approaches to enhance virtual trust. Their insights and suggestions are practical guidance for policymakers seeking to enhance healthcare access for underserved populations through telehealth. NCT05794984.

Adopting Verbal and Non-verbal Communication Strategies in Oral Discussion by Omani University Students

Effective communication, both verbal and non-verbal, is key to the success of university students in academic and professional settings. This paper examines how Omani university students use these communication strategies during oral discussions, focusing on the balance between spoken words and non-verbal cues like body language and eye contact. The study finds that while students mostly rely on verbal communication, non-verbal signals play an important role in making their message clearer and more impactful. Recommendations are offered to help students better integrate both forms of communication, improving their readiness for both academic challenges and future careers.

Current perspectives on vestibular insights into spatial cognition: A narrative review

Abstract: Conventionally, the focus on vestibular information has centered on basic functions such as adjusting eye movements, controlling posture, and gaze stabilization. However, there has been a noteworthy transformation in recent years as researchers seek to unravel the mysterious relationship between the vestibular system and spatial cognition. This narrative review endeavors, to provide a thorough analysis of current perspectives by delving into a vast body of research in this domain. The principal aim is to critically assess existing studies, offering nuanced insights into the complex interplay between the vestibular system and spatial abilities. For this the electronic database such as PubMed, EMBASE, CINAHL, and Google Scholar was searched for available literature from 2014 onward based on inclusion and exclusion criteria. After reviewing the literature by different authors, a brief review was conceptualized from the same. This article thoroughly explores brain regions related to vestibular function and their connections to spatial orientation and clinical implications. It identifies research gaps and proposes future avenues to deepen our understanding of the vestibular system’s role in spatial cognition, aiming for a holistic perspective. The intricate link between the vestibular system and spatial memory processing is a significant area in neuroscience, with vestibular exercises holding potential for personalized interventions, emphasizing the need to address research gaps for optimal cognitive well-being.

A common and specialized neural code for social attention triggered by eye gaze and biological motion

Humans appear to be endowed with the ability to readily share attention with interactive partners through the utilization of social direction cues, such as eye gaze and biological motion (BM). Here, we investigated the specialized brain mechanism underlying this fundamental social attention ability by incorporating different types of social (i.e., BM, gaze) and non-social (arrow) cues and combining functional magnetic resonance imaging (fMRI) with a modified central cueing paradigm. Using multi-voxel pattern analysis (MVPA), we found that although gaze- and BM-mediated attentional orienting could be decoded from neural activity in a wide range of brain areas, only the right anterior and posterior superior temporal sulcus (aSTS and pSTS) could specifically decode attentional orienting triggered by social but not non-social cues. Critically, cross-category MVPA further revealed that social attention could be decoded across BM and gaze cues in the right STS and the right superior temporal gyrus (STG). However, these regions could not decode attentional orienting across social and non-social cues. These findings together provide evidence for the existence of a specialized social attention module in the human brain, with the right STS/STG being the critical neural site dedicated to social attention.

Mental State Attribution Mediates Exogenous Orienting of Attention Triggered by Gaze Cues, but not Other Social Cues

AbstractWe examined the properties in orienting visual attention that are triggered by social cues (eye gaze or pointing finger) and nonsocial cues (an arrow). Particularly, we investigated whether the mental state of others would be modulated by any social cue. We presented an occluder between the cue and target to manipulate the mental state of an agent in cues (i.e., whether the agent is aware of the target). For Experiment 1, the reaction time (RT) to detect the target was prolonged when the target side was occluded only in the gaze‐cue condition, but not for the arrow or the pointing finger. For Experiment 2, the RT of a discrimination task, which demanded greater cognitive demand, was not prolonged for any cue type. These results suggest that the mental state attribution for the agency of the cue, which is affected by an occluder, is specific to the gaze cue, and suggest that it is under top‐down control that requires cognitive resources.

Autism: A review

Reduced eye contact, facial expressions, and body movements during the first three years of life are among the social behaviors and nonverbal interactions that define autism spectrum disorder (ASD), a collection of neurodevelopmental diseases. It is generally accepted that this condition is a multifactorial disorder resulting from the combination of both hereditary and non-genetic risk factors. It is not a single disorder. Studies on the genetics of ASD have found mutations that disrupt normal neurodevelopment from infancy through childhood. Axon mobility and synaptogenesis have been linked to these gene complexes. Advances in neuroimaging research have yielded numerous significant insights into the pathological alterations that take place in the brains of individuals with ASD while they are living their lives. Numerous neuropathological and neuroimaging studies have demonstrated the significance of the amygdala, a key component of the limbic system and the affective loop of the cortico-striatothalamo-cortical circuit, in cognition and ASD. The nucleus accumbens is seen as another important structure associated with the social reward response in ASD, in addition to the amygdala. While behavioral and educational interventions have traditionally been the cornerstones of ASD care, pharmaceutical and interventional therapies have also demonstrated some promise in ASD patients. Additionally, a small number of individuals have reportedly improved following deep brain stimulation, one of the interventional treatments.

Pinky-Links and Eye Contact: How the Use of Pre-Competitive Routines Changed My Coaching Practices

As a volleyball coach, my training approach has often relied on reproducing what I saw others do. Consequently, in this study, my purpose was to transform my own coaching practices with a U16 volleyball team. Through my learning during a post-graduate course-based Master’s degree, I became fascinated with pre-competitive (PC) routines and the potential they have to improve athletes’ positive psychological states during training and competition. I employed an iterative Action Research (AR) process to facilitate my learning and application of different PC routine approaches. Specifically, I aimed to challenge myself to examine critically not only my planning and implementation of PC routines (what I did), but also how this process helped me learn to become a more conscientious coach.

Pilot Study on Gaze Characteristics of Older Drivers While Watching Driving Movies.

Objective: This study aims to clarify the gazing characteristics of older drivers while driving cars using a gaze analysis device. Methods: The participants included 16 older and 12 middle-aged drivers who drove cars daily. After conducting cognitive and attentional function tests, eye gaze while watching driving videos was measured using an eye tracker. Ten driving videos were prepared. In addition, a total of 34 hazard areas were analyzed. Results: The results of the gaze measurement parameters were statistically compared between the two groups. In the older group, the gaze analysis results indicated that while viewing driving videos, the search for areas close to the car was expanded. In addition, in several hazard areas, we observed a decrease in the number of drivers gazing at the driver, shortened total gazing time, delay in the timing of gazing, and decrease in the number of visits. Conclusions: Older drivers' eye movement is increased; however, it is characterized by gazing at unimportant areas, indicating an inefficient scanning pattern. Although these results do not indicate an obvious decline in driving ability among older drivers, the decline in hazard perception may become apparent in some situations. The data contain underpowered results and require revalidation in larger studies.

Lock Operations Through the Operator’s Eyes: A Qualitative Exploration of Gaze Strategies

This paper reports a qualitative exploration of gaze strategies during closed-circuit television (CCTV) tasks in remote nautical object control of a lock. Previous research has not examined gaze strategies in scenarios where systems, such as nautical objects, are operated remotely using CCTV. As contextual factors matter in nautical object control, a qualitative approach was necessary to uncover domain-specific terminology and insights into gaze strategies. We recorded eye gaze from professional lock operators and then conducted semi-structured interviews with domain experts to assess these recordings. Thematic analysis revealed that experts were able to identify (features of) gaze strategies but did not share the same terminology. Based on this analysis we defined four strategies: anticipating, verifying, overview, and movement-directed gazes (RQ1). All strategies, except movement-directed gaze, were observed consistently across operators (RQ2), with verifying gaze aligning with task steps in a predefined protocol (RQ3). More generally, our classification framework from thematic analysis could help to systematically define and verify gaze strategies based on domain and task features across various CCTV working contexts. For nautical object control, the framework can be instrumental in interpreting and verifying future (quantitative) eye tracking results and informing instructional procedures.

Evaluation of Optical Tracking to Distinguish Surgeon Experience During Endoscopic Stone Surgery.

Introduction and Objectives: Optical tracking (OT) has shown potential in assessing surgical skill but has yet to be evaluated for endoscopic urologic surgery. We sought to evaluate the potential for OT to distinguish expert and trainee surgeons during flexible ureteroscopy (fURS) for kidney stone treatment in both simulated and live surgical settings. Methods: We performed OT analysis of six surgeons performing stone localization during fURS in two settings. In the first setting, surgeons were tasked with fiducial localization in three separate kidney phantoms during fURS. In the second setting, surgeons performed stone localization via fURS in five separate patients. Surgeons were categorized as "expert" (n = 3, endourologist, average case volume of >100 fURS per year) or trainee (n = 3, trainee, <100 fURS per year). OT metrics were recorded for both settings using the Microsoft HoloLens 2© as the surgeons viewed the surgical monitor during fURS. Standard OT metrics of experts and trainees were compared, and included: area of eye gaze movement, gaze distance traveled, number of gaze fixation points, percentage of gaze fixation dwell time, and number of saccades. Results: In the simulated setting, the average time for stone localization was greater for trainees compared to experts (318 seconds vs 52 seconds, p < 0.01). Additionally, the mean area of eye gaze movements with area of interest (AOI) was greater for trainees compared to experts (1430 cm2 vs 1060 cm2, p < 0.01). The total gaze distance traveled was also greater for trainees compared to experts (1480 cm vs 730 cm, p < 0.01). In the live surgical setting, average time for stone localization was similar for trainees and experts (74 seconds vs 51 seconds, p = 0.05). The total area of eye gaze movements in AOI was greater for trainees compared to experts (700 cm2 vs 30 cm2, p < 0.01). Additionally, the total gaze distance traveled was greater for trainees compared to experts (14,000 cm vs 680 cm, p < 0.01). This suggests more varied and less point specific concentration on the surgical screen by trainees. There was no difference in percentage of gaze fixation dwell time and number of saccades between experts and trainees in either setting. Conclusions: OT analysis can objectively distinguish surgical experience between experts and trainee surgeons performing fURS in both simulated and live surgical settings. These findings may play a role in future surgical training and skills assessment.

Critical Peer Feedback for Oral Presentation at TEFL Tertiary Education: Comparison, Perception and Reflection

Critical peer feedback is regarded as an effective means to facilitate quality of peer feedback in TEFL class. In this study, a comparative study was conducted between two experimental classes (Nc1=31, Nc2=31) to study Chinese undergraduate perception and efficiency of critical peer feedback in oral presentation. By a mixed study, the 5-scale Likert questionnaires and semi-structured interviews (N=8) were implemented at the setting. The study finds that students have strong confidence that critical peer feedback can improve their quality of oral presentation and the quality of peer feedback. And the quality of oral presentation and quality of peer feedback are facilitated in this comparative study. However, the students still perceive that they are inefficient of the skills of oral presentation like eye contact, PPT design and language organization, and critical peer feedback like critical questions and rubrics. In addition, this implies that the skill training of oral presentation and critical peer feedback is the prerequisite for the novice users in TEFL class which can be facilitated by training, and critical peer feedback focuses on the critical content of peer feedback by critical thinking.

Vision-sharing system for android avatars to enable remote eye contact

Maintaining eye contact is a fundamental aspect of non-verbal communication, yet current remote communication tools, such as video calls, struggle to replicate the natural eye contact experienced in face-to-face interactions. This study presents a cutting-edge vision-sharing system for android avatars that enables remote eye contact by synchronizing the eye movements of the operator and the avatar. Our innovative system features an eyeball integrated with a wide-angle lens camera, meticulously designed to mimic human eyes in both appearance and functionality. This technology is seamlessly integrated into android avatars, enabling operators to perceive the avatar’s surroundings as if physically present. It provides a stable and immersive visual experience through a head-mounted display synchronized with the avatar’s gaze direction. Through rigorous experimental evaluations, we demonstrated the system’s ability to faithfully replicate the operator’s perspective through the avatar, making eye contact more intuitive and effortless compared with conventional methods. Subjective assessments further validated the system’s capacity to reduce operational workload and enhance user experience. These compelling findings underscore the potential of our vision-sharing system to elevate the realism and efficacy of remote communication using android avatars.