Eye Gaze Research Articles

Tasks Reflected in the Eyes: Egocentric Gaze-Aware Visual Task Type Recognition in Virtual Reality.

With eye tracking finding widespread utility in augmented reality and virtual reality headsets, eye gaze has the potential to recognize users' visual tasks and adaptively adjust virtual content displays, thereby enhancing the intelligence of these headsets. However, current studies on visual task recognition often focus on scene-specific tasks, like copying tasks for office environments, which lack applicability to new scenarios, e.g., museums. In this paper, we propose four scene-agnostic task types for facilitating task type recognition across a broader range of scenarios. We present a new dataset that includes eye and head movement data recorded from 20 participants while they engaged in four task types across 15 360-degree VR videos. Using this dataset, we propose an egocentric gaze-aware task type recognition method, TRCLP, which achieves promising results. Additionally, we illustrate the practical applications of task type recognition with three examples. Our work offers valuable insights for content developers in designing task-aware intelligent applications. Our dataset and source code are available at zhimin-wang.github.io/TaskTypeRecognition.html.

Lack of Eye Gaze and its Effects on Spoken Interaction in Synchronous Online Communication

The importance of oral interaction in language learning is well recognised, and this paper examines the factors that hinder English as a Foreign Language (EFL) learners’ active participation in online discussions during Synchronous Online Communication. Using focus groups with 51 Cypriot Greek-speaking students from three tertiary institutions in Cyprus, thematic analysis revealed that the perceived prominent factor inhibiting oral interaction in the online environment was the absence of eye gaze and its associated social functions. Specifically, eye gaze was identified as a signal for turn-taking, turn-yielding, and turn-denying, whose absence hindered learners’ ability to interpret their peers’ and teachers’ intentions and expectations. The paper concludes with pedagogical implications for technologists, software developers, students, language teachers, and language teacher educators.

Using large language models to accelerate communication for eye gaze typing users with ALS

Accelerating text input in augmentative and alternative communication (AAC) is a long-standing area of research with bearings on the quality of life in individuals with profound motor impairments. Recent advances in large language models (LLMs) pose opportunities for re-thinking strategies for enhanced text entry in AAC. In this paper, we present SpeakFaster, consisting of an LLM-powered user interface for text entry in a highly-abbreviated form, saving 57% more motor actions than traditional predictive keyboards in offline simulation. A pilot study on a mobile device with 19 non-AAC participants demonstrated motor savings in line with simulation and relatively small changes in typing speed. Lab and field testing on two eye-gaze AAC users with amyotrophic lateral sclerosis demonstrated text-entry rates 29–60% above baselines, due to significant saving of expensive keystrokes based on LLM predictions. These findings form a foundation for further exploration of LLM-assisted text entry in AAC and other user interfaces.

Is It Possible to Recognize a Speaker Without Listening? Unraveling Conversation Dynamics in Multi-Party Interactions Using Continuous Eye Gaze

Is It Possible to Recognize a Speaker Without Listening? Unraveling Conversation Dynamics in Multi-Party Interactions Using Continuous Eye Gaze

An Investigation of Multimodal Kinematic Template Matching for Ray Pointing Prediction for Target Selection in VR

We explore the use of multimodal input to predict the landing position of a ray pointer while selecting targets in a virtual reality (VR) environment. We first extend a prior 2D Kinematic Template Matching technique to include head movements. This new technique, Head-Coupled Kinematic Template Matching, was found to improve upon the existing 2D approach, with an angular error of 10.0° when a user was 40% of the way through their movement. We then investigate two additional models that incorporated eye gaze, which were both found to further improve the predicted landing positions. The first model, Gaze-Coupled Kinematic Template Matching resulted in angular error of 6.8° for reciprocal target layouts and 9.1° for random target layouts, when a user was 40% of the way through their movement. The second model, Hybrid Kinematic Template Matching, resulted in angular error of 5.2° for reciprocal target layouts and 7.2° for random target layouts when a user was 40% of the way through their movement. We also found that using just the current gaze location resulted in sufficient predictions in many conditions. We reflect on our results by discussing the broader implications of utilizing multimodal input to inform selection predictions in VR.

Multi-stage gaze-controlled virtual keyboard using eye tracking.

This study presents a novel multi-stage hierarchical approach to optimize key selection on virtual keyboards using eye gaze. Existing single-stage selection algorithms have difficulty with distant keys on large interfaces. The proposed technique divides the standard QWERTY keyboard into progressively smaller regions guided by eye movements, with boundary fixations first selecting halves and quarters to sequentially narrow the search area. Within each region, keys are highlighted one by one for selection. An experiment compared the multi-stage approach to single-step techniques, having participants copy text using eye gaze alone under both conditions. Metrics on selection speed, words per minute, and usability ratings were significantly improved with the hierarchical technique. Half and quarter selection times decreased over 30% on average while maintaining accuracy, with overall task completion 20% faster. Users also rated the multi-stage approach as more comfortable and easier to use. The multi-level refinement of the selection area optimized interaction efficiency for gaze-based text entry.

The Influence of Eye Gaze Direction on Consumers

Abstract: There are now static ads where the model looks at the product, as well as static ads where the model doesn't look at the product. The study's goal was to investigate how models' eye gaze directions affect consumers. This paper uses a questionnaire survey as a case study to conduct a detailed analysis. It collects data on consumers' perceived attractiveness of the product, their evaluation of the product, and their intention to purchase the product. Additionally, it discusses the impact of the model's eye gaze direction on these consumers. The model's eye gaze direction has the first influence on consumers' perceived attraction to the product. Consumers will be more attracted to the product when the model's gaze remains fixed on it. In light of this influence, this paper proposes adding dynamic elements to the advertisement to make consumers more attracted to the product. Consumers' evaluation of the product is the second influence of the model's eye gaze direction on consumers is consumers' evaluation of the product. Fixing the model's eye gaze on the product improves consumers' evaluation of it. This paper suggests that the advertisement should truly reflect the product's characteristics and advantages in light of this influence. The third effect of the model's direction of gaze on consumers is their intention to purchase the product. Focusing the model's gaze on the product enhances consumers' purchase intentions. Given this influence, this paper recommends allowing stars or models that align with the product's characteristics to represent it.

Second Language Listeners’ Emotion and Eye Gaze: A Web-Based Eye-Tracking Study

ABSTRACT While previous studies have shown that L2 listeners tend to focus more on videos with additional information, like presentation slides, the amount of eye gaze did not necessarily translate to higher listening test scores . Unlike previous research focusing on the benefits of additional visual cues, this study explores how emotions impact L2 listeners’ viewing behavior. Sixty-four adults completed the Foreign Language Listening Anxiety Scale (FLLAS), watched three academic lectures with their eye movements tracked, and answered comprehension questions. According to the results, listening anxiety was not a significant predictor of viewing videos. The relationship between viewing time and comprehension scores was non-significant. Interviews and survey responses highlighted diverse attitudes toward the videos. The findings suggest that individual differences in listening anxiety may not significantly influence how much participants look at the videos. Furthermore, adding context videos to listening tests to increase authenticity does not seem to affect comprehension scores, consistent with previous studies. The implications for developing video-based listening tests are discussed.

Probiotics and Other Supplements for Autism Spectrum Disorder (ASD): A Comprehensive Review

Introduction: Autism Spectrum Disorder (ASD) is a complex neurodevelopmental condition characterized by social interaction challenges, communication difficulties, and repetitive behaviors. While ASD lacks a cure, there is a growing interest in supplements, notably probiotics, for potential benefits. Probiotics are live microorganisms with health potential due to their role in the gut microbiome. Gut-brain axis is a bi-directional communication system that connects the gastrointestinal (GI) tract and the brain. Objective: This comprehensive review systematically searched scientific databases up to September 2023 to examine the use of supplements, particularly probiotics, in individuals with ASD. The review focused on addressing gut-related issues and improving behavior, speech, and overall well-being. Methods: A systematic search across databases such as PubMed, PsycINFO, and Cochrane library was conducted using keywords like "probiotics," "supplements," "ASD," "gut dysbiosis," and "therapeutic interventions." Studies meeting inclusion criteria, including clinical trials, observational studies, and case reports, were considered. Results: Several studies suggest that probiotics may improve behavior, brain activity, and eye contact in individuals with ASD by addressing gut dysbiosis. Lactobacillus reuteri and specific Bifidobacterium strains are recommended probiotics, but more research is needed to confirm their efficacy. This review also explores supplements like Vitamin B6, magnesium, Vitamin B12, Vitamin C, and Omega-3 fatty acids, which show potential in supporting speech and overall well-being in individuals with ASD. However, they are not a cure and should be used under professional guidance. The article also discusses supplements for adults with ASD, underlining the importance of consulting healthcare professionals before use and the necessity for further research to determine effectiveness and optimal dosages. Conclusion: Probiotics and supplements offer potential benefits for individuals with ASD, but they should be seen as complementary therapies rather than cures. A holistic approach, including medical supervision, therapy, and dietary considerations, is crucial for addressing the complex needs of individuals with ASD. Further research is necessary to uncover the precise mechanisms and therapeutic potential of these supplements in enhancing the lives of those with ASD. Categories: Neurology, Gastroenterology, Nutrition

Communicative Skills in Medical Students

Positive interaction between the doctor and the patient affects the treatment outcome, as well as the level of satisfaction with healthcare services. Many young doctors experience communicative issues that can lead to negative consequences for all stakeholders. The research featured various problems in shaping communicative skills in medical students. It involved a review of scientific publications, a survey of first-year medical students (n = 20), and an analysis of 40 negative feedbacks from patients. The communicative issues included: lack of eye contact / active listening, misleading mimics, inappropriate intonation / voice volume, violation of private space, insufficient or excessive amount of information, lack of bedside manners / respect for patients. The list of communication skills to be mastered by medical students in order to improve the quality of medical care included: eye contact, self-presentation, active listening, conflict management, strategies of delivering bad news, and conclusion phrases. The data obtained make it possible to identify key aspects that affect the formation of communicative skills in future doctors, as well as to propose methods for its improvement at university level. The authors emphasize the importance of developing communicative skills in future doctors to provide high-quality medical care and prevent emotional burnout in young professionals.

Early gesture development as a predictor of autism spectrum disorder in elevated-likelihood infants of ASD

BackgroundGesture difficulties have been reported in later-born siblings of children with autism spectrum disorder (ASD). Careful observation of gesture development during the first two years of children at elevated likelihood (EL) of developing ASD may identify behavioral indicators that facilitate early diagnosis.MethodsThis study enrolled 47 EL infants and 27 low-likelihood (LL) infants to explore gesture developmental trajectories and the predictive value of gesture to expedite the early detection of core characteristics of ASD. Gesture frequency, communication function, and integration ability were observed and coded from a semi-structured assessment administered longitudinally across 9–19 months of age. We conducted the Autism Diagnostic Observation Schedule assessment at 18–19 months for ASD’s core characteristics.ResultsThe development of joint attention (JA) gestures was slower in the EL than in the LL group. The trajectories of the two groups began to diverge at 14–18 months. Children who reached the diagnostic cutoff point for ASD showed reductions in social interaction gestures at 12–13 months, in gestures integrated with any two communication skills (G-M) at 15–16 months; and in gestures integrated with eye contact (G-E) at 18–19 months. Overall gesture and G-M integration were associated with an overall ADOS communication and social interaction score.ConclusionsThe developmental trajectories of JA gestures of EL and LL children differed. G-M gestures represent early indicators that may be a predictor of ASD.

Telehealth to increase healthcare access; perspectives of people who use drugs.

People who use drugs (PWUD) often face restricted healthcare access despite their heightened healthcare needs. Factors such as stigma, mistrust of the healthcare system, competing priorities, and geographical barriers pose significant healthcare access challenges. Telehealth offers an innovative solution to expand healthcare access for better inclusion of underserved populations in healthcare. We aimed to explore PWUDs' perceptions of telehealth as a healthcare delivery modality. We utilized purposive sampling to recruit participants (N = 57) for nine focus group discussions (FGDs) in Athens, Greece. Eligibility criteria required participants to be at least 18years, with current or prior injection drug use, and current internet access. The FGDs followed a semi-structured interview guide, were audio recorded, transcribed verbatim, translated into English, and de-identified. We applied thematic analysis to analyze FGD transcripts. Participants' mean (standard deviation) age was 47.9 (8.9) years, 89.5% (51/57) were male, 91.2% (52/57) were of Greek origin, and 61.4% (35/57) had attended at least 10years of school. Three main themes emerged from the FGDs: (1) high internet utilization for healthcare-related purposes among PWUD, (2) highlighting telehealth benefits despite access obstacles and PWUDs' concerns about diagnostic accuracy, and (3) approaches to overcome access obstacles and build digital trust. Participants extensively used the internet for healthcare-related processes, such as accessing healthcare information and scheduling provider appointments. Despite being telehealth-inexperienced, most participants expressed a strong willingness to embrace telehealth due to its perceived convenience, time-saving nature, and trusted digital environment. Some participants recognized that the inability to conduct physical examinations through telehealth reduces its diagnostic accuracy, while others expressed concerns about digital literacy and technological infrastructure accessibility. Most participants expressed a preference for video-based telehealth encounters over audio-only encounters. To build trust in telehealth and promote patient-centeredness, participants recommended an initial in-person visit, virtual eye contact during telehealth encounters, patient education, and partnerships with PWUD-supportive community organizations equipped with appropriate infrastructure. PWUD frequently use the internet for health-related purposes and suggested several approaches to enhance virtual trust. Their insights and suggestions are practical guidance for policymakers seeking to enhance healthcare access for underserved populations through telehealth. NCT05794984.

Adopting Verbal and Non-verbal Communication Strategies in Oral Discussion by Omani University Students

Effective communication, both verbal and non-verbal, is key to the success of university students in academic and professional settings. This paper examines how Omani university students use these communication strategies during oral discussions, focusing on the balance between spoken words and non-verbal cues like body language and eye contact. The study finds that while students mostly rely on verbal communication, non-verbal signals play an important role in making their message clearer and more impactful. Recommendations are offered to help students better integrate both forms of communication, improving their readiness for both academic challenges and future careers.

Current perspectives on vestibular insights into spatial cognition: A narrative review

Abstract: Conventionally, the focus on vestibular information has centered on basic functions such as adjusting eye movements, controlling posture, and gaze stabilization. However, there has been a noteworthy transformation in recent years as researchers seek to unravel the mysterious relationship between the vestibular system and spatial cognition. This narrative review endeavors, to provide a thorough analysis of current perspectives by delving into a vast body of research in this domain. The principal aim is to critically assess existing studies, offering nuanced insights into the complex interplay between the vestibular system and spatial abilities. For this the electronic database such as PubMed, EMBASE, CINAHL, and Google Scholar was searched for available literature from 2014 onward based on inclusion and exclusion criteria. After reviewing the literature by different authors, a brief review was conceptualized from the same. This article thoroughly explores brain regions related to vestibular function and their connections to spatial orientation and clinical implications. It identifies research gaps and proposes future avenues to deepen our understanding of the vestibular system’s role in spatial cognition, aiming for a holistic perspective. The intricate link between the vestibular system and spatial memory processing is a significant area in neuroscience, with vestibular exercises holding potential for personalized interventions, emphasizing the need to address research gaps for optimal cognitive well-being.

A common and specialized neural code for social attention triggered by eye gaze and biological motion

Humans appear to be endowed with the ability to readily share attention with interactive partners through the utilization of social direction cues, such as eye gaze and biological motion (BM). Here, we investigated the specialized brain mechanism underlying this fundamental social attention ability by incorporating different types of social (i.e., BM, gaze) and non-social (arrow) cues and combining functional magnetic resonance imaging (fMRI) with a modified central cueing paradigm. Using multi-voxel pattern analysis (MVPA), we found that although gaze- and BM-mediated attentional orienting could be decoded from neural activity in a wide range of brain areas, only the right anterior and posterior superior temporal sulcus (aSTS and pSTS) could specifically decode attentional orienting triggered by social but not non-social cues. Critically, cross-category MVPA further revealed that social attention could be decoded across BM and gaze cues in the right STS and the right superior temporal gyrus (STG). However, these regions could not decode attentional orienting across social and non-social cues. These findings together provide evidence for the existence of a specialized social attention module in the human brain, with the right STS/STG being the critical neural site dedicated to social attention.

Mental State Attribution Mediates Exogenous Orienting of Attention Triggered by Gaze Cues, but not Other Social Cues

AbstractWe examined the properties in orienting visual attention that are triggered by social cues (eye gaze or pointing finger) and nonsocial cues (an arrow). Particularly, we investigated whether the mental state of others would be modulated by any social cue. We presented an occluder between the cue and target to manipulate the mental state of an agent in cues (i.e., whether the agent is aware of the target). For Experiment 1, the reaction time (RT) to detect the target was prolonged when the target side was occluded only in the gaze‐cue condition, but not for the arrow or the pointing finger. For Experiment 2, the RT of a discrimination task, which demanded greater cognitive demand, was not prolonged for any cue type. These results suggest that the mental state attribution for the agency of the cue, which is affected by an occluder, is specific to the gaze cue, and suggest that it is under top‐down control that requires cognitive resources.

Autism: A review

Reduced eye contact, facial expressions, and body movements during the first three years of life are among the social behaviors and nonverbal interactions that define autism spectrum disorder (ASD), a collection of neurodevelopmental diseases. It is generally accepted that this condition is a multifactorial disorder resulting from the combination of both hereditary and non-genetic risk factors. It is not a single disorder. Studies on the genetics of ASD have found mutations that disrupt normal neurodevelopment from infancy through childhood. Axon mobility and synaptogenesis have been linked to these gene complexes. Advances in neuroimaging research have yielded numerous significant insights into the pathological alterations that take place in the brains of individuals with ASD while they are living their lives. Numerous neuropathological and neuroimaging studies have demonstrated the significance of the amygdala, a key component of the limbic system and the affective loop of the cortico-striatothalamo-cortical circuit, in cognition and ASD. The nucleus accumbens is seen as another important structure associated with the social reward response in ASD, in addition to the amygdala. While behavioral and educational interventions have traditionally been the cornerstones of ASD care, pharmaceutical and interventional therapies have also demonstrated some promise in ASD patients. Additionally, a small number of individuals have reportedly improved following deep brain stimulation, one of the interventional treatments.

Pinky-Links and Eye Contact: How the Use of Pre-Competitive Routines Changed My Coaching Practices

As a volleyball coach, my training approach has often relied on reproducing what I saw others do. Consequently, in this study, my purpose was to transform my own coaching practices with a U16 volleyball team. Through my learning during a post-graduate course-based Master’s degree, I became fascinated with pre-competitive (PC) routines and the potential they have to improve athletes’ positive psychological states during training and competition. I employed an iterative Action Research (AR) process to facilitate my learning and application of different PC routine approaches. Specifically, I aimed to challenge myself to examine critically not only my planning and implementation of PC routines (what I did), but also how this process helped me learn to become a more conscientious coach.

Pilot Study on Gaze Characteristics of Older Drivers While Watching Driving Movies.

Objective: This study aims to clarify the gazing characteristics of older drivers while driving cars using a gaze analysis device. Methods: The participants included 16 older and 12 middle-aged drivers who drove cars daily. After conducting cognitive and attentional function tests, eye gaze while watching driving videos was measured using an eye tracker. Ten driving videos were prepared. In addition, a total of 34 hazard areas were analyzed. Results: The results of the gaze measurement parameters were statistically compared between the two groups. In the older group, the gaze analysis results indicated that while viewing driving videos, the search for areas close to the car was expanded. In addition, in several hazard areas, we observed a decrease in the number of drivers gazing at the driver, shortened total gazing time, delay in the timing of gazing, and decrease in the number of visits. Conclusions: Older drivers' eye movement is increased; however, it is characterized by gazing at unimportant areas, indicating an inefficient scanning pattern. Although these results do not indicate an obvious decline in driving ability among older drivers, the decline in hazard perception may become apparent in some situations. The data contain underpowered results and require revalidation in larger studies.

Lock Operations Through the Operator’s Eyes: A Qualitative Exploration of Gaze Strategies

This paper reports a qualitative exploration of gaze strategies during closed-circuit television (CCTV) tasks in remote nautical object control of a lock. Previous research has not examined gaze strategies in scenarios where systems, such as nautical objects, are operated remotely using CCTV. As contextual factors matter in nautical object control, a qualitative approach was necessary to uncover domain-specific terminology and insights into gaze strategies. We recorded eye gaze from professional lock operators and then conducted semi-structured interviews with domain experts to assess these recordings. Thematic analysis revealed that experts were able to identify (features of) gaze strategies but did not share the same terminology. Based on this analysis we defined four strategies: anticipating, verifying, overview, and movement-directed gazes (RQ1). All strategies, except movement-directed gaze, were observed consistently across operators (RQ2), with verifying gaze aligning with task steps in a predefined protocol (RQ3). More generally, our classification framework from thematic analysis could help to systematically define and verify gaze strategies based on domain and task features across various CCTV working contexts. For nautical object control, the framework can be instrumental in interpreting and verifying future (quantitative) eye tracking results and informing instructional procedures.