Gaze Behavior Research Articles

The Use of Eye-Tracking to Explore the Relationship Between Consumers’ Gaze Behaviour and Their Choice Process

Eye-tracking technology can assist researchers in understanding motivational decision-making and choice processes by analysing consumers’ gaze behaviour. Previous studies showed that attention is related to decision, as the preferred stimulus is generally the most observed and the last visited before a decision is made. In this work, the relationship between gaze behaviour and decision-making was explored using eye-tracking technology. Images of six wardrobes incorporating different sustainable design strategies were presented to 57 subjects, who were tasked with selecting the wardrobe they intended to keep the longest. The amount of time spent looking was higher when it was the chosen version. Detailed analyses of gaze plots and heat maps derived from eye-tracking records were employed to identify different patterns of gaze behaviour during the selection process. These patterns included alternating attention between a few versions or comparing them against a reference, allowing the identification of stimuli that initially piqued interest but were ultimately not chosen, as well as potential doubts in the decision-making process. These findings suggest that doubts that arise before making a selection warrant further investigation. By identifying stimuli that attract attention but are not chosen, this study provides valuable insights into consumer behaviour and decision-making processes.

Effect of daytime and nighttime on helicopter pilot’s gaze behavior: a preliminary study in real flight conditions

Nighttime affects pilot visual scan patterns and increase the risks of helicopter operations, contributing to many helicopter accidents and incidents. Several past studies have attempted to examine the effect of nighttime on helicopter pilot gaze behavior, but researchers had limited success due to the difficulty of collecting representative data under real flight conditions. The present study attempted to address this challenge by conducting a real flight study involving daytime and nighttime traffic pattern tasks and using a Tobii Glasses 3 eye-tracking device to collect helicopter pilot eye-tracking data. This study preliminarily explored the feasibility of data collection in real flight conditions in the context of eye-tracking research on civil helicopter pilots in China. Due to safety considerations, only one pilot was recruited to collect data in multiple tasks. Differences and correlations were examined for all gaze behavior metrics. The results suggested that pilot gaze behavior metrics and their correlations differed between daytime and nighttime flights in aspects critical to aviation safety. Pilot gaze behavior also varied with the flight phase. The findings from this study serve as a reference for optimizing helicopter pilot training systems, improving pilot performance during nighttime flights, and ensuring flight safety on helicopters.

Social attention in the wild - fixations to the eyes and autistic traits during a naturalistic interaction in a healthy sample

Attention to social stimuli is a key component of social behavior and facilitates the development of fundamental social skills. Studies investigating social attention in neurotypical or neurodiverse populations have often relied on screen-based experiments using static images or videos, which lack the sensory richness and reciprocity present in real-life social interactions. This can possibly be attributed to the challenges one encounters when creating naturalistic experiments, such as dealing with dynamically moving areas of interest (AOIs), which require either time-intensive manual coding or restraining of participants. Here, we present findings from an experimental paradigm using unrestrained mobile eye-tracking and a face detection algorithm (MTCNN) to measure fixation rates during a semi-structured, face-to-face interview. Data from N = 62 healthy adult participants was analyzed for gaze behavior and related to participants’ autistic traits. We observed a significant negative correlation between fixation rates on the eye region averaged over the entire interaction and scores on the autism spectrum quotient (AQ) (r = −0.14), indicating participants with high autistic traits fixated less frequently on the eye region. We also compared different types of interview questions (open vs. closed) to explore whether the reduction in fixation rates was more pronounced for specific time intervals during the interview. Lastly, we discuss both possibilities for extensions as well as limitations of the presented paradigm that could serve as inspiration for future research.

An eye-tracking and neuroimaging study of negative wording effects on cognitive load in a metacognitive awareness tool

We compared the extraneous cognitive load imposed by two wording conditions: negatively worded and non-negated items in an L2 questionnaire. The questionnaire is the metacognitive awareness listening questionnaire (MALQ), a widely used instrument for assessing metacognitive awareness strategies. Respondents' (N = 109) eye movements measured by an eye-tracker and brain activation levels measured by functional near-infrared spectroscopy (fNIRS) were obtained to examine their extraneous cognitive load in responding to MALQ. Using MANOVA, we identified distinct gaze behavior associated with negatively worded items, indicating that the presence of such items may increase extraneous cognitive load. In addition, English-as-a-second-language participants generally exhibited higher extraneous cognitive load than their L1 counterparts. The results of the neuroimaging investigation further indicated that negatively worded items require more visual attention and cognitive effort, while positively worded items may engage higher-order reflective processing in the brain, highlighting a complex interaction between attention and extraneous cognitive load. Additionally, linear mixed effects models showed that although the models under the two-wording conditions explained a significant amount of variation in respondents’ MALQ scores, they had relatively lower explanatory power (R2) though better global fit compared to the models based on the five constructs that MALQ measures (planning-evaluation, directed attention, person knowledge, mental translation, and problem-solving). We suggest that a balanced approach that considers both the target constructs and the negeative wording effect might be the most effective strategy in questionnaire design and validation. Further implications of these findings are discussed.

Patterns of Gaze Behavior During Live Interactions in Adults and Adolescents with Autism or High Autistic Traits: A Systematic Review

Patterns of Gaze Behavior During Live Interactions in Adults and Adolescents with Autism or High Autistic Traits: A Systematic Review

Neural integration of egocentric and allocentric visual cues in the gaze system.

A fundamental question in neuroscience is how the brain integrates egocentric (body-centered) and allocentric (landmark-centered) visual cues, but for many years this question was ignored in sensorimotor studies. This changed in recent behavioral experiments, but the underlying physiology of ego / allocentric integration remained largely unstudied. The specific goal of this review is to explain how prefrontal neurons integrate eye-centered and landmark-centred visual codes for optimal gaze behavior. First, we briefly review the whole-brain / behavioral mechanisms for ego / allocentric integration in the human and summarize egocentric coding mechanisms in the primate gaze system. We then focus in more depth on cellular mechanisms for ego / allocentric coding in the frontal and supplementary eye fields. We first explain how prefrontal visual responses integrate eye-centered target and landmark codes to produce a transformation toward landmark-centered coordinates. Next, we describe what happens when a landmark shifts during the delay between seeing and acquiring a remembered target, initially resulting in independently co-existing ego / allocentric memory codes. We then describe how these codes are re-integrated in the motor burst for the gaze shift. Deep network simulations suggest that these properties emerge spontaneously for optimal gaze behavior. Finally, we synthesize these observations and relate them to normal brain function through a simplified conceptual model. Together, these results show that integration of visuospatial features continues well beyond visual cortex and suggests a general cellular mechanism for goal-directed visual behaviour.

Predicting closed quarters battle capability – Examining the influence of personality, attentional ability, 2D:4D-ratio and mindfulness on tactical performance

ABSTRACT Close Quarters Battle (CQB) is an operational approach in confined spaces gaining increasing significance in urban combat missions. Due to its high psychophysiological demands, the CQB ability is an essential selection criterion for special forces. Until now, there has been no research on predictors of CQB capability. This study examined the influence of the Big Five personality traits, self-esteem, resilience, attentional ability, 2D:4D digit ratio, and mindfulness on the CQB performance. The German sample comprised a total of n = 45 individuals (n = 29police special forces; n = 16 unspecialized soldiers) who conducted psychometrics and a CQB test consisting of three scenarios. In these scenarios, two independent experts evaluated tactical behavior, weapon handling, gaze behavior, response time, and failures using a standardized behavioral observation instrument based on video recordings (external cameras and mobile eye-tracking). The results revealed that only extraversion predicted the CQB performance (β = -.40, p = .035). However, the mean 2D:4D ratio was strongly associated with gaze behavior (r = .45, p = .007), tactical behavior (r = .41, p = .019), and attentional ability (p = .57, p < .001). Surprisingly, the findings indicate that CQB, as a high-risk and analytical task, is better performed by introverted personnel.

Impact of visual distraction on neonatal mask ventilation: a simulation-based eye-tracking study

ObjectiveThis study aimed to investigate whether distractions during simulated neonatal resuscitation impact mask leakage and visual gaze patterns during positive pressure ventilation (PPV) of a newborn manikin.Study designIn this observational,...

The effects of a dual task on gaze behavior examined during a simulated flight in low-time pilots.

Cognitive load can impair an operator's ability to optimally scan and process relevant information that is critical to the safe and successful operation of an aircraft. Since the cognitive demands experienced by pilots fluctuate throughout a given flight due to changes in task demands that range from high to low cognitive load, it has become increasingly important to objectively track and quantify these changes accordingly. The analysis of eye movements has been shown to be a promising method to understand information acquisition, processing efficiency, and how these aspects of cognition impact pilot performance. Therefore, the aim of the current study was to assess the impact of a dual task paradigm on low-time pilot flight performance and gaze behavior during two phases of flight with varying levels of cognitive load. Twenty-two licensed pilots (<350 h) completed simulated flight circuits alongside an auditory oddball task under visual flight rules conditions. Self-reported situation awareness scores and auditory task performance revealed the dual task was more demanding than the single tasks. Flight performance and gaze behavior indicated that primary task performance and information processing remained unaffected. These results suggest that the recruited pilots attained a level of skill proficiency that enabled the efficient deployment of cognitive resources to successfully complete the flying task under states of increased cognitive load. Combined with previous research findings, the results suggest that the effect of secondary tasks depends on the type of tasks used (i.e., simple/choice response tasks, memory recall, etc.). The utility of using a dual task and gaze behavior to probe flight proficiency and information processing efficiency throughout training are discussed.

Identifying Behavioral Correlates to Visual Discomfort

Outside of self-report surveys, there are no proven, reliable methods to quantify visual discomfort or visually induced motion sickness symptoms when using head-mounted displays. While valuable tools, self-report surveys suffer from potential biases and low sensitivity due to variability in how respondents may assess and report their experience. Consequently, extreme visual-vestibular conflicts are generally used to induce discomfort symptoms large enough to measure reliably with surveys (e.g., stationary participants riding virtual roller coasters). An emerging area of research is the prediction of discomfort survey results from physiological and behavioral markers. However, the signals derived from experimental paradigms that are explicitly designed to be uncomfortable may not generalize to more naturalistic experiences where comfort is prioritized. In this work we introduce a custom VR headset designed to introduce significant near-eye optical distortion (i.e., pupil swim) to induce visual discomfort during more typical VR experiences. We evaluate visual comfort in our headset while users play the popular VR title Job Simulator and show that eye-tracked dynamic distortion correction improves visual comfort in a multi-session, within-subjects user study. We additionally use representational similarity analysis to highlight changes in head and gaze behavior that are potentially more sensitive to visual discomfort than surveys.

Gaze-action coupling, gaze-gesture coupling, and exogenous attraction of gaze in dyadic interactions.

In human interactions, gaze may be used to acquire information for goal-directed actions, to acquire information related to the interacting partner's actions, and in the context of multimodal communication. At present, there are no models of gaze behavior in the context of vision that adequately incorporate these three components. In this study, we aimed to uncover and quantify patterns of within-person gaze-action coupling, gaze-gesture and gaze-speech coupling, and coupling between one person's gaze and another person's manual actions, gestures, or speech (or exogenous attraction of gaze) during dyadic collaboration. We showed that in the context of a collaborative Lego Duplo-model copying task, within-person gaze-action coupling is strongest, followed by within-person gaze-gesture coupling, and coupling between gaze and another person's actions. When trying to infer gaze location from one's own manual actions, gestures, or speech or that of the other person, only one's own manual actions were found to lead to better inference compared to a baseline model. The improvement in inferring gaze location was limited, contrary to what might be expected based on previous research. We suggest that inferring gaze location may be most effective for constrained tasks in which different manual actions follow in a quick sequence, while gaze-gesture and gaze-speech coupling may be stronger in unconstrained conversational settings or when the collaboration requires more negotiation. Our findings may serve as an empirical foundation for future theory and model development, and may further be relevant in the context of action/intention prediction for (social) robotics and effective human-robot interaction.

Emotional expressions, but not social context, modulate attention during a discrimination task

ABSTRACT Investigating social context effects and emotional modulation of attention in a laboratory setting is challenging. Electroencephalography (EEG) requires a controlled setting to avoid confounds, which goes against the nature of social interaction and emotional processing in real life. To bridge this gap, we developed a new paradigm to investigate the effects of social context and emotional expressions on attention in a laboratory setting. We co-registered eye-tracking and EEG to assess gaze behavior and brain activity while participants performed a discrimination task followed by feedback. Video clips of one second in which a confederate displayed either positive, neutral or negative expressions were presented as feedback to the discrimination task. Participants’ belief was manipulated by telling them that the videos were selected either by the computer (non-social condition) or by the experimenter in the adjacent room that observed them via videochat (social condition). We found that emotional expressions modulated late attention processing in the brain (EPN and LPC), but neither early processing (P1) nor saccade latency. Social context did not influence any of the variables studied. We conclude this new paradigm serves as a stepping stone to the development of new paradigms to study social interaction within EEG experiments.

Prehospital ultrasound constitutes a potential distraction from the observation of critically ill patients: a prospective simulation study

BackgroundPrehospital point-of-care ultrasound allows an unstable patient to be rapidly and accurately assessed. However, we are concerned that an excessive focus on the ultrasound device, in an already demanding emergency medical service environment, may distract from patient care, potentially leading to reduced situational awareness and the neglect of other crucial instruments, such as the patient monitor. Thus, in this study, we examined the influence of prehospital ultrasound on situational awareness, by studying the degree to which physicians were distracted from the patient monitor.MethodsWe observed HEMS physicians in a simulated setting and analysed their gaze behaviour using an eye tracker placed on three areas of interests: the ultrasound device, the patient and the patient monitor. In the course of the experiment, the simulated patient desaturated, which was presented on the patient monitor. The primary outcome was the fraction of gaze distribution across the three areas of interest, while secondary outcomes were different gaze metrics (dwell time, revisits, average duration of visual intake and entry time) on the patient monitor. We then compared the participants who noticed the patient’s deterioration with those who did not.ResultsIn 75% of cases, the severely decreased oxygen saturation went unnoticed during the test. Moreover, the gaze distribution of the two groups differed, with the group that recognised the deterioration focusing longer on the patient monitor (7.8% (95% CI 5–10.7) vs 0.1% (95% CI 0–0.3), p: 0.124).ConclusionsThe task of performing an ultrasound examination appears to overwhelm some participants and distract them from other aspects of the scenario. Efforts to mitigate distractions and optimise the use of prehospital ultrasound, such as education, a focus on human factors aspects and standardisation, are crucial for maximising the potential benefits of prehospital ultrasound.

How does contextual information affect aesthetic appreciation and gaze behavior in figurative and abstract artwork?

Numerous studies have investigated how providing contextual information with artwork influences gaze behavior, yet the evidence that contextually triggered changes in oculomotor behavior when exploring artworks may be linked to changes in aesthetic experience remains mixed. The aim of this study was to investigate how three levels of contextual information influenced people's aesthetic appreciation and visual exploration of both abstract and figurative art. Participants were presented with an artwork and one of three contextual information levels: a title, title plus information on the aesthetic design of the piece, or title plus information about the semantic meaning of the piece. We measured participants liking, interest and understanding of artworks and recorded exploration duration, fixation count and fixation duration on regions of interest for each piece. Contextual information produced greater aesthetic appreciation and more visual exploration in abstract artworks. In contrast, figurative artworks were highly dependent on liking preferences and less affected by contextual information. Our results suggest that the effect of contextual information on aesthetic ratings arises from an elaboration effect, such that the viewer aesthetic experience is enhanced by additional information, but only when the meaning of an artwork is not obvious.

Dynamic modulation of social gaze by sex and familiarity in marmoset dyads.

Social communication relies on the ability to perceive and interpret the direction of others' attention, and is commonly conveyed through head orientation and gaze direction in humans and nonhuman primates. However, traditional social gaze experiments in nonhuman primates require restraining head movements, significantly limiting their natural behavioral repertoire. Here, we developed a novel framework for accurately tracking facial features and three-dimensional head gaze orientations of multiple freely moving common marmosets ( Callithrix jacchus ). By combining deep learning-based computer vision tools with triangulation algorithms, we were able to track the facial features of marmoset dyads within an arena. This method effectively generates dynamic 3D geometrical facial frames while overcoming common challenges like occlusion. To detect the head gaze direction, we constructed a virtual cone, oriented perpendicular to the facial frame. Using this pipeline, we quantified different types of interactive social gaze events, including partner-directed gaze and joint gaze to a shared spatial location. We observed clear effects of sex and familiarity on both interpersonal distance and gaze dynamics in marmoset dyads. Unfamiliar pairs exhibited more stereotyped patterns of arena occupancy, more sustained levels of social gaze across social distance, and increased social gaze monitoring. On the other hand, familiar pairs exhibited higher levels of joint gazes. Moreover, males displayed significantly elevated levels of gazes toward females' faces and the surrounding regions, irrespective of familiarity. Our study reveals the importance of two key social factors in driving the gaze behaviors of a prosocial primate species and lays the groundwork for a rigorous quantification of primate behaviors in naturalistic settings.

Effects of teacher students’ study progress on their gaze behavior while solving of an economics knowledge test

Positive effects of study progress on the economic knowledge of bachelor students are evident and were often referred to as proof of the validity of tests in the context of a longitudinal analysis. However, differences between domain-specific (e.g., semester) or discipline-specific (e.g., attended courses) indicators of study progress on students’ solving the economics tasks are relevant for both diagnostic and instructional purposes, but have hardly been researched to date. In an eye tracking study, we therefore calculated the average fixation duration during 900 task-solving processes of 35 economics teacher students solving 25 single-choice economics tasks. A multi-level mediation analysis shows that both indicators (i.e., semester and attended courses) were positively correlated with economics knowledge. At the same time, the impact of semesters and courses attended on their test performance was partially mediated by average fixation duration on the attractor and distractors, respectively. This suggests that visual attention differs during the task-solving process depending on the domain- or discipline-specific indicator of study progress.

The timing of vision in basketball three-point shots.

The aim of the present study was to explore the relationship between gaze behaviour, motor responses and the direction of visual attention when different levels of basketball players were engaged in a basketball three-point shot. Twelve near-experts and 12 amateur basketball players, wearing an eye tracker and an inertial sensor, performed 20 shots on a basketball field, receiving the ball from a teammate, who then acted as the opponent. The trial sequence was subdivided into catching, aiming and ball flight phases. The analysis demonstrated that near-experts exhibited longer fixation durations and saccades of lower amplitude and peak velocity than amateurs. The gaze behaviour showed that all players utilized fixations during the last part of the catching phase, during most of the aiming phase, and during the final part of the ball flight phase. The greatest number of saccades was exhibited between the aiming and the ball flight phases, when the ball was released by the players. Saccades were oriented toward the teammate during the catching phase. Instead, during the aiming and ball flight phases, saccade orientations were not polarized toward a specific visual cue. In conclusion, vision plays a critical role in every aspect of the three-point shot in basketball, from catching the ball, to aiming preparation, and shot execution. It is a key factor in decision-making, spatial awareness, and overall performance in team sports.

Gaze and hand behaviors during haptic abilities testing-An update to multimedia learning theory.

The Cognitive Theory of Multimedia Learning (CTML) suggests humans learn through visual and auditory sensory channels. Haptics represent a third channel within CTML and a missing component for experiential learning. The objective was to measure visual and haptic behaviors during spatial tasks. The haptic abilities test (HAT) quantifies results in several realms, accuracy, time, and strategy. The HAT was completed under three sensory conditions using sight (S), haptics (H), and sight with haptics (SH). Subjects (n = 22, 13 females (F), 20-28 years) completed the MRT (10.6 ± 5.0, mean ± SD) and were classified as high or low spatial abilities scores with respect to mean MRT: high spatial abilities (HSA) (n = 12, 6F, MRT = 13.7 ± 3.0), and low spatial ability (LSA) groups (n = 10, 7F, MRT = 5.6 ± 2.0). Video recordings gaze and hand behaviors were compared between HSA and LSA groups across HAT conditions. The HSA group spent less time fixating on mirrored objects, an erroneous answer option, of HAT compared to the LSA group (11.0 ± 4.7 vs. 17.8 ± 7.3 s, p = 0.020) in S conditions. In haptic conditions, HSA utilized a hand-object interaction strategy characterized as palpation, significantly less than the LSA group (23.2 ± 16.0 vs. 43.1 ± 21.5 percent, p = 0.022). Before this study, it was unclear whether haptic sensory inputs appended to the mental schema models of the CTML. These data suggest that if spatial abilities are challenged, LSA persons both benefit and utilize strategies beyond the classic CTML framework by using their hands as a third input channel. This data suggest haptic behaviors offer a third type of sensory memory resulting in improved cognitive performance.

Infrared thermal imaging and eye-tracking for deception detection: a laboratory study

Despite significant advances in deception detection in forensic psychology using polygraphy, there is a lack of empirical evidence for the potential of deception detection in ordinary situations of simple conversation where contact and invasive measurement methods are not appropriate. To address this issue, we used two strategies: 1) a non-invasive observation of facial thermal changes and gaze behaviour under deceptive and truthful conditions and 2) combination of prepared and unprepared questions during an interview. We used a within-person experimental design where responses from 16 participants were recorded, using infrared thermal imaging (fITI) and eye-tracking to measure the dependent variables (i.e., thermal changes of the nose, cheeks and forehead and gaze fixations of the interviewer’s eyes). The independent variables were veracity (truth vs. lie) and type of scenarios (prepared vs. spontaneous). Mixed-effects regression models were used to analyse the effect of lying and effect of preparation. Veracity did not significantly modulate any physiological marker, but forehead and cheek temperature were significantly modulated by the different scenario conditions in the expected direction. Multiple comparisons revealed a significant modulation of eye fixations by both the lying and scenario conditions, with eye fixations being lower in the spontaneous scenarios and higher in the prepared deceptive conditions. The results underline the significant influence of arousal and cognitive load on individual variability in all dependent variables and provide essential insights for future research into the physiological and behavioural aspects of deception detection. This study lays the foundation for the use of fITI and eye-tracking under certain experimental conditions of an ordinary conversation in content and emphasises the role of (un)preparation for the accuracy of deception detection.

Cooperativeness as a Personality Trait and Its Impact on Cooperative Behavior in Young East Asian Adults Who Synchronized in Casual Conversations.

Cooperation is essential in social life, involving collaborative efforts for mutual benefits. Individual differences in the cooperativeness trait are pivotal in these interactions. A single-group pretest-posttest design was used in this study to determine if Duchenne smiling with gaze and inter-brain synchrony (IBS) during conversation mediates the relationship between cooperativeness and cooperative behavior. The relationships among the variables were examined using mediation analysis and path analysis. We hypothesized that Duchenne smiling with gaze would mediate cooperativeness' impact on cooperative behavior, while expecting IBS in the left prefrontal region to predict cooperative behavior. The results demonstrated that cooperativeness significantly predicted Duchenne smiling with gaze and cooperative behavior; however, Duchenne smiling with gaze did not mediate the relationship between them. Additionally, IBS during conversation did not predict successive cooperative behavior. These results suggest dispositional factors like cooperativeness may play a more decisive role than momentary expressional cues or neural synchrony in naturalistic unstructured communication in shaping cooperative behavioral outcomes after the communication. The study highlights how personality traits like cooperativeness shape nonverbal communication and social interactions, implying that interventions aimed at developing cooperativeness could lead to more effective collaboration in social settings.