Combined Eye Tracking Research Articles

Neural mechanisms of attention become more specialised during infancy: Insights from combined eye tracking and EEG.

Successful use of combined simultaneous remote eye tracking and EEG to measure infant attention shifts. Neural responses involved in attention shifts change in the first year of life. The lateralisation of EEG responses changes with age in the first year of life. Frontal cortex is involved in attention shifts from around 2 months of age.

Perceptions of harm and addiction of snus: An exploratory study.

Tobacco companies in the United States are prohibited from making reduced harm claims without filing a modified risk tobacco product application with the Food and Drug Administration and obtaining an order to market as such. However, it is possible that product marketing may suggest reduced risk to individuals. This study examines perceptions, in particular those related to harm and addiction, of snus print advertisements using a combination of eye-tracking, survey, and semistructured interviews. Participants were 22 male smokers ages 19-29 (M = 26.64, SD = 2.92). Five snus advertisements were each displayed for 20 s and eye movements were tracked. Participants responded to questions about harm and addiction after each advertisement and interviews were conducted after seeing all advertisements. For each advertisement, descriptive statistics were calculated and regression analyses predicted harm and addiction perceptions from eye tracking areas of interest (e.g., warning label). Qualitative data were analyzed using inductive/deductive thematic analysis. For certain advertisements, areas of interest were significantly associated with harm and/or addiction perceptions. For example, higher total fixation duration on the graphic in the Smokeless for Smokers advertisement was associated with decreased perceptions of addiction (B = -.360, p = .048). Qualitative themes emerged and in many instances corroborated quantitative results. This study indicates that for some advertisements, attention on certain areas (measured through eye tracking) is associated with perceptions among young male smokers. Understanding how smokers perceive and understand products after viewing advertisements may inform regulations regarding claims about product harm and addiction and may guide public health efforts to educate smokers on the risks of emerging products. (PsycINFO Database Record

Eye tracking study of attention to print advertisements: Effects of typeface figuration

The use of rhetorical figures has become a widely–accepted method for capturing attention and positively increasing cognitive effort in print advertisements. So far research studies mostly analyzed the effect of rhetorical figures in the written as well as pictorial elements of an ad. However, there have been few studies addressing the effect of rhetorical figuration in the specific area of typeface design. This study analyzes the effects of typeface figuration (i.e., regular vs. irregular stylization of the form) on attention and attitude of the viewers. The study also looks at how the effect of typeface figuration changes in relation to the type of a product (hedonistic vs. utilitarian) being advertised. Through the use of a 2 × 2 experimental design, the study measures data using a combination of eye tracking (an objective method) and attitude scaling (a subjective method). 65 volunteers participated in the study. The eye tracking results show that using rhetorical figures in typeface mainly affects attention of the viewers. We have also determined that they influence their attitude. Additionally, the study shows that a typeface and a type of products are correlated; it shows that the hedonistic type of products can benefit more from the figuration. In conclusion, our study builds on and expands the current understanding of the use of rhetorical figures by proving that there is a correlation between the use of rhetorical figures in typeface and viewers' attention, depending on the type of product being advertised.

Neural Differences between Covert and Overt Attention Studied using EEG with Simultaneous Remote Eye Tracking.

Research on neural mechanisms of attention has generally instructed subjects to direct attention covertly while maintaining a fixed gaze. This study combined simultaneous eye tracking and electroencephalogram (EEG) to measure neural attention responses during exogenous cueing in overt attention shifts (with saccadic eye movements to a target) and compared these with covert attention shifts (responding manually while maintaining central fixation). EEG analysis of the period preceding the saccade latency showed similar occipital response amplitudes for overt and covert shifts, although response latencies differed. However, a frontal positivity was greater during covert attention shifts, possibly reflecting saccade inhibition to maintain fixation. The results show that combined EEG and eye tracking can be successfully used to study natural overt shifts of attention (applicable to non-verbal infants) and that requiring inhibition of saccades can lead to additional frontal responses. Such data can be used to refine current neural models of attention that have been mainly based on covert shifts.

Dissociating parafoveal preview benefit and parafovea-on-fovea effects during reading: A combined eye tracking and EEG study.

During reading, the parafoveal processing of an upcoming word n+1 can influence word recognition in two ways: It can affect fixation behavior during the preceding fixation on word n (parafovea-on-fovea effect, POF), and it can facilitate subsequent foveal processing once word n+1 is fixated (preview benefit). While preview benefits are established, evidence for POF effects is mixed. Recently, it has been suggested that POF effects exist, but have a delayed impact on saccade planning and thus coincide with preview benefits measured on word n+1. We combined eye movement and EEG recordings to investigate and separate neural correlates of POF and preview benefit effects. Participants read lists of nouns either in a boundary paradigm or the RSVP-with-flankers paradigm, while we recorded fixation- or event-related potentials (FRPs/ERPs), respectively. The validity and lexical frequency of the word shown as preview for the upcoming word n+1 were orthogonally manipulated. Analyses focused on the first fixation on word n+1. Preview validity (correct vs. incorrect preview) strongly modulated fixation times and electrophysiological N1 amplitudes, replicating previous findings. Importantly, gaze durations and FRPs measured on word n+1 were also affected by the frequency of the word shown as preview, with low-frequency previews eliciting a sustained, N400-like centroparietal negativity. Results support the idea that POF effects exist but affect word recognition with a delay. Lastly, once word n+1 was fixated, its frequency also modulated N1 amplitudes in ERPs and FRPs. Taken together, we separated immediate and delayed effects of parafoveal processing on brain correlates of word recognition.

Out of sight, out of mind: Categorization learning and normal aging

The present combined EEG and eye tracking study examined the process of categorization learning at different age ranges and aimed to investigate to which degree categorization learning is mediated by visual attention and perceptual strategies. Seventeen young subjects and ten elderly subjects had to perform a visual categorization task with two abstract categories. Each category consisted of prototypical stimuli and an exception. The categorization of prototypical stimuli was learned very early during the experiment, while the learning of exceptions was delayed. The categorization of exceptions was accompanied by higher P150, P250 and P300 amplitudes. In contrast to younger subjects, elderly subjects had problems in the categorization of exceptions, but showed an intact categorization performance for prototypical stimuli. Moreover, elderly subjects showed higher fixation rates for important stimulus features and higher P150 amplitudes, which were positively correlated with the categorization performances. These results indicate that elderly subjects compensate for cognitive decline through enhanced perceptual and attentional processing of individual stimulus features. Additionally, a computational approach has been applied and showed a transition away from purely abstraction-based learning to an exemplar-based learning in the middle block for both groups. However, the calculated models provide a better fit for younger subjects than for elderly subjects. The current study demonstrates that human categorization learning is based on early abstraction-based processing followed by an exemplar-memorization stage. This strategy combination facilitates the learning of real world categories with a nuanced category structure. In addition, the present study suggests that categorization learning is affected by normal aging and modulated by perceptual processing and visual attention.

Using support vector machines to identify literacy skills: Evidence from eye movements

Is inferring readers' literacy skills possible by analyzing their eye movements during text reading? This study used Support Vector Machines (SVM) to analyze eye movement data from 61 undergraduate students who read a multiple-paragraph, multiple-topic expository text. Forward fixation time, first-pass rereading time, second-pass fixation time, and regression path reading time on different regions of the text were provided as features. The SVM classification algorithm assisted in distinguishing high-literacy-skilled readers from low-literacy-skilled readers with 80.3% accuracy. Results demonstrate the effectiveness of combining eye tracking and machine learning techniques to detect readers with low literacy skills, and suggest that such approaches can be potentially used in predicting other cognitive abilities.

Understanding Consumers’ Inferences from Price and Nonprice Information in the Online Lodging Purchase Decision

The sustained success of variable pricing for revenue management (RM) is dependent on the creation of appropriate price points at which to sell a given product offering. To date, few studies have considered the impact of nonprice information on consumer reaction to price, and none have investigated the relative weights that consumers assign to price and the nonprice information available to them during different phases of the purchase choice process. This exploratory study uses a combination of eye tracking and retrospective think-aloud (RTA) interviews to examine how consumers consider the price and nonprice content generated by the firm and the nonprice information generated by other consumers during two distinct phases of the online choice process: browsing and deliberation. This study’s findings suggest that during browsing, firm-generated content appears to be very influential, particularly the image selected to represent the property in search results. Both firm-generated and user-generated content play a role in hotel choice during deliberation, with the interplay among several types of information being an important indication of value for consumers.

What’s happening when nothing’s happening? Combining eyetracking and keylogging to explore cognitive processing during pauses in translation production

This article investigates whether a combination of eyetracking and keylogging can yield a better understanding of the cognitive processing that occurs during pauses in translation production. It analyses the interaction between a number of temporal and spatial variables associated with pausing (including pause duration, the syntactic location of the pause and reading behaviour during the pause). Eight third-year students of translation, translating from English to Afrikaans, translated a 180-word text while their keystrokes and eye movements were recorded. Pauses were defined by means of a predetermined cut-off point, and coded for the temporal and spatial variables above. The relationships between these variables form the focus of the analysis. The findings of the study point to a complex relationship between pause duration, the syntactic position of the pause, syntactic asymmetries between the languages involved, reading behaviour and cognitive effort.

MAPPING PROCESSING STRATEGIES IN LEARNING FROM EXPOSITORY TEXT: AN EXPLORATORY EYE TRACKING STUDY FOLLOWED BY A CUED RECALL

This study starts from the observation that current empirical research on students’ processing strategies in higher education has mainly focused on the use of self-report instruments to measure students’ general preferences towards processing strategies. In contrast, there is a rather limited use of more direct and online observation techniques to uncover differences in processing strategies at a task specific level. We based our study on one of the most influential studies in the domain of Students’ Approaches to Learning (SAL) (Marton, Dahlgren, Säljö, & Svensson, 1975). In our exploratory experiment we used eye tracking followed by a cued recall to investigate how students use processing strategies in learning from expository text. Nineteen university students participated in the experiment. Results suggested that students in the deep condition did not look longer at the essentials in the text compared with students in the surface condition, but that they processed them in a more deep way. In our sample, students in the surface condition looked longer at facts and details and also reported repeating these facts and details more often. We suggest that the combination of eye tracking followed by a cued recall is a promising tool to investigate students’ processing strategies since not all differences in processing strategies are reflected in overt eye movement behaviour. The current methodology allows researchers in the domain of SAL to complement and extend the present knowledge base that has accumulated through years of research with self-report questionnaires and interviews on students’ general preferences towards processing strategies.

The Power of Eye Tracking in Economics Experiments

Eye tracking is a technology that tracks eye activity including how long and where a participant is looking. As eye tracking technology has improved and become more affordable its use has expanded. We discuss how to design, implement, and analyze an experiment using this technology to study economic theory. Using our experience fielding an experiment to study hiring decisions we guide the reader through how to choose an eye tracker, concerns with participants and set-up, types of outputs, limitations of eye tracking, data management and data analysis. We conclude with suggestions for combining eye tracking with other measurements.

Toward Semantics in the Wild: Activation to Manipulable Nouns in Naturalistic Reading.

The study of language and reading has traditionally relied on single word or sentence stimuli. In fMRI, this is necessitated by the fact that time resolution of a BOLD signal much lower than that of cognitive processes that take place during natural reading of connected text. Here, we propose a method that combines eye tracking and fMRI, and can extract word-level information from the BOLD signal using high-temporal resolution eye tracking. In two experiments, we demonstrate the method by analyzing the activation of manipulable nouns as subjects naturally read paragraphs of text in the scanner, showing the involvement of action/motion perception areas. This opens up new avenues for studying neural correlates of language and reading in more ecologically realistic contexts.

意志和眼动控制的关系

意志是指个体自觉地确定目的，并根据目的来支配、调节行动，克服各种困难，从而实现目的的心理过程。作为自我控制眼跳的一种，反向眼跳包括抑制优势(反射性或朝向)眼跳反应、产生眼跳计划和执行眼跳等过程。本研究采用眼动追踪和问卷测量相结合的方法探讨了意志和眼动控制的关系。结果表明：在重复条件下，意志力分数与反向眼跳代价呈负相关；在转换条件下，如果排除前一试次的影响，意志力分数与反向眼跳代价也呈负相关。这说明意志提高了反向眼跳成绩的实质是意志对抑制过程的促进作用。 Will is a psychological process which refers that the individual consciously sets goals, and according to the purpose to control, adjusts action, overcoming various difficulties, in order to achieve the purpose. As a kind of self control saccade, antisaccade includes inhibition of the advantage saccade (reflective or orientation), producing saccadic reaction plan and execution process of saccade. This study uses the combination of eye tracking and questionnaire survey method researching the relationship between the will and the eye movement control. The results show that: under the condition of repetition, will scores and antisaccade cost is negatively correlated; under the condition of switch, excluding the influence of the last trial, will scores and antisaccade cost also is negative correlation. It suggests that the essence that will improves antisaccade performance is the promotion that will does at the inhibition process.

New Eye-Tracking Techniques May Revolutionize Mental Health Screening

Visually-guided behavior recruits a network of brain regions so extensive that it is often affected by neuropsychiatric disorders, producing measurable atypical oculomotor signatures. Wang et al. (2015) combine eye tracking with computational attention models to decipher the neurobehavioral signature of autism.

Eye Movements During Action Observation

An important element in social interactions is predicting the goals of others, including the goals of others’ manual actions. Over a decade ago, Flanagan and Johansson demonstrated that, when observing other people reaching for objects, the observer’s gaze arrives at the goal before the action is completed. Moreover, those authors proposed that this behavior was mediated by an embodied process, which takes advantage of the observer’s motor knowledge. Here, we scrutinize work that has followed that seminal article. We include studies on adults that have used combined eye tracking and transcranial magnetic stimulation technologies to test causal hypotheses about underlying brain circuits. We also include developmental studies on human infants. We conclude that, although several aspects of the embodied process of predictive eye movements remain to be clarified, current evidence strongly suggests that the motor system plays a causal role in guiding predictive gaze shifts that focus on another person’s future goal. The early emergence of the predictive gaze in infant development underlines its importance for social cognition and interaction.

Combining eye tracking and pupillary dilation analysis to identify Website Key Objects

Identifying the salient zones from Web interfaces, namely the Website Key Objects, is an essential part of the personalization process that current Web systems perform to increase user engagement. While several techniques have been proposed, most of them are focused on the use of Web usage logs. Only recently has the use of data from users׳ biological responses emerged as an alternative to enrich the analysis. In this work, a model is proposed to identify Website Key Objects that not only takes into account visual gaze activity, such as fixation time, but also the impact of pupil dilation. Our main hypothesis is that there is a strong relationship in terms of the pupil dynamics and the Web user preferences on a Web page. An empirical study was conducted on a real Website, from which the navigational activity of 23 subjects was captured using an eye tracking device. Results showed that the inclusion of pupillary activity, although not conclusively, allows us to extract a more robust Web Object classification, achieving a 14% increment in the overall accuracy.

Combined eye tracking and fMRI reveals neural basis of linguistic predictions during sentence comprehension

It is widely agreed upon that linguistic predictions are an integral part of language comprehension. Yet, experimental proof of their existence remains challenging. Here, we introduce a new predictive eye gaze reading task combining eye tracking and functional magnetic resonance imaging (fMRI) that allows us to infer the existence and timing of linguistic predictions via anticipatory eye-movements. Participants read different types of word sequences (i.e., regular sentences, meaningless jabberwocky sentences, non-word lists) up to the pre-final word. The final target word was displayed with a temporal delay and its screen position was dependent on the syntactic word category (nouns vs verbs). During the delay, anticipatory eye-movements into the correct target word area were indicative of linguistic predictions. For fMRI analysis, the predictive sentence conditions were contrasted to the non-word condition, with the anticipatory eye-movements specifying differences in timing across conditions. A conjunction analysis of both sentence conditions revealed the neural substrate of word category prediction, namely a distributed network of cortical and subcortical brain regions including language systems, basal ganglia, thalamus, and hippocampus. Direct contrasts between the regular sentence condition and the jabberwocky condition indicate that prediction of word category in meaningless jabberwocky sentences relies on classical left-hemispheric language systems involving Brodman's area 44/45 in the left inferior frontal gyrus, left superior temporal areas, and the dorsal caudate nucleus. Regular sentences, in contrast, allowed for the prediction of specific words. Word-specific predictions were specifically associated with more widely distributed temporal and parietal cortical systems, most prominently in the right hemisphere. Our results support the presence of linguistic predictions during sentence processing and demonstrate the validity of the predictive eye gaze paradigm for measuring syntactic and semantic aspects of linguistic predictions, as well as for investigating their neural substrates.

Striatal and midbrain connectivity with the hippocampus selectively boosts memory for contextual novelty.

The role of contextual expectation in processing familiar and novel stimuli was investigated in a series of experiments combining eye tracking, functional magnetic resonance imaging, and behavioral methods. An experimental paradigm emphasizing either familiarity or novelty detection at retrieval was used. The detection of unexpected familiar and novel stimuli, which were characterized by lower probability, engaged activity in midbrain and striatal structures. Specifically, detecting unexpected novel stimuli, relative to expected novel stimuli, produced greater activity in the substantia nigra/ventral tegmental area (SN/VTA), whereas the detection of unexpected familiar, relative to expected, familiar stimuli, elicited activity in the striatum/globus pallidus (GP). An effective connectivity analysis showed greater functional coupling between these two seed areas (GP and SN/VTA) and the hippocampus, for unexpected than for expected stimuli. Within this network of midbrain/striatal–hippocampal interactions two pathways are apparent; the direct SN–hippocampal pathway sensitive to unexpected novelty and the perirhinal–GP–hippocampal pathway sensitive to unexpected familiarity. In addition, increased eye fixations and pupil dilations also accompanied the detection of unexpected relative to expected familiar and novel stimuli, reflecting autonomic activity triggered by the functioning of these two pathways. Finally, subsequent memory for unexpected, relative to expected, familiar, and novel stimuli was characterized by enhanced recollection, but not familiarity, accuracy. Taken together, these findings suggest that a hippocampal–midbrain network, characterized by two distinct pathways, mediates encoding facilitation and most critically, that this facilitation is driven by contextual novelty, rather than by the absolute novelty of a stimulus. This contextually sensitive neural mechanism appears to elicit increased exploratory behavior, leading subsequently to greater recollection of the unexpected stimulus. © 2015 The Authors Hippocampus Published by Wiley Periodicals, Inc.

Identifying the location of a concealed object through unintentional eye movements.

In some investigative and interrogative contexts, the investigator is seeking to identify the location of an object (e.g., implanted bomb) which is known to a given subject (e.g., a terrorist). In this paper, we present a non-intrusive methodology for uncovering the loci of a concealed object by analyzing the subject's eye movements. Using a combination of eye tracking, psychological manipulation and a search algorithm, we have performed two experiments. In the first experiment, we have gained 58% hit rate in identifying the location of the concealed object and in the second experiment 56% hit rate. The pros and cons of the methodology for forensic investigation are discussed.

Movement Onset Detection and Target Estimation for Robot-Aided Arm Training

Abstract This paper presents a motion intention estimation algorithm that is based on the recordings of joint torques, joint positions, electromyography, eye tracking and contextual information. It is intended to be used to support a virtual-reality-based robotic arm rehabilitation training. The algorithm first detects the onset of a reaching motion using joint torques and electromyography. It then predicts the motion target using a combination of eye tracking and context, and activates robotic assistance toward the target. The algorithm was first validated offline with 12 healthy subjects, then in a real-time robot control setting with 3 healthy subjects. In offline crossvalidation, onset was detected using torques and electromyography 116 ms prior to detectable changes in joint positions. Furthermore, it was possible to successfully predict a majority of motion targets, with the accuracy increasing over the course of the motion. Results were slightly worse in online validation, but nonetheless show great potential for real-time use with stroke patients.