Eye Movement Patterns Research Articles

Attention Priority Map of Face Images in Human Early Visual Cortex.

Attention priority maps are topographic representations that are used for attention selection and guidance of task-related behavior during visual processing. Previous studies have identified attention priority maps of simple artificial stimuli in multiple cortical and subcortical areas, but investigating neural correlates of priority maps of natural stimuli is complicated by the complexity of their spatial structure and the difficulty of behaviorally characterizing their priority map. To overcome these challenges, we reconstructed the topographic representations of upright/inverted face images from fMRI BOLD signals in human early visual areas primary visual cortex (V1) and the extrastriate cortex (V2 and V3) based on a voxelwise population receptive field model. We characterized the priority map behaviorally as the first saccadic eye movement pattern when subjects performed a face-matching task relative to the condition in which subjects performed a phase-scrambled face-matching task. We found that the differential first saccadic eye movement pattern between upright/inverted and scrambled faces could be predicted from the reconstructed topographic representations in V1-V3 in humans of either sex. The coupling between the reconstructed representation and the eye movement pattern increased from V1 to V2/3 for the upright faces, whereas no such effect was found for the inverted faces. Moreover, face inversion modulated the coupling in V2/3, but not in V1. Our findings provide new evidence for priority maps of natural stimuli in early visual areas and extend traditional attention priority map theories by revealing another critical factor that affects priority maps in extrastriate cortex in addition to physical salience and task goal relevance: image configuration.SIGNIFICANCE STATEMENT Prominent theories of attention posit that attention sampling of visual information is mediated by a series of interacting topographic representations of visual space known as attention priority maps. Until now, neural evidence of attention priority maps has been limited to studies involving simple artificial stimuli and much remains unknown about the neural correlates of priority maps of natural stimuli. Here, we show that attention priority maps of face stimuli could be found in primary visual cortex (V1) and the extrastriate cortex (V2 and V3). Moreover, representations in extrastriate visual areas are strongly modulated by image configuration. These findings extend our understanding of attention priority maps significantly by showing that they are modulated, not only by physical salience and task-goal relevance, but also by the configuration of stimuli images.

Patterns of Eye Movements When Observers Judge Female Facial Attractiveness.

The purpose of the present study is to explore the fixed model for the explicit judgments of attractiveness and infer which features are important to judge the facial attractiveness. Behavioral studies on the perceptual cues for female facial attractiveness implied three potentially important features: averageness, symmetry, and sexual dimorphy. However, these studies did not explained which regions of facial images influence the judgments of attractiveness. Therefore, the present research recorded the eye movements of 24 male participants and 19 female participants as they rated a series of 30 photographs of female facial attractiveness. Results demonstrated the following: (1) Fixation is longer and more frequent on the noses of female faces than on their eyes and mouths (no difference exists between the eyes and the mouth); (2) The average pupil diameter at the nose region is bigger than that at the eyes and mouth (no difference exists between the eyes and the mouth); (3) the number of fixations of male participants was significantly more than female participants. (4) Observers first fixate on the eyes and mouth (no difference exists between the eyes and the mouth) before fixating on the nose area. In general, participants attend predominantly to the nose to form attractiveness judgments. The results of this study add a new dimension to the existing literature on judgment of facial attractiveness. The major contribution of the present study is the finding that the area of the nose is vital in the judgment of facial attractiveness. This finding establish a contribution of partial processing on female facial attractiveness judgments during eye-tracking.

Genetic Influence on Eye Movements to Complex Scenes at Short Timescales

Where one looks within their environment constrains one's visual experiences, directly affects cognitive, emotional, and social processing [1-4], influences learning opportunities [5], and ultimately shapes one's developmental path. While there is a high degree of similarity across individuals with regard to which features of a scene are fixated [6-8], large individual differences are also present, especially in disorders of development [9-13], and clarifying the origins of these differences is essential to understand the processes by which individuals develop within the complex environments in which they exist and interact. Toward this end, a recent paper [14] found that "social visual engagement"-namely, gaze to eyes and mouths of faces-is strongly influenced by genetic factors. However, whether genetic factors influence gaze to complex visual scenes more broadly, impacting how both social and non-social scene content are fixated, as well as general visual exploration strategies, has yet to be determined. Using a behavioral genetic approach and eye tracking data from a large sample of 11-year-old human twins (233 same-sex twin pairs; 51% monozygotic, 49% dizygotic), we demonstrate that genetic factors do indeed contribute strongly to eye movement patterns, influencing both one's general tendency for visual exploration of scene content, as well as the precise moment-to-moment spatiotemporal pattern of fixations during viewing of complex social and non-social scenes alike. This study adds to a now growing set of results that together illustrate how genetics may broadly influence the process by which individuals actively shape and create their own visual experiences.

Characterizing eye movement behaviors and kinematics of non-human primates during virtual navigation tasks.

Virtual environments (VE) allow testing complex behaviors in naturalistic settings by combining highly controlled visual stimuli with spatial navigation and other cognitive tasks. They also allow for the recording of eye movements using high-precision eye tracking techniques, which is important in electrophysiological studies examining the response properties of neurons in visual areas of nonhuman primates. However, during virtual navigation, the pattern of retinal stimulation can be highly dynamic which may influence eye movements. Here we examine whether and how eye movement patterns change as a function of dynamic visual stimulation during virtual navigation tasks, relative to standard oculomotor tasks. We trained two rhesus macaques to use a joystick to navigate in a VE to complete two tasks. To contrast VE behavior with classic measurements, the monkeys also performed a simple Cued Saccade task. We used a robust algorithm for rapid classification of saccades, fixations, and smooth pursuits. We then analyzed the kinematics of saccades during all tasks, and specifically during different phases of the VE tasks. We found that fixation to smooth pursuit ratios were smaller in VE tasks (4:5) compared to the Cued Saccade task (7:1), reflecting a more intensive use of smooth pursuit to foveate targets in VE than in a standard visually guided saccade task or during spontaneous fixations. Saccades made to rewarded targets (exploitation) tended to have increased peak velocities compared to saccades made to unrewarded objects (exploration). VE exploitation saccades were 6% slower than saccades to discrete targets in the Cued Saccade task. Virtual environments represent a technological advance in experimental design for nonhuman primates. Here we provide a framework to study the ways that eye movements change between and within static and dynamic displays.

THE EYES HAVE IT: USING EYE TRACKING TECHNOLOGY TO ASSESS THE USABILITY OF LEARNING MANAGEMENT SYSTEMS IN ELEMENTARY SCHOOLS

Twenty-six students from a sixth grade math class in Upstate New York received guardian approval to participate in a study that gathered data pertaining to student navigation ability, information retrieval ability, and satisfaction in regards to the Learning Management System (LMS) their school utilized. Data collection began with the researchers attending math classes for observation and to conduct cognitive walkthroughs with the students to gather information about their experiences and navigation through the LMS. An eye tracker and the associated eye tracking software were utilized to monitor and detect patterns of eye movements when the students were looking at a device screen. For this study, students were monitored by the eye tracker while they attempted to complete several tasks from the experiment. By measuring the length of time taken by students as they completed tasks on the LMS, quantitative data can be collected and used later in the experiment. After analyzing the time metrics and the eye tracking data produced and feedback given on the questionnaire distributed at the beginning of the experiment, a targeted LMS page was slightly modified in hopes to increase the effectiveness of the page, based on user interface design standards. Well defined organization, accessibility, and usability in an LMS is essential to allow learners to focus to be on their curriculums, and not how to access their assignments. An in-depth analysis of navigation through an LMS will allow for a better understanding of how users interact with the structure of their curriculum in an electronic format. The study described in this paper intended to address the question of whether an LMS used in an elementary school setting can provide users with an interface that optimizes the accessibility and usability of their class materials. Article visualizations:

Cultural and Developmental Influences on Overt Visual Attention to Videos

Top-down influences on observers’ overt attention and how they interact with the features of the visual environment have been extensively investigated, but the cultural and developmental aspects of these modulations have been understudied. In this study we investigated these effects for US and Yucatec Mayan infants, children, and adults. Mayan and US participants viewed videos of two actors performing daily Mayan and US tasks in the foreground and the background while their eyes were tracked. Our region of interest analysis showed that viewers from the US looked significantly less at the foreground activity and spent more time attending to the ‘contextual’ information (static background) compared to Mayans. To investigate how and what visual features of videos were attended to in a comprehensive manner, we used multivariate methods which showed that visual features are attended to differentially by each culture. Additionally, we found that Mayan and US infants utilize the same eye-movement patterns in which fixation duration and saccade amplitude are altered in response to the visual stimuli independently. However, a bifurcation happens by age 6, at which US participants diverge and engage in eye-movement patterns where fixation durations and saccade amplitudes are altered simultaneously.

Neuroanatomy of the Oculomotor System

After just a clinical examination, the experienced neurologist can assign specific symptoms quite precisely to distinct lesions within the brain and other parts of the nervous system, on the basis of his neuroanatomical knowledge. This also holds true for lesions affecting the oculomotor system. The aim of this article is to give a comprehensive overview of the neuroanatomical basis of the oculomotor system, in order to facilitate the precise spatial assignment of potential lesions affecting the control of eye movements. After a brief introduction, the components of the system are discussed, including the extraocular muscles and their innervating nerves. The following section will then cover the control of eye movements and will specifically address distinct patterns of eye movements and areas within the central nervous system controlling these. This article also gives a brief overview of the intraocular muscles and their control.

Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures

It remains controversial whether culture modulates eye movement behavior in face recognition. Inconsistent results have been reported regarding whether cultural differences in eye movement patterns exist, whether these differences affect recognition performance, and whether participants use similar eye movement patterns when viewing faces from different ethnicities. These inconsistencies may be due to substantial individual differences in eye movement patterns within a cultural group. Here we addressed this issue by conducting individual-level eye movement data analysis using hidden Markov models (HMMs). Each individual’s eye movements were modeled with an HMM. We clustered the individual HMMs according to their similarities and discovered three common patterns in both Asian and Caucasian participants: holistic (looking mostly at the face center), left-eye-biased analytic (looking mostly at the two individual eyes in addition to the face center with a slight bias to the left eye), and right-eye-based analytic (looking mostly at the right eye in addition to the face center). The frequency of participants adopting the three patterns did not differ significantly between Asians and Caucasians, suggesting little modulation from culture. Significantly more participants (75%) showed similar eye movement patterns when viewing own- and other-race faces than different patterns. Most importantly, participants with left-eye-biased analytic patterns performed significantly better than those using either holistic or right-eye-biased analytic patterns. These results suggest that active retrieval of facial feature information through an analytic eye movement pattern may be optimal for face recognition regardless of culture.

Eye movement patterns when driving in real environment

Eye movement patterns when driving in real environment

Analytic eye movement patterns in face recognition are associated with enhanced face recognition performance and top-down control of visual attention

Analytic eye movement patterns in face recognition are associated with enhanced face recognition performance and top-down control of visual attention

Eye Movement Patterns in Response to Anti-Binge Drinking Messages

ABSTRACTHealth message design combines selected visual and textual components that are thought to work in concert to produce a particular intended message effect. Most health message effects research assumes rather than determines that message recipients attend to those visual and textual components. In contrast, the present research mapped viewing patterns of 50 participants in response to a set of anti-binge drinking print messages using eye-tracking methodology. Results showed that participants primarily viewed faces of persons portrayed in the messages, as well as alcohol use cues and cryptic one-liners. Textual components (e.g., information about consequences of heavy drinking) were viewed infrequently and briefly. Viewing patterns were associated with perceptions of message effectiveness, but more so for women than for men. Additionally, men, for whom anti-binge drinking messages were more self-relevant than for women, viewed message components more often and longer than women. These findings suggest that when message recipients view a self-relevant health message, they may attend primarily to a subset of components that do not necessarily convey the full message.

Qualitatively Coherent Representation Makes Decision-Making Easier with Binary-Colored Multi-Attribute Tables: An Eye-Tracking Study.

We aimed to identify the ways in which coloring cells affected decision-making in the context of binary-colored multi-attribute tables, using eye movement data. In our black-white attribute tables, the value of attributes was limited to two (with a certain threshold for each attribute) and each cell of the table was colored either black or white on the white background. We compared the two natural ways of systematic color assignment: “quantitatively coherent” ways and “qualitatively coherent” ways (namely, the ways in which the black-white distinction represented the quantitative amount distinction, and the ways in which the black-white distinction represented the quality distinction). The former consists of the following two types: (Type 1) “larger is black,” where the larger value-level was represented by black, and “smaller is white,” and (Type 2) “smaller is black.” The latter consisted of the following two types: (Type 3) “better is black,” and (Type 4) “worse is black.” We obtained the following two findings. [Result 1] The qualitatively coherent black-white tables (Types 3 and 4) made decision-making easier than the quantitatively coherent ones (Types 1 and 2). [Result 2] Among the two qualitatively coherent types, the “black is better” tables (Type 3) made decision making easier; in fact, the participants focused on the more important (black) cells in the case of “black is better” tables (Type 3) while they did not focus enough on the more important (white) ones in the case of the “white is better” tables (Type 4). We also examined some measures of eye movement patterns and showed that these measures supported our hypotheses. The data showed differences in the eye movement patterns between the first and second halves of each trial, which indicated the phased or combined decision strategies taken by the participants.

Tracking the Eye Movement of Four Years Old Children Learning Chinese Words.

Storybook reading is the major source of literacy exposure for beginning readers. The present study tracked 4-year-old Chinese children's eye movements while they were reading simulated storybook pages. Their eye-movement patterns were examined in relation to their word learning gains. The same reading list, consisting of 20 two-character Chinese words, was used in the pretest, 5-min eye-tracking learning session, and posttest. Additionally, visual spatial skill and phonological awareness were assessed in the pretest as cognitive controls. The results showed that the children's attention was attracted quickly by pictures, on which their attention was focused most, with only 13% of the time looking at words. Moreover, significant learning gains in word reading were observed, from the pretest to posttest, from 5-min exposure to simulated storybook pages with words, picture and pronunciation of two-character words present. Furthermore, the children's attention to words significantly predicted posttest reading beyond socioeconomic status, age, visual spatial skill, phonological awareness and pretest reading performance. This eye-movement evidence of storybook reading by children as young as four years, reading a non-alphabetic script (i.e., Chinese), has demonstrated exciting findings that children can learn words effectively with minimal exposure and little instruction; these findings suggest that learning to read requires attention to the basic words itself. The study contributes to our understanding of early reading acquisition with eye-movement evidence from beginning readers.

THE FLASH-PREVIEW MOVING WINDOW PARADIGM: UNPACKING VISUAL EXPERTISE ONE GLIMPSE AT A TIME

How we make sense of what we see and where best to look is shaped by our experience, our current task goals and how we first perceive our environment. An established way of demonstrating these factors work together is to study how eye movement patterns change as a function expertise and to observe how experts can solve complex tasks after only very brief glances at a domain-specific image. The primary focus of this paper is to introduce an innovative gaze-contingent method called the ‘Flash-Preview Moving Window’ (FPMW) paradigm (Castelhano & Henderson, 2007), which was recently developed to understand our shared expertise in scene perception and how our first glimpse of a scene is used to guide our eye movement behaviour. In keeping with this special issue on visual expertise and medicine, this paper will highlight how the FPMW paradigm has the potential to resolve long-standing theoretical issues as to how, right from the very first glance, experts are able to process domain-specific images and guide their eye movements better than novices. Since FPMW is a gaze-contingent eye-tracking method, the paper will first outline the current methodological and theoretical frontier, and how the FPMW paradigm bridges established methods used to investigate visual expertise. The paper will discuss a recent example in which the FPMW was employed to investigate medical image perception expertise for first the time (Litchfield & Donovan, 2016), and by confronting the insights and challenges this method offers, this should ultimately deepen our understanding of visual expertise.

EYE MOVEMENT BEHAVIOR IN EARLY ALZHEIMER'S DISEASE: THE IMPACT OF TIME AND STIMULI SIMILARITY AS A MEASURE OF COGNITIVE EFFORT

Research has been showing that oculomotor measurements can accurately detect higher-order cognitive deficits, namely in memory and visuospatial processing deficits (Rizzo et al., 2004; Garbutt et al., 2008; Crutcher et al., 2009). Literature has still failed to analyze the impact of cognitive effort in the eye movement behavior as a tool to distinguish healthy subjects from those with cognitive decline due to Alzheimer's disease. 26 age and education matched participants (6 AD, 10 MCI, 10 NC) were submitted to a computational task composed by a familiarization phase and a test phase. During the familiarization phase, participants were instructed to look at two initial images. After that, there was a variable time delay of 5 or 90 seconds. During the test phase, other two images were presented, one of them was identical to previously seen, the other was a new one. Subjects were instructed to select the novel image which was either similar or non similar to the familiar stimulus. Eye-movement bahavior was analyzed based on four main parameters: number of visits (VC), duration of visits (VD) number of fixations (FC), fixation duration (FD). Parameters were analyzed regarding diagnostic, stimuli similarity and time between trials. Stimuli similarity revealed significant interference in the following parameters: VC, PrFC, PrVD, PrVC. Stimuli similarity also had impact on eye-movement pattern when associated with time delay between the familiarization phase and the test phase (PrFD, PrFC, PrVC). Both the proportion of time fixated on the novel stimulus (PrFD) and the proportion of the number of visits on the novel stimulus (PrVC) were affected by the participants’ diagnosis, when combined with stimuli similarity and time delay, respectively.

Cerebral hemodynamics during scene viewing: Hemispheric lateralization predicts temporal gaze behavior associated with distinct modes of visual processing.

Systematic patterns of eye movements during scene perception suggest a functional distinction between 2 viewing modes: an ambient mode (characterized by short fixations and large saccades) thought to reflect dorsal activity involved with spatial analysis, and a focal mode (characterized by long fixations and small saccades) thought to reflect ventral activity involved with object analysis. Little neuroscientific evidence exists supporting this claim. Here, functional transcranial Doppler ultrasound (fTCD) was used to investigate whether these modes show hemispheric specialization. Participants viewed scenes for 20 s under instructions to search or memorize. Overall, early viewing was right lateralized, whereas later viewing was left lateralized. This right-to-left shift interacted with viewing task (more pronounced in the memory task). Importantly, changes in lateralization correlated with changes in eye movements. This is the first demonstration of right hemisphere bias for eye movements servicing spatial analysis and left hemisphere bias for eye movements servicing object analysis. (PsycINFO Database Record

LPiTrack: Eye movement pattern recognition algorithm and application to biometric identification

A comprehensive nonparametric statistical learning framework, called LPiTrack, is introduced for large-scale eye-movement pattern discovery. The foundation of our data-compression scheme is based on a new Karhunen–Loéve-type representation of the stochastic process in Hilbert space by specially designed orthonormal polynomial expansions. We apply this novel nonlinear transformation-based statistical data-processing algorithm to extract temporal-spatial-static characteristics from eye-movement trajectory data in an automated, robust way for biometric authentication. This is a significant step towards designing a next-generation gaze-based biometric identification system. We elucidate the essential components of our algorithm through data from the second Eye Movements Verification and Identification Competition, organized as a part of the 2014 International Joint Conference on Biometrics.

Looking at paintings in the Vincent Van Gogh Museum: Eye movement patterns of children and adults.

In the present study, we examined the eye movement behaviour of children and adults looking at five Van Gogh paintings in the Van Gogh Museum, Amsterdam. The goal of the study was to determine the role of top-down and bottom-up attentional processes in the first stages of participants’ aesthetic experience. Bottom-up processes were quantified by determining a salience map for each painting. Top-down processing was manipulated by first allowing participants to view the paintings freely, then providing background information about each painting, and then allowing them to view the paintings a second time. The salience analysis showed differences between the eye movement behaviour of children and adults, and differences between the two phases. In the children, the first five fixations during the free viewing phase were strongly related to visually salient features of the paintings—indicating a strong role for bottom-up factors. In the second phase, after children had received background information, top-down factors played a more prominent role. By contrast, adults’ observed patterns were similar in both phases, indicating that bottom-up processes did not play a major role when they viewed the paintings. In the second phase, children and adults both spent more time looking at regions that were mentioned in the background information. This effect was greater for adults than for children, confirming the notion that adults, when viewing paintings, rely much more on top-down processing than children.

Intuitive Face Judgments Rely on Holistic Eye Movement Pattern

Non-verbal signals such as facial expressions are of paramount importance for social encounters. Their perception predominantly occurs without conscious awareness and is effortlessly integrated into social interactions. In other words, face perception is intuitive. Contrary to classical intuition tasks, this work investigates intuitive processes in the realm of every-day type social judgments. Two differently instructed groups of participants judged the authenticity of emotional facial expressions, while their eye movements were recorded: an ‘intuitive group,’ instructed to rely on their “gut feeling” for the authenticity judgments, and a ‘deliberative group,’ instructed to make their judgments after careful analysis of the face. Pixel-wise statistical maps of the resulting eye movements revealed a differential viewing pattern, wherein the intuitive judgments relied on fewer, longer and more centrally located fixations. These markers have been associated with a global/holistic viewing strategy. The holistic pattern of intuitive face judgments is in line with evidence showing that intuition is related to processing the “gestalt” of an object, rather than focusing on details. Our work thereby provides further evidence that intuitive processes are characterized by holistic perception, in an understudied and real world domain of intuition research.

Upper limb and eye movement coordination during reaching tasks in people with stroke

Purpose: To enhance understanding of the relationship between upper limb and eye movements during reaching tasks in people with stroke.Methods: Eye movements were recorded from 10 control participants and 8 chronic stroke participants during a visual orienting task (Experiment 1) and a series of reaching tasks (Experiment 2). Stroke participants completed the reaching tasks using (i) their less impaired upper limb, (ii) their more impaired upper limb without support, and (iii) their more impaired upper limb, with support (SaeboMAS gravitational support and/or electrical stimulation). Participants were tested individually and completed both experiments in the same session.Results: Oculomotor control and the coordination between the upper limb and the oculomotor system were found to be intact in stroke participants when no limb movements were required, or when the less impaired upper limb was used. However, when the more impaired upper limb was used, success and accuracy in reaching decreased and patterns of eye movements changed, with an observed increase in eye movements to the limb itself. With upper limb support, patterns of hand-eye coordination were found to more closely resemble those of the control group.Conclusion: Deficits in upper limb motor systems result in changes in patterns of eye movement behavior during reaching tasks. These changes in eye movement behavior can be modulated by providing upper limb support.Implications for RehabilitationDeficits in upper limb motor systems can result in changes in patterns of eye movement behavior during reaching tasks.Upper limb support can reduce deficits in hand-eye coordination.Stroke rehabilitation outcomes should consider motor and oculomotor performance.