Eye Movement Analysis Research Articles

Analysis of vertical eye movements in Parkinson’s disease and its potential for diagnosis

It is well known that eye movements are highly affected by Parkinson’s disease. The majority of studies related to effects of Parkinson’s disease on eye movements have been performed for rapid eye movements during sleep. However, in the current study, eye movements during resting-state (eyes-open and eyes-closed conditions) were studied to evaluate Parkinson’s disease. To measure eye movements, vertical electrooculography (VEOG) was used. Using extracted features in time-, frequency-, and time-frequency domains of VEOG time-series, a classification analysis between healthy subjects and Parkinson’s disease patients in OFF- and ON-medication states was performed. The most-informative features for an error-correcting output codes support vector machine classifier were selected according to the multiple-comparison corrected p-values. VEOG data obtained 69.10 % and 87.27 % discrimination accuracy for OFF- and ON-medication states, respectively. Interestingly, higher discrimination was obtained for the lower frequency contents of VEOG time-series (0.1–1.25 Hz). The most discriminative features were related to the variation of amplitude and frequency content for OFF-medication, while in ON-medication the features according to the variation of VEOG amplitudes were removed from the most discriminative features list. Based on the obtained results, it was concluded that vertical eye movements of Parkinson’s disease patients had lower amplitude variation compared with healthy subjects in OFF-medication, while levodopa prescription increased such variation in vertical eye movements during the eyes-closed condition and decreased the variation during the eyes-open condition. Levodopa prescription possibly affects the amplitude variation of VEOG time-series, while it had no effect on the movement rates (frequency contents) of vertical eye movements.

Differential effects of aging and cognitive decline on visual exploration behavior in the elderly

Visual exploration disturbance has been examined in the elderly, mainly from the perspective of associations with cognitive function. However, it remains unknown whether this is a consequence of cognitive decline, age-related changes independent of cognitive decline, or both. In this study, 15 healthy elderly individuals were evaluated using two figure-matching tasks representing visual information processing (clock-matching and inverted clock-matching tasks). Cognitive functions were evaluated for each subject using the Mini-Mental State Examination (MMSE). Infrared eye-movement assessments were used to analyze eye movements during task performance. Behavioral analyses showed that age was associated with longer reaction time, while MMSE score was associated with higher accuracy on the inverted clock-matching task. Analyses of eye-movement parameters showed that MMSE score was negatively associated with a parameter indicating difficulty in the efficiency of visual exploration planning, while age was tended to be positively associated with the sum of saccade times in each trial, both predominantly on the inverted clock-matching task. Our approaches highlighted that age and cognitive decline are separately associated with eye-movement characteristics: cognitive decline is associated with difficulty in visual exploration planning, particularly in situations that require substantial visual working memory resources, whereas aging may be associated with oculomotor dysfunction.

Global Saccadic Eye Movements Characterise Artists’ Visual Attention While Drawing

Previous research has shown that artists employ flexible attentional strategies during offline perceptual tasks. The current study explored visual processing online, by tracking the eye movements of artists and non-artists (n=65) while they produced representational drawings of photographic stimuli. The findings revealed that it is possible to differentiate artists from non-artists on the basis of the relative amount of global-to-local saccadic eye movements they make when looking at the target stimulus while drawing, but not in a preparatory free viewing phase. Results indicated that these differences in eye movements are not specifically related to representational drawing ability, and may be a feature of artistic ability more broadly. This eye movement analysis technique may be used in future research to characterise the dynamics of attentional shifts in eye movements while artists are carrying out a range of artistic tasks.

Eye-movement patterns to social and non-social cues in early deaf adults.

Previous research on covert orienting to the periphery suggested that early profound deaf adults were less susceptible to uninformative gaze-cues, though were equally or more affected by non-social arrow-cues. The aim of this work was to investigate whether spontaneous eye movement behaviour helps explain the reduced impact of the social cue in deaf adults. We tracked the gaze of 25 early profound deaf and 25 age-matched hearing observers performing a peripheral discrimination task with uninformative central cues (gaze vs arrow), stimulus-onset asynchrony (250 vs 750 ms), and cue validity (valid vs invalid) as within-subject factors. In both groups, the cue effect on reaction time (RT) was comparable for the two cues, although deaf observers responded significantly slower than hearing controls. While deaf and hearing observers' eye movement pattern looked similar when the cue was presented in isolation, deaf participants made significantly more eye movements than hearing controls once the discrimination target appeared. Notably, further analysis of eye movements in the deaf group revealed that independent of the cue type, cue validity affected saccade landing position, while latency was not modulated by these factors. Saccade landing position was also strongly related to the magnitude of the validity effect on RT, such that the greater the difference in saccade landing position between invalid and valid trials, the greater the difference in manual RT between invalid and valid trials. This work suggests that the contribution of overt selection in central cueing of attention is more prominent in deaf adults and helps determine the manual performance, irrespective of the cue type.

How Does Wearing a Facecover Influence the Eye Movement Pattern in Times of COVID-19?

BackgroundSince the emergence of the COVID-19 pandemic facecovers have become a common sight. The effect of facecovers on the gaze when looking at faces has not been assessed yet.ObjectiveThe aim of the present study is to investigate a potential difference in eye movement pattern in observes which are exposed to images showing a face without and with facecover to identify if there is truly a change of gaze when identifying (masked) facial features.Materials and MethodsThe eye movement of a total of 64 study participants (28 males and 36 females) with a mean age of 31.84±9.0 years was analyzed in this cross-sectional observational study. Eye movement analysis was conducted based on positional changes of eye features within an x- and y- coordinate system while two images (face without/with facecover) were displayed for 8 seconds.ResultsThe results of this study revealed that the sequence of focussing on facial regions was not altered when wearing a facecover and followed the sequence: perioral, nose, periorbital. Wearing a facecover significantly increased the time of focussing on the periorbital region and increased also the number of repeated eye fixations during the interval of visual stimulus presentation. No statistically significant differences were observed between male and female participants in their eye movement pattern across all investigated variables with p > 0.433.ConclusionAesthetic practitioners could utilized the presented data and develop marketing and treatment strategies which majorly target the periorbital area understanding the altered eye movement pattern in times of COVID-19.

Gaze Parameters in the Analysis of Ambiguous Geometric Shapes.

This study explores perceptual organisation and shape perception when viewing a tetragon and an additional element (a dot) that is located at varying positions and distances next to the tetragon. The aim of the study is to determine the factors that can alter the interpretation of object configuration and impact whether the presented tetragon is perceived as a diamond or a square. Methods used in this study are a forced-choice task as a subjective measurement and eye tracking as an objective measurement of perceptual processes. Overall, 31 stimuli were presented to the participants: a tetragon in two different sizes with an additional element (a dot) located inside or outside the object at three different positions at three distances. The results indicate significant changes in shape perception, depending on the location of the additional element. The results are complemented with eye movement analysis indicating that as the distance between the elements increases, there is a higher probability of either of the two shape interpretations and the gaze is less likely to be directed to the area between the stimuli. Furthermore, the subjective perception of shape is codetermined by the shape perception when the tetragon is presented without the additional element.

Parameter dependence in visual pattern-component rivalry at onset and during prolonged viewing

In multistability, perceptual interpretations (“percepts”) of ambiguous stimuli alternate over time. There is considerable debate as to whether similar regularities govern the first percept after stimulus onset and percepts during prolonged presentation. We address this question in a visual pattern-component rivalry paradigm by presenting two overlaid drifting gratings, which participants perceived as individual gratings passing in front of each other (“segregated”) or as a plaid (“integrated”). We varied the enclosed angle (“opening angle”) between the gratings (experiments 1 and 2) and stimulus orientation (experiment 2). The relative number of integrated percepts increased monotonically with opening angle. The point of equality, where half of the percepts were integrated, was at a smaller opening angle at onset than during prolonged viewing. The functional dependence of the relative number of integrated percepts on opening angle showed a steeper curve at onset than during prolonged viewing. Dominance durations of integrated percepts were longer at onset than during prolonged viewing and increased with opening angle. The general pattern persisted when stimuli were rotated (experiment 2), despite some perceptual preference for cardinal motion directions over oblique directions. Analysis of eye movements, specifically the slow phase of the optokinetic nystagmus (OKN), confirmed the veridicality of participants’ reports and provided a temporal characterization of percept formation after stimulus onset. Together, our results show that the first percept after stimulus onset exhibits a different dependence on stimulus parameters than percepts during prolonged viewing. This underlines the distinct role of the first percept in multistability.

Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements

Recent research has suggested the importance of part-based information in face recognition in addition to global, whole-face information. Nevertheless, face drawing experience was reported to enhance selective attention to the eyes but did not improve face recognition performance, leading to speculations about limited plasticity in adult face recognition. Here we examined the mechanism underlying the limited advantage of face drawing experience in face recognition through the Eye Movement analysis with Hidden Markov Models (EMHMM) approach. We found that portrait artists showed more eyes-focused eye movement patterns and outperformed novices in face matching, and participants' drawing rating was correlated with both eye movement pattern and performance. In contrast, portrait artists did not outperform novices and did not differ from novices in eye movement pattern in either the face recognition or part-whole tasks, although the eyes-focused pattern was associated with better recognition performance and longer response times in the whole condition relative to the part condition. Interestingly, in contrast to the face recognition and part-whole tasks, participants' performance in face matching was predicted by their drawing rating but not eye movement pattern. These results suggested that artists' advantage in face processing is specific to tasks similar to their drawing experience such as face matching, and may be related to their better ability in extracting identity-invariant information between two faces rather than more eyes-focused eye movement patterns.

Integrating eye-movement analysis and the semantic differential method to analyze the visual effect of a traditional commercial block in Hefei, China

Eye-movement analysis was adopted to evaluate the visual perception of Chinese traditional commercial blocks, and the Chenghuangmiao block in Hefei, China, was selected as a typical case. Eye-movement data from 40 respondents viewing 14 sample pictures were recorded. The spatial elements of the sample pictures, including landmarks and commercial brands, were further extracted to analyze the visual characteristics of spatial elements and the factors that affect the respondents' perceptions of those elements. Then, the semantic differential method was used to analyze the relationship between visual preferences and psychological perceptions of spatial elements. Seventeen pairs of opposing adjectives were selected to score the intrinsic properties and visitors’ feelings of spaces. The software SPSS 22.0 was used to analyze these data. Results showed that distinctive spatial elements, such as street corridors, Ma Tau Walls, and various landmarks, were the most visually attractive. In addition, the location of a given element within a picture was an important factor affecting eye movements. On this basis, strategies for improving spatial-visual effects are proposed. The strategies include emphasizing the visual characteristics of different spatial elements, considering the overall layout of spatial elements, and creating diversified spaces based on different spatial categories.

Deep learning framework for subject-independent emotion detection using wireless signals.

Emotion states recognition using wireless signals is an emerging area of research that has an impact on neuroscientific studies of human behaviour and well-being monitoring. Currently, standoff emotion detection is mostly reliant on the analysis of facial expressions and/or eye movements acquired from optical or video cameras. Meanwhile, although they have been widely accepted for recognizing human emotions from the multimodal data, machine learning approaches have been mostly restricted to subject dependent analyses which lack of generality. In this paper, we report an experimental study which collects heartbeat and breathing signals of 15 participants from radio frequency (RF) reflections off the body followed by novel noise filtering techniques. We propose a novel deep neural network (DNN) architecture based on the fusion of raw RF data and the processed RF signal for classifying and visualising various emotion states. The proposed model achieves high classification accuracy of 71.67% for independent subjects with 0.71, 0.72 and 0.71 precision, recall and F1-score values respectively. We have compared our results with those obtained from five different classical ML algorithms and it is established that deep learning offers a superior performance even with limited amount of raw RF and post processed time-sequence data. The deep learning model has also been validated by comparing our results with those from ECG signals. Our results indicate that using wireless signals for stand-by emotion state detection is a better alternative to other technologies with high accuracy and have much wider applications in future studies of behavioural sciences.

Under-exploration of Three-Dimensional Images Leads to Search Errors for Small Salient Targets

Advances in 3D imaging technology are transforming how radiologists search for cancer1,2 and how security officers scrutinize baggage for dangerous objects.3 These new 3D technologies often improve search over 2D images4,5 but vastly increase the image data. Here, we investigate 3D search for targets of various sizes in filtered noise and digital breast phantoms. For a Bayesian ideal observer optimally processing the filtered noise and a convolutional neural network processing the digital breast phantoms, search with 3D image stacks increases target information and improves accuracy over search with 2D images. In contrast, 3D search by humans leads to high miss rates for small targets easily detected in 2D search, but not for larger targets more visible in the visual periphery. Analyses of human eye movements, perceptual judgments, and a computational model with a foveated visual system suggest that human errors can be explained by interaction among a target's peripheral visibility, eye movement under-exploration of the 3D images, and a perceived overestimation of the explored area. Instructing observers to extend the search reduces 75% of the small target misses without increasing false positives. Results with twelve radiologists confirm that even medical professionals reading realistic breast phantoms have high miss rates for small targets in 3D search. Thus, under-exploration represents a fundamental limitation to the efficacy with which humans search in 3D image stacks and miss targets with these prevalent image technologies.

Analysis of eye-movement for application to the training of cerebral endovascular treatment 2

Analysis of eye-movement for application to the training of cerebral endovascular treatment 2

К ВОПРОСУ ОБ ОСОБЕННОСТЯХ АНАЛИЗА ДВИЖЕНИЙ ГЛАЗ В ПРОЦЕССЕ ВОСПРИЯТИЯ ЛИЦ

Background. The article is devoted to the study of the mechanisms of face perception when using the technology of eye-tracking. In the scientific literature, two processes are distinguished - analytical (perception of individual facial features) and holistic (perception of a general configuration of facial features). It is assumed that each of the mechanisms can be specifically manifested in patterns of eye movements during face perception. However, there is disagreement among the authors concerning the eye movements patterns which reflect the dominance of the holistic or analytic processing. We hypothesized that the contradictions in the interpretation of eye movement indicators in the studies of face perception may be associated with the features of the eye-tracker data processing, namely, with the specifics of identifying areas of interest (eyes, nose, bridge of the nose, lips), as well as with individual strategies of eye movements. Objective. Revealing the features of eye movements analysis in the process of facial perception. Method. A method for studying analytical and holistic processing in the task of assessing the attractiveness of upright and inverted faces using eye-tracking technology has been developed and tested. The eye-tracking data were analyzed for the entire sample using three types of processing, differing in the marking of the areas of interest (AOIs), and separately for two groups differing in eye movement strategies. The distinction of strategies was considered based on differences in the mean values of the fixation duration and the amplitude of saccades. Results. It was shown that: the presence of statistically significant differences of the dwell time in the AOIs between the condition of upright and inverted faces depended on the method of identifying these AOIs. It was shown that the distribution of the dwell time by zones is closely related to individual strategies of eye movements. Analysis of the data separately by groups showed significant differences in the distribution of the dwell time in the AOIs. Conclusion. When processing eye-tracking data obtained in the studies of face perception, it is necessary to consider individual strategies of eye movements, as well as the features associated with identifying AOIs. The absence of a single standard for identifying these areas can be the reason for inconsistency of the data about the holistic or analytical processing dominance. According to our data, the most effective for the analysis of holistic processing is a more detailed type of marking the AOIs, in which not only the main features (eyes, nose, mouth) are distinguished, but also the area of the nose bridge and nose.

Does Augmented-Reality Head-Up Display Help? A Preliminary Study on Driving Performance Through a VR-Simulated Eye Movement Analysis

Augmented reality heads-up display (AR-HUD) is becoming increasingly popular as a way to keep drivers focusing on roads. By overlaying visuals on the windshield, AR-HUDs improve the drivers’ view of the environment outside the car, creating a stronger sense of awareness of the surroundings. However, whether AR-HUD and to what extent different AR-HUD layouts could improve drivers’ driving performance are still questionable. Unfortunately, AR-HUD is still at a research stage, not yet fully commercialized. Hence, there are few actual products in the market available for testing. For this reason, this study developed a virtual reality driving simulator to tested drivers’ driving performance environment under three scenarios: without AR-HUD, dispersed layout (AR-HUD1), and dense layout (AR-HUD2). Twelve subjects were invited to join the experiment. Their driving performance was measured in various aspects. This study showed that AR-HUD with interfaces that conform to human-computer interaction principles and visual design rules could improve cognitive resource allocation and promote driving safety. Conversely, a poor designed AR-HUD could negatively impact driving safety.

Automated Filtering of Eye Movements Using Dynamic AOI in Multiple Granularity Levels

Eye-tracking experiments involve areas of interest (AOIs) for the analysis of eye gaze data. While there are tools to delineate AOIs to extract eye movement data, they may require users to manually draw boundaries of AOIs on eye tracking stimuli or use markers to define AOIs. This paper introduces two novel techniques to dynamically filter eye movement data from AOIs for the analysis of eye metrics from multiple levels of granularity. The authors incorporate pre-trained object detectors and object instance segmentation models for offline detection of dynamic AOIs in video streams. This research presents the implementation and evaluation of object detectors and object instance segmentation models to find the best model to be integrated in a real-time eye movement analysis pipeline. The authors filter gaze data that falls within the polygonal boundaries of detected dynamic AOIs and apply object detector to find bounding-boxes in a public dataset. The results indicate that the dynamic AOIs generated by object detectors capture 60% of eye movements & object instance segmentation models capture 30% of eye movements.

Proposing for a new sport analysis method based on the eye movement analysis of Free throws

Proposing for a new sport analysis method based on the eye movement analysis of Free throws

Slice: an algorithm to assign fixations in multi-line texts

When analyzing eye movement data from the reading of multi-line texts, it is important to ensure that fixations are assigned correctly to the lines of the text. This is a non-trivial problem as eye movement data are noisy and often show complex non-linear distortions. Here, we introduced Slice, a new algorithm to assign fixations in multi-line text. We describe how Slice operates and evaluate it using a data set of natural reading data. Results show that Slice performs better than the default method used by many software packages, is robust to many forms of distortions, and approximates manual coding decisions.

Research on Cognitive Effects of Narrative Rhetoric in Print Advertisement Based on Eye Movement

This article uses eye movement experiments to study the cognitive effects of consumer groups on different narrative-quality advertisements. The experiment selects typical advertising cases, takes college students as subjects, and uses computers to track and analyze eye movement data. The experimental results show that the quality of narrative rhetoric directly affects the number of attention, duration, and pupil diameter of the subjects, and the subjects’ browsing time and memory of advertisements are positively related to the quality of narrative rhetoric of advertisements. Among them, in the Low-involvement/Thinking product advertisements, consumers' eye movement data for advertisements with better narrative quality is relatively more significant.

An Analysis of Eye Movements according to the Ability of Pre-service Elementary Teachers to Read Music

An Analysis of Eye Movements according to the Ability of Pre-service Elementary Teachers to Read Music

Revealing the dynamics of prospective memory processes in children with eye movements

Prospective memory (PM), the memory for delayed intentions, develops during childhood. The current study examined PM processes, such as monitoring, PM cue identification and intention retrieval with particular focus on their temporal dynamics and interrelations during successful and unsuccessful PM performance. We analysed eye movements of 6–7 and 9–10 year olds during the inspection of movie stills while they completed one of three different tasks: scene viewing followed by a snippet allocation task, a PM task and a visual search task. We also tested children's executive functions of inhibition, flexibility and working memory. We found that older children outperformed younger children in all tasks but neither age group showed variations in monitoring behaviour during the course of the PM task. In fact, neither age group monitored. According to our data, initial processes necessary for PM success take place during the first fixation on the PM cue. In PM hit trials we found prolonged fixations after the first fixation on the PM cue, and older children showed a greater efficiency in PM processes following this first PM cue fixation. Regarding executive functions, only working memory had a significant effect on children's PM performance. Across both age groups children with better working memory scores needed less time to react to the PM cue. Our data support the notion that children rely on spontaneous processes to notice the PM cue, followed by a resource intensive search for the intended action.