Eye Movement Analysis Research Articles

Eye-movement patterns to social and non-social cues in early deaf adults.

Previous research on covert orienting to the periphery suggested that early profound deaf adults were less susceptible to uninformative gaze-cues, though were equally or more affected by non-social arrow-cues. The aim of this work was to investigate whether spontaneous eye movement behaviour helps explain the reduced impact of the social cue in deaf adults. We tracked the gaze of 25 early profound deaf and 25 age-matched hearing observers performing a peripheral discrimination task with uninformative central cues (gaze vs arrow), stimulus-onset asynchrony (250 vs 750 ms), and cue validity (valid vs invalid) as within-subject factors. In both groups, the cue effect on reaction time (RT) was comparable for the two cues, although deaf observers responded significantly slower than hearing controls. While deaf and hearing observers' eye movement pattern looked similar when the cue was presented in isolation, deaf participants made significantly more eye movements than hearing controls once the discrimination target appeared. Notably, further analysis of eye movements in the deaf group revealed that independent of the cue type, cue validity affected saccade landing position, while latency was not modulated by these factors. Saccade landing position was also strongly related to the magnitude of the validity effect on RT, such that the greater the difference in saccade landing position between invalid and valid trials, the greater the difference in manual RT between invalid and valid trials. This work suggests that the contribution of overt selection in central cueing of attention is more prominent in deaf adults and helps determine the manual performance, irrespective of the cue type.

How Does Wearing a Facecover Influence the Eye Movement Pattern in Times of COVID-19?

BackgroundSince the emergence of the COVID-19 pandemic facecovers have become a common sight. The effect of facecovers on the gaze when looking at faces has not been assessed yet.ObjectiveThe aim of the present study is to investigate a potential difference in eye movement pattern in observes which are exposed to images showing a face without and with facecover to identify if there is truly a change of gaze when identifying (masked) facial features.Materials and MethodsThe eye movement of a total of 64 study participants (28 males and 36 females) with a mean age of 31.84±9.0 years was analyzed in this cross-sectional observational study. Eye movement analysis was conducted based on positional changes of eye features within an x- and y- coordinate system while two images (face without/with facecover) were displayed for 8 seconds.ResultsThe results of this study revealed that the sequence of focussing on facial regions was not altered when wearing a facecover and followed the sequence: perioral, nose, periorbital. Wearing a facecover significantly increased the time of focussing on the periorbital region and increased also the number of repeated eye fixations during the interval of visual stimulus presentation. No statistically significant differences were observed between male and female participants in their eye movement pattern across all investigated variables with p > 0.433.ConclusionAesthetic practitioners could utilized the presented data and develop marketing and treatment strategies which majorly target the periorbital area understanding the altered eye movement pattern in times of COVID-19.

Gaze Parameters in the Analysis of Ambiguous Geometric Shapes.

This study explores perceptual organisation and shape perception when viewing a tetragon and an additional element (a dot) that is located at varying positions and distances next to the tetragon. The aim of the study is to determine the factors that can alter the interpretation of object configuration and impact whether the presented tetragon is perceived as a diamond or a square. Methods used in this study are a forced-choice task as a subjective measurement and eye tracking as an objective measurement of perceptual processes. Overall, 31 stimuli were presented to the participants: a tetragon in two different sizes with an additional element (a dot) located inside or outside the object at three different positions at three distances. The results indicate significant changes in shape perception, depending on the location of the additional element. The results are complemented with eye movement analysis indicating that as the distance between the elements increases, there is a higher probability of either of the two shape interpretations and the gaze is less likely to be directed to the area between the stimuli. Furthermore, the subjective perception of shape is codetermined by the shape perception when the tetragon is presented without the additional element.

Parameter dependence in visual pattern-component rivalry at onset and during prolonged viewing

In multistability, perceptual interpretations (“percepts”) of ambiguous stimuli alternate over time. There is considerable debate as to whether similar regularities govern the first percept after stimulus onset and percepts during prolonged presentation. We address this question in a visual pattern-component rivalry paradigm by presenting two overlaid drifting gratings, which participants perceived as individual gratings passing in front of each other (“segregated”) or as a plaid (“integrated”). We varied the enclosed angle (“opening angle”) between the gratings (experiments 1 and 2) and stimulus orientation (experiment 2). The relative number of integrated percepts increased monotonically with opening angle. The point of equality, where half of the percepts were integrated, was at a smaller opening angle at onset than during prolonged viewing. The functional dependence of the relative number of integrated percepts on opening angle showed a steeper curve at onset than during prolonged viewing. Dominance durations of integrated percepts were longer at onset than during prolonged viewing and increased with opening angle. The general pattern persisted when stimuli were rotated (experiment 2), despite some perceptual preference for cardinal motion directions over oblique directions. Analysis of eye movements, specifically the slow phase of the optokinetic nystagmus (OKN), confirmed the veridicality of participants’ reports and provided a temporal characterization of percept formation after stimulus onset. Together, our results show that the first percept after stimulus onset exhibits a different dependence on stimulus parameters than percepts during prolonged viewing. This underlines the distinct role of the first percept in multistability.

Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements

Recent research has suggested the importance of part-based information in face recognition in addition to global, whole-face information. Nevertheless, face drawing experience was reported to enhance selective attention to the eyes but did not improve face recognition performance, leading to speculations about limited plasticity in adult face recognition. Here we examined the mechanism underlying the limited advantage of face drawing experience in face recognition through the Eye Movement analysis with Hidden Markov Models (EMHMM) approach. We found that portrait artists showed more eyes-focused eye movement patterns and outperformed novices in face matching, and participants' drawing rating was correlated with both eye movement pattern and performance. In contrast, portrait artists did not outperform novices and did not differ from novices in eye movement pattern in either the face recognition or part-whole tasks, although the eyes-focused pattern was associated with better recognition performance and longer response times in the whole condition relative to the part condition. Interestingly, in contrast to the face recognition and part-whole tasks, participants' performance in face matching was predicted by their drawing rating but not eye movement pattern. These results suggested that artists' advantage in face processing is specific to tasks similar to their drawing experience such as face matching, and may be related to their better ability in extracting identity-invariant information between two faces rather than more eyes-focused eye movement patterns.

Integrating eye-movement analysis and the semantic differential method to analyze the visual effect of a traditional commercial block in Hefei, China

Eye-movement analysis was adopted to evaluate the visual perception of Chinese traditional commercial blocks, and the Chenghuangmiao block in Hefei, China, was selected as a typical case. Eye-movement data from 40 respondents viewing 14 sample pictures were recorded. The spatial elements of the sample pictures, including landmarks and commercial brands, were further extracted to analyze the visual characteristics of spatial elements and the factors that affect the respondents' perceptions of those elements. Then, the semantic differential method was used to analyze the relationship between visual preferences and psychological perceptions of spatial elements. Seventeen pairs of opposing adjectives were selected to score the intrinsic properties and visitors’ feelings of spaces. The software SPSS 22.0 was used to analyze these data. Results showed that distinctive spatial elements, such as street corridors, Ma Tau Walls, and various landmarks, were the most visually attractive. In addition, the location of a given element within a picture was an important factor affecting eye movements. On this basis, strategies for improving spatial-visual effects are proposed. The strategies include emphasizing the visual characteristics of different spatial elements, considering the overall layout of spatial elements, and creating diversified spaces based on different spatial categories.

Deep learning framework for subject-independent emotion detection using wireless signals.

Emotion states recognition using wireless signals is an emerging area of research that has an impact on neuroscientific studies of human behaviour and well-being monitoring. Currently, standoff emotion detection is mostly reliant on the analysis of facial expressions and/or eye movements acquired from optical or video cameras. Meanwhile, although they have been widely accepted for recognizing human emotions from the multimodal data, machine learning approaches have been mostly restricted to subject dependent analyses which lack of generality. In this paper, we report an experimental study which collects heartbeat and breathing signals of 15 participants from radio frequency (RF) reflections off the body followed by novel noise filtering techniques. We propose a novel deep neural network (DNN) architecture based on the fusion of raw RF data and the processed RF signal for classifying and visualising various emotion states. The proposed model achieves high classification accuracy of 71.67% for independent subjects with 0.71, 0.72 and 0.71 precision, recall and F1-score values respectively. We have compared our results with those obtained from five different classical ML algorithms and it is established that deep learning offers a superior performance even with limited amount of raw RF and post processed time-sequence data. The deep learning model has also been validated by comparing our results with those from ECG signals. Our results indicate that using wireless signals for stand-by emotion state detection is a better alternative to other technologies with high accuracy and have much wider applications in future studies of behavioural sciences.

Under-exploration of Three-Dimensional Images Leads to Search Errors for Small Salient Targets

Advances in 3D imaging technology are transforming how radiologists search for cancer1,2 and how security officers scrutinize baggage for dangerous objects.3 These new 3D technologies often improve search over 2D images4,5 but vastly increase the image data. Here, we investigate 3D search for targets of various sizes in filtered noise and digital breast phantoms. For a Bayesian ideal observer optimally processing the filtered noise and a convolutional neural network processing the digital breast phantoms, search with 3D image stacks increases target information and improves accuracy over search with 2D images. In contrast, 3D search by humans leads to high miss rates for small targets easily detected in 2D search, but not for larger targets more visible in the visual periphery. Analyses of human eye movements, perceptual judgments, and a computational model with a foveated visual system suggest that human errors can be explained by interaction among a target's peripheral visibility, eye movement under-exploration of the 3D images, and a perceived overestimation of the explored area. Instructing observers to extend the search reduces 75% of the small target misses without increasing false positives. Results with twelve radiologists confirm that even medical professionals reading realistic breast phantoms have high miss rates for small targets in 3D search. Thus, under-exploration represents a fundamental limitation to the efficacy with which humans search in 3D image stacks and miss targets with these prevalent image technologies.

Analysis of eye-movement for application to the training of cerebral endovascular treatment 2

Analysis of eye-movement for application to the training of cerebral endovascular treatment 2

К ВОПРОСУ ОБ ОСОБЕННОСТЯХ АНАЛИЗА ДВИЖЕНИЙ ГЛАЗ В ПРОЦЕССЕ ВОСПРИЯТИЯ ЛИЦ

Background. The article is devoted to the study of the mechanisms of face perception when using the technology of eye-tracking. In the scientific literature, two processes are distinguished - analytical (perception of individual facial features) and holistic (perception of a general configuration of facial features). It is assumed that each of the mechanisms can be specifically manifested in patterns of eye movements during face perception. However, there is disagreement among the authors concerning the eye movements patterns which reflect the dominance of the holistic or analytic processing. We hypothesized that the contradictions in the interpretation of eye movement indicators in the studies of face perception may be associated with the features of the eye-tracker data processing, namely, with the specifics of identifying areas of interest (eyes, nose, bridge of the nose, lips), as well as with individual strategies of eye movements. Objective. Revealing the features of eye movements analysis in the process of facial perception. Method. A method for studying analytical and holistic processing in the task of assessing the attractiveness of upright and inverted faces using eye-tracking technology has been developed and tested. The eye-tracking data were analyzed for the entire sample using three types of processing, differing in the marking of the areas of interest (AOIs), and separately for two groups differing in eye movement strategies. The distinction of strategies was considered based on differences in the mean values of the fixation duration and the amplitude of saccades. Results. It was shown that: the presence of statistically significant differences of the dwell time in the AOIs between the condition of upright and inverted faces depended on the method of identifying these AOIs. It was shown that the distribution of the dwell time by zones is closely related to individual strategies of eye movements. Analysis of the data separately by groups showed significant differences in the distribution of the dwell time in the AOIs. Conclusion. When processing eye-tracking data obtained in the studies of face perception, it is necessary to consider individual strategies of eye movements, as well as the features associated with identifying AOIs. The absence of a single standard for identifying these areas can be the reason for inconsistency of the data about the holistic or analytical processing dominance. According to our data, the most effective for the analysis of holistic processing is a more detailed type of marking the AOIs, in which not only the main features (eyes, nose, mouth) are distinguished, but also the area of the nose bridge and nose.

Does Augmented-Reality Head-Up Display Help? A Preliminary Study on Driving Performance Through a VR-Simulated Eye Movement Analysis

Augmented reality heads-up display (AR-HUD) is becoming increasingly popular as a way to keep drivers focusing on roads. By overlaying visuals on the windshield, AR-HUDs improve the drivers’ view of the environment outside the car, creating a stronger sense of awareness of the surroundings. However, whether AR-HUD and to what extent different AR-HUD layouts could improve drivers’ driving performance are still questionable. Unfortunately, AR-HUD is still at a research stage, not yet fully commercialized. Hence, there are few actual products in the market available for testing. For this reason, this study developed a virtual reality driving simulator to tested drivers’ driving performance environment under three scenarios: without AR-HUD, dispersed layout (AR-HUD1), and dense layout (AR-HUD2). Twelve subjects were invited to join the experiment. Their driving performance was measured in various aspects. This study showed that AR-HUD with interfaces that conform to human-computer interaction principles and visual design rules could improve cognitive resource allocation and promote driving safety. Conversely, a poor designed AR-HUD could negatively impact driving safety.

Automated Filtering of Eye Movements Using Dynamic AOI in Multiple Granularity Levels

Eye-tracking experiments involve areas of interest (AOIs) for the analysis of eye gaze data. While there are tools to delineate AOIs to extract eye movement data, they may require users to manually draw boundaries of AOIs on eye tracking stimuli or use markers to define AOIs. This paper introduces two novel techniques to dynamically filter eye movement data from AOIs for the analysis of eye metrics from multiple levels of granularity. The authors incorporate pre-trained object detectors and object instance segmentation models for offline detection of dynamic AOIs in video streams. This research presents the implementation and evaluation of object detectors and object instance segmentation models to find the best model to be integrated in a real-time eye movement analysis pipeline. The authors filter gaze data that falls within the polygonal boundaries of detected dynamic AOIs and apply object detector to find bounding-boxes in a public dataset. The results indicate that the dynamic AOIs generated by object detectors capture 60% of eye movements & object instance segmentation models capture 30% of eye movements.

Proposing for a new sport analysis method based on the eye movement analysis of Free throws

Proposing for a new sport analysis method based on the eye movement analysis of Free throws

Slice: an algorithm to assign fixations in multi-line texts

When analyzing eye movement data from the reading of multi-line texts, it is important to ensure that fixations are assigned correctly to the lines of the text. This is a non-trivial problem as eye movement data are noisy and often show complex non-linear distortions. Here, we introduced Slice, a new algorithm to assign fixations in multi-line text. We describe how Slice operates and evaluate it using a data set of natural reading data. Results show that Slice performs better than the default method used by many software packages, is robust to many forms of distortions, and approximates manual coding decisions.

Research on Cognitive Effects of Narrative Rhetoric in Print Advertisement Based on Eye Movement

This article uses eye movement experiments to study the cognitive effects of consumer groups on different narrative-quality advertisements. The experiment selects typical advertising cases, takes college students as subjects, and uses computers to track and analyze eye movement data. The experimental results show that the quality of narrative rhetoric directly affects the number of attention, duration, and pupil diameter of the subjects, and the subjects’ browsing time and memory of advertisements are positively related to the quality of narrative rhetoric of advertisements. Among them, in the Low-involvement/Thinking product advertisements, consumers' eye movement data for advertisements with better narrative quality is relatively more significant.

An Analysis of Eye Movements according to the Ability of Pre-service Elementary Teachers to Read Music

An Analysis of Eye Movements according to the Ability of Pre-service Elementary Teachers to Read Music

Revealing the dynamics of prospective memory processes in children with eye movements

Prospective memory (PM), the memory for delayed intentions, develops during childhood. The current study examined PM processes, such as monitoring, PM cue identification and intention retrieval with particular focus on their temporal dynamics and interrelations during successful and unsuccessful PM performance. We analysed eye movements of 6–7 and 9–10 year olds during the inspection of movie stills while they completed one of three different tasks: scene viewing followed by a snippet allocation task, a PM task and a visual search task. We also tested children's executive functions of inhibition, flexibility and working memory. We found that older children outperformed younger children in all tasks but neither age group showed variations in monitoring behaviour during the course of the PM task. In fact, neither age group monitored. According to our data, initial processes necessary for PM success take place during the first fixation on the PM cue. In PM hit trials we found prolonged fixations after the first fixation on the PM cue, and older children showed a greater efficiency in PM processes following this first PM cue fixation. Regarding executive functions, only working memory had a significant effect on children's PM performance. Across both age groups children with better working memory scores needed less time to react to the PM cue. Our data support the notion that children rely on spontaneous processes to notice the PM cue, followed by a resource intensive search for the intended action.

The Analysis of Accommodation Response and Convergence Eye Movement When Viewing 8K Images

The Analysis of Accommodation Response and Convergence Eye Movement When Viewing 8K Images

Differential diagnosis of vergence and saccade disorders in dyslexia

Previous studies suggest vergence and saccade abnormalities in dyslexic adolescents. However, these studies are mainly clinically based and do not provide objective measurements of eye movements, but rather subjectively evaluate vergence using haplosopic conditions in which the two eyes are dissociated (via polarizers, prisms, or intermittent spectacles). Other studies have identified deficits with binocular coordination during reading in dyslexics. Yet, there are few studies that provide objective measurements of eye movements in the dyslexic population to help provide more information regarding if these deficits could be due to an intrinsic motor problem or if they are the consequence of poor reading. 47 dyslexic adolescents (18 female, 29 male; mean age 15.5) and 44 non-dyslexic adolescents (22 female, 22 male; mean age 14.8) wore a head-based eye tracker (PupilCore, Pupil Labs, Berlin) which recorded wide angle saccade and vergence eye movements at 200 Hz. Tests were run using the REMOBI device, which produced a saccade or vergence audiovisual target. Analysis of eye movements was performed with lab-developed software, AIDEAL. The results showed statistically significant abnormalities in vergence and saccades. In vergence, dyslexics displayed a reduced amplitude of the visually driven portion of convergence and a longer duration in the initial phase of divergence. In saccades, dyslexic adolescents demonstrated slower saccades in both directions. They also had an increased disconjugate drift in the first 80 or 160 ms following saccades to the right, suggesting poor binocular coordination. For both vergence and saccades, the peak velocity and time to peak velocity was higher and earlier, respectively, in non-dyslexics compared to dyslexics; yet the average velocity of both movements was lower in dyslexics. Thus, these results indicate peculiar velocity profiles in dyslexics, particularly a slow deceleration phase in both vergence and saccades. The study provides an objective method to diagnose vergence and saccade abnormalities while viewing targets in the real three-dimensional space in a dyslexic population. Vergence abnormalities are demonstrated to be a problem in dyslexics, occurring independently from reading. We hypothesize these disconjugate drifts following saccades are the result of slow vergence capacity. Rehabilitation programs, such as those using REMOBI, should aim to target these deficits in vergence velocity, as this has been shown to improve binocular control.

Virtual reality–based mindfulness training, sensory activation and mental assessment in dementia care

AbstractBackgroundRecent studies underline the importance of cognitive reserve, which is supported by stress reduction, pleasure experience and meditation, for mental health. Mindfulness training is successfully applied to dementia and indicate a lasting positive effect on cognitive reserve, well‐being and motivation. The research project OpenSense investigated the potential of VR‐based intervention and assessment for dementia care in a proof‐of concept study. The VR‐based intervention was developed to foster mindfulness and sensory activation.MethodVR‐based intervention was applied in persons with dementia (PwD) with Alzheimer’s dementia (AD; n=12, age M=85.0 years, MMSE M=21.5) and healthy controls (n=12, age M=75.1 years, MMSE M=30) using 30 minutes of panoramic video‐based multi‐sensory experiences presenting stimuli that empower relaxation (body‐scanning, beach, forest) and activation (bakery, orchestra). EEG‐based alpha‐band signals (8‐12 Hz) associated with relaxation and inhibitory control were recorded before, during and after intervention and eye tracking was applied during intervention.ResultPre‐post EEG analysis showed significant increases in alpha power and brain connectivity for PwD with AD and controls (post > pre, p<.05). EEG baseline alpha power demonstrated higher values for healthy controls than for PwD (AD). Eye movement analysis demonstrated significant differences between PwD (AD) and controls: eye blink rate AD > controls, p=.004(**) from the observation of a 3 minutes video, and significant correlation (Rho=.607, p=.003(**); 3 minutes video) was achieved between eye movements and the Freiburg Mindfulness Inventory score.ConclusionThe potential of VR‐based intervention based on mindfulness and sensory activation is very promising: the study demonstrated significant increases of EEG alpha power and brain connectivity where PwD usually suffer from decline and gaze data acquired during intervention indicate potential for non‐invasive assessment for decision support. OpenSense anticipates numerous opportunities for novel VR‐based care services for empowering cognitive reserve, inducing sensory activation, raising awareness and motivation for self‐regulation, and as pervasive assessment tool.