Eye Head Research Articles

An Enhanced Eye-Tracking Approach Using Pipeline Computation

Tracking and authentication at a low cost and in a convenient way is an important issue nowadays as opposed to using high cost for specified hardware and complex calibration process. In the paper, the prime concentration is divided into two: (i) eye tracking and (ii) parallelism in execution. First part has been subdivided as: Firstly, human face is taken from video sequence, and this is divided into frames. Eye regions are recognized from image frames. Secondly, iris region and pupils (central point) are being identified. In identifying pupil, the energy intensity and edge strength are taken into account together. Iris and eye corners are considered as tracking points. The famous sinusoidal head model is used for 3-D head shape, and adaptive probability density function (APDF) is proposed for estimating pose in facial features extraction. Thirdly, iris (pupil) tracking is completed by integrating eye vector and head movement information gained from APDF. The second part focuses on reducing execution time (ET) by applying pipeline architecture (PA). So the entire process has been subdivided into three phases. Phase-I is tracking eyes and pupils and preparing an eye vector. Phase-II is completing the calibration process. Phase-III is for matching and feature extraction. PA is integrated to improve performance in terms of ET because three phases are running in parallel. The experiment is done based on CK + image sets. Indeed, by using PA, the ET is reduced by (66.68%) two-thirds. The average accuracy in tracking (91% in left eye pupil (LEP)) and 93.6% in right eye pupil (REP)) is a robust one.

Morphometric asymmetry of Barbodes binotatus (cyprinidae) collected from three different rivers in Java

Barbodes binotatus (Bleeker, 1859) is an endemic freshwater fish species that currently used for aquaculture. Good quality seed can be attained from cross-breed of parental stock from different geographical areas. This study aimed to distinguish morphological asymmetry of the species collected from three different rivers in Java: Sungai Tawang (East Java); Sungai Opak (Central Java); and Sungai Cisanggarung (West Java). Total 30 specimen were randomly sub-sampled from each river. Morphology, morphometry and meristic characters, based on 14 anatomical landmarks were measured and analyzed using Thin Plate Spline (TPSDIG), Symmetry-Asymmetry Geometric Analysis (SAGE) and Principal Component Analysis (PCA). Result of SAGE analysis showed that there were no significant asymmetries observed within, and between regions, respectively (p > 0.05). The result of PCA analysis however, showed qualitative differences in ratio between eye diameter (ED) versus head length (HL) (49%) and total length (TL) versus standard length (SL) (17%). Genetic (through DNA analysis) study need to be elaborated to see the differences more accurately.

Identification of larval stages of fish in southeastern coastal waters of the Caspian Sea- Golestan Province

This study was carried out to develop a practical guide for identifying species of fish larvae in coastal waters of Caspian Sea-Golestan Province. A total of 18 sample sites in the Caspian Sea and 6 sampling sites in the Gorgan Bay was sampled monthly from March to September 2015 with a Bongo net (diameter, 46cm; mesh size, 330 µm). Most of the fish larvae belonged to postflexion and transitional stages. Morphological and meristic measurements were made. Fish larvae included Atherina boyeri, Rutilus rutilus, Rutilus firisii kutum, Cyprinus carpio, Liza saliens, Liza aurata and Gambusia holbrooki, representing 5 genera in 4 families. Results showed Cyprinus sp. and Rutilus sp. separated based on pigments patterns on the body while R. rutilus and R. frisii kutum were discerned by the number of pre-anal myomers. Liza spp. could be differentiated by different pigments patterns and some morphometric characters including eye diameter, body depth, and head length. The results of this study revealed that in contrast to the current perception, the analysis of the morphometric variation of Liza sp., Rutilus sp., and Cyprinus carpio fry could be used for their discrimination.

A brief Review of Deep Learning Based Approaches for Facial Expression and Gesture Recognition Based on Visual Information

Psychological researchers and Many Other Researchers have found that body language of a human can provide substantial information in detecting and interpreting emotions. It could express explicit and implicit information mutually of one’s emotional state and intentions over multi-channel modalities. These imperative channels include eye gaze, head movement, facial expression, body posture and gesture and so on. This learning focuses on detecting emotional states from the body language of the hand and face using computer vision and soft computing techniques. The facial expression and gesture recognition have widely used and challenging task in the present scenario. This paper describes brief review of all approaches which are majorly categorized into two -categories where the first category belongs to Conventional approaches and other based on Deep-learning or Non - Conventional. This paper is basically used as a survey of deep-learning approaches for hand-gesture and Facial Expression Recognitions. We describe all review through the taxonomy of deep-learning approaches proposed architecture details, fusion strategies, datasets, way to treat temporal-dimensions of data, its main features, basic knowledge & general understanding of its challenges

Spatial coordinate transforms linking the allocentric hippocampal and egocentric parietal primate brain systems for memory, action in space, and navigation.

A theory and model of spatial coordinate transforms in the dorsal visual system through the parietal cortex that enable an interface via posterior cingulate and related retrosplenial cortex to allocentric spatial representations in the primate hippocampus is described. First, a new approach to coordinate transform learning in the brain is proposed, in which the traditional gain modulation is complemented by temporal trace rule competitive network learning. It is shown in a computational model that the new approach works much more precisely than gain modulation alone, by enabling neurons to represent the different combinations of signal and gain modulator more accurately. This understanding may have application to many brain areas where coordinate transforms are learned. Second, a set of coordinate transforms is proposed for the dorsal visual system/parietal areas that enables a representation to be formed in allocentric spatial view coordinates. The input stimulus is merely a stimulus at a given position in retinal space, and the gain modulation signals needed are eye position, head direction, and place, all of which are present in the primate brain. Neurons that encode the bearing to a landmark are involved in the coordinate transforms. Part of the importance here is that the coordinates of the allocentric view produced in this model are the same as those of spatial view cells that respond to allocentric view recorded in the primate hippocampus and parahippocampal cortex. The result is that information from the dorsal visual system can be used to update the spatial input to the hippocampus in the appropriate allocentric coordinate frame, including providing for idiothetic update to allow for self-motion. It is further shown how hippocampal spatial view cells could be useful for the transform from hippocampal allocentric coordinates to egocentric coordinates useful for actions in space and for navigation.

Eye Gaze and Head Orientation Cues in Face-to-Face Referential Communication

ABSTRACTDuring face-to-face communication, people use visual cues about what their partners are attending to as they process language. An eyetracking experiment explored how addressees use speakers’ eye gaze and head orientation while interpreting references to objects in a spatial task. Thirty-six naive director/matcher pairs seated face-to-face were separated by a low or high barrier that hid identical mirror-image arrangements of objects. We compared matchers’ ability to disambiguate referring expressions when directors’ eyes and heads were visible over the barrier, when only directors’ heads were visible (with eyes obscured by mirrored sunglasses), or when directors were completely hidden. Seeing directors’ head orientation helped matchers quickly restrict attention to the target side of the display. Seeing directors’ eye gaze helped matchers disambiguate referring expressions earlier (before the linguistic point of disambiguation) than did seeing head orientation alone. Along with benefits, however, there were some costs to monitoring eye gaze in face-to-face communication.

External trigeminal nerve stimulation: Potential rescue treatment for acute vestibular migraine

ObjectiveVestibular migraine (VM) is the most common neurologic cause of vertigo among adults. However, there are no specifically studied or approved rescue therapies for acute VM attacks. This study describes how external trigeminal nerve stimulation (eTNS) using the Cefaly® (CEFALY Technology, Seraing, Belgium) device relieves acute VM episodes. MethodsSingle-center, retrospective review of 19 patients with acute VM attacks (seen between May 2018 and June 2019) treated with 20-min eTNS. Prior to treatment, patients graded the severity of their vertigo/headache using a 10-point visual analog scale (VAS) with 0 representing no vertigo/headache, and 10 representing the worst imaginable vertigo/headache. After eTNS, patients graded their vertigo/headache using the same VAS 15 min. In addition, bedside neuro-otologic examination was performed before and after treatment. Results19/19 patients reported improvement in vertigo severity. Mean vertigo severity was 6.6 (±2.1; median 7) before eTNS, and 2.7 (±2.6; median 3) following treatment; mean improvement in vertigo was 61.3% (±32.6; median 50.0%). During VM episodes, 14/19 experienced headache. Mean headache severity was 4.8 (±2.4; median 4.5) before eTNS, and was 1.4 (±2.4; median 0) following treatment; mean improvement in headache was 77.2% (±32.7; median 100.0%). Neuro-otologic examination was normal during VM attacks in all except Patient 7 who had spontaneous upbeat nystagmus which resolved after eTNS. Other improvements include improvement of eye pressure, head pressure, and chronic facial pain. No intolerable side effects were reported. ConclusionThis study provides preliminary evidence that eTNS is a novel, non-invasive, safe and effective treatment for acute VM attacks.

Face detection in 2- to 6-month-old infants is influenced by gaze direction and species.

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills-attending to faces and attending to the eyes-surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2-, 4-, and 6-month-olds' (N=65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following-the ability to look where another individual looks-which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.

Development of a novel artifact-free eye shield based on silicon rubber-lead composition in the CT examination of the head

The aim of this work was to develop a novel artifact-free eye shield and evaluate its effect on the dose received by the eye lens and the resulting image quality in the CT examination of the head. A new material for an eye shield was synthesised from silicon rubber (SR) and lead (Pb) using a simple method. The percentage of Pb was varied from 0 to 5% wt. An anthropomorphic head phantom was scanned with and without the SR-Pb eye shield, and compared with a tungsten paper (WP) eye shield. The distance from the eye shield and head was varied from 0 to 5 cm. The dose to the eye lens was measured using photo-luminescence detectors (PLDs). The presence of artifacts was determined by measuring CT numbers at different eye lens locations and by subtracting images with and without the eye shield. The dose reduction increases with increasing Pb content in the SR-Pb eye shield. A 5% wt SR-Pb eye shield reduced the eye lens dose by up to 50%, whereas the WP eye shield reduced the dose by up to 86%. The CT numbers in images with the SR-Pb eye shield in the regions of both eyes and the center of the head phantom is similar to those without the eye shield, indicating that there is no artifact in the resulting image. Using the WP eye shield, there is considerable artifact with the CT number increasing by up to 700% in the regions of both eyes and the center of the head. It is found that the distance between the SR-Pb eye shield and the head does not affect either the dose or the resulting images. A SR-Pb-based eye shield can be applied in clinical environments and should be placed directly above the eye surface for dose optimisation.

Assessing situation awareness in multitasking supervisory control using success rate of self-terminating search

The purpose of this study is to investigate measuring situation awareness (SA) by using the success rate of self-terminating visual search (STVS) in a multitasking supervisory control environment. Currently, many researchers have focused on developing unobtrusive SA metrics in a multitasking environment. Although some of the advanced eye-tracking metrics can estimate the operator's SA during a task, certain methodological issues remain for measuring SA in a supervisory control and multitasking environment. In this study, participants performed a distributed control task with the multi-attribute task battery. To measure the participant's SA, situation awareness global assessment technique (SAGAT) was used during the experiment. SA performance was compared to the success rate of STVS. An eye-head integrated tracking system was used to measure the rate of STVS based on the participants' eye movements and head positions in different monitoring conditions. The results showed that task-switching activity was influenced by salient features in a display. It causes a significant difference on SA between different monitoring conditions, and the difference is also monitored in the success rate of STVS. Furthermore, the study found that the attention level in visual searching influences situational awareness in a supervisory control environment. The findings from this study suggest that the success rate of STVS could be used as a new metric for measuring SA related to the visual perception of the elements in a multitasking supervisory control environment.

Discharge properties of morphologically identified vestibular neurons recorded during horizontal eye movements in the goldfish.

Computational capability and connectivity are key elements for understanding how central vestibular neurons contribute to gaze-stabilizing eye movements during self-motion. In the well-characterized and segmentally distributed hindbrain oculomotor network of goldfish, we determined afferent and efferent connections along with discharge patterns of descending octaval nucleus (DO) neurons during different eye motions. Based on activity correlated with horizontal eye and head movements, DO neurons were categorized into two complementary groups that either increased discharge during both contraversive (type II) eye (e) and ipsiversive (type I) head (h) movements (eIIhI) or vice versa (eIhII). Matching time courses of slow-phase eye velocity and corresponding firing rates during prolonged visual and head rotation suggested direct causality in generating extraocular motor commands. The axons of the dominant eIIhI subgroup projected either ipsi- or contralaterally and terminated in the abducens nucleus, Area II, and Area I with additional recurrent collaterals of ipsilaterally projecting neurons within the parent nucleus. Distinct feedforward commissural pathways between bilateral DO neurons likely contribute to the generation of eye velocity signals in eIhII cells. The shared contribution of DO and Area II neurons to eye velocity storage likely represents an ancestral condition in goldfish that is clearly at variance with the task separation between mammalian medial vestibular and prepositus hypoglossi neurons. This difference in signal processing between fish and mammals might correlate with a larger repertoire of visuo-vestibular-driven eye movements in the latter species that potentially required a shift in sensitivity and connectivity within the hindbrain-cerebello-oculomotor network. NEW & NOTEWORTHY We describe the structure and function of neurons within the goldfish descending octaval nucleus. Our findings indicate that eye and head velocity signals are processed by vestibular and Area II velocity storage integrator circuitries whereas the velocity-to-position Area I neural integrator generates eye position solely. This ancestral condition differs from that of mammals, in which vestibular neurons generally lack eye position signals that are processed and stored within the nucleus prepositus hypoglossi.

SGaze: A Data-Driven Eye-Head Coordination Model for Realtime Gaze Prediction.

We present a novel, data-driven eye-head coordination model that can be used for realtime gaze prediction for immersive HMD-based applications without any external hardware or eye tracker. Our model (SGaze) is computed by generating a large dataset that corresponds to different users navigating in virtual worlds with different lighting conditions. We perform statistical analysis on the recorded data and observe a linear correlation between gaze positions and head rotation angular velocities. We also find that there exists a latency between eye movements and head movements. SGaze can work as a software-based realtime gaze predictor and we formulate a time related function between head movement and eye movement and use that for realtime gaze position prediction. We demonstrate the benefits of SGaze for gaze-contingent rendering and evaluate the results with a user study.

Differential impact of trait, social, and attachment anxiety on the stare-in-the-crowd effect

Eye gaze conveys crucial information for social interactions, with straight versus averted gaze triggering distinct emotional and cognitive processes. The “stare-in-the-crowd” effect exemplifies such differential visual processing of gaze direction, in more recent reports also in interaction with head orientation. Besides aiming at replicating the “stare-in-the-crowd” effect by means of an eye gaze by head orientation interaction, the present study intended to for the first time testing its susceptibility to inter-individual differences in trait, social, and attachment anxiety. Our findings reveal a significant relation between the “stare-in-the-crowd” effect and social and attachment, but not trait anxiety, and therefore provide preliminary cues for personality influences on visual processing of eye gaze and head orientation.

Cognitive engagement in emotional text reading: concurrent recordings of eye movements and head motion

ABSTRACTThe present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotionally positive texts on a digital tablet and both participants’ eye movements and body movements were recorded using respectively eye-tracking glasses and a motion capture system. The results showed that emotionally positive texts were read faster than neutral texts, and that readers’ movements decreased when reading emotional texts regardless of valence polarity. Recent studies suggested that postural movements may reflect cognitive engagement and especially the engagement in the task to be done. Our findings seem to validate this hypothesis of a bodily engagement in reading emotional contents. The present results suggest that the novel methodology of eye and postural movement recordings is informative in studying the readers’ embodied engagement during reading emotional materials.

Strategies for Gaze Stabilization Critically Depend on Locomotor Speed

Locomotion involves complex combinations of translational and rotational head movements. For gaze stability, this necessitates the interplay of angular and linear vestibulo-ocular reflexes (VOR) as well as the integration of visual feedback about the desired viewing distance. Furthermore, gaze stabilizing systems must be able to cope with vast differences in head motion brought about by changing locomotor speeds and patterns (walking vs. running). The present study investigated horizontal and vertical angular VOR (aVOR) and linear gaze stabilization (lGS) as well as compensation for linear head movements by angular counter rotation of the head during treadmill walking and running at different velocities (0.4 to 2.4 m/s) while fixating either a close (0.5 m) or distant (2.0 m) target. In the horizontal plane, the aVOR predominated throughout all locomotor speeds, whereas the compensation of linear translations was highly variable and generally insufficient. In contrast, in the vertical plane, eye and angular head motion steadily became more in phase with increasing locomotor speed, which served to optimize linear motion compensation. Furthermore, the timing of the vertical aVOR became more automated and independent of visual feedback during faster locomotion. Thus, horizontal and vertical gaze stabilization strategies appear to be considerably different. Whereas horizontal gaze control is likely governed by passive sensorimotor reflexes throughout all locomotor speeds, vertical gaze stabilization switches to an automated feed-forward control at faster locomotion. This switch is presumably driven by efference copies from spinal locomotor commands that were previously shown to govern gaze stabilization in animal models during stereotypic locomotion.

INTERAKSI MUSIKAL MELALUI GESTUR DAN VERBAL DALAM MUSIK JAZZ

ABSTRACT This paper explains a process of musical interaction in jazz music performances, on the performances of Solo Jazz Society musicians in Surakarta. The focus of this paper is about (1) how the process of musical interaction between Sojazz musicians occurs and (2) what factors cause musical interaction between Sojazz musicians. With the aim (1) to know how the process of musical interactions between Sojazz musicians occur and (2) to know the factors that cause the musical interactions between Sojazz musicians. The research method used is qualitative with descriptive analysis approach. n the performance, Sojazz musicians perform musical interactions between musicians through two forms of process. Gesture interactions that include eye contact, hand code, head jerking, lip reading and overall body posture are applied as cues while improvising. The second form of the process is through the musical interaction itself which is Accompaniment, melodic phrase and rhythmic motif, tension growth, and trade four. The process of musical interaction applied by Sojazz musicians as mentioned above, is through gesture used to create mutual interaction between musicians. Kata kunci : Solo Jazz Society, interaksi musikal jazz,

Development of Wearable Body Fatigue Evaluation and Awakening System

In this paper, a portable or wearable online monitoring system for eye movement and head motion parameters is designed. The eye movement tracking and head tracking are used to monitor the wearer for a long time, so as to determine the function expectation of the wearer in real time, and the lack of awakening condition under the setting conditions. In order to improve the level of arousal, people used sound, light and vibration stimulation to conduct state warning and physical stimulation. From the system, the wearer’s brain fatigue state data can be monitored in a long time and continuous monitoring in the process of continuous operation and sleep deprivation, which can effectively improve the user’s long time working ability and working state, and improve the vigilance and operation ability.

Referential processing during reading: concurrent recordings of eye movements and head motion.

The present study utilized a new experimental set-up synchronizing eye movements and head motion for investigating referential change occurring in a reading task. We examined the effects of a change in narrative perspective during reading on eye movements and head motion. Forty-four participants read texts on a digital tablet, and both participants' eye movements and head movements were recorded using eye tracker and motion capture. The results showed longer eye fixation duration, longer reading time and decreasing head motions when perspective changed. Recent studies have supported the dynamic engagement hypothesis suggesting that there is a fluctuation in cognitive engagement reflected by postural movements. Our findings on head movements seem to validate this hypothesis of a bodily engagement in reading. The results provided by our study showed that the novel methodology of eye and head movement recordings we used was proven to be informative in studying the reader's embodiment during reading.

Fuzzy Logic Decision Support System for Hypovigilance Detection based on CNN Feature Extractor and WN Classifier

Fatigue and drowsiness are among the main causes of traffic accidents, just behind excessive speed and alcoholism. This paper deals with the problem of road safety. It attempts to present a driver vigilance monitoring system based on a video approach. This work aims at creating an assistive driving application employing eyes closure duration and head posture estimation as performant signs for alertness control. The proposed system can be summarized in three main steps: Eyes' detection and tracking in a video, eyes' state classification and fusion of both sub-systems based on eyes' blinking and head position. To accomplish the previous tasks, we used the Viola and Jones algorithm for interest area detection thanks to its efficiency in real time applications. For the classification step, we used two novel architectures of transfer learning classifier based on fast wavelet transform and separator wavelet networks, which presents our main contribution of this paper. This novel architecture proves its performance compared to the classic version of the transfer learning based on SVM classifier and to our old classifier based only on fast wavelet networks without a deep learning structure. Different datasets with different classifiers are used to evaluate our new approach. Our second contribution is illustrated by the final system which uses the fuzzy logic and provides five different vigilance levels. Global rates given by experimental results show the effectiveness of our proposed classification system for eyes' state recognition and driver drowsiness detection.

A pilot study assessing the spiritual, emotional, physical/environmental, and physiological needs of mechanically ventilated surgical intensive care unit patients via eye tracking devices, head nodding, and communication boards

BackgroundMechanically ventilated patients in the intensive care unit (ICU) are unable to communicate verbally. We sought to evaluate their needs via a communication board (CB) and a novel eye tracking...