Eye Control System Research Articles

Survey on Eye Gaze Tracking to Control Cursor Movement

In Controlling the mouse by a physically challenged person is really a tough one. To find a solution for the people who cannot use the Mouse physically, we have proposed this mouse cursor control using Eye Movements. Eye gaze is an alternative way of accessing a computer using eye movements to control the mouse. For someone who fine touch screens, mouse inaccessible, eye gaze is an alternative method to allow a user to operate their computer, using the movement of their eyes. Eye movement can be regarded as a pivotal real-time input medium for human-computer communication, which is especially important for people with physical disability. In order to improve the reliability, mobility, and usability of eye tracking technique in user-computer dialogue, a novel eye control system is proposed in this system using Webcam and without using any extra hardware. The proposed system focuses on providing a simple and convenient interactive mode by only using user’s eye. The usage flow of the proposed system is designed to perfectly follow human natural habits. The proposed system describes the implementation of both iris and movement of cursor according to iris position which can be used to control the cursor on the screen using webcam and implemented using Python

Magilock: a reliable control triggering method in multi-channel eye-control systems.

Eye-tracking technology brings a different human-computer interaction experience to users because of its intuitive, natural, and hands-free operation characteristics. Avoiding the Midas touch problem and improving the accuracy of interaction are among the main goals of the research and development of eye-control systems. This study reviews the methods and limitations of research on avoiding the Midas touch problem. For typical control clicking operations with low fault tolerance, such as mode switching and state selection in an eye-control system, this study proposes Magilock, a more reliable control triggering method with a high success rate in multi-channel eye-control systems. Magilock adds a control pre-locked mechanism between the two interactive steps of eye-control channel positioning control and other interactive channel triggering controls in the multi-channel eye-control system. This effectively avoids incorrect control triggering caused by multi-channel coordination disorder and gaze-point drift. This study also conducted ergonomic experiments to explore the lock and unlock times of the control pre-locked mechanism in Magilock. Taking into account the experimental data and subjective evaluation of the participants, we recommend setting the lock time and the unlock time of Magilock to 200 ms.

Design recommendations of target size and tracking speed under circular and square trajectories for smooth pursuit with Euclidean algorithm in eye-control system

In this study, we investigated how the size, speed, and trajectory shape of smooth-pursuit targets for Euclid's algorithm affect the ergonomics and usability of the gaze interface, and conducted a user study with 20 participants, examining the priority of five target sizes in circular and square trajectories, and the recommended speed for each size in the five target speeds. The usability of the SUS and ISO 9241 (acceptability and comfort) of the eye control system had been evaluated. Based on the experiment results, the design recommendations of the priority of the target size and speed of the circular and square trajectories, suggested trajectory shapes. The research is an important reference for the design and development of smooth-pursuit targets based on the Euclidean algorithm.

Computer Vision Mouse for Tetraplegic Individuals to Access Computers Using Facial Expressions

Abstract: Controlling the mouse by a physically challenged person is really a tough one. To find a solution for the people who cannot use the Mouse physically, we have proposed this mouse cursor control using Eye Movements. Eye gaze is an alternative way of accessing a computer using eye movements to control the mouse. For someone who fine touchscreens, mouse inaccessible, eye gaze is an alternative method to allow a user to operate their computer, using the movement of their eyes. Eye movement can be regarded as a pivotal real-time input medium for human-computer communication, which is especially important for people with physical disability. In order to improve the reliability, mobility, and usability of eye tracking technique in user-computer dialogue, a novel eye control system is proposed in this system using Webcam and without using any extra hardware. The proposed system focuses on providing a simple and convenient interactive mode by only using user’s eye. The usage flow of the proposed system is designed to perfectly follow human natural habits. The proposed system describes the implementation of both iris and movement of cursor according to iris position which can be used to control the cursor on the screen using webcam and implemented using Python.

Vision Controlled Motorised Wheelchair

Abstract: Even in this modern day, it is very difficult for physically challenged people to move from one place to other without others help. To give them an independent feel, a smart eye-controlled system is provided. A novel design of an embedded cardiorespiratory monitoring system for wheelchair users is proposed. This system gets the input from eye. An eye-ball controlled wheelchair is a type of assistive technology designed for individuals with paralysis or limited mobility. The wheelchair is controlled through the movement of the user's eyes, allowing them to navigate the chair without the use of their hands or arms. The system consists of a set of sensors that detect eye movements, a microcontroller that interprets the signals, and a motor controller that translates the signals into movement. The user wears a headset with a camera that tracks the movement of their eyes, which is then relayed to the sensors. The wheelchair can be programmed to respond to different eye movements, such as blinking or sustained gaze in a particular direction. The system is designed to be intuitive and easy to use, with minimal training required. One of the primary benefits of the eye-ball controlled wheelchair is increased independence for individuals with limited mobility. It allows them to move around their environment and interact with others without needing assistance. Additionally, the system is non-invasive and does not require surgery or implants. The movement of the wheel chair will be controlled by these inputs. Depending on this input the wheel chair will move forward, left, right or backward. With the help of this system the user can move independently without others help. It also included with obstacle detection system to ensure the safety for the user. If any obstacle is detected then the indication can be given with the help of LCD.The entire system is composed of a sensor node, and a cloud server. The former is used to obtain continuous vitalsign signals, and the latter processes the sampled signals to estimate the temperature level, implemented in an embedded system to achieve a fully integrated radar system. MATLAB image processing is used to sense the movement of the eye ball’s direction using eye ball sensor (Straight Command, Left/Right Command, Stop Command). The system is cost effective and thus can be used by patients spread over a large economy range

Justification of the method for determining the dynamic parameters of the mobile fire fighting installation operator

The object of this study is the process of functioning of the "man-robot" system. The task to coordinate parameters of the human operator and the robot is investigated. Aligning these parameters is based on the method of determining the dynamic parameters of the human operator using mathematical models that describe two types of relative errors. The first type includes relative errors in determining the dynamic parameters of the operator, which depend on the error in determining the signals characterizing his response to the test impact. The second type of relative errors is the methodical error, which is due to the approximation of partial derivatives. The formation of a test impact on the operator is carried out using an interactive whiteboard. The method is based on finding the roots of a linear system of algebraic equations, for the construction of which an approximation of partial derivatives from signals characterizing the operator's response to the test effect is used. The parameters of this system of algebraic equations depend on time parameters. Determination of time parameters is carried out using tolerance criteria and using nomograms. When justifying the main parameter of the test impact on the operator – the speed of movement of the fire front on the interactive whiteboard screen, the properties of the angular eye control system of the mobile fire installation operator are used. These properties are formalized as a mathematical model of dynamic error, which occurs in the process of tracking by the operator the image of a fire on the interactive whiteboard screen. To verify the obtained results, a test problem has been solved; it is shown that the error in determining the dynamic parameters of the operator does not exceed 1.0 %. The results reported here could be used for designing mobile fire installations of a new generation, the structure of which is based on the use of segways

Eye control system based on convolutional neural network: a review

PurposeThis paper primarily aims to focus on a review of convolutional neural network (CNN)-based eye control systems. The performance of CNNs in big data has led to the development of eye control systems. Therefore, a review of eye control systems based on CNNs is helpful for future research.Design/methodology/approachIn this paper, first, it covers the fundamentals of the eye control system as well as the fundamentals of CNNs. Second, the standard CNN model and the target detection model are summarized. The eye control system’s CNN gaze estimation approach and model are next described and summarized. Finally, the progress of the gaze estimation of the eye control system is discussed and anticipated.FindingsThe eye control system accomplishes the control effect using gaze estimation technology, which focuses on the features and information of the eyeball, eye movement and gaze, among other things. The traditional eye control system adopts pupil monitoring, pupil positioning, Hough algorithm and other methods. This study will focus on a CNN-based eye control system. First of all, the authors present the CNN model, which is effective in image identification, target detection and tracking. Furthermore, the CNN-based eye control system is separated into three categories: semantic information, monocular/binocular and full-face. Finally, three challenges linked to the development of an eye control system based on a CNN are discussed, along with possible solutions.Originality/valueThis research can provide theoretical and engineering basis for the eye control system platform. In addition, it also summarizes the ideas of predecessors to support the development of future research.

Research on visual representation of icon colour in eye-controlled systems

Given the wide application of eye-controlled systems, the target population is not only people with a physical disability. The importance of design is increasing; no matter where the eye-controlled system is to be applied, research on the interface needs to keep up with system development. Based on the analysis of the characteristics of eye movement, and the interaction of eye-controlled systems and visual design principles, the aim of this study was to explore whether a change in the colour of the interactive elements in an eye-controlled system will affect the efficiency of a user's visual search. Based on the actual needs of the eye-movement interaction process in the eye-controlled system, we developed an eye-controlled interaction system using Unity software. Based on this system, we investigated whether a change in the colour of the interactive elements in the eye-controlled system interface was related to search duration. The experimental data verified that changes in colour saturation and brightness affected users’ search efficiency. When the saturation value of the icon colour was in the three ranges of 33% to 44%, 62% to 70, or 85% to 98%, reaction time was longest; the brightness value of the icon colour should be higher than 16%, and it is not recommended to be less than 5% under any circumstances. The experiment was combined with a questionnaire to quantitatively analyse participants' evaluation of the three types of feedback colours: reducing brightness, converting to the contrasting colour and converting to white. It was found that participants generally believed that the feedback form of reducing brightness was very natural, and the feedback form of converting to the contrasting colour was very clear. Moreover, it was found that participants of different ages had significant differences in the evaluation of feedback colour types. This study adds substantial evidence to the field of colour research in the visual representation of eye-controlled system interfaces.

Smooth Pursuit Study on an Eye-Control System for Continuous Variable Adjustment Tasks

ABSTRACT Smooth pursuit is a physiological phenomenon of human eyes, which can be used as eye-control interaction to avoid the “Midas” problem. This article describes the smooth pursuit properties of continuous variable tasks under Euclid’s algorithm. Two experiments were conducted to investigate the effects of slider speed, initial position of “plus,” and variable value position on smooth pursuit interactions. The initial position and slider speed are combined in 12 combination forms, and the variable value positions are divided into 7 cases. Then, the optimal combination forms and variable value position case are derived. Experiment 1 divided the initial position into four levels of up, down, left and right and divided the slider speed into three levels of 1 deg/s, 2 deg/s, and 3 deg/s, concluding that the optimal combination of initial position and slider speed is that the speed is 2 deg/s and initial position is up. Experiment 2 was conducted on the basis of the conclusion obtained in experiment 1. The position of the variable value was divided into seven cases according to whether the left, center, and right of the smooth pursuit track the variable value appeared. The result showed that the position of the variable value in the center had the greatest influence on the pursuit efficiency. This research has an important value for the parameter set of smooth pursuit in the case of the Euclidean algorithm, it has great guiding significance for building smooth pursuit interaction in the context of the eye-control system.

Paying attention to adopting modern epidemiological methods for the prevention and treatment of infectious eye diseases

Carrying out research on infectious epidemics is an important work contents stipulated in the Law on the Prevention and Control of Infectious Diseases in China. Nowadays, Based on the recent Chinese prevention and treatment system of infectious eye diseases, it is difficult to meet the needs of data collection, etiology determination, and spatiotemporal analysis. The present article explores how to use modern social epidemiology methods to clarify the role of individual factors, social factors, and structural factors in the three links of eye disease epidemic, how to use spatial epidemiology methods to describe, quantify, and explain the spatial distribution characteristics of eye diseases in the population, and how to use infodemiology and digital epidemiology methods to promptly and efficiently mine and process massive amounts of electronic data of eye diseases. These may be used to improve the scientific nature of Chinese eye disease epidemiology research, and strengthen the China's infectious eye disease prevention and control system.(Chin J Ophthalmol, 2020, 56:567-570).

Eye Tracking Based Control System for Natural Human-Computer Interaction.

Eye movement can be regarded as a pivotal real-time input medium for human-computer communication, which is especially important for people with physical disability. In order to improve the reliability, mobility, and usability of eye tracking technique in user-computer dialogue, a novel eye control system with integrating both mouse and keyboard functions is proposed in this paper. The proposed system focuses on providing a simple and convenient interactive mode by only using user's eye. The usage flow of the proposed system is designed to perfectly follow human natural habits. Additionally, a magnifier module is proposed to allow the accurate operation. In the experiment, two interactive tasks with different difficulty (searching article and browsing multimedia web) were done to compare the proposed eye control tool with an existing system. The Technology Acceptance Model (TAM) measures are used to evaluate the perceived effectiveness of our system. It is demonstrated that the proposed system is very effective with regard to usability and interface design.

Helmet-mounted eye control system for pupil recognition and position

Existing eye control systems either are expensive or have high computational complexity, difficulties in realising and low detection rate. We propose an integrated and novel Helmet-Mounted Display HMD using macro infrared eye gaze tracking and spot detection algorithm that can help the limb-disabled people with healthy eyes. Clear black and white images of the pupil can be obtained by a micro-focus camera system and pre-processing software. We discuss pupil and spot detection method based on the improved Hough algorithm, and the black and white image of the pupil location algorithm, tracking pupil movement by eye tracking. Furthermore, integration of the improved Hough algorithm can reduce the HMD micro-positioning. Experimental results show that the proposed system has a higher accuracy than the existing methods.

Eye Control System Base on Ameliorated Hough Transform Algorithm

This paper proposes an eye control system employing eye gaze tracking techniques that might be helpful for those limb disabled people with healthy eyes. Eye gaze tracking technique is attracting more and more research interest in recent years. With an aim to overcome the shortcomings of existing methods (e.g., high hardware complexity and low detection accuracy), we use the pupil-corneal reflection technique to develop an ameliorated Hough transform algorithm, which is the core unit of the proposed system. We also design a typing function as well as an efficiently blink detection function. With these functions, users can input numbers into the computer with their eyes only through a specifically designed head mount eye control device. Experimental results demonstrate that the proposed ameliorated Hough transform algorithm provides a satisfactory typing accuracy of 87%, much higher than its counterpart in the literature.

A model of saccade generation based on parallel processing and competitive inhibition

During active vision, the eyes continually scan the visual environment using saccadic scanning movements. This target article presents an information processing model for the control of these movements, with some close parallels to established physiological processes in the oculomotor system. Two separate pathways are concerned with the spatial and the temporal programming of the movement. In the temporal pathway there is spatially distributed coding and the saccade target is selected from a "salience map." Both pathways descend through a hierarchy of levels, the lower ones operating automatically. Visual onsets have automatic access to the eye control system via the lower levels. Various centres in each pathway are interconnected via reciprocal inhibition. The model accounts for a number of well-established phenomena in target-elicited saccades: the gap effect, express saccades, the remote distractor effect, and the global effect. High-level control of the pathways in tasks such as visual search and reading is discussed; it operates through spatial selection and search selection, which generally combine in an automated way. The model is examined in relation to data from patients with unilateral neglect.

Brain stem omnipause neurons and the control of combined eye-head gaze saccades in the alert cat.

When the head is unrestrained, rapid displacements of the visual axis-gaze shifts (eye-re-space)-are made by coordinated movements of the eyes (eye-re-head) and head (head-re-space). To address the problem of the neural control of gaze shifts, we studied and contrasted the discharges of omnipause neurons (OPNs) during a variety of combined eye-head gaze shifts and head-fixed eye saccades executed by alert cats. OPNs discharged tonically during intersaccadic intervals and at a reduced level during slow perisaccadic gaze movements sometimes accompanying saccades. Their activity ceased for the duration of the saccadic gaze shifts the animal executed, either by head-fixed eye saccades alone or by combined eye-head movements. This was true for all types of gaze shifts studied: active movements to visual targets; passive movements induced by whole-body rotation or by head rotation about stationary body; and electrically evoked movements by stimulation of the caudal part of the superior colliculus (SC), a central structure for gaze control. For combined eye-head gaze shifts, the OPN pause was therefore not correlated to the eye-in-head trajectory. For instance, in active gaze movements, the end of the pause was better correlated with the gaze end than with either the eye saccade end or the time of eye counterrotation. The hypothesis that cat OPNs participate in controlling gaze shifts is supported by these results, and also by the observation that the movements of both the eyes and the head were transiently interrupted by stimulation of OPNs during gaze shifts. However, we found that the OPN pause could be dissociated from the gaze-motor-error signal producing the gaze shift. First, OPNs resumed discharging when perturbation of head motion briefly interrupted a gaze shift before its intended amplitude was attained. Second, stimulation of caudal SC sites in head-free cat elicited large head-free gaze shifts consistent with the creation of a large gaze-motor-error signal. However, stimulation of the same sites in head-fixed cat produced small "goal-directed" eye saccades, and OPNs paused only for the duration of the latter; neither a pause nor an eye movement occurred when the same stimulation was applied with the eyes at the goal location. We conclude that OPNs can be controlled by neither a simple eye control system nor an absolute gaze control system. Our data cannot be accounted for by existing models describing the control of combined eye-head gaze shifts and therefore put new constraints on future models, which will have to incorporate all the various signals that act synergistically to control gaze shifts.

Oculomotor adaptation with virtual reality scotomas

A simulation of central blindness in normal human subjects was produced by linking a high- accuracy eye position sensor with a computer visual display. This eye controlled system may be classified as a form of virtual reality for safely exploring the effects of visual defects, diseases, and adaptability under experimental control. A circularly symmetric simulated scotoma or visual blindspot was stabilized on the fovea of 6 normal observers while they attempted to maintain a target in clear view. The subjects were naive and were free to view the target in any way they chose. Eccentric eye positioning developed within 2 minutes of viewing time with most subjects. Cumulated fixation positions showed that the edge of the scotoma was positioned next to the target. All subjects reported that they found an upper right position relative to the target easier to maintain as an eccentric vantage point and fixation maps showed that the majority of fixations were located there. The durations of correctly positioned fixations became longer during eccentric viewing practice indicating rapid improvements in fixation stability, while fixation durations of incorrect, error fixation positions became shorter demonstrating adaptability. A test for eye fixation stability around clock positions failed to explain the upper right field preference as an eccentric viewing point.

Eye-Controlled Switching for Crew Station Design

Integration of eye and head position monitoring devices may enable practical control of systems using the operator's eye line-of-sight (LOS) under conditions of free head and eye movement. This paper describes the components of an eye-control system developed to examine the use of eye LOS as an alternate control interface for crew station design. The implications of the performance of this system to the implementation of eye-controlled switching are discussed.

An adaptive control model for human head and eye movements while walking

When a person walks the head undergoes horizontal and vertical rotations, and also horizontal and vertical translations. To visually fixate on an object while walking, compensatory horizontal and vertical eye movements must be made. The model for this gaze (head plus eye) control system includes three types of eye movements: smooth pursuit, saccadic, and vestibulo-ocular. The smooth pursuit system uses a target-selective adaptive controller that compensates for the large inherent time delay and produces zero-latency tracking of predictable targets. Target movements were selected to minimize the role of the saccadic control system. Typical tracking is shown while seated with the head restrained, standing with unrestrained head, performing voluntary head rotations, and walking. Each additional degree of freedom produced additional head movements that were compensated by additional eye movements. It is shown that while a human walks the effects of head rotations (yaw) cancel the effects of head translations, thus minimizing the resulting horizontal eye rotations necessary to maintain fixation.