User's Pupil Research Articles

Foveated pancake lens design for improved optical performance and eye rotation support.

We propose a novel, to our knowledge, approach to address the limitations of traditional pancake lenses for virtual reality headsets, such as low image contrast and poor performance when eyes rotate. The design leverages the foveated nature of human vision, achieving a superior modulation transfer function in the foveal area to enhance optical performance significantly. Furthermore, the pancake lens design is presented that considers the rotation of the user's pupil position, maintaining optimal image quality even when the user's eye rotates. The proposed method presents the parameters and optimization of a novel pancake lens that utilizes the characteristics of the human visual system and accounts for the rotation of the pupil position of the user, leading to improvements in image quality and user experience. The lens design and image simulation results are presented to demonstrate the effectiveness of the approach.

EyeMo: A Solution for Individuals with Disabilities to Use a Computer Through Eye Movements

The maintenance of an upright posture and the execution of desired movements by individuals necessitate the seamless and harmonious functioning of the muscular and skeletal systems. Neuromuscular diseases, spinal cord injuries, and related conditions can adversely impact individuals' motor functions, leading to a loss of muscle strength and, in severe cases, paralysis. Such health challenges may result in social isolation and detachment from one's social life. This study is focused on the development of a computer control application utilizing eye movements to aid users in navigating and interacting with computers. The system utilizes a lightweight eyeglass frame and a mini-USB camera to accurately capture images of the user's pupil. Pupil detection is achieved through a combination of traditional image processing and deep learning techniques, ensuring high accuracy under diverse conditions. Users have the ability to interactively calibrate the application to accommodate varying screen sizes, thereby enhancing system responsiveness. The user interface incorporates functionalities such as left-click, right-click, double-click, and scrolling, empowering users to perform tasks ranging from internet browsing to video watching. 
 After the development of the application, a request for research permission was submitted to the local institution to allow volunteers to test the application, adhering to ethical standards. Following the approval of ethical clearance, the application was made available for use by volunteers, and feedback was systematically collected. Volunteers generally reported that the application was beneficial, indicating its potential use by disadvantaged individuals. The upcoming versions of the application have the potential for integration with smart home systems. Additionally, the developed application can be used in games and for educational purposes.

Pupil Center Detection Using Radial Symmetry Transform to Measure Pupil Distance in the Eye

In patients with refractive errors or impaired vision, light rays received by the pupil do not fall directly onto the retina. This can be corrected by wearing monocled glasses. The focal point of the eyeglass lens needs to be adjusted to the center of the user's pupil. This can be known through the measured pupil distance (PD) value information. The measurement of the PD is very important to determine the center distance of the pupils in both eyes. where the eye does not experience the prism effect. This study aims to apply the radial symmetry transformation (RST) method combined with self-quotient (SQI) imagery to detect the pupillary center and measure PD. This algorithm combines to get more optimal results in detecting the center of the pupil in dark conditions or those exposed to shadow illumination. The program created using the MATLAB software simulates PD measurements for pupillary center detection in bright and dark images conditions. The test was carried out ten times, and the results showed that the system was able to measure PD on low-resolution images of 300 x 300 pixels at 72 dpi in bright image conditions; with measurement uncertainty values in each image of 0.60 mm. As for testing on dark images, the uncertainty values are 0.80 mm. In this case, the standard deviation value is obtained from the effect of the different dimensions of the face object on the tested image.

流体解析の現象評価における視線と熟練度との関係

In the manufacturing industry, DX efforts are active, and in addition to digitization of manufacturing information and inspection data, digitization of expert skills and knowledge in design is also progressing. Systems have been developed to support the transfer of skills and knowledge using these data, but it is difficult to present knowledge that matches the user's skill level. On the other hand, a technique has been developed that measures the user's gaze and determines the skill level from the trajectory. In addition, the pupil size dilates as the cognitive load increases. The cognitive load on a task may differ depending on the skill level. Therefore, it may be possible to judge the user's skill level by measuring the pupil size. In this study, in order to examine the possibility of determining the skill level at an early stage when the user starts using the system, we focused on the fluctuation of the pupil size during task execution and evaluated the difference between the experts and beginners. As a result of measuring the pupil size in the task of searching for a vortex from the fluid simulation image, it was found that the user's pupil size has a latency of 900 ms and increases 900 ms after observing the vortex. In addition, the pupil size of an expert is large in a place with a vortex, and the pupil size is small in a place without a vortex, which depends on the presence or absence of a vortex, but the beginner does not depend on the location of the vortex. From this result, it was found that it may be possible to judge the skill level at an early stage by analyzing the location of the vortex and the pupil size in association with each other at the initial stage when the system is started to be used.

Information systems and task demand: An exploratory pupillometry study of computerized decision making

Information systems (IS) play an important role in successful execution of organizational decisions, and the ensuing tasks that rely on those decisions. Because decision making models show that cognitive load has a significant impact on how people use information systems, objective measurement of cognitive load becomes both relevant and important in IS research. In this paper, we manipulate task demand during a decision making task in four different ways. We then investigate how increasing task demand affects a user's pupil data during interaction with a computerized decision aid. Our results suggest that pupillometry has the potential to serve as a reliable, objective, continuous and unobtrusive measure of task demand and that the adaptive decision making theory may serve as a suitable framework for studying user pupillary responses in the IS domain.

Pupil Extraction and Tracking for Interactive Optical See- Through HMD

In this paper, we propose a simple and effective system to extract a pupil and gaze detection. This system is developed using an optical based method to extract user's pupil. For extracting the pupil of the eye and detecting gaze, we use a camera with an infrared filter, an optical see-through HMD, and infrared light. We can possible to move freely without fixing it to user's head because of optical see-through HMD with the camera, and infrared light. The proposed system displays the gaze point on the HMD after extracting user's pupil and detecting gaze real time.

눈동자 시선 추적에 의한 3차원 1인칭 슈팅 게임

본 논문에서는 HMD(Head Mounted Display) 하단에 눈동자의 움직임 영상을 취득할 수 있는 USB 카메라를 부착한 후, 3차원 1인칭 슈팅(First Person Shooting) 게임에서 게임 캐릭터의 시선방향을 눈동자 움직임에 의해 조작하는 방법을 제안한다. 본 논문에서 제안하는 방법은 다음과 같은 3부분으로 이루어져 있다. 첫 번째는 입력 영상으로부터 눈동자의 중심 위치를 실시간 영상 처리 방법으로 추출하는 부분, 두번째는 HMD 모니터상의 임의 지점을 쳐다볼 때 추출된 눈동자의 위치 정보와 모니터상의 응시 지점사이의 기하학적인 연관관계를 결정하는 캘리브레이션 부분, 그리고 마지막은 캘리브레이션 정보를 기반으로 모니터 상의 최종적인 응시 위치를 결정하고 이 정보에 의해 게임상의 3차원 뷰 방향을 조정하는 부분으로 구성되어 있다. 실험 결과 본 논문의 방법에 의해 손이 불편한 사용자에게 게임을 즐길 수 있는 기회를 제공하고, 게임 캐릭터와 게임 사용자의 시선 방향을 일치시킴으로서 게임의 흥미와 몰입감을 증가시킬 수 있는 결과를 얻음을 알 수 있었다. In this paper, we propose the method of manipulating the gaze direction of 3D FPS game's character by using eye gaze detection from the successive images captured by USB camera, which is attached beneath HMB. The proposed method is composed of 3 parts. At first, we detect user's pupil center by real-time image processing algorithm from the successive input images. In the second part of calibration, when the user gaze on the monitor plane, the geometric relationship between the gazing position of monitor and the detected position of pupil center is determined. In the last part, the final gaze position on the HMD monitor is tracked and the 3D view in game is controlled by the gaze position based on the calibration information. Experimental results show that our method can be used for the handicapped game player who cannot use his(or her) hand. Also, it can Increase the interest and the immersion by synchronizing the gaze direction of game player and the view direction of game character.

Registration of an on-axis see-through head-mounted display and camera system

An optical see-through head-mounted display (HMD) system integrating a miniature camera that is aligned with the user's pupil is developed and tested. Such an HMD system has a potential value in many augmented reality applications, in which registration of the virtual display to the real scene is one of the critical aspects. The camera alignment to the user's pupil results in a simple yet accurate calibration and a low registration error across a wide range of depth. In reality, a small camera-eye misalignment may still occur in such a system due to the inevitable variations of HMD wearing position with respect to the eye. The effects of such errors are measured. Calculation further shows that the registration error as a function of viewing distance behaves nearly the same for different virtual image distances, except for a shift. The impact of prismatic effect of the display lens on registration is also discussed.