Abstract
Head pose is utilized to approximate a user's line-of-sight for real-time image rendering and interaction in most of the 3D visualization applications using head-mounted displays (HMD). The eye often reaches an object of interest before the completion of most head movements. It is highly desirable to integrate eye-tracking capability into HMDs in various applications. While the added complexity of an eyetracked-HMD (ET-HMD) imposes challenges on designing a compact, portable, and robust system, the integration offers opportunities to improve eye tracking accuracy and robustness. In this paper, based on the modeling of an eye imaging and tracking system, we examine the challenges and identify parametric requirements for video-based pupil-glint tracking methods in an ET-HMD design, and predict how these parameters may affect the tracking accuracy, resolution, and robustness. We further present novel methods and associated algorithms that effectively improve eye-tracking accuracy and extend the tracking range.
Highlights
Graphics-driven head-mounted displays (HMD) have been explored for a wide range of applications in the fields of 3D virtual and augmented environments, 3D scientific visualization, and engineering processes [1,2]
By examining the geometrical relationships among the glints using the simulation, we discovered that the angle, referred to as θ, which is formed by the lines connecting the two diagonal pairs of glints, remains constantly 90°, regardless of the angle of eye rotation, when the following two perpendicularity conditions are met: (1) the four LEDs are arranged in a way that the lines connecting the diagonal pairs are perpendicular to each other (i.e., ζ equal 90°); (2) the optical axis of the camera passing through the intersection of the lines connecting the diagonal pairs of LEDs is perpendicular to the plane containing the LEDs (i.e. φ equal 0°)
An eyetracked HMD system is highly desirable in various applications
Summary
Graphics-driven head-mounted displays (HMD) have been explored for a wide range of applications in the fields of 3D virtual and augmented environments, 3D scientific visualization, and engineering processes [1,2]. A few researchers have attempted to integrate commercially available HMDs and eyetrackers[12,13] This method is referred to as the functionality integration approach, in which two separate instruments are brought together at a later stage of utilization. The subject of this paper is to examine the new challenges related to the eyetracker subsystem and to explore schemes and opportunities for optimizing the tracker sub-system to improve eye tracking accuracy, range, and robustness in an ET-HMD design. To improve the eyetracking accuracy and robustness in an ET-HMD system, we further describe a novel eyetracking method and associated algorithms by tracking a virtual on-axis glint created with the use of multiple off-axis LEDs symmetrically placed around the optical axis.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
