Abstract

In this paper, a new application of the optical mouse sensor is presented. The optical mouse is used as a main low-cost infrared vision system of a new proposal of a head-mounted human-computer interaction (HCI) device controlled by eye movements. The default optical mouse sensor lens and illumination source are replaced in order to improve its field of view and capture entire eye images. A complementary 8-bit microcontroller is used to acquire and process these images with two optimized algorithms to detect forced eye blinks and pupil displacements which are translated to computer pointer actions. This proposal introduces an inexpensive and approachable plug and play (PnP) device for people with severe disability in the upper extremities, neck, and head. The presented pointing device performs standard computer mouse actions with no extra software required. It uses the human interface device (HID) standard class of the universal serial bus (USB) increasing its compatibility for most computer platforms. This new device approach is aimed at improving comfortability and portability of the current commercial devices with simple installation and calibration. Several performance tests were done with different volunteer users obtaining an average pupil detection error of 0.34 pixels with a successful detection in 82.6% of all mouse events requested by means of pupil tracking.

Highlights

  • Nowadays, the most widely used human-computer interaction is a graphic pointer that is displaced across the screen of a display peripheral

  • The compact sensor based on a metal-oxidesemiconductor (CMOS) is complemented with a digital signal processor (DSP), integrated on the same chip (Figure 2)

  • The external light source has been replaced by the higher radiant intensity SFH-4350 near-infrared (NIR) lightemitting diode (LED) from OSRAM [51] in order to obtain a uniform light in the field of view and highlight the pupil

Read more

Summary

Introduction

The most widely used human-computer interaction is a graphic pointer that is displaced across the screen of a display peripheral. In [26], two mini cameras and two medium-sized processing boards are used to simultaneously track the pupil and the user’s view, allowing an absolute pointer control on the computer screen It proposes to use low-cost off-the-shelf components and a set of open-source software, the installation is complicated because the multiple parts. The main goal of this contribution is the proposed device cost (~$20), compared with the most affordable current commercial eye-tracking devices—e.g., Pupil Labs Pupil Core, $1,850 [31]; Tobii PCEye Mini, $1,149 [32]; or Tobii Pro Glasses II, $10,000 [33] This is possible because the new proposal uses the same components of a common commercial optical mouse. A procedure to detect forced eye blinks has been implemented and used as complementary interaction input

Sensor
Pupil Tracking
Eye Blink Detection
Pointing Device
Results and Discussion
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call