Abstract

In the area of Human-Computer Interaction (HCI), the concept of Around Device Interaction (ADI) is gaining special attention nowadays. It provides the possibility of interacting with the device by making use of gestures made in the surrounding space, as well as by detecting certain ambient changes, thus eliminating the need of direct physical contact. Contact-free interaction can be useful for wearable and smart devices, especially in cases where operating with small buttons and touchscreens appears to be particularly inconvenient. This paper presents alternative techniques for smartphone interaction based on different sensory inputs. Namely, external sources of magnetic field, light, and infrared (IR) signals are used to manipulate device sensors' readings which are in turn interpreted as the corresponding interaction commands. Proof-of-concept mobile applications are developed and here presented, demonstrating both the potentials and utility of the contact-free interaction. Specifically, small neodymium magnet was used for smartphone text entry, typical battery flashlight served for sending information to device via Morse code, as well as for alarm triggering, and voice-enabled control device was utilized for invoking smartphone calls from a distance. The presented interaction techniques do not require smartphone hardware alterations. While the usage of built-in magnetic field and ambient light sensors is assumed, peripheral infrared receiver can be used in order to provide IR-based support.

Highlights

  • Touch gestures still represent the dominant interaction technique for devices encompassed by a contemporary mobile domain

  • Apart from straightforward implementations that utilize the position of the mobile device for changing screen orientation, scrolling, navigation through lists and menus, and controlling mobile game applications, tilt-based interaction has been successfully used within alternative text entry solutions for smartphones and tablets [1, 2]

  • We introduce two text entry methods which rely on the magnet-based Around Device Interaction (ADI)

Read more

Summary

Introduction

Touch gestures still represent the dominant interaction technique for devices encompassed by a contemporary mobile domain. ADI concept allows interaction commands to be invoked by natural movement-based gestures made in the space around the device, as well as by making use of changes detected in the surrounding environment. One of the most recent Google projects, named Soli [3], presents a new sensing technology that uses miniature radar for motion tracking of the human hand Fine motions of both thumb and index finger are used within a 3Dgesture interaction language. Projects like Soli exemplify the growing popularity and projected utility of the sensor-based interaction in ubiquitous computing When it comes to ADI supported by typical smartphone sensors, front facing camera is used in vision-based input detection systems for capturing finger gestures performed above the respective sensor [4]. General impressions from initial testing are discussed in the concluding section

Related work
ADI based on magnetic field manipulation
Proof-of-concept: text entry using magnet
ADI based on ambient light manipulation
Interaction based on infrared source
Proof-of-concept: assistive technology voice activated phone call
Conclusion
Authors
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call