Abstract
Human-mobile interaction is aimed at facilitating interaction with the smartphone devices. The conventional way to interact with mobile devices is through manual input where most of the applications are made assuming that the end user has full control over their hand movements. However, this assumption excludes people who are unable to use their hands or have suffered limb damage. In this paper, we proposed a nose and teeth based interaction system, which allows the users to control their mobile devices completely hands free. The proposed system uses the front facing camera of the smartphone to track the position of the nose for cursor control on the smartphone screen. The system detects teeth for performing the touch screen events such as tap, scroll, long press, and drag. Viola-Jones algorithm is used to detect the face and teeth based on the Haar features. After detecting the face, the nose position is calculated and tracked continuously using Lucas Kanade’s method for optical flow estimation. All the touch screen events have been implemented in the system so that the user can execute all the operations of the smartphone. To evaluate the performance and the effect of (smartphone) device type on the execution time, the proposed system was installed in 3 smartphone devices and 7 trials for each device were performed by 3 different able-bodied elderly persons. The result shows a significant success rate for the detection of nose and teeth, and for the execution of the operations. The execution time of each operation slightly varies by 0.72s on average because of the configuration of the smartphones.
Highlights
Human Computer Interaction (HCI) is a field of study in computer science, which is dedicated to facilitate the interaction between computing devices and the users [1]
Considering all this, we developed the nose-teeth mobile interaction system which will stretch a helping hand to the people who are incapable of using the android smartphones due to their disabilities
It is seen that there are no prior studies that explicitly focus on hands-free interaction with the smartphone
Summary
Human Computer Interaction (HCI) is a field of study in computer science, which is dedicated to facilitate the interaction between computing devices (desktop computers, mobiles, etc.) and the users [1]. It has become a very important research field due to the fact that HCI makes systems more functional, safe and increases the usability and user experience (UX). In recent times, research interests on real time HCI have been growing [2]. Smartphones are widely adopted and used around the world. According to a recent statistic, the number of smartphone users in the world is 3.5 billion, which means 45.04%. Not much has been done to enable a user to use the smartphone completely hands free
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
