Abstract
This paper proposes a hand free human-machine interaction (HMI) system to establish a novel way for communication between humans and computers. A regular interaction system based on the computer mouse puts the user's hand for too long in a pronation posture that increases inflammation in the wrist and hand. Additionally, the need for hand obstructs the use of computers for handicap people. In this paper, we develop a new pointing device for differently able people based on open and closed human eyes with inertia measurement that restrict to deal with carpal tunnel syndrome (CTS) for regular people and enables a novel way to interact with computers for the handicap people. The proposed system carries the human head gesture and eyes to perform the movement and clicking event of the mouse cursor. A combined three-axis accelerometer and gyroscope is used to detect the head gesture and translate it into the position of the mouse cursor on the computer monitor. To perform the left and right-clicking event, the user needs to shut down the left and right eye for a moment while opening another eye. This paper is also carried out the design of a deep learning approach to classify the individual openness and closeness of both human eyes with quite a high accuracy of 95.36% that ensures the comprehensive control over the clicking performance. The use of complementary filter removes the noise and drift from the obtained performance and confirms the smooth and accurate operation of the proposed device. An experimental validation is added to show the effectiveness of the proposed HMI system. The experimental details along with the performance evaluation prove that the proposed HMI system has extensive control over its performance for differently able people.
Highlights
Human-machine interaction (HMI) develops an assistive communication technology for differently able people with more flexibilities
EXPERIMENTAL RESULTS This section exhibits the experimental results of proposed architecture applying in the proposed pointing device to compare between the usability of the traditional computer mouse and pointing devices performance
The output from proposed structure defines the state of the user image and performs the desired task based on multi-directional position channel
Summary
Human-machine interaction (HMI) develops an assistive communication technology for differently able people with more flexibilities. The HMI creates a phenomenon to design, evaluate and implement interactive computing devices for the interaction The development of this technology enables a medium of communication between machines and humans by using graphical user interfaces (GUIs). It includes the efficient design of the operating systems, computer graphics, and different programming languages to control. A computer interaction based on regular mouse requires a human hand and plane surface for its operation which is not adequate for fixed pointing on the computer screen To address this problem, the idea of air mouse have been emerged in [5].
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
