Approach for the construction of gestural interfaces to control graphical interfaces based on artificial intelligence

Abstract

Due to hygienic concerns, the COVID-19 has accelerated the use of touchless technology, which has expedited the transition to Zero User Interface. This Interface (UI) refers to a controlled user interface that enables interaction with technology using gestures, voice, eye tracking and biometrics like contactless fingerprints and facial recognition. These control interfaces incorporate interaction techniques like speech and gestures. The advancement of touchless interaction with hand gesture interfaces is the main topic of this study, these interfaces are specialized programs that track and predict hand gestures to give alternative controls and interaction techniques. The hand gesture interface consisting of four main layers: Hand Gesture Interface, Mapping Gesture, Action, The Input Simulator, and Graphical User Interface. In addition to our interface, we employed the new algorithm for according to the hand-type classification. By doing trials on a gastronomy application, we confirm our methodology. With five volunteers, we conducted a small-scale user study to evaluate and test the hand gesture interface. User feedback indicates that the hand gesture interface is simple to be used.