Virtual Gesture Recognition Keyboard

Abstract

In this study we’ve considered advantages and disadvantages of different keyboard types and propose a fundamentally new one: keyboard based on gesture recognition. Keyboard itself is glove-shaped, and is supposed to be worn on hand. It provides enhanced mobility, as this keyboard doesn’t need any surface in order to type. Its compactness is a notable feature, since standard keyboards take up more space, which can cause an issue during a trip. Its technology is based on detecting flexion of the fingers and recognizing incoming readings as a press of a specific symbol. Powered with machine learning, it can adapt to users’ hand’s physiological features as well as to their way of using said keyboard. Its functionality can be extended by defining new symbols or making a set of commands to execute on triggering, and since metrics are range-based, they can be easily inserted in an existing set. Due to technology’s analog nature, many other input devices can be emulated using the base glove, with only the need for writing supporting drivers.A working prototype of such keyboard has been developed and its build and realization are described in this study. Prototype has been built on top of an Arduino UNO r3 board, using one of the most common types of LEDs and photoresistors, which are often shipped in starter kits. As well, a simple driver has been developed, which can correctly recognize input symbols and implement adaptation to specificities of user’s typing, using optimized k-nearest neighbors machine learning algorithm. Simplicity of its build, and availability of its components suggest low production cost and greater opportunity of serial production. As well, conclusions have been made about the convenience of its usage, and whether it meets expected requirements.Manuscript received 12.06.2020