Korean grapheme recognition immersive scheme with gesture on smartphone

Abstract

Character recognition schemes on information and communication technology devices, such as smart phones that use touchscreens, are currently used daily. In character recognition, users complete a desired sentence with predetermined character allocation by pushing buttons or using touch typing. Existing character recognition requires pushing many buttons for sentence completion. Smart phones, representative smart devices with diverse built-in sensors, have improved convenience by minimizing the number of pushes required for sentence completion based on application research using the drag function of the touchscreen. Despite the development of many touch interfaces, scarce character recognition schemes exist that account for those with disabilities or for unspecified situations, such as users wearing gloves. This paper proposes the Korean Grapheme Immersive Recognition Scheme (KGIRS), which uses gyro and acceleration sensors and was developed for smart devices with diverse built-in sensors. The KGIRS recognizes user gestures through gyro and acceleration sensors and performs Korean grapheme recognition by mapping a character recognition table. The KGIRS could be an excellent solution for the inconvenience of many existing push-type character input schemes by providing character recognition without restraint, regardless of the user’s condition, even for touch incapability. Moreover, it can be used when general users have trouble typing characters using a push-type scheme.