Mobile robot: automatic speech recognition application for automation and STEM education

Abstract

Nowadays, robots are widely applied in life as well as industrial production, medicine, rescue, learning, and entertainment. There are many kinds of robots using different modern technologies such as manipulators, movement, and biomimetic robots; each type is applied according to its own role. Robots are also applied in training, especially in STEM training implemented with mobile robots. In this paper, we proposed models to design mobile robot combined with Android OS Tablet with a user interaction screen, voice control model, and AIDL IPC interactive model for remote control. We research the mobile robot using RockChip AI Processor RK3399Pro, which focuses on understanding the structure and operating mechanism of the AI Processor that RockChip robot uses, along with researching Android with IPC AIDL architecture and Automatic Voice Recognition technology to control robot to turn left, turn right, move forward, backward, and stop the movement by voice with three languages: Korean, English, and Vietnamese. We experimented on 1850 recording audio files including 1013 female voices and 837 male voices with ‘latest_short,’ ‘latest_long,’ and ‘command_and_search’ models. The results obtained a fairly high average confidence of 95% for English and Vietnamese languages and 87% for Korean. From results of this study, it will serve as a foundation for the research and development of a system to support students in learning by interacting with mobile robots through voice with multi-language. STEM education in the form of gamification of the curriculum, especially for extensive research on training programs can be applied in mobile robots with more flexibility.