Abstract

Within the context of service robotics (SR), the development of assistive technologies has become an important research field. However, the accomplishment of assistive tasks requires precise and fine control of the mechanic systems that integrate the robotic entity. Among the most challenging tasks in robot control, the handwriting task (transcription) is of particular interest due to the fine control required to draw single and multiple alphabet characters to express words and sentences. For language learning activities, robot-assisted speech transcription can motivate the student to practice pronunciation and writing tasks in a dynamic environment. Hence, this paper is aimed to provide the techniques and models to accomplish accurate robot-assisted transcription of Spanish speech. The transcriptor is integrated by a multi-user speech recognizer for continuous speech and the kinematic models for the Mexican Spanish alphabet characters. The Bioloid system with the standard humanoid configuration and no special modifications or tools was considered for implementation. Particularly, the proposed transcriptor could perform the handwriting task with the Bioloid’s two two DOF (degrees-of-freedom) arms. This enabled writing of one-line short and long sentences with small alphabet characters (width <1.0 cm). It is expected that the technique and models that integrate the transcriptor can provide support for the development of robot-assisted language learning activities for children and young adults.

Highlights

  • Within the educational context, robots can take the roles of learning tools, learning companions, teaching assistants and mediators to support group learning [1,2,3]

  • The details of the speech-to-text transcriptor are presented. These details include the development of the speech recognizer, the kinematic models of the Mexican alphabet and the graphical user interface (GUI) that integrated all elements

  • The length of the robotic arm consists of the links L1 (7.0 cm), which is attached at the shoulder, and L2 (6.0 cm), which is attached at the elbow

Read more

Summary

Introduction

Robots can take the roles of learning tools, learning companions, teaching assistants and mediators to support group learning [1,2,3]. The NAO robot was used to perform trajectories that were expected to represent handwritten Latin alphabet characters and single words with different variability levels These characters were not “written” by the robot. Children would evaluate the word written by the robot (displayed in the tablet) and present the correct (or most appropriate) writing With this approach, children could improve their handwriting skills by teaching the robot the correct trajectories. These details include the development of the speech recognizer, the kinematic models of the Mexican alphabet and the graphical user interface (GUI) that integrated all elements.

The Bioloid System
Speech Recognizer and Alphabet Segmentation
Writing Space
Inverse Kinematics
Angular Conversion
Execution of the Kinematic Models
Performance
Findings
Discussion and Future
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call