Abstract

The present work deals with design aspects and testing results of a novel solution regarding the remote control of two virtual robotic manipulators by using hands motion tracking and palms gesture recognition. The spatial position and orientation of the user's left and right hands' wrists are interpreted by a custom built software application and then forwarded as positioning data and gripper status to a V-Rep server running the simulation scene. The goal of the presented setup is for the user to be able to manipulate objects in the scene in a collaborative way, i.e. pick one object with the first robot and give it to the second one for elsewhere depositing. The real-life applications for this approach are to provide a framework for simplified operator training and programming of robots used in pick-and-place or assembly operations, and also in healthcare for assisting patients in hand -coordination and mobility recovery.

Highlights

  • Remote control of robotic manipulators is an interesting and attractive idea, considering the increasing number of robotic applications in industry and other service areas

  • The goal of the present work is to start the development of a novel framework that will allow remote control of robotic manipulators

  • The paper deals with the hardware & software design aspects and testing results, related to the remote control of two virtual robotic manipulators

Read more

Summary

Introduction

Remote control of robotic manipulators is an interesting and attractive idea, considering the increasing number of robotic applications in industry and other service areas. The paper deals with the hardware & software design aspects and testing results, related to the remote control of two virtual robotic manipulators. For this type of control, the user should move the hands towards desired target positions. A Kinect for Xbox One will track the hands motion and recognize palms gestures and forward this data to a virtual simulation environment (V-Rep) that animates a scene with two robotic manipulators,

Objectives
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call