Abstract
Abstract We present an intuitive system for the programming of industrial robots using markerless gesture recognition and mobile augmented reality in terms of programming by demonstration. The approach covers gesture-based task definition and adaption by human demonstration, as well as task evaluation through augmented reality. A 3D motion tracking system and a handheld device establish the basis for the presented spatial programming system. In this publication, we present a prototype toward the programming of an assembly sequence consisting of several pick-and-place tasks. A scene reconstruction provides pose estimation of known objects with the help of the 2D camera of the handheld. Therefore, the programmer is able to define the program through natural bare-hand manipulation of these objects with the help of direct visual feedback in the augmented reality application. The program can be adapted by gestures and transmitted subsequently to an arbitrary industrial robot controller using a unified interface. Finally, we discuss an application of the presented spatial programming approach toward robot-based welding tasks.
Highlights
The demographic change and a general shortage of skilled workers are key challenges for manufacturing in western industrialized countries
This is still appropriate for the realization of robotic pick‐and‐place tasks, but there is potential for optimization regarding the sensor concept and object recognition algorithm
We presented an intuitive programming system for industrial robots on modern smartphones and tablet PCs
Summary
The demographic change and a general shortage of skilled workers are key challenges for manufacturing in western industrialized countries. In contrast to an ageing society is a new generation ofdigital natives, young people who are familiar with using new technologies (e.g., computers and handhelds) intuitively and highly efficiently. One can meet the challenges of an ageing workforce both by taking preventive measures and through intelligent assistance systems, which support the worker in manual production processes toward ergonomics and efficiency. Manual online programming requires a high degree of expertise. Due to the time‐consuming and complex programming process, small and medium‐sized enterprises (SME) have reservations about investing in an industrial robot [1]. A recent report initiated by the European Union on robotic application [2] identifies human interaction as key technology for research with high likelihood of use in application. Communication through human‐like natural interfaces has increasingly www.intechopen.com
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
