Abstract

Intuitive and safe interfaces for robots are challenging issues in robotics. Robo-HUD is a gadget-less interaction concept for contactless operation of industrial systems. We use virtual collision detection based on time-of-flight sensor data, combined with augmented reality and audio feedback, allowing the operators to navigate a virtual menu by “hover and hold” gestures. When incorporated with virtual safety barriers, the collision detection also functions as a safety feature, slowing or stopping the robot if a barrier is breached. Additionally, a user focus recognition module monitors the awareness, enabling the interaction only when intended. Early case studies show that these features present good use-cases for inspection tasks and operation in difficult environments, where contactless operation is needed.

Highlights

  • The industry must adapt ever faster to constantly changing environmental conditions, such as technological leaps and product individualization

  • The hazard posed by an industrial robot can be reduced to a certain degree by utilizing cobots, robots especially designed for human–robot collaboration, cooperation and coexistence, an important field of human–robot interaction (HRI) [5]

  • In a previous Wizard-of-Oz (WoZ) study, we explored the different forms of communication required for intuitive human–robot interaction (HRI)

Read more

Summary

Introduction

The industry must adapt ever faster to constantly changing environmental conditions, such as technological leaps and product individualization. An important prerequisite for the design of the future production factories is their adaptability. Humans and robots coexist in the industrial environment mostly with physical barriers, to ensure safety. Removing these barriers creates new possibilities and challenges [4] in the field of human–robot interaction (HRI). The hazard posed by an industrial robot can be reduced to a certain degree by utilizing cobots, robots especially designed for human–robot collaboration, cooperation and coexistence, an important field of HRI [5]. The challenge of an intuitive human–machine interaction system for industrial robots remains unresolved. Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations

Related Works
Previous Work
Our Approach
Hardware
Software
Sensor Module and Calibration
Collision Module
HUD Module
Attention Module
Safety Module
Speech Module
Results and Discussion
Industrial Use
Collision
Safety
Future Works and Author Remarks
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call