Abstract
Mobile robotic systems have evolved to include sensors capable of truthfully describing robot status and operating environment as accurately and reliably as never before. This possibility is challenged by effective sensor data exploitation, because of the cognitive load an operator is exposed to, due to the large amount of data and time-dependency constraints. This paper addresses this challenge in remote-vehicle teleoperation by proposing an intuitive way to present sensor data to users by means of using mixed reality and visual aids within the user interface. We propose a method for organizing information presentation and a set of visual aids to facilitate visual communication of data in teleoperation control panels. The resulting sensor-information presentation appears coherent and intuitive, making it easier for an operator to catch and comprehend information meaning. This increases situational awareness and speeds up decision-making. Our method is implemented on a real mobile robotic system operating outdoor equipped with on-board internal and external sensors, GPS, and a reconstructed 3D graphical model provided by an assistant drone. Experimentation verified feasibility while intuitive and comprehensive visual communication was confirmed through an assessment, which encourages further developments.
Highlights
During the last two decades, robotic vehicles have been proposed for controlled environments such as depots and automated manufacture halls
1) COLORS We propose the use of standard color conventions, including those associated to danger–caution–safety [47], as they match users’ expectations and recall the ordinary vehicle driving experience
We propose live video-images to be inserted into a wider Augmented Virtuality (AV) context through Computer graphics (CG) video-mapping
Summary
During the last two decades, robotic vehicles have been proposed for controlled environments such as depots and automated manufacture halls. Different systems have been employed to help with dangerous tasks such as bomb disposal and mine discovery. Whereas mobile robots’ autonomy has constantly increased, so has the awareness of the unreplaceable value of manual teleoperation, especially for challenging tasks and unknown environments. The associate editor coordinating the review of this manuscript and approving it for publication was Pedro Neto. Quite often behaving semi-autonomously, need to be commanded through their operator’s interface. There has been an increased consciousness about the role of the interface in enhancing operator’s situational awareness and its impact on operational performance
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
