A Human-Computer Interaction Method with Multi-Dimensional Information in the Teleoperation Augmented Reality System

Abstract

In order to further improve the operating performance of teleoperation robot system, and give full play to the advantages of augmented reality technology, this paper presents a human-computer interaction method with multi-dimensional information in the teleoperation augmented reality scenario. This method not only synthesizes the information the operator can directly perceive, but also the information that operators can not directly perceive is also conveyed to the operator by an intuitive way, and finally establishes the multi-dimensional information interaction channel between implement-side and host-side. Firstly the composition of the model's information content, the information acquisition way, and a way to convey information of the model are analyzed, and then several aspects of visual information interaction, the show mechanism of text prompts and voice prompts, hap tic interaction method, etc are analyzed in-depth separately. Experimental results show the teleoperation augmented reality system with multi-dimensional information could increase the operating accuracy and reduce the procedure time.