Multi-Channel Augmented Reality Interactive Framework Design for Ship Outfitting Guidance

Abstract

Abstract Industrial Augmented Reality (IAR) technique has been bloomed in recent years, but the interaction schemes of existing applications are relatively sole and inconvenient. To improve the interaction efficiency for complex scenes like the ship outfitting guidance, this paper proposes a natural multi-channel fusion interaction framework that integrates four information sensing channels including bar code scanning, free gesture, eye movement, and voice control to catch the user’s interaction intention comprehensively. A communication storage architecture and an asynchronous mechanism are introduced to address the multi-channel sensing signals in real-time. A prototype application was developed on the Microsoft HoloLens 2 to facilitate the product designers to browse the parts assembly sequences for process validation. Experimental results verify that the proposed method can realize the interaction intention of the subjects more intuitively and takes less responding time than the single-channel interaction scheme.