Abstract
To provide remote assistance to people more efficiently, an augmented reality (AR)-based method for remote real-time assistance for collaboration is proposed. This paper aims to reduce communication barriers and enhance the three-dimensional (3D) feel of immersive interactions. First, a multiplayer real-time video communication framework with WebRTC is built, which enables remote experts to observe a first-hand view of an operator’s site. Second, a shared cross-platform virtual whiteboard based on Canvas, WebSocket and Node.js is developed that enables remote experts to provide visual assistance, such as drawings or text, and adjust the position of the whiteboard for seamless integration with video. Last, the virtual assistance information provided by the remote experts is displayed on the screen of AR holographic glasses to enhance the assistance capability of the platform and enable an expert to explain to an operator how to correctly perform tasks. A hybrid tracking and registration technique based on natural features and gyroscopes is adopted to estimate the operator’s posture in real time to enable the virtual assistance information to be perfectly integrated with the real world at all times. An experimental analysis shows that this system is both practicable and stable and has broad application prospects in many fields.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
