The industrial metaverse is an emerging paradigm of integrated information technologies. A human-robot collaboration assembly system is developed using extended reality (XR) and blockchain technologies. This system includes the physical, virtual reality (VR), augmented reality (AR) supporting, and blockchain systems. Virtual avatars represent physical operators and mobile robots in the XR environment. The VR system emulates real-time physical operations, facilitating pre-planning, online task optimization, and converting strategic decisions into executable instructions for physical robots. The AR system enhances the cognitive experience of intelligent operators, contributing to decision-making and VR system control through multi-modal interactions. The integration of the VR and AR systems in perception-decision-control enables real-time process optimization and the reverse control of physical operations. The system is implemented using a decentralized blockchain and end-edge-cloud collaborative network architecture to regulate interaction permissions for each scene characters, ensuring systematic functionality, robust communication, and comprehensive data management. A case study of a gearbox assembly is used to demonstrate the system’s development and efficacy. The results indicate the VR system's comprehensive perception and the AR system's detailed insights, yielding reliable information on global and local levels. The integration of artificial intelligence (AI) algorithms and spatiotemporal visualization during VR decision-making provides computational advantages. Incorporating human input into the AR system enables human-in-the-loop operational decision-making, providing optimal instructions to improve human-robot collaboration performance. Notably, the fusion of blockchain and end-edge-cloud architectures augments inter-system data exchange by efficiently managing and processing human-robot interactions and their diverse avatars. This system offers an innovative approach to human-robot collaboration assembly in manufacturing, with implications for analogous contexts.
Read full abstract