Abstract
AbstractIn view of the low efficiency of production and assembly in traditional industries, we use AR technology to replace traditional assembly instructions and design an industry-oriented cloud-edge intelligent assembly guidance system. Since the computing power of AR glasses cannot meet the high complexity requirements of scene understanding, we adopt the joint solution of Cloud-Edge. First, the sensor data collected by the AR glasses are streamed to the edge server using high-speed and low-latency wireless interconnection technology. Then, the product artifacts in the data scene are identified and understood through the instance segmentation network BlendMask based on deep learning. Then, the 3D pose of the object is calculated in real time by combining pose estimation and 3D reconstruction. Furthermore, an accurate 3D guidance animation is generated, and the virtual 3D model in the AR glasses is accurately superimposed on the real object to determine whether the assembly is correct in real time. Experiments show that the system effectively combines artificial intelligence and intelligent manufacturing, integrates various elements in the scene in real time to provide operators with multimodal and multidimensional immersive guidance, and corrects in time when assembly errors occur. It can not only quickly guide the operator to complete the learning of the assembly process but also assist the staff in the assembly in real time. Ultimately, it improves assembly speed and accuracy, which in turn improves enterprise productivity.KeywordsMixed realityInstance segmentationPose estimationCloud edgeEdge computingSmart assembly
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.