Exploring Simultaneous Localization and Mapping(SLAM) Technology for Complex Equipment Maintenance with the Perspective of Human-Machine Collaboration

Abstract

The rapid development of Augmented Reality (AR) and Mixed Reality (MR) technologies across various industries has intensified the need for advanced maintenance solutions in the context of the digital transformation of Industry 4.0. Taking the forming machine equipment in Taiwan's metal centre as an example. The declining birth rates and labor shortages makes it challenging for experts to be present on-site for timely repairs, leading to prolonged downtime and additional costs due to production line halts. This study aims to propose an MR-based maintenance guide, enabling on-site technicians to conduct repairs using digital technology even in the absence of equipment experts. By using head-mounted MR devices, technicians can instantly see system alerts and access 3D visualized step-by-step guidance, significantly improving repair speed and accuracy. This approach also reduces the need for expert travel, thus saving time and resources. More importantly, integrating Simultaneous Localization and Mapping (SLAM) technology ensures precise alignment between virtual and actual machine imagery, enhancing the accuracy of maintenance instructions and focusing on a human-centered experience. This technological innovation is not only applicable to forming machine equipment but can also be extended to other complex equipment maintenance fields requiring specialized knowledge. With the maturation of MR technology, this maintenance strategy is expected to become more prevalent in the future, promoting Industry 4.0's digital transformation in manufacturing.To achieve these goals, a systematic methodology was developed. Initially, the scope was defined, and the overall research process was planned during the preparation phase. The literature review phase involved an in-depth investigation into the development of head-mounted MR devices in various settings and the exploration of their application possibilities. Literature about remote collaboration was also reviewed to understand the technical requirements and limitations of this mode. Therefore, SLAM testing with Microsoft HoloLens2 in an indoor factory setting was conducted to evaluate its effectiveness in aligning virtual and physical machinery models. Finally, system development and testing were undertaken using Unity3D and Microsoft's Mixed Reality Toolkit (MRTK) to implement the MR device functionalities on-site. Overall, this methodology aims to comprehensively consider the application of digital technology in industrial maintenance to enhance efficiency and accuracy.This research has yielded several significant findings, including valuable perspectives on SLAM technology. It also sheds light on the performance capabilities of HoloLens 2 in industrial environments, particularly regarding system operation processes.