Abstract
The increasing digitalization and advancement in information communication technologies has greatly changed how humans interact with digital information. Nowadays, it is not sufficient to only display relevant data in production activities, as the enormous amount of data generated from smart devices can overwhelm operators without being fully utilized. Operators often require extensive knowledge of the machines in use to make informed decisions during processes such as maintenance and production. To enable novice operators to access such knowledge, it is important to reinvent the way of interacting with digitally enhanced smart devices. In this research, a mobile augmented reality remote monitoring system is proposed to help operators with low knowledge and experience level comprehend digital twin data of a device and interact with the device. It analyses both historic logs as well as real-time data through a cloud server and enriches 2D data with 3D models and animations in the 3D physical space. A cloud-based machine learning algorithm is applied to transform learned knowledge into live presentations on a mobile device for users to interact with. A scaled-down case study is conducted using a tower crane model to demonstrate the potential benefits as well as implications when the system is deployed in industrial environments. This user study verifies that the proposed solution yields consistent measurable improvements for novice users in human-device interaction that is statistically significant.
Highlights
Digitalization has transformed traditional physical devices into smart connected devices across all industries
Regardless of the individual differences between users, AR DT monitoring system (ARDTMS) users tend to give ratings at a similar level because their experiences when using the system is similar. This shows that ARDTMS has an equalization effect on the user performance in terms of smaller variation in response time, and the user experience among different users consistently. It proves that the ARDTMS can bring more novice users to an acceptable performance, it is more generalizable than dashboard monitoring among novice users
This paper has described a framework for integrating augmented reality (AR) and Digital twin (DT) to improve human computer interaction (HCI) with smart devices by allowing remote monitoring and control, extracting knowledge from data, and presenting in AR
Summary
Digitalization has transformed traditional physical devices into smart connected devices across all industries. Intelligent systems assembled from these smart devices are transforming home, city, and factory into smart home, smart city, and smart factory Technologies, such as Internet of Things (IoT), machine learning, and cloud computing endow devices with communication capabilities and own intelligence. In the manufacturing industry, manufacturing data from sensors and production lines is often displayed as out-of-context digital numerals on inbuilt displays or centralized terminals. This is difficult for novice users without sufficient training to understand and can hinder the overall productivity. This research presents an integrated mobile AR DT monitoring system (ARDTMS) that can help users better visualize and interact with the data produced using smart devices. A user study is conducted to evaluate the performance of novice users in a fault identification task when using the proposed system in comparison with using a traditional data dashboard
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
