Development of a smartphone-based augmented reality device for industrial tasks

Abstract

Currently, VR and AR headsets are becoming widespread. Such technologies make it possible to significantly expand the possibilities of using services for remote maintenance and repair complex technical systems by highly qualified specialists. During the COVID-19 pandemic, the need for service representatives of manufacturing enterprises from foreign countries using such funds has increased significantly. Restrictive measures on movement between states limit the possibility of interaction between manufacturers' representatives (without losing the quality of work performed), so AR technology has become virtually uncontested. The article describes augmented reality glasses based on a mobile phone (system DAR), which combines the functions of VR and AR technologies and a low cost of the final product. The proposed solution combines a helmet with a smartphone, which is used to transmit information about the surrounding space and connect the augmented reality elements built on this image. Information about the surrounding space comes to the smartphone screen from stereo cameras equipped with autofocus. It allows the user to transmit the picture with a minimum delay and high quality. The low cost of the final device is ensured by stereo cameras, a module with sensors, and housing for attaching to the user's head. Processing of information about movement, sound transmission, and superposition of augmented reality elements is done using a smartphone. This solution makes it possible to expand AR technology scope for remote maintenance of complex technical systems by highly qualified specialists at remote sites since using a smartphone, and a DAR headset will be sufficient. The device's proposed technical solutions allow providing a high IP class, which is necessary for industrial use. © 2021 SPIE.