Dynamic Mixed Reality Assembly Guidance Using Optical Recognition Methods

Abstract

Augmented (AR) and Mixed Reality (MR) technologies are enablers of the Industry 4.0 paradigm and are spreading at high speed in production. Main applications include design, training, and assembly guidance. The latter is a pressing concern, because assembly is the process that accounts for the biggest portion of total cost within production. Teaching and guiding operators to assemble with minimal effort and error rates is pivotal. This work presents the development of a comprehensive MR application for guiding novice operators in following simple assembly instructions. The app follows innovative programming logic and component tracking in a dynamic environment, providing an immersive experience that includes different guidance aids. The application was tested by experienced and novice users, data were drawn from the performed experiments, and a questionnaire was submitted to collect the users’ perception. Results indicate that the MR application was easy to follow and even gave confidence to inexperienced subjects. The guidance support was perceived as useful by the users, though at times invasive in the field of view. Further development effort is required to draw from this work a complete and usable architecture for MR application in assembly, but this research forms the basis to achieve better, more consistent instructions for assembly guidance based on component tracking.