A CAD-augmented Reality Integrated Environment for Assembly Sequence Check and Interactive Validation

Abstract

An integrated environment based on CAD assembly software and on an Augmented Reality wearable system is used to improve the overall integration between engineering design and real prototypes manufacturing. The environment following called – Personal Active Assistant (PAA) – exploits a CAD tool connection to remarkably improve object recognition, best assembly sequence optimization, and operator instructions generation. PAA is real-time and wirelessly linked to a remote server or designer workstation where project geometric database is stored. The PAA head-mounted camera is also able to acquire the human-driven assembly sequence and check the efficiency and correctness via object recognition: an incremental sub-assembly detection algorithm has been developed in order to achieve complex dataset monitoring. On the other hand, the Augmented Reality-based assembly evaluation tool allows engineers to interact directly with the assembly operator while manipulating the real and virtual prototype components. Information from the assembly planner can be displayed, directly superimposed, on the real scene by using a see-through head-mounted display. Thus the new combined software and hardware equipment may be considered a step ahead in the support of true concurrent engineering and remote collaboration, strongly improving this latter through a better heterogeneous task integration. Several tests have been performed also to achieve personnel training and warehouse part seeking.