Using marker based augmented reality and natural user interface for interactive remote experiments

Abstract

Remote Access Laboratories (RALs) use computer-based platforms to deliver educational goals for engineering and scientific laboratories. To pursue more effective user interfaces, RAL can now be integrated with Augmented and Virtual Reality features to enhance users' interactions and control features. A Natural User Interface (NUI) is one way to implement advanced input methods to capture data from users' natural movement. These methods aim to enable interactions with greater options and flexibility. This paper introduces a method to use augmented reality and a natural user interface to create interactive laboratory experiments. In this case, experiments have a virtual object which is download at the users' location. The users use a NUI device to interact with the virtual object. Interaction with this object is translated to operational commands which are performed on the real hardware in a remote location through the Internet. The paper presents both, an overall architecture to support such environments and an example RAL experiment using this method, in form of a Gearbox, to show the practical relevance of the approach within RAL. The new system permits hands-on-experience with virtual objects as a part of the RAL activity.