Human-Computer Interaction in Remote Laboratories with the Leap Motion Controller

Abstract

In this paper, the role of the human-computer interface for remote, or online, laboratories is considered. The traditional equipment used in such remotely accessed laboratories is based on a desktop or laptop computer with keyboard, mouse and visual display unit (VDU). This is typical for both the client and server side computing. In recent years, tablet PCs (personal computers) and smart phones have enabled remote and mobile access using device touch screen based communications, changing the manner in which the user interacts with the laboratory services. The remote laboratory therefore needs to be set-up in order to allow for different user interaction (input-output) requirements. However, other forms of user-laboratory interaction via alternative human-computer interaction (HCI) devices and approaches could also be accommodated. For example, hand position/motion/gesture control and voice activation are modes of HCI that are of increasing interest, driven in many cases by computer gaming and home automation requirements. To illustrate an alternative user control of the remote experiment, this paper will present an example remote experiment arrangement that uses the Leap Motion controller for hand position, motion and gesture control of laboratory test and measurement equipment.