Leap Motion Technology In Learning

Abstract

The paper presents the Leap Motion Technology, the dedicated software development environments, as well as some results in using it for learning and training. The Leap Motion Controller is a Human Interface Device (HID) that is connected to a computer and enables the user to interact with the digital system using hand movements, allowing the interaction by simply making gestures above the device, without physical contact with the digital system. The captured information is sent to the software on the host computer and 3D information is reconstructed with sub-millimeter precision from the 2D images sent by the cameras. The development of dedicated applications benefits from APIs for JavaScript, Unity, C#, C++, Java, Python, Objective-C and Unreal engine. The Leap Motion can be thus easily used in Virtual Reality applications, in games or just as a touch-less interface for various software products, adding a new way to interact with the digital environment. The designed applications use the gestures to play games, create art, practice exercises and learn using the ‘hands on’ experience. The device is a great tool for experimentation and learning, allowing the students to have natural 3D interactions in domains like sculpture, painting, design, music, medicine, natural sciences, engineering, etc… With Leap Motion, students can have immersive experiences in Virtual Reality environments or control intuitively digital devices in the real world using a simple and affordable interface.