3D interaction for puzzle solving with the cubtile, 3D multitouch device

Abstract

This experimentation proposes a new interaction technique for 3D puzzle solving using a cubic device with five multitouch surfaces. The interaction is based on three levels. First, the device is used to move a 3D pointer (a selection box) into the virtual environment using. Such translations are performed relying on all the device faces. Once the selection icon is close to a piece of the puzzle, the user can grab it into this selection box, where he can orientate it freely using the four vertical faces of the device. The position of the 3D object is therefore global using the selection box, but its orientation is local regarding to the interaction on the device. Thanks to this combination the user can take, move, orientate and put in place the puzzle pieces to solve the problem.