Understanding differences between combinations of 2D and 3D input and output devices for 3D data visualization

Abstract

Focusing on interaction needs for scientific data exploration, we evaluated people’s performance using a 2D mouse, 3D SpaceMouse, or 3D-tangible tablet as input devices to interact with visualizations on 2D screens or stereoscopic augmented reality (AR) head-mounted displays. The increasing availability and power of immersive displays drives us to try to understand how to choose input devices, interaction techniques and output displays for the visualization of scientific data, thus to finally help us guide the interaction design for hybrid AR and PC visualization systems. With a docking task and a clipping plane placement/orientation task, we measure our participants’ performance (completion time and accuracy) with each of the different combinations of input and output. We also report on their perceived workload, their preference, and on other qualitative feedback. Results show that the mouse remains good with any display, especially for tasks that require a high accuracy. Our results highlight the potential to retain the mouse as a primary input device, and to complement it with other 3D interaction devices for specific uses.