Multi-user interactive systems for immersive virtual environments

Abstract

Human-scale immersive spaces are increasingly prevalent in real-world contexts as viable applications for large-scale displays, speaker arrays, and reactive platforms continue to be discovered. One of the primary challenges hindering adoption of these modalities is the integration of intuitive interaction frameworks, allowing individuals in the space to engage naturally with the environment. In the Collaborative Research-Augmented Immersive Virtual Environment, or CRAIVE-Lab, at Rensselaer Polytechnic Institute, we have integrated a variety of technologies to foster natural engagement with the space. We developed a dynamic display environment to enable user-specific contribution to and control of the virtual space. In addition, we installed a sensor network consisting of both video and audio sensor arrays to provide fused location data and voice activity detection for each user in the space without body-worn devices. Integration of these technologies into the environment facilitates an immersive experience by fostering natural interaction between an individual and the lab system.