Audio-haptic perception in immersive improvisational environments

Abstract

This presentation describes a recent study that explored audio-haptic perception in group performance contexts. Vocalizing and listening activities were structured using methods from the Deep Listening practice developed by Pauline Oliveros, with augmentations to the immersive environment made using a multi-channel audio system, in combination with under-floor and body-worn vibrotactile transducers. Bio-signals from participants were captured and qualitative feedback solicited in order to understand the perceptual and physiological effects of introducing signals to these structured performative activities that are dynamically spatialized in audio as well as haptic sense modalities. The study compares the differences in response when these signals are driven by an external source in comparison to being driven by the bio-signals of participants, including measures focused on convergence and divergence of bio-phyiscal activity. The presentation will compare these scenarios and discuss the larger implications for developing immersive interactive environments that contribute to a sense of connection, sociality and play.