Users as performers in vocal interactive media — the role of expressive voice visualisation

Abstract

Few multimedia studies have investigated how vocal skills and coordination capabilities of performers can be exploited as input mechanisms to create immersive, expressive and engaging interactive Media. The paper explores the potential role of real-time voice-controlled visualisations in augmenting expressiveness and performance. It first investigates some of the recent attempts to develop voice visualisation projects and the range of possible ways to map voice characteristics to visual parameters. It then examines the role of voice input in facilitating more expressive voice-visual performances and interactive installations. It proposes that expressive voice-visualisation may enable users to eventually become performers and turn into an integral part of the entertaining installation.