The Role of Sound in the Immersive Experience

Abstract

To create an immersive experience, it is not important to have a plethora of stimuli for different sensors, but to have their coherence, or in other words, multi-sensory integration. This coherence becomes the necessary basis for immersing oneself in a story, a game, a movie, or any other experience. Sound plays a key role in creating such an experience, both by accompanying the action and emphasizing the narrative flow, and as an independent actor that takes a central role and directs attention. The aim of the paper and poster is to explore the means by which sound can influence immersion in computer-generated virtual environments and the psychological mechanisms involved in the musical induction of emotions. The main question to be answered is how these techniques and models can be used to create a sense of immersion. The first part of the article examines immersiveness itself. The second part is devoted to the practical aspects of sound design for immersive technologies, describing the tools and techniques used to create realistic and compelling soundscapes. The third part touches briefly on the psychological mechanisms behind the induction of musical emotions. Taking a holistic view of these components and using them to reveal each other is how sound can create a sense of presence and place.