Making COVID dis-connections: designing intra-active and transdisciplinary sound-based narratives for phenomenal new material worlds

Abstract

ABSTRACT In this article, we reflect on the design and implementation of an interactive transhistorical and transmedial web-based digital narrative audio experience, PATTER(n)INGS: Apt 3B, 2020 that we developed in 2020. This work is an immersive audio-only application, and it focuses on the complex, material living conditions during the COVID-19 pandemic. Drawing inspiration from PATTER(n)INGS and its complex, material audio and narrative design, we propose a model for creating the content and delivery for similar sound-based interactive digital narratives. Our proposed model focuses primarily on the creative process for designing such sound-based work. To construct our analytical model, the New Material/Spectral Morphology Design Model (or NM/SM Design Model), we draw on theoretical influences from critical posthumanism, feminist new materialism and non-human narrative that critique notions of stable subjectivity as sites for power and authority over semiotic meaning-making. We combine these views with foundational theoretical research in electroacoustic musical composition notation, and audio experimentation that complicate notions of sound, sound making, spatial perception, psychoacoustic phenomena, and listening practices. Together, this theoretical/compositional framework provides a unique method to consider how one can sustain and maximize sonic agents as core phenomena to create anti-cognitive worlds and stories.