Grafting acoustic instruments and signal processing: Creative control and augmented expressivity

Abstract

In this study, work is presented on a hybrid acoustic/electric violin. The instrument has embedded processing that provides real-time simulation of acoustic body models using DSP techniques able to gradually transform a given body model into another, including extrapolations beyond the models to explore interesting new timbres. Models can include everything from various violin bodies to guitars, sitars with their sympathetic strings, and even physically impossible acoustic bodies. The development also presents several practical approaches to sensor augmentation and gestural playing techniques that can be applied to bowed-string and other acoustic instruments, in order to provide immediate creative control over the possibilities offered by DSP. The study has focused on augmenting the expressivity of the violin toward finding novel timbral possibilities, rather than a goal of simulating prior acoustic violins with high fidelity. The opportunity to control a virtually malleable body while playing, i.e., a model that changes reverberant resonances in response to player input, results in interesting audio effects. Other common audio effects can also be employed and simultaneously controlled via the musician’s movements. For example, gestural tilting of the instrument is tracked via an embedded Inertial Measurement Unit (IMU), which can be assigned to alter parameters such as the wet/dry mix of an octave-doubler or other effect, further augmenting the expressivity of the player.