Abstract
One way to achieve an intuitive sound design are visual approaches for synthesis and sound collages. Therefore, during spectral synthesis and editing, the sound is designed in a visualization of the frequency domain. In order to create a coherent workflow between visuals and the resulting audio, the stimuli should be matched to each other. In this work, a qualitative user study is presented, which is supposed to show the intuitive understanding from the shape to the sound. The shape is hereby the spectral envelope. The general aim is to find out whether there is a connection between the visual shape and the subsequent auditory impression.
Highlights
Synthesizer and DSP algorithms are often adjusted via value inputs, sliders or knobs, similar to their hardware counterparts
Our approach is that when the visual impression of what is only heard correlates with the actual visual sound design, there is coherence
In future a tool for automatic clustering of the result from drawing studies should be considered, to deal with even more participants, due to this very diverse and subjective topic
Summary
Synthesizer and DSP algorithms are often adjusted via value inputs, sliders or knobs, similar to their hardware counterparts. Sound design and music production becomes more creative through a visual manipulation of audio. It was shown that multi sensory convergence exists in the low-sensory processing [34] and for visual-auditive stimuli (see [14, 27]). This low-level processing of coherent sensor inputs allows the improvement of visual and acoustic perception by simultaneous matching stimuli (compare [4, 34]). The correlation between color and sound was examined with an empirical approach [17] and showed that there is a strong correlation between loudness and saturation as well as tonality and brightness
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
