Abstract

In this paper, a flexible control strategy for a synthesis model dedicated to nonlinear friction phenomena is proposed. This model enables to synthesize different types of sound sources, such as creaky doors, singing glasses, squeaking wet plates or bowed strings. Based on the perceptual stance that a sound is perceived as the result of an action on an object we propose a genuine source/filter synthesis approach that enables to elude physical constraints induced by the coupling between the interacting objects. This approach makes it possible to independently control and freely combine the action and the object. Different implementations and applications related to computer animation, gesture learning for rehabilitation and expert gestures are presented at the end of this paper.

Highlights

  • Friction between two objects can produce a wide variety of sounds like squealing brakes, creaking doors, squeaking dishes or beautiful sounds from bowed strings in musical conditions.The understanding of such acoustical phenomena constitutes a historical challenge of physics that was subjected to early researches already from the 18th century [1]

  • Such models have for instance been used for musical purposes in the case of simulations of sounds from bowed string instruments intended for electronic cellos or violins [5] or unusual friction driven instruments based on both physical and signal models [6]

  • In this article we propose to synthesize nonlinear friction sounds from signal models using a paradigm based on perceptually relevant acoustic morphologies

Read more

Summary

Introduction

Friction between two objects can produce a wide variety of sounds like squealing brakes, creaking doors, squeaking dishes or beautiful sounds from bowed strings in musical conditions. In addition to the velocity control, the roughness of the surface can be modified by shaping the spectral content of the noise in filtering pre-processing step Another advantage of using signal models that are unconstrained by mechanics is that physically impossible situations can be generated. In this article we propose to synthesize nonlinear friction sounds from signal models using a paradigm based on perceptually relevant acoustic morphologies This approach enables to elude the physical constraints and to separately control the nature of the interaction and the resonating object from a perceptual point of view. From a perceptual point of view, squeaking or squealing sounds may convey the sense of “effort” or “annoyance” while tonal sounds may convey the sense of “success” or “wellness” Based on these evocative auditory percepts, new sonic devices aiming at guiding or learning specific gestures can be developed with such flexible sound synthesis models. Several applications linked to gesture guidance and video game applications are presented

Perceptually Informed Friction Sound Synthesis
Source Modeling
The Coulomb Friction Model
Empirical Observations on Recorded Sounds
Signal Model
Implementation
Additive Synthesis
Subtractive Synthesis
Applications
Auditory Guidance Tools for Motor Learning
Pedagogical Bowed String Instrument
Computer Animation
Conclusions and Perspectives
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call