Sound Design Research Articles

Cinematic Techniques: Shaping Viewer Perception and Emotion

Cinematic techniques form the foundation of storytelling in films, encompassing visual, auditory, and narrative methods that guide viewers’ emotions and perceptions. This paper examines the role of these techniques in shaping audience engagement across genres, with a focus on their aesthetic, psychological, and cultural dimensions. Visual elements such as lighting, color, and composition, combined with auditory tools like soundtracks and diegetic sounds, create a sensory experience that aligns with a film’s narrative objectives. The integration of narrative techniques, including character arcs and non-linear storytelling, further deepens audience connection and emotional resonance. By examining the interplay of these elements, the paper underscores how filmmakers construct immersive cinematic worlds and provoke emotional responses, fostering deeper engagement and reflection among viewers. Keywords: Cinematic Techniques, Viewer Perception, Emotional Engagement, Visual Storytelling, Narrative Structure, Lighting and Color, Sound Design.

The Development of Performing Arts to Promote Local Identity in Supporting Tourists in Pathum Thani Province

This research aimed to: 1) explore the identity of local arts and culture in Pathum Thani Province, and 2) develop performing arts based on local identity to support tourism in the region. Employing qualitative research methods, the study utilized document analysis, media reviews, field surveys, structured interviews, and data triangulation. The findings were synthesized to inform the design of performing arts, later presented as creative concepts by students in the course 07201005 Community Arts Innovation. The study revealed that Pathum Thani Province’s cultural identity is shaped by its ethnic diversity, resulting in a multicultural society. Its geography, defined by rivers and canals, serves as a center for activities, with agriculture playing a key role alongside industrial development that impacts the national economy. Pathum Thani balances sustainable development with a blend of traditional and modern lifestyles, preserving its uniqueness while embracing progress. These characteristics provide a rich foundation for creating performing arts that promote tourism. The study identified two key aspects for performing arts development: Creative dance reflecting local careers and wisdom and Creative dance rooted in traditions and beliefs. The creative dance concept highlights the knowledge and cultural heritage of the province’s seven districts, showcasing their unique identities and values through performance. Eight critical elements of dance creation were defined: 1) performance design, 2) performer selection, 3) choreography design, 4) performance prop design, 5) sound and music design, 6) costume design, 7) performance space design, and 8) lighting design. These elements integrate cultural identity with interdisciplinary knowledge, forming a guideline for innovative dance development. The research contributes to understanding the role of performing arts in cultural promotion and tourism while offering a foundation for future advancements in performing arts.

Use of orthogonal treatment of acoustic attributes to study interaction effects in sound quality design

Use of orthogonal treatment of acoustic attributes to study interaction effects in sound quality design

Does amplitude compression help or hinder attentional neural speech tracking?

Amplitude compression is an indispensable feature of contemporary audio production and especially relevant in modern hearing aids. The cortical fate of amplitude-compressed speech signals is not well-studied, however, and may yield undesired side effects: We hypothesize that compressing the amplitude envelope of continuous speech reduces neural tracking. Yet, leveraging such a 'compression side effect' on unwanted, distracting sounds could potentially support attentive listening if effectively reducing their neural tracking. In this study, we examined 24 young normal-hearing (NH) individuals, 19 older hearing-impaired (HI) individuals, and 12 older normal-hearing individuals. Participants were instructed to focus on one of two competing talkers while ignoring the other. Envelope compression (1:8 ratio, loudness-matched) was applied to one or both streams containing short speech repeats. Electroencephalography (EEG) allowed us to quantify the cortical response function and degree of speech tracking. With compression applied to the attended target stream, HI participants showed reduced behavioural accuracy, and compressed speech yielded generally lowered metrics of neural tracking. Importantly, we found that compressing the ignored stream resulted in a stronger neural representation of the uncompressed target speech. Our results imply that intelligent compression algorithms, with variable compression ratios applied to separated sources, could help individuals with hearing loss suppress distraction in complex multi-talker environments.Significant statement Amplitude compression, integral in contemporary audio production and hearing aids, poses an underexplored cortical challenge. Compressing the amplitude envelope of continuous speech is hypothesized to diminish neural tracking. Yet, capitalizing on this 'compression side effect' for distracting sounds might enhance attentive listening. Studying normal-hearing (NH), older hearing-impaired (HI), and older normal hearing individuals in dual-talker scenarios, we applied envelope compression to speech streams. Both NH and HI participants showed diminished neural tracking with compression on the speech streams. Despite weaker tracking of a compressed distractor, HI individuals exhibited stronger neural representation of the concurrent target. This suggests that adaptive compression algorithms, employing variable ratios for distinct sources, could aid individuals with hearing loss in suppressing distractions in complex multi-talker environments.

Techno-musicality in Australian secondary music classrooms

Techno-musicality – the mechanics of audio production on the meaningful effect of a recording – is an integral part of composition, production and performance of popular music. Yet this discussion is largely absent from Australian music classrooms. The pedagogy of aural perception is taught as part of the Australian music curriculum and framed via six concepts/elements of music – pitch, duration, structure, texture, timbre and dynamics/expressive techniques. Student engagement with these six concepts largely neglects to address matters of techno-musicality. A study, conducted across Australian secondary students and their educators, revealed that students demonstrate rudimentary skills and/or knowledge to adequately engage with techno-musicality in their listening analyses, and yet educators are willing and mostly confident working in this area. This article addresses the importance of techno-musicality to meaningful analyses of recorded sound and discusses how educators can equip students to engage with techno-musicality utilizing the musical concepts and, in particular, timbre and expressive techniques.

Effectiveness of carbon dioxide cryotherapy for the treatment of cutaneous leishmaniasis: Systematic review and meta-analysis.

Cutaneous leishmaniasis is one of the neglected tropical diseases which is hard to treat. Carbon dioxide-based cryotherapy is a novel therapeutic option for cutaneous leishmaniasis in both developed and developing nations. This study aims to summarize the pooled evidence on the effectiveness of carbon dioxide-based cryotherapy for the treatment of cutaneous leishmaniasis. Searches of grey literature using Google Scholar and databases including PubMed, Scopus, EMBASE, Web of Science, and Google Scholar were conducted to find studies that reported the cure rate of cryotherapy. The search, screening, data extraction, and critical evaluation were carried out by two authors, with a third acting as a tiebreaker. To locate papers, we used Medical Subject Headings (MeSH) phrases and keywords. Between May 10 and May 13, 2023, the review protocol was developed using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 checklist. For the meta-analysis, STATA 17 was the statistical software used. The random effects model was employed to compile the effect estimates. Lastly, we used the funnel plot and Egger's test to evaluate publication bias, heterogeneity, sensitivity, and subgroup analyses. Out of the 16 researches included in the review, seven papers with a total of 1,357 cases were chosen for the meta-analysis. For the treatment of cutaneous leishmaniasis, the pooled cure rate with carbon dioxide-based cryotherapy was 87.84% (95% CI: 65.92-109.77). Randomized controlled trials made up the majority of the studies that were used. The highest cure rate was seen when there were two lesions, 94.34% (95% CI:68.21-119.48), and when the size of the lesion was less than or equal to 4, 93.83% (95% CI:68.92-118.75). There was no indication of a significant publishing bias. Carbon dioxide-based cryotherapy revealed a high pooled efficacy. The efficacy of the CL instances was mostly dependent on the extent of the lesion and the frequency of therapy administration. To determine if this therapy is beneficial in a routine care context, a large-scale study with a sound design is necessary.

Sonic e-mobility: traffic noise, sound-producing electric vehicles, and blind pedestrians

This article is situated at the intersection of mobility studies, sound studies, and critical disability studies. It centers on the sonic qualities of electric mobility which have changed the urban sound environment. The analysis highlights how associations of the blind have advocated against silent cars. The debate around sound-producing cars is described with regard to three different but related areas. First, I consider how traffic noise is framed as a health hazard, whereas electric vehicles (EVs) incorporate a possible solution to the current noise levels in urban environments despite posing a threat to pedestrian safety. While questioning the positive characteristics ascribed to EVs, I then turn to traffic noise as a productive factor for blind as well as sighted pedestrians’ mobility. This leads me to consider the recently established regulation for Acoustic Vehicle Alerting Systems (AVAS) in EVs and scrutinize the sonic dimension of EVs. Thirdly, synthetic car noise will be analyzed as an innovative component of contemporary sound design and marketing strategies. Consequently, unraveling the co-constitution of blind walking, sonic productions, and electric mobility allows me to emphasize how a just future politics of (auto)mobility necessarily has to consider the senses of pedestrians in their heterogeneous variability.

ARTIFICIAL AUDIO: EMERGING USES OF AI IN PODCASTING

Like other media industries (e.g. music, film, TV), the podcasting industry has spent the last year coming to grips with the impact that generative artificial intelligence tools will have on the future of podcast production and consumption. Several high-profile examples of AI-generated podcasts have raised questions about the ethics, legality, and creativity of AI for creating podcast scripts, voices, and sound design. These in turn raise larger concerns about ownership and the economics of the platforms that distribute podcasts (like Spotify). In this paper, I survey the state of artificial intelligence in the podcasting industry to address the following two questions: How is AI being used by podcasters and other actors in the podcasting industry? How is the use of AI in podcasting framed in articles and writing about the industry? By sampling a number of podcasts that employ AI during the production and consumption process (e.g. AI scriptwriting, AI voiced hosts, AI sound design, etc.), my paper explores how podcasters and others in the podcasting industry are using AI as part of their everyday work. I develop a typology for the different ways AI is currently being used in podcasting in order to explore the anxieties around the use of artificial intelligence in the cultural industries as well as the everyday, and more mundane, impact AI is having on workflows, production capabilities and notions of creativity in the creative industries.

PROCESSING OBJECT SOUNDS, AN EXPLORATION OF SAMPLING IN DIGITAL MUSIC

The practice of sampling-capturing, manipulating, and recontextualizing sounds from the physical world-has become the cornerstone of digital music production. Among the diverse ranges of sampled sounds, object sounds-auditory impressions derived from everyday items and environments-offer unique creative possibilities. This study explores the process of incorporating object sounds into digital music, examining how they can be recorded, manipulated, and transformed through various digital tools and techniques. The ability to sample objects provides musicians and sound designers with a rich palette to create unconventional textures, rhythms, and sonic landscapes. Additionally, this exploration delves into the psychological and emotional impact of object-based sounds on listeners, considering how they evoke memories, sensations, or associations. By investigating the intersection of field recording, digital processing, and music composition, this study underscores the artistic potential of object sounds in shaping the future of experimental and mainstream music production. As digital tools evolve, the role of object sounds continues to expand, thereby encouraging new forms of auditory expressions and interactivity in the music industry.

Telling Data Stories with the Hero's Journey: Design Guidance for Creating Data Videos.

Data videos increasingly becoming a popular data storytelling form represented by visual and audio integration. In recent years, more and more researchers have explored many narrative structures for effective and attractive data storytelling. Meanwhile, the Hero's Journey provides a classic narrative framework specific to the Hero's story that has been adopted by various mediums. There are continuous discussions about applying Hero's Journey to data stories. However, so far, little systematic and practical guidance on how to create a data video for a specific story type like the Hero's Journey, as well as how to manipulate its sound and visual designs simultaneously. To fulfill this gap, we first identified 48 data videos aligned with the Hero's Journey as the common storytelling from 109 high-quality data videos. Then, we examined how existing practices apply Hero's Journey for creating data videos. We coded the 48 data videos in terms of the narrative stages, sound design, and visual design according to the Hero's Journey structure. Based on our findings, we proposed a design space to provide practical guidance on the narrative, visual, and sound custom design for different narrative segments of the hero's journey (i.e., Departure, Initiation, Return) through data video creation. To validate our proposed design space, we conducted a user study where 20 participants were invited to design data videos with and without our design space guidance, which was evaluated by two experts. Results show that our design space provides useful and practical guidance for data storytellers effectively creating data videos with the Hero's Journey.

Application of environmental thermal energy simulation and audio image processing in film and television animation sound design

Application of environmental thermal energy simulation and audio image processing in film and television animation sound design

Designing Emotional and Intuitive Sounds for Tech: Insights From Psychoacoustics

User interface (UI) sounds communicate information and guide users as they navigate an interface. Research exploring the direct links between these sounds’ physical characteristics and their communicative power is lacking. In the present study, we asked 100 participants to report the emotional and functional connotations of 30 UI sounds from household devices. For each sound, they provided ratings on eight emotion scales and then categorized the sound by its position in time within a user experience (beginning, middle, or end) and by its function (a confirmation, a notification, or a cancelation). We then explored the relation between acoustic characteristics (attack time, release time, spectral centroid height, and mean fundamental frequency) and the effects of the change in perceived pitch and loudness over time (melodic and loudness contour) on participants’ ratings of emotion and categorization of function and time. Results showed effects of the acoustic characteristics, especially release time, as well as effects of melodic and loudness contour on emotion, function, and time in experience. This study provides a basic set of guidelines for intuitive UI sound design and informs the discussion on how sound can be leveraged to enhance tech experiences.

Sonic Landscapes in the Metaverse: Exploring Immersive Audio Design in Virtual Environments

Abstract This study examines the critical importance of audio design in crafting immersive experiences within the metaverse. The analysis focuses on key technologies driving this field, with particular emphasis on spatial audio techniques such as Head-Related Transfer Functions (HRTF) and Ambisonics, which enable precise three-dimensional sound positioning. The research investigates adaptive audio rendering, highlighting tools such as Microsoft's Spatial Audio Unity Plugin, which facilitates dynamic soundscape adjustments based on user interactions. Furthermore, the application of artificial intelligence in audio design is explored, with a discussion on the potential of Generative Adversarial Networks (GANs) for synthetic sound production and personalized audio experiences. The study presents two significant case studies: the partnership between TCG World, STYNGR, and Downtown for interactive sonic environments, and research on Audio Augmented Reality (AAR) in art galleries. Ethical considerations, including privacy, accessibility, and the psychological impact of immersive audio, are critically examined. The research concludes by exploring future directions, such as cross-modal integration and emotional AI systems in metaverse audio design, emphasizing the necessity for responsible development practices. Through this comprehensive analysis, the study aims to provide insights into the challenges and opportunities presented by audio design in virtual environments, contributing to the evolving landscape of metaverse technology.

영화 내러티브와 사운드 디자인의 상호작용에 관한 연구

Film is a comprehensive art form composed of various elements such as acting, cinematography, music, sound, and lighting. Yet, from the perspective of visual art, it is clear that the picture remains the most central component of film. This is evidenced by the term “Silent Film,” used to describe works from the era when only visuals existed, underscoring the indispensable nature of the picture in cinema. As film developed over time, auditory elements like music and sound were integrated, enhancing the narrative delivery. Consequently, the film’s narrative has achieved greater clarity and expressiveness through the use of diverse sound design techniques. This paper explores the interaction between film narrative and sound design, focusing not merely on background music but on composed music and designed sound. It analyzes how the deliberate use of sound influences the film’s narrative, with case studies drawn from actual film scenes. When sound is presented without any accompanying visuals in the opening scene of a film, the audience is compelled to rely solely on sound to imagine the narrative. Even when such sound design is employed outside the opening scene, it not only evokes prior scenes but also enhances the audience’s immersion in a new narrative. Additionally, when the visuals in a scene are static, incorporating uniquely designed sounds that align with the intended narrative can lead the audience to envision spaces, characters, and objects that are not visually depicted, stimulating their imagination and anticipation. Depending on how sound is designed in a film, the audience can perceive the same scene either positively or negatively. This aspect serves as a direct medium for the filmmaker’s intended message to be conveyed to the audience, significantly influencing their reactions. Furthermore, by continuously designing both diegetic and non-diegetic sounds, the narrative that the audience comprehends can be expanded, a point that this study illustrates through various case examples. As opportunities to experience films through various forms of media have increased, countless pieces of content employing diverse techniques have been produced. However, a clear methodology for the use of film narrative and sound design has yet to be fully established. Therefore, it is hoped that similar case studies to this research will continue, paving the way for more systematic and comprehensive studies on this methodology.

The Impact of Sound Design in Film and Television Productions on Movies

In the current movie and television industry, visual art and aural art are vital components that cooperatively build immersive experiences for viewers. In the aftermath of the epidemic, there has been a resurgence in the production of films and television shows, in addition to rapid advancements in technology, which has led to an increase in the requirements for content development and promotion. The advancement of storytelling and visual effects has led to the emergence of sound design as a crucial component, which enhances the emotional depth and authenticity of each and every scene. Sound design utilizes the delicacy of ambient noises and the intensity of sound effects in dynamic sequences to enhance atmosphere, guide viewer emotions, and bolster narrative arcs. The rise of surround sound and immersive audio formats, like Dolby Atmos, is indicative of a growing need for improved audio that complements visual experiences. As a result, sound design has become an increasingly important component in the production of contemporary works.

Research on Design Methods for Immersive Games Based on Virtual Reality

Virtual Reality (VR) technology has rapidly advanced, offering immersive gaming experiences previously unattainable. However, creating truly immersive VR games remains a challenge despite improved hardware. This study investigates effective VR game design with a focus on environment design, interaction mechanics, and narrative and user interface (UI) design. The paper highlights that detailed environments enhance immersion but must balance visual quality with performance to avoid discomfort. It emphasizes the necessity of natural interaction mechanisms while considering system constraints and explores the importance of combining narrative depth with intuitive UI design. The findings suggest that successful VR game design requires a multifaceted approach that integrates detailed environmental elements, natural interactions, and a cohesive narrative. Additionally, the study underscores the significance of audio design and its role in enhancing realism and immersion. These design strategies are essential for achieving high levels of immersion and meeting the growing demand for engaging VR experiences. The research also points out the importance of testing and iterative refinement to ensure that the final product is both functional and enjoyable for users.

DIGITAL TECHNOLOGIES IN CREATING CHOREOGRAPHIC PERFORMANCES

Digital technologies such as computers, websites, 3D modelling and VR reality, multimedia, computer graphics are increasingly used by contemporary choreographers to create performances, choreographic shows and contemporary choreographic works. Nowadays, not every viewer can understand digital media as a new way of perceiving choreographic art. The viewer also underestimates the objects of media art, i.e. the technologies that are used to create a choreographic work. The fact that computer technologies were used in the process of their creation, levels the artistic intention of the choreographer and devalues his creative process. Thus, contemporary dance performances that use sensors to control stage and sound design cannot be understood by everyone and perceived as new media art. Digital technologies are not perceived as a representation of an audio or multimedia object. Like contemporary dance itself, it is the creation of an imaginary world by the dancer's body. All this is based on certain symbols, because choreographic art is symbolic by nature. As a result, contemporary dance creates a new system of movements and positions of the body in space, which is still developing very rapidly, and which increases the perception of contemporary compositions due to the use of media technologies by contemporary choreographers. The article is addressed to choreographers, choreography teachers, teachers of dance disciplines and directors of dance companies who should be prepared to create highly artistic choreographic performances, dance show projects, performances using modern digital technologies and have a methodology for staging such art products.

Comparison of Sound Insulation Performance of Water Drop and Trapezoidal Sound Barriers

With increasing urbanization and industrialization, noise pollution has become a significant environmental issue. This study compares the sound insulation performance of two different sound barrier designs: water drop and trapezoidal. COMSOL Multiphysics software for computational simulations is used to calculate sound transmission loss (STL). The results indicated that the water drop design provides more effective sound insulation compared to the trapezoidal model. Additionally, economic analyses suggest that the water drop design may offer long-term advantages despite higher initial costs.

Interrelationship between Multichannel Sound Formats and the “Embodiment” in Cinema

The article investigates the connection between the use of multichannel sound formats and the development of film theory: in particular, the ability of surround sound to “immerse” the viewer in the narrative universe, evoking proprioceptive sensations with sound which gives a new impetus to the theory of “embodiment” developing in the paradigm of phenomenological aesthetics. New sound films not only put the viewer into a new acoustic environment, but also create parallel universes represented by sound and identified by the viewer as “material”, capable of not only causing a reaction, but also “finalizing” the image in the minds of viewers. Technological innovations in sound recording and sound reproduction due to the introduction of multichannel systems have led to the transformation of auditory perception and the emergence of an entirely new type of acoustic space. With film sound becoming more multi-layered and omnidirectional, the auditory component has been elaborated with synthesized textures as a result of sound design. The aesthetic potential and expressiveness of the “format” sound has broken a new ground in the progress of virtual reality in film and affected the viewer’s artistic perception of the latest works of screen art as well as the development of new theoretical ideas.

Nonlinear dynamic analysis of prestressed cable structure under random aerodynamic loading

Abstract. This paper includes the development and dynamic analysis of a mathematical model of an elastic prestressed cable structure such as those used in light roof structures known as “tensile structures” in which the external loads are balanced by tensile forces in the cables. Due to the light weight of this structural model the aerodynamic loads are critical and determine the design.The model consists of four same length and section cables arranged in an X-shape in a planar view, fixed at one end, with an equivalent mass of the system in the center node, their other extremity. The cables are not in a plane: two opposite cables have their supports in the same positive vertical height, and the other two opposite cables have their support in the same negative vertical height.There are forces acting on the central node in the x, y and z directions modeling random aerodynamic loading simulated by a Monte Carlo-type procedure inspired by Prof. Franco’s Synthetic Wind Method. This technique involves creating several loading series combining different harmonic components with amplitudes and frequencies obtained from an adopted PSD (Power Spectrum Density Function) with randomly chosen phases. This results a large number of response displacements and tensions to be statistically treated to render sound engineering design decisions. The model admits large displacements so that a nonlinear dynamic approach is adopted. A numerical step-by-step finite differences time integration scheme is also implemented.