Sound Effects Research Articles

Handheld controller-based locomotion in Virtual Reality as an approach to interactive music composition: insights from composers’ preferences

ABSTRACT In this paper, we propose a novel interactive composition approach in which locomotion within a virtual environment is used as a means to trigger predefined sound events, attenuations of sound parameters, immersive sound spatializations, and reverberations. To implement such an approach, we developed a virtual environment consisting of a large auditorium shaped like a nautilus, where users move via handheld controllers. We tested the proposed virtual environment and composition approach by conducting a user study with 15 expert composers, where we compared the 3 locomotion techniques most used in VR to move in a 3D virtual space using a handheld controller: continuous (i.e. walking), discrete (i.e. teleporting), and mixed movement (i.e. walking and teleporting). Our results showed a preference for the mixed locomotion technique. We provide a critical reflection on such a result as well as on various insights that arose from the composers’ comments.

Integrating sound effects and background music in Robotic storytelling – A series of online studies across different story genres

Social robots as storytellers combine advantages of human storytellers – such as embodiment, gestures, and gaze – and audio books – large repertoire of voices, sound effects, and background music. However, research on adding non-speech sounds to robotic storytelling is yet in its infancy. The current series of four online studies investigates the influence of sound effects and background music in robotic storytelling on recipients’ storytelling experience and enjoyment, robot perception, and emotion induction across different story genres, i.e. horror, detective, romantic and humorous stories. Results indicate increased enjoyment for romantic stories and a trend for decreased fatigue for all genres when adding sound effects and background music to the robotic storytelling. Of the four genres examined, horror stories seem to benefit the most from the addition of non-speech sounds. Future research should provide guidelines for the selection of music and sound effects to improve the realization of non-speech sound-accompanied robotic storytelling. In conclusion, our ongoing research suggests that the integration of sound effects and background music holds promise for enhancing robotic storytelling, and our genre comparison provides first guidance of when to use them.

Development of the Flappy Helicopter Game Using Scratch

The development of the Fruit Ninja game using Scratch is an innovative and educational project. By utilizing Scratch, this game development allows users to express their creativity in designing fruit characters, sound effects, and unique game mechanics. This process also provides a deep understanding of basic programming concepts such as logic, loops, branching, and variables, presented in an intuitive and easy-to-understand interface. Additionally, this game development involves in-depth analysis in designing game flow, score management, and difficulty levels, which can enhance users' analytical skills. Through the Scratch platform, users also have the opportunity to collaborate and share projects with the online community, receive feedback, and improve their skills. With a step-by-step approach, users can start with basic features and gradually add additional features to create a fun and educational game. This project combines creativity, programming learning, and community interaction to produce a beneficial and educational product.

Creating a Fruit Ninja Game for Kids Using SCRATCH Application

The development of the Fruit Ninja game using Scratch is an innovative and educational project. By utilizing Scratch, this game development allows users to express their creativity in designing fruit characters, sound effects, and unique game mechanics. This process also provides a deep understanding of basic programming concepts such as logic, loops, branching, and variables, presented in an intuitive and easy-to-understand interface. Additionally, this game development involves in-depth analysis in designing game flow, score management, and difficulty levels, which can enhance users' analytical skills. Through the Scratch platform, users also have the opportunity to collaborate and share projects with the online community, receive feedback, and improve their skills. With a step-by-step approach, users can start with basic features and gradually add additional features to create a fun and educational game. This project combines creativity, programming learning, and community interaction to produce a beneficial and educational product.

Sound transmission loss analysis of novel sandwich plate with star-shaped auxetic cellular cores

A star-shaped auxetic cellular metamaterial with a negative Poisson’s ratio (NPR) was employed in this study to model lightweight sandwich panels, and an analysis of its sound transmission characteristics was conducted. Utilizing the first-order shear deformation theory (FSDT) and the Hamiltonian principle, the free vibration equation for the sandwich plate is derived. Subsequently, leveraging the fluid-structure coupling condition and incorporating the Navier method, the sound transmission loss (STL) is analytically described. The efficacy of the proposed method is validated through numerical analysis and an acoustic insulation experiment using an impedance tube. Based on the theoretical modeling, it is calculated that the sound insulation effect of the star-shaped cellular core exceeds that of the traditional reentrant cellular with NPR. A systematic analysis is subsequently conducted to explore the impact of star-shaped cellular structure parameters on the STL of the sandwich panel. It can be obtained that the increase in core layer thickness leads to a reduction in the first-order resonance frequency of the sandwich panel, but concurrently diminishing its sound insulation performance. The change of the connecting rib length exerts a more considerable influence on the structure’s STL compared to the side rib length. While as the cell wall thickness reduces from 2.0 to 1.0 mm, the average STL of the sandwich plate across the analysis band decreases by 8.43%, from 46.3 to 42.7 dB.

Birds, bats and beyond: evaluating generalization in bioacoustics models

In the context of passive acoustic monitoring (PAM) better models are needed to reliably gain insights from large amounts of raw, unlabeled data. Bioacoustics foundation models, which are general-purpose, adaptable models that can be used for a wide range of downstream tasks, are an effective way to meet this need. Measuring the capabilities of such models is essential for their development, but the design of robust evaluation procedures is a complex process. In this review we discuss a variety of fields that are relevant for the evaluation of bioacoustics models, such as sound event detection, machine learning metrics, and transfer learning (including topics such as few-shot learning and domain generalization). We contextualize these topics using the particularities of bioacoustics data, which is characterized by large amounts of noise, strong class imbalance, and distribution shifts (differences in the data between training and deployment stages). Our hope is that these insights will help to inform the design of evaluation protocols that can more accurately predict the ability of bioacoustics models to be deployed reliably in a wide variety of settings.

Study on the Effects of Sound and Music as Medicine on Cardiovascular Health

This paper explores the dual impact of Sound frequencies and music on cardiovascular health, analyzing how sound frequencies and musical interventions influence cardiovascular risk factors and outcomes. While environmental factors have been linked to an increase in cardiovascular diseases due to stressrelated mechanisms, Sound frequencies and music therapy offer potential benefits through their calming effects on the autonomic nervous system.

Legislation to Drug Control: Cognitive and Empirical Analysis

Drug addiction is a significant issue that affects individuals' bodily and mental health, family and social relationships, and society as a total. The rising incidences of drug addiction are global concerns, with policymakers, administrators, and social activists worldwide working to address this issue. Legislation plays an essential role in controlling drug-related issues, aiming to mitigate the harmful sound effects of drug abuse on individuals and the social order. This paper presents a cognitive and empirical analysis of drug control legislation, focusing on its impact, effectiveness, and challenges. Using a multidisciplinary approach, the study examines the cognitive processes involved in drug policy decision-making and the empirical evidence supporting different legislative measures. The analysis highlights the complexities of drug control legislation, including the tension between enforcement and public health approaches, the influence of socio-cultural factors on policy outcomes, and the need for evidence-based interventions.

The Application of Distance Education Technology in Standardized Training of Resident Physicians in Primary Orientation Training

This paper explores the application of distance education technology in standardized training of resident physicians in primary orientation training. With the rapid development and popularization of distance education technology, the special needs faced by primary medical institutions in resident physician training are becoming increasingly prominent. By analyzing the current application state, it is found that distance education technology can effectively promote the sharing of high-quality educational resources, improve the flexibility and coverage of training, moreover, it also faces challenges such as technological equipment limitations and insufficient teacher-student interaction. To optimize the application effect, this paper proposes strategies such as strengthening technical support, optimizing teaching content and form, and establishing a sound training effect evaluation system. This study not only helps to improve the training quality of primary resident physicians, but also has important significance for improving the level of primary medical services. Looking to the future, distance education technology will play a greater role in the training of primary resident physicians, which is of great significance for improving the level of primary medical services.

Enhancing Augmented Reality (AR) Technology to Improve Medical English Literacy

Since the paradigm for teaching reading has shifted from traditional literacy to multimodal literacy, prior research has demonstrated that augmented reality (AR) technology can successfully improve conventional literacy in general language learning. Only a few research, particularly in English for Nurse courses, have examined the potential of Augmented Reality (AR) technology to improve multimodal literacy in ESP learning. The purpose of this study was to determine how AR technology affects nursing students' multimodal literacy in ESP learning and how they communicate with others through a variety of multimodal modalities to improve their multimodal literacy in medical English. Fifty nursing students enrolled in English for Nursing courses participated in the study to share their experiences using this multimodal ESP learning survey to improve their medical English literacy. In the auditory mode, background music and sound effects were used to elicit strong emotions and improve immersive experiences. The results also showed a significant improvement in nursing students' multimodal English literacy skills when the material was created for a location-based augmented reality application. The findings revealed that nursing students used three modes in AR (visual, imaging, and animations). The three modes were used to help viewers comprehend complex material, give them specific ideas, and encourage participation.

GLFER-Net: a polyphonic sound source localization and detection network based on global-local feature extraction and recalibration

Polyphonic sound source localization and detection (SSLD) task aims to recognize the categories of sound events, identify their onset and offset times, and detect their corresponding direction-of-arrival (DOA), where polyphonic refers to the occurrence of multiple overlapping sound sources in a segment. However, vanilla SSLD methods based on convolutional recurrent neural network (CRNN) suffer from insufficient feature extraction. The convolutions with kernel of single scale in CRNN fail to adequately extract multi-scale features of sound events, which have diverse time-frequency characteristics. It results in that the extracted features lack fine-grained information helpful for the localization of sound sources. In response to these challenges, we propose a polyphonic SSLD network based on global-local feature extraction and recalibration (GLFER-Net), where the global-local feature (GLF) extractor is designed to extract the multi-scale global features through an omni-directional dynamic convolution (ODConv) layer and multi-scale feature extraction (MSFE) module. The local feature extraction (LFE) unit is designed for capturing detailed information. Besides, we design a feature recalibration (FR) module to emphasize the crucial features along multiple dimensions. On the open datasets of Task3 in DCASE 2021 and 2022 Challenges, we compared our proposed GLFER-Net with six and four SSLD methods, respectively. The results show that the GLFER-Net achieves competitive performance. The modules we designed are verified to be effective through a series of ablation experiments and visualization analyses.

Letting Pulsars Sing: Sonification With Granular Synthesis

An astronomy sonification project has been initiated to create sound and music from the data of pulsars in space. Pulsars are formed when some stars burn out all of their fuel and emit electromagnetic radiation, which hits earth periodically as the pulsar rotates. Each pulsar has unique characteristics. The source of the data is the online Pulsar Catalog from the Australian National Telescope Facility. The first result is a stereo fixed media composition, From Orion to Cassiopeia, which reveals a sweep of much of the Milky Way, displaying audio for many of the known pulsars. Galactic longitude, rotation speed, pulse width, mean flux density, age, and distance are mapped to granular synthesis parameters. Sound event duration, amplitude, amount of reverberation, grain rate, grain duration, grain frequency, and panning are controlled by the data. The piece was created with the new SGRAN2() instrument in the RTcmix music programming language.

Audiovisual Accessibility in Peruvian Cinema: an Analysis of Subtitling for the Deaf in a National Film

Research Implications: Accessible subtitling enables individuals with hearing impairments to access audiovisual content. Practically, subtitlers should not only identify and categorize characters in the audiovisual product but also include crucial information about sound effects to ensure comprehensive understanding. Theoretically, this study lays the groundwork for further exploration into factors such as age and the degree of hearing impairment.

The Effectiveness Of Sound Effects As A Supplement In An Industrial Product

تناول الفصل الاول مشكلة البحث والتي عنيت بالتعرف على المؤثر الصوتي ودوره الفاعل كمؤثر في المنتجات الصناعية وكذلك دوره كمكمل وظيفي وجمالي, هذا فضل عن انه يعد لغة حوار ما بين المصمم كمرسل وبين المنتج كرسالة وبين المتلقي كمستقبل حيث تعمل المؤثرات الصوتية في احياء عملية الاتصال والتواصل بين المنتج والمتلقي . وبات اليوم احد المكملات الوظيفية والجمالية للمنتج , والتي اصبحت الشغل الشاغل للمصمم, في كيفية ادخالها للمنتج واستغلالها للتعبير الجمالي والوظيفي . ومن هنا جاء التساؤل :- حول ماهيه تأثير الصوت في المنتج الصناعي كمكمل وظيفي وجمالي ؟ اما الاهمية من البحث فقد جاءت في التوعيه بدور المؤثرات الصوتية في تحقيق الجوانب الجمالية والوظيفية والنفعية لمستخدمي تلك المنتجات . وتناول هدف البحث الى معرفة : ماهو دور المؤثر الصوتي كمكمل جمالي وظيفي وتعبيري في المنتج الصناعي . فضلا عن تناول بعض المصطلحات التي تخص البحث . وناقش الفصل الثاني الصوت والتعرف على المؤثرات الصوتية في المنتج الصناعي والذي يعد احد الوسائل التي تعمل على زيادة عامل الجذب والتشويق والترفيه . فضلا عن تناوله لأنواع المثيرات الصوتية والتي شمل المؤثرات الطبيعية والصناعية ومحورا اخر وهو المؤثرات الصوتية كمكمل وظيفي وجمالي وتعبيري . وقد اعتمدت الباحثة على العينة القصدية في الفصل الثالث من البحث واتخذت من منتجات شركة سامسونك لسنة 2024 مجتما للعينه وتم تحليليها بالتحليل الوصفي . وفي نهاية البحث خرجت الباحثة بنتائج وجاء اهمها يعد المؤثر الصوتي لغه حوار ما بين المتلقي والمنتج التصميمي من خلاله يساهم المصمم في ايصال معنى ومضمون الرسالة بطريقة اكثر سهولة واقناعا وتقبلا و وساطة .

Laminated acoustic metamaterials for low-frequency broadband ultra-strong sound insulation

In this paper, a kind of laminated acoustic metamaterials (LAMS), which can realize the bandwidth widening and amplitude improvement through the parallel coupling of in-plane gradient parameters and the series laminated design in the thickness direction of the local resonance units, is proposed. The designed LAMS consists of two different layers of single-layer acoustic metamaterials (SLAMs) laminated in series in the thickness direction. During the design process of the two layers of SLAMs, non-uniform mass distribution and non-consistent frame coupling layouts are respectively introduced to broaden the sound insulation frequency band of the acoustic metamaterials. Through careful design, the two layers of SLAMs have distinct working frequency bands, effectively preventing the occurrence of sound insulation valleys with low amplitude. Based on numerical analysis of two layers of SLAMs, this study discusses the results of transmission loss (TL) and the working mechanism of interlayer superposition coupling sound insulation. The analysis of TL for LAMS reveals its capability to achieve ultra-strong sound insulation effects across a low-frequency broadband range. The accuracy of the numerical analysis in this study is verified through semi-analytical methods and small-scale impedance tube experiments. The LAMS proposed in this paper holds significant potential for wide-band noise reduction control in various high-noise mechanical equipment or workplaces.

Designing Effective Scripts and Resources to Support Simulated Practice, Using Basic Life Support as an Exemplar

This is the third instalment in a series of papers featured in this journal, focusing on the application of mental simulation in nursing. This specific article addresses the pervasive issue of skill decay in Basic Life Support (BLS) training, proposing an innovative solution through the integration of mental simulation. Despite mandatory annual BLS updates for nurses, evidence suggests a decline in skills over time, posing risks to patient safety. Traditional methods, reliant on face-to-face sessions, may not sufficiently prevent skill decay, particularly in time-sensitive scenarios. The article advocates for mental simulation as a complementary and accessible approach to augment traditional BLS training. Focused on the vivid mental rehearsal of actions, mental simulation offers a promising avenue for nurses, seeking to reinforce correct techniques and deepen their understanding of BLS interventions. Guided by the physical, environment, task, timing, learning, emotion, perspective (PETTLEP) framework, the discussion navigates through the practical application of mental simulation. The framework serves as a model for crafting scenario scripts, emphasising each of the PETTLEP elements. Recommendations include the incorporation of progressive scripts aligned with learners’ evolving knowledge, providing a nuanced approach to skill enhancement. Authenticity is emphasised through the integration of real experiences into scripts, adopting a first-person perspective, and incorporating sound effects. While acknowledging challenges such as empirical testing and individual differences, the paper concludes by highlighting the potential of mental simulation to bridge gaps in nursing education. In offering a practical and immersive learning experience, mental simulation emerges as a valuable tool for nurses aiming to optimise their BLS proficiency, ultimately contributing to enhanced patient safety.

Improvement of broadband low-frequency sound insulation of sandwich plates with negative Poisson's ratio butterfly-shaped auxetic cellular

The novel cellular cores auxetic metamaterials with negative Poisson's ratio (NPR) exhibit unique mechanical deformation characteristics compared to conventional cellular cores, which can be further exploited in modeling lightweight sandwich structures. The butterfly-shaped auxetic cellular is not only an improvement upon the traditional re-entrant auxetic cellular with NPR, but also a kind of bionic design, which possesses higher stiffness and thus offers greater potential for sound insulation. Based on this, the present article explores a study of the sound transmission characteristics exhibited by sandwich plates with butterfly-shaped auxetic cellular core layers. Firstly, the motion equation is derived based on the first-order shear deformation theory and Hamilton's principle, which is further solved analytically based on fluid-structure coupling conditions and combined with Navier method. Then, the sound transmission loss (STL) is analytically described. The correctness of the theoretical model is verified by comparing the theoretical solution with the calculation results of the commercial software COMSOL and the experimental results of impedance tube sound insulation tests. Based on the theoretical model, it is calculated that the sound insulation effect of butterfly-shaped auxetic cellular core is better than that of traditional re-entrant cellular with NPR. An analysis is subsequently conducted to explore the impact of key parameters on the STL of the butterfly-shaped cellular sandwich plates.

The Rhetorical Construction of Introductory Viewing in The Cinematic Film

Research studies address many aspects of the rhetorical construction of opening scenes in cinematic films, and among these studies it is possible to understand the rhetorical construction of opening scenes. The film is distinguished by its exciting and complex opening scenes that use many rhetorical methods to attract the attention of viewers and deliver the intended message. Here are some points that can be part of the rhetorical structure of introductory scenes. Use of image and sound: Image and sound are used innovatively in introductory scenes in the film to powerfully convey thoughts and feelings. Innovative filming techniques and appropriate sound effects are used to create an exciting and interesting cinematic experience. Tension and suspense: The opening scenes in the film are scenes full of tension and suspense. Many visual and audio elements are used to create an atmosphere of tension and suspense, such as exciting music and dynamic cinematography. Cinematic composition: Cinematic composition is used elaborately in the opening scenes of the film to convey the story and events smoothly and coherently. Editing and transition techniques are used expertly to create a cohesive narrative flow. Symbolism and Visual Symbols: Symbolism and visual symbols are distinctively used in the opening scenes of the film to convey deep messages and hidden meanings. Colors and visual symbols are used to give the viewer character and reinforce the message.

Application of High-Dimensional Data Visualization and Visual Communication Technology in Virtual Reality Environment

How to efficiently find what you want from massive data has become a hot topic. It is precisely because network information is developing so fast that so many data-oriented software systems and pages are used to manage so much network information. Aiming at problems such as insufficient information mining of visual communication websites in ASPNET and poor visual communication effects, a design scheme for integrating high-dimensional data into visual communication websites is proposed. Its working architecture includes high-dimensional data integration, multi-type visual integration, and visual support services. The main functions of the website include comprehensive management, charts, data sources, projects, systems, etc. We have conducted specific design and Implementation of high-dimensional information integration on the website, completed the design and Implementation of integration of high-dimensional data, integration of multiple visualization types, and integrated access to visualization-supported functions. Use a deep web crawler to search the visual site. It uses a search-based approach to filter URLs and crawl valuable web pages. Practice has proved that the intelligent distribution network management page implemented by the solution proposed in this article has good performance. The system shows good performance in visualization implementation and the ability to discover information. The system achieved sound and visual communication effects.

The aesthetic and educational use of music and sound effects in the structure of school theater performances

The aesthetic and educational use of music and sound effects in the structure of school theater performances