Sound Effects Research Articles

Listen to the beat: Behavioral and neurophysiological correlates of slow and fast heartbeat sounds

BackgroundListening to heartbeat sounds have been found to affect cardiac activity and behavior. However, less is known about the effects of these stimuli on brain activity and cognition. Alpha oscillations (8–13 Hz) are considered markers of cortical activation. Frontal alpha Asymmetry (FαA) reflects the valence attributed to the stimulus and the tendency to approach/avoid it. AimThis study investigates the effects of sounds mimicking heart pulsations at different rhythms on reaction times and neurophysiological activity. MethodEEG data were collected during a resting-state condition and two Simple Reaction Time tasks (SRT), during which artificially generated heartbeat sounds at fast (120 bpm, FastBeat condition) or slow (60 bpm, SlowBeat condition) rhythms were administered. Alpha power was compared across the three conditions. Differences in the SRT and FαA values were examined between the FastBeat and SlowBeat conditions. ResultsCompared to the resting-state condition, decreased alpha activity over bilateral frontocentral regions was observed in both tasks. The comparison between the FastBeat and the SlowBeat conditions revealed faster response times, a pattern of alpha suppression over right frontal regions, and lower FαA values in the former. ConclusionsThe similarity of alpha reductions elicited in the comparison between the resting-state and the two task conditions suggests that these patterns were ascribable to processes common to both conditions (SRT task, auditory stimulation). In contrast, the differences between the two conditions suggest that fast heartbeat sounds are perceived as more adverse and stressful stimuli, inducing cortical activation over regions associated with negative states and avoidant tendencies.

CRATI: Contrastive representation-based multimodal sound event localization and detection

CRATI: Contrastive representation-based multimodal sound event localization and detection

Reclaiming and remediating space: The dynamics of queer presence in audio drama platform

The censorship of Boys’ Love (BL) content in mainland China is marked by inconsistencies in both its intensity and scope. Amid these shifting regulatory boundaries, this study analyzes the systematic removal and occasional reappearance of visual BL content from the public sphere. We found that as visual channels are most susceptible to suppression, audio – though still monitored – emerges as a crucial medium, leveraging the agentive power of sound and media remediation to sustain fan engagement with BL narratives. Focusing on Miss Evan, a Chinese audio streaming platform, we explore how it navigates state censorship and market marginalization while restoring the BL subculture through innovative design features, sexually appealing voice performances, and provocative sound effects. Additionally, we investigate the agency of Chinese BL fans in reclaiming BL’s presence through polymedia engagement. We argue that the dynamic negotiation between the platform, state censorship, and fandom reveals an ongoing contest between queer marginalization and restoration. While the platform seeks mainstream acceptance by conforming to censorship through the minimization of queer visual representation, the BL fandom employs counterstrategies to sustain the subculture in audio form. This tension highlights the cultural resilience and technological adaptability of queer subcultures as they navigate and resist the censorship imposed by state and societal norms.

Study on the Sound Absorption Characteristics and Noise Reduction Mechanism of Coconut-Shell-Activated Carbon Particles and Coconut Fiber Composite Biomass Sound-Absorption Materials

Abstract Sound absorbing materials are widely used in the field of automotive industry. Biomass materials are abundant in nature, and some biomass has natural sound absorption and noise reduction properties. Biomass sound absorption material is green and pollution-free, and has obvious noise reduction effect on middle and high frequency noise, large specific surface area, light weight, and strong sound absorption effect. In order to analyze the sound absorption and physical properties of biomass sound absorbing materials, the noise reduction performance of the different structure of biomass sound absorbing materials were analyzed. In this paper, the biomass sound absorbing materials coconut fiber and coconut shell activated carbon particles were used to make samples. Coconut shell activated carbon sound absorption material (CSAC) was made. The cylindrical holes was made and filled with coconut fiber materials to form composite sound absorbing materials (CSAC-F). The acoustic performance of impedance tube was tested based on the acoustic absorption coefficient, and the physical performance was studied by means of Scanning Electron Microscope (SEM), Brunauer, Emmett and Teller (BET), X-ray diffraction (XRD), Fourier Transform Infrared Spectrometer (FTIR), Thermogravimetric (TGA) and other detection methods. In contrast, the sound absorption effect of CSAC-F was better in the middle and low frequency range. The microstructure of the material was analyzed and the mechanism of noise reduction was studied. This research will provide a new way for the research and development of sound absorbing materials in the automotive industry, and biomass sound absorbing materials have potential applications in the noise absorption and vibration control of automotive interior.

On the patterning of sound imitation by onomatopoeia in Slovak

Summary This paper presents an experiment with onomatopoeia formation. Fifty-one Slovak participants were asked to imitate ten sound events of various frequencies by writing down onomatopoeic words using the letters of the Slovak alphabet. The purpose of the experiment was to examine the role of image iconicity in producing new onomatopoeias. Image iconicity is expected to be manifested in the participants’ agreement on the form of the proposed onomatopoeias and, therefore, in the possibility of establishing onomatopoeic patterns. The pattern structure was determined by the realization of five characteristics: initial position, final position, transition, lengthening, and repetition. In addition, the established patterns make it possible to examine the role of sound-symbolism, particularly phonesthemes in the formation of onomatopoeias.

Enhanced Learning Outcomes with Audio in E-learning: An Analysis

Audio in any form whether as narration, sound effects, background music, or commentary can make e-learning more interesting for a learner. It completes the sensory engagement in a learner where the visual meets the auditory to comprehend a learning component. As an instructional designer and trainer, over the years, I have created several e-learning courses for adult learners with and without audio. The learning outcomes of the two when compared using several surveys and other evaluation mechanisms showed that learners not only prefer learning instruction that has audio but were also able to retain the learning and apply it to their jobs. This paper analyses how the level of learning outcomes is better in e-learning courses with audio than without audio. It shares some of the science and research that supports this. In addition, it describes the learner surveys and evaluation mechanisms that I have used to prove this and discusses the national and international compliances that make audio a mandate in e-learning to support of my analysis.

Tunable underwater sound absorption via piezoelectric materials with local resonators

In recent years, piezoelectric composite materials have been widely used in the design of underwater anechoic coatings due to their adaptability to tuning parameters. However, there are also some shortcomings, such as a single dissipation mechanism, narrow bandwidth, and poor low-frequency sound absorption. This work proposes an acoustic composite structure combining piezoelectric composite materials with local resonance units, which effectively enhances the sound absorption performance of the structure through the coupling effect of the piezoelectric energy consumption mechanism and local resonance mechanism. Compared to conventional acoustic structures, the proposed acoustic composite structure not only has a strong low-frequency sound absorption effect but also enriches the mid-high frequency sound absorption modes by connecting shunt damping circuits. On this basis, the effect of piezoelectric parameters and resonator morphological properties on structural sound absorption performance is further investigated, and the results show that the designed structure has the characteristic of sound absorption performance that is tunable. In addition, key factors affecting the sound absorption performance of the structure have been optimized to achieve better broadband sound absorption performance. This work may provide valuable ideas for the development of low-frequency broadband adjustable underwater sound-absorbing coatings.

Hierarchical-Concatenate Fusion TDNN for sound event classification.

Semantic feature combination/parsing issue is one of the key problems in sound event classification for acoustic scene analysis, environmental sound monitoring, and urban soundscape analysis. The input audio signal in the acoustic scene classification is composed of multiple acoustic events, which usually leads to low recognition rate in complex environments. To address this issue, this paper proposes the Hierarchical-Concatenate Fusion(HCF)-TDNN model by adding HCF Module to ECAPA-TDNN model for sound event classification. In the HCF module, firstly, the audio signal is converted into two-dimensional time-frequency features for segmentation. Then, the segmented features are convolved one by one for improving the small receptive field in perceiving details. Finally, after the convolution is completed, the two adjacent parts are combined before proceeding with the next convolution for enlarging the receptive field in capturing large targets. Therefore, the improved model further enhances the scalability by emphasizing channel attention and efficient propagation and aggregation of feature information. The proposed model is trained and validated on the Urbansound8K dataset. The experimental results show that the proposed model can achieve the best classification accuracy of 95.83%, which is an approximate improvement of 5% (relatively) over the ECAPA-TDNN model.

The cybercultural characteristics present in the digital story The Boat (2015)

The digital story The Boat (2015) by Matt Huynh revolves around the Vietnamese teenager Mai who had to emigrate from Vietnam to Australia in a boat. Mai had to endure poor living conditions such as hunger, thirst, and emotional distress caused by the war. In this context, the digital story narrates those hardships and provides an immersive, interactive reading experience by incorporating cybercultural features into the narrative. Despite the prevalence of cyberculture in the narrative, recent studies about The Boat (2015) focus either on movement-related features (Lehman, 2020) or utilize the story as an emotional healing, and pedagogic online tool (Kwak, 2021; Miles & Boltin, 2024). Therefore, our study aimed to identify and analyze the cybercultural characteristics incorporated in The Boat (2015) by proposing an analysis of selected scenes after applying meta-analysis and systematic methods. We have identified three dominant characteristics of The Boat (2015): immersion, interaction, and platform. Those characteristics are often presented in overlapping layers since the cyberculture features such as anchor texts, GIFs, and sound effects require a platform and create a propitious environment for the audience to interact and immerse themselves in Mai’s story.

Aurally enhanced media promotion: Music and sound in Greek television commercials

The sonic dimensions of modern media—including speech, sound effects, and music—play a significant role in communicating signs, meanings, and messages through multimodal channels of audiovisual connotations. Each feature can be regarded as a discrete unit; however, the overall framework is established through an orchestrated “interaction” of these components. Receiving information through televised advertisements is a cognitive process that requires critical analysis. This study examines the functions of music and sound in television advertising, emphasizing the collaboration between visual and audio material. Our objective is to equally investigate optical and musical conventions in selected TV commercials. We will also analyze how meaning emerges through visuals, sounds, and music in correlation to the product, branding, and the purpose of advertisements as short, concise audiovisual narratives. The data for this study were collected from a series of food and drink ads shown on Greek television between 2015 and 2020. The research draws upon contemporary culturally informed, musicological, semiotic, and interpretive methodologies, applying both textual and contextual analyses to examine how these techniques captivate audiences and effectively communicate messages. Understanding music’s psychological and pragmatic effects in advertising is crucial for recognizing its role as a powerful tool that influences consumer behavior and perception.

Exploring sex differences in auditory saliency: the role of acoustic characteristics in bottom-up attention

BackgroundSeveral cognitive functions are related to sex. However, the relationship between auditory attention and sex remains unclear. The present study aimed to explore sex differences in auditory saliency judgments, with a particular focus on bottom-up type auditory attention.MethodsForty-five typical adults (mean age: 21.5 ± 0.64 years) with no known hearing deficits, intelligence abnormalities, or attention deficits were enrolled in this study. They were tasked with annotating attention capturing sounds from five audio clips played in a soundproof room. Each stimulus contained ten salient sounds randomly placed within a 1-min natural soundscape. We conducted a generalized linear mixed model (GLMM) analysis using the number of responses to salient sounds as the dependent variable, sex as the between-subjects factor, duration, maximum loudness, and maximum spectrum of each sound as the within-subjects factor, and each sound event and participant as the variable effect.ResultsNo significant differences were found between male and female groups in age, hearing threshold, intellectual function, and attention function (all p > 0.05). Analysis confirmed 77 distinct sound events, with individual response rates of 4.0–100%. In a GLMM analysis, the main effect of sex was not statistically significant (p = 0.458). Duration and spectrum had a significant effect on response rate (p = 0.006 and p < 0.001). The effect of loudness was not statistically significant (p = 0.13).ConclusionsThe results suggest that male and female listeners do not differ significantly in their auditory saliency judgments based on the acoustic characteristics studied. This finding challenges the notion of inherent sex differences in bottom-up auditory attention and highlights the need for further research to explore other potential factors or conditions under which such differences might emerge.

Equipment Sounds’ Event Localization and Detection Using Synthetic Multi-Channel Audio Signal to Support Collision Hazard Prevention

Construction workplaces often face unforeseen collision hazards due to a decline in auditory situational awareness among on-foot workers, leading to severe injuries and fatalities. Previous studies that used auditory signals to prevent collision hazards focused on employing a classical beamforming approach to determine equipment sounds’ Direction of Arrival (DOA). No existing frameworks implement a neural network-based approach for both equipment sound classification and localization. This paper presents an innovative framework for sound classification and localization using multichannel sound datasets artificially synthesized in a virtual three-dimensional space. The simulation synthesized 10,000 multi-channel datasets using just fourteen single sound source audiotapes. This training includes a two-staged convolutional recurrent neural network (CRNN), where the first stage learns multi-label sound event classes followed by the second stage to estimate their DOA. The proposed framework achieves a low average DOA error of 30 degrees and a high F-score of 0.98, demonstrating accurate localization and classification of equipment near workers’ positions on the site.

The Effect of Competition Sounds on Balance Performance in Football Players

Abstract Objective This study aimed to investigate the impact of competition environment sounds on the static and dynamic balance of football players. Materials and Methods Thirty-two football players with a mean age of 21.12±2.99 years and a body mass index of 21.98±2.58 kg/m² were included in this study. The initial assessment condition (whether in a quiet environment or with competition sounds) was determined by simple randomization. Forty-eight hours later, at the same time of day, the tests were repeated with the environmental conditions reversed. Balance performance was assessed using the Tecnobody device for both static and dynamic balance. Results In the static balance test, it was found that the surface area covered significantly decreased in the environment where competition sounds were played (p=0.014), while there was no significant change in overall sway (p=0.313), anteroposterior sway (p=0.852), or mediolateral sway (p=0.104). In the dynamic balance test, no significant change was observed in anteroposterior sway (p=0.411), but mediolateral sway (p=0.025) and overall sway (p=0.042) significantly decreased. Additionally, there was a significant improvement in the athletes’ score for reaching the target (p=0.003). The perceived difficulty levels during the tests were found to be significantly lower in both the static (p=0.048) and dynamic (p=0.001) balance tests in the environment where competition sounds were played. Conclusion In conclusion, competition environment sounds were found to positively affect the balance performance of football players and reduce the perceived difficulty level. Incorporating balance training with competition sounds during athlete rehabilitation may contribute to improved balance recovery.

Evidence of a metacognitive illusion in stimulus-specific prospective judgments of distraction by background speech

Two experiments served to examine how people arrive at stimulus-specific prospective judgments about the distracting effects of speech on cognitive performance. The direct-access account implies that people have direct metacognitive access to the cognitive effects of sounds that determine distraction. The processing-fluency account implies that people rely on the processing-fluency heuristic to predict the distracting effects of sounds on cognitive performance. To test these accounts against each other, we manipulated the processing fluency of speech by playing speech forward or backward and by playing speech in the participants’ native or a foreign language. Forward speech and native speech disrupted serial recall to the same degree as backward speech and foreign speech, respectively. However, the more fluently experienced forward speech and native speech were incorrectly predicted to be less distracting than backward speech and foreign speech. This provides evidence of a metacognitive illusion in stimulus-specific prospective judgments of distraction by speech, supporting the processing-fluency account over the direct-access account. The difference between more and less fluently experienced speech was largely absent in the participants’ global retrospective judgments of distraction, suggesting that people gain access to comparatively valid cues when experiencing the distracting effects of speech on their serial-recall performance firsthand.

Using mobile EEG to study auditory work strain during simulated surgical procedures

Surgical personnel face various stressors in the workplace, including environmental sounds. Mobile electroencephalography (EEG) offers a promising approach for objectively measuring how individuals perceive sounds. Because surgical performance does not necessarily decrease with higher levels of distraction, EEG could help guide noise reduction strategies that are independent of performance measures. In this study, we utilized mobile EEG to explore how a realistic soundscape is perceived during simulated laparoscopic surgery. To examine the varying demands placed on personnel in different situations, we manipulated the cognitive demand during the surgical task, using a memory task. To assess responses to the soundscape, we calculated event-related potentials for distinct sound events and temporal response functions for the ongoing soundscape. Although participants reported varying degrees of demand under different conditions, no significant effects were observed on surgical task performance or EEG parameters. However, changes in surgical task performance and EEG parameters over time were noted, while subjective results remained consistent over time. These findings highlight the importance of using multiple measures to fully understand the complex relationship between sound processing and cognitive demand. Furthermore, in the context of combined EEG and audio recordings in real-life scenarios, a sparse representation of the soundscape has the advantage that it can be recorded in a data-protected way compared to more detailed representations. However, it is unclear whether information get lost with sparse representations. Our results indicate that sparse and detailed representations are equally effective in eliciting neural responses. Overall, this study marks a significant step towards objectively investigating sound processing in applied settings.

Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task

In gamification users show increased motivation and engagement towards tasks. So far, this effect has mostly been empirically tested based on the visual depiction of game elements, while research on the use and addition of auditory aspects is sparse. In this work we investigate the effect of different modalities of game elements (auditory, visual, audiovisual) on user experience, perception and performance in a gamified image-tagging task. We approached this via an online validation survey to find suitable sound effects (N=50), a main quantitative study (N=109) and a qualitative semi-structured interview (N=9). Our results show that while visual gamification increases performance, auditory and audiovisual gamification had no effect. However, they were shown to have an influence on the user's flow state. Our qualitative follow-up study shed light on underlying reasons and revealed each modality has its own drawbacks and advantages and that combining both visual and auditory aspects was preferred by participants.

«ОПТИКА» БӨЛІМІ БОЙЫНША ЭЛЕКТРОНДЫҚ ОҚУЛЫҚТАРДЫҢ ЗАМАНУИ БІЛІМ БЕРУ ҚҰРАЛЫ РЕТІНДЕ РӨЛІ

The article examines the effectiveness and role of the use of electronic textbooks in the education system. And, including in the section «Optics», optical phenomena and patterns are taken as a basis. The creation of electronic textbooks is one of the most pressing problems of the educational process today. The expansion of the use of modern information technologies has led to the need to develop electronic learning tools that increase the effectiveness of self-learning and the quality of learning for students. The use of electronic means in the learning process is effective for both the teacher and the student. The use of electronic learning tools in the educational process does not contradict the traditional teaching method, but rather complements the use of its achievements. Comparison parameters are also considered: page and rotation; reader's movement through the book; plane and depth; book block; personal appearance of the book; text; illustration; tactile sensations; reliability of information storage and accessible information update; one can say about the pros and cons of this and other types of books. The advantages of an electronic textbook in terms of printing are accompanied only by sound effects associated with its large information capacity and ease of use. With all the convenience of the e-book format, the reader may want to see it directly on the site if he does not want to download it, or, as in a bookstore, first view the publication and then decide whether to download it or not. The main disadvantages of the electronic textbook are due to its loss of personal artistic appearance. Currently, there are many tools for creating electronic textbooks. For example, the possibilities of the program SunRav BookEditor, SunRav BookReader, TurboSite, Flipsnack, EdApp, Canva, etc. are considered. In the article, we will define the role of analyzing the digital literacy of students using an electronic textbook. Examples of electronic forms of a physics textbook for grades 7-9 can be given.

Shooting Simulator «Inhibitor»: Mathematical Support of Shot Special Effects

The algorithms for preparing shooters to perform an exercise, conducting its course with real-time informing, as well as the implementation of mathematical support of shot special effects (sounds, tracers, explosions, hits, and misses) for the optical-electronic shooting simulator 'Inhibitor' developed at Institute of Mechanics UdmFRC UB RAS and at facilities of Computer Department of Kalashnikov ISTU jointly with JSC «Kalashnikov» Concern» are described. A tactical and technical task is given for the visual and sound effects of a shot, such as tracers, grenade ruptures, misses, return fire, and controlled flight of PTURS. In addition, the manager must monitor the weapon simulator sensors during the preparation of the exercise (magazine, fire switch, cartridge inside the barrel and sight readings) and conduct the course of the exercise with real-time viewing of both targets and shots and altering the ammunition number and type (all ammunition can be made tracer ones). The arrows are selected from the department database for convenience. Viewing shooting errors and aiming along with hit points allows correction of trainees’ actions by means of commands and quick display service information for trainee independent classes on the projection screen. The study the factors affecting ballistic dispersion was carried out and the recommendations for its modeling were formulated. The literature review confirms the potential of further research and development of electronic rifle simulators via improvement of computational tools and the development of software libraries in order to increase the accuracy of shot process simulation and flexible display adjustment of current training exercise results. It is necessary to expand realistic opportunities of shot special effects and reduce the cost constantly, which means to increase the competitiveness of electronic shooting simulators.

Partial equivalent sound pressure level as an approach to manage irrelevant sounds in environmental noise measurements

Residual sound and unwanted events are known factors affecting the accuracy of environmental noise measurements. ISO 1996-2 provides methods to manage these irrelevant sounds, for example by applying correction factors, but the methods require a degree of knowledge of the irrelevant sounds that is not always practical or possible to obtain when performing long-term measurements with unattended monitoring stations in complex urban soundscapes. While automatic detection of irrelevant sounds provides the required information, it also allows for new approaches not described in ISO 1996-2. In this paper, we discuss a metric called partial equivalent sound pressure level (Partial Leq), calculated after data samples with residual sound and unwanted events are identified automatically and replaced by project-specific values. Our hypothesis is that better estimates of equivalent sound pressure levels (Leq) can be achieved with this metric, compared with the general methods given in ISO 1996-2. Comparisons of results are presented, together with a discussion of applicability of the Partial Leq metric and experiences gathered from its use.

Instrumentation and automatic evaluation of event indicators alongside railway lines: a first attempt to comply with article 90 of the French mobility legislation on transport

According to the Article 90 of the French Mobility Orientation Law (LOM) No. 2019-1428 (December 24, 2019), the Testing and Measurement Laboratory (LEM) of the Régie Autonome Des Transports Parisiens (RATP) 1 has been at the forefront in determining and evaluating indicators of annoyance due to event-related noise from railway transport infrastructure. Six measurement points located near tramway, metro, and suburban trains transport infrastructures were equipped with specific instrumentation allowing for measuring and automatically detecting railway and non-railway sound events (road traffic, alert sirens, and other sound activities), this multiplicity of noise sources necessitated a comprehensive approach to data collection and analysis, ensuring accurate assessment of the impact of railway transport infrastructure on surrounding area. Measurements were carried out continuously for 15 days. A post-processing system was also developed to analyze over a dozen noise indicators for each category of sound events. This article presents the technical solutions developed and deployed by the laboratory in a few months to address the regulatory challenges posed by the experimental phase of Article 90 of the LOM law.