Audiovisual Experience Research Articles

Real and Virtual Lecture Rooms: Validation of a Virtual Reality System for the Perceptual Assessment of Room Acoustical Quality

Enhancing the acoustical quality in learning environments is necessary, especially for hearing aid (HA) users. When in-field evaluations cannot be performed, virtual reality (VR) can be adopted for acoustical quality assessments of existing and new buildings, contributing to the acquisition of subjective impressions in lab settings. To ensure an accurate spatial reproduction of the sound field in VR for HA users, multi-speaker-based systems can be employed to auralize a given environment. However, most systems require a lot of effort due to cost, size, and construction. This work deals with the validation of a VR-system based on a 16-speaker-array synced with a VR headset, arranged to be easily replicated in small non-anechoic spaces and suitable for HA users. Both objective and subjective validations are performed against a real university lecture room of 800 m3 and with 2.3 s of reverberation time at mid-frequencies. Comparisons of binaural and monoaural room acoustic parameters are performed between measurements in the real lecture room and its lab reproduction. To validate the audiovisual experience, 32 normal-hearing subjects were administered the Igroup Presence Questionnaire (IPQ) on the overall sense of perceived presence. The outcomes confirm that the system is a promising and feasible tool to predict the perceived acoustical quality of a room.

Mukbang Live Streaming Commerce and Green Agri-Food Products Consumption: Exploring the New Dynamics of Consumer Purchasing Decisions

China’s live streaming boom has led to mukbang live streaming as a unique food marketing tool. Hosts interact with viewers by tasting and showcasing diverse cuisines in real time. This form of mukbang live streaming has recently been utilized to promote and sell green agri-food products. However, in-depth research into how mukbang live streaming affects the purchase intention for green agri-food products and the underlying mechanisms remains scant. We developed a theoretical model based on stimuli–organism–response theory to explore the impact mechanism. Data was collected via a survey of 455 users from agriculture-related live streaming platforms and analyzed using structural equation modeling with partial least squares. The study found that professional recommendation, audiovisual experience, and social interaction enhance consumers’ perceived utilitarian value; green advocacy, audiovisual experience, and social interaction positively affect consumers’ perceived social value. Both perceived utilitarian value and perceived social value positively affect the intention to purchase green agri-food products. Additionally, we used importance-performance map analysis to compare the model’s effects with latent variable averages, revealing each factor’s importance and performance. The findings offer new insights and recommendations for agri-food marketing strategies, particularly in enhancing consumer behaviors towards green agri-food products, aiding suppliers and mukbang live streaming platforms in more effectively promoting these products.

Camera-Sourced Heart Rate Synchronicity: A Measure of Immersion in Audiovisual Experiences

Audio presentation is often attributed as being capable of influencing a viewer’s feeling of immersion during an audiovisual experience. However, there is limited empirical research supporting this claim. This study aimed to explore this effect by presenting a clip renowned for its immersive soundtrack to two groups of participants with either high-end or basic audio presentation. To measure immersion, a novel method is applied, which utilises a camera instead of an electroencephalogram (ECG) for acquiring a heart rate synchronisation feature. The results of the study showed no difference in the feature, or in the responses to an established immersion questionnaire, between the two groups of participants. However, the camera-sourced HR synchronicity feature correlated with the results of the immersion questionnaire. Moreover, the camera-sourced HR synchronicity feature was found to correlate with an equivalent feature sourced from synchronously recorded ECG data. Hence, this shows the viability of using a camera instead of an ECG sensor to quantify heart rate synchronisation but suggests that audio presentation alone is not capable of eliciting a measurable difference in the feeling of immersion in this context.

The Subtitling of Swearing: A Pilot Reception Study

Reception studies in audiovisual translation seek to explore how translation choices affect the audience’s comprehension, emotional engagement, enjoyment, and overall viewing experience of audiovisual materials. This study focuses on the subtitling product and analyzes the acceptability of swear words translated through different stimuli: subtitles with softened, maintained, and intensified swearing, along with standard Netflix subtitles (control). Employing a multi-method approach, the study collected data through a survey, using questionnaires with a Likert scale and interviews, following the user-centered translation model to understand how participants receive and perceive swear words in subtitling. The results indicate that the control group had the highest acceptability of the participants, while the group with softened swear words presented the lowest acceptability rate. The analysis shows that participants across all groups reported that discomfort does not arise from reading the swear word in the subtitle but from perceiving a deliberate change in its offensive load—usually softened. The findings demonstrate that this change can lead to a breach of the contract of illusion in subtitling, as participants are exposed to the original dialogue and the translated subtitle simultaneously. In conclusion, when perceived, the change in the offensive load can redirect the viewer’s focus from the video to the subtitles, negatively affecting the enjoyment of the audiovisual experience.

Navigating parallel interactive narratives in virtual reality

ABSTRACT The application of Campbell’s hero’s journey in cinema commonly adopts a director-centric approach in which the director decides how the viewer will see the narrative. A parallel interactive narrative in virtual reality titled Table for Two adopts screen production enquiry to investigate the divergence from the hero’s journey from a director-centric approach towards a navigator-centric approach. Here, the conventional cinema viewer is proposed as a navigator due to the immersive, interactive, and intellectual role they perform in terms of 360-degree viewing, teleportation, and meaning creation. While hero’s journey has been examined across various narrative platforms such as literature, theatre, cinema, gaming, theme parks, education, and more; there are limited discussions on the hero’s journey and its relevance to virtual reality experiences. Table for Two is a one-shot 360-degree audio-visual experience captured simultaneously by three 360-degree cameras. The navigator is encouraged to teleport from one narrative to another as the remaining narratives unfold irrespective of their choices. Each navigator is empowered to untie the knotted pieces and construct a narrative puzzle. Table for Two diverges from the hero’s journey through its multi-linear structure, simultaneous parallel narrative approach, and 360-degree spatial storytelling that offers freedom to navigate.

Illusions in speech sound and voice perception

ABSTRACT Hearing speech in a particular voice is a common experience in spoken linguistic communication. Nevertheless, the nature and role(s) of that experience are relatively under-theorized in philosophy. What can we learn about auditory experiences of listening to speech in a voice from illusions? In this paper I discuss two illusions and two special effects in speech sound and voice perception: (1) the temporal induction illusion in speech, (2) the phantom words illusion, (3) the McGurk effect, and (4) the audiovisual experience of the voice-over translation. The first two phenomena support widely accepted claims of top-down influences in speech perception. The latter two illustrate the nature and scope of multimodal integration in speech and voice perception. My discussion of the voice-over translation technique and the experiences it may give rise to will expand the scope of the phenomena that are typically discussed in this area.

Penerapan Dutch Angle Dalam Enggambarkan Emosional Pada Film “Tolong Aku”

Film, as a genre in the world of cinema, offers a short but captivating audiovisual experience. Films have the potential to create creative, entertaining works and have high artistic value. In the filmmaking process, various techniques and elements are used to improve the quality of the final result. Films are able to convey messages and emotions through various means, including dialogue, visuals, music and special effects. This research focuses on the important role of shooting techniques or cameras in film making. One of the techniques taught is Dutch Angle or Dutch Tilt, which involves tilting the camera angle on a vertical or horizontal axis. This technique is often used in the thriller and horror genres to create a dramatic effect on the audience. The film "Help Me" is an interesting case study, utilizing the Dutch Angle to produce emotions such as sadness, fear, anger, and surprise in the audience. The story of this film tells the story of a student named Dinda who is trapped in an organization that adheres to devil beliefs. Through the use of Dutch Angle, the audience is presented with an unstable atmosphere, creating tension and anxiety that blends with the main character's experiences. The aim of making the film "Help Me" is to apply the Dutch Angle technique to arouse the audience's emotions. In this way, the author hopes to strengthen the message and emotional nuances conveyed through this film. This research also aims to provide an overview of how shooting techniques in films can influence the audience's perception and emotions towards the work.

Research on the Advantages of Short Video and the Way to Revive Long Video

Short video is one of the fastest growing industries at present, and the spread of short video on social media is very large. Long videos not only provide more selectivity, but also change the way humans watch videos. However, in the face of massive content competition, it becomes more difficult to attract viewers, leading to more people choosing to watch short videos. This paper explores the advantages of short video in modern communication, and proposes the revival of long video. Short videos are popular for their concise and clear features, which grab viewers' attention in a fast-paced society. They are easily shared and disseminated across various platforms, expanding the reach of information. Moreover, short videos provide a rich audio-visual experience, making communication more lively and interesting. On the other hand, long videos face challenges such as the dominance of short video platforms, rising membership fees, and copyright restrictions. To revive long videos, platforms can open up copyrights, reduce fees, and improve member benefits. Creators should focus on producing premium content with appealing themes, while the government can promote the import of foreign films to enrich viewing options. Viewers can use their free time to watch long-form videos in theaters or on TV. By addressing these challenges and promoting quality content, long-form videos can thrive alongside short-form videos in the modern media landscape.

Kairos: Exploring a Virtual Botanical Garden through Point Clouds

This paper reports the design, implementation and evaluation of a point cloud-based virtual reality environment for a botanical garden. The objective of this work was the creation of a point cloud-based digital timestamp of the Botanical Garden of the University of Coimbra, capturing reality and thus a moment in time that can be run and visualised in 3D space in real-time. This environment consists of three distinct locations within the Garden, containing century-old tree specimens. These areas were digitised through photogrammetry to create point clouds, which were then used as the basis of an immersive audiovisual experience whose main goal was to convey the ambiance of the Garden, along with showing people its natural processes, usually hidden to the naked eye, with the aim of rekindling our relationship with nature. We produced multimedia content consisting of PC- and VR-based experiences and 360° videos. Both PC and VR variants were evaluated by 22 volunteers where we assessed the user experience, the resulting ambiance and the gameplay. The results show a positive response from users, which described the resulting experience as “Peaceful”, “Calming”, “Relaxing”, “Dreamy”, “Colourful”, “Immersive” and “Nice”.

Engaging Learning Experience: Enhancing Productivity Software Lessons with Screencast Videos

The use of screencast videos can improve the effectiveness of the teaching and learning process, whether it is face-to-face or online. Screencast videos are digital resources that capture the computer screen and create an audio-visual experience, and they can be shared online to aid the learning process. It eliminates the need for educators to repeat information multiple times and creates an uninterrupted personalised learning environment for the students. This method of learning gives students a more personalised sense, as if they were given one-on-one guidance from the educator, with students having access to the educator and receiving immediate feedback during the class session. The purpose of this study is to investigate how well students learn when screencast videos are used as instructional materials in lab classes. The report gives the opinions of 34 business programme students regarding their experience learning basic word processing, presentation slides, and spreadsheet creation using screencast recordings. This is a descriptive study with data collected using a Likert scale questionnaire. According to the study's findings, students responded favourably to this technique. Students stated that they can study more effectively and complete their work faster when there is no interruption. They were able to fully concentrate on the videos and effortlessly follow the instructions. When compared to traditional instructor-led lab programmes, the time required to complete the video lessons and supplementary challenge questions was significantly reduced. They also appreciated the educator’s immediate feedback because the educator's time was spent observing them rather than teaching.

Utilizing Microwave Technology in Radio and Television Transmitters

In order to improve the performance and reliability of the radio and television transmission system and provide users with a better audiovisual experience this paper first analyzes the advantages of microwave in radio and television transmitters and further elaborates the radio and television transmission system. Through the reasonable configuration and application of microwave equipment the performance and reliability of radio and television transmission system can be improved and the stable transmission of radio and television signals can be ensured.

Re-imagining “care”: Reflections from digital fieldwork with slum-dwelling children in the Philippines

This work offers a reflection on children's caring practices as participants of digital fieldwork. I interrogate and illustrate how children might offer a different appreciation of care as a practice in digitally-mediated research. Examining digitally-mediated research with children participants reveals invisible caring expressions during the research process as doing digital fields is complex, overlooking various aspects of care throughout the research process. I propose a paucity to appreciate children's caring practices amidst the uncertainty of digital fieldwork and refresh our cherishing of such agency amidst thinking. Through video calls with slum-dwelling Filipino children (9–12 years old), I narrate how children demonstrated their versions of caring practices. Findings discuss: 1) The audio-visual experience and children's curiosity and criticisms; 2) Children's creative caring practices through symbolic expressions; and 3) negotiated transnational care through digitally-mediated research. This paper emphasises that caring through the digital platforms is a multi-layered practice that is not only demonstrated by adults but also enacted by children in their own means. This study invites further engagement on digital children's geographies in disentangling children's roles in digitally-mediated research.

Exploring Integration Mechanism of Music Instructional Design and Education Informatization

INTRODUCTION: In the new era of information society, the knowledge reform of school music education is getting more and more attention. Traditional teaching methods need to make full use of information technology. They cannot meet the current learning needs because the learning of information technology teaching is an essential means to realize modern learning. , therefore, the application of information technology in music education meets the requirements of the times.
 OBJECTIVES: To improve traditional teaching methods by utilizing modern teaching techniques so that students can gain more knowledge. With the help of modern technology and information technology, secondary music education can change the students' audiovisual experience, enrich their musical experience, and deepen their understanding and memorization of knowledge.
 METHODS: In this paper, use a neural network algorithm to explore the integration mechanism of music teaching design and education information technology, optimize the traditional information technology teaching platform, improve the stability of the music teaching platform, and further improve the level of network teaching from the feedback of students and teachers.
 RESULTS: This study's results found that this experiment's educational platform could motivate students to manage teaching and actively participate in music teaching and lessons. However, due to the real-time nature of information technology, it removes doubts between the parties and facilitates communication between teachers and students. The primary goal of music education is to perceive the attraction of music in terms of sight and sound, to relax the mind and body, and to develop a musical personality. From this perspective, it is also necessary to utilize modern information technology to change teachers' traditional teaching methods in classical performance and singing.
 CONCLUSION: With the help of modern technology and information technology, secondary music education can change the audiovisual experience of students, enrich their musical experience, and deepen their understanding and memorization of knowledge. The information system can motivate students to manage teaching and actively participate in music teaching.

The surface urban heat island effect decreases bird diversity in Chinese cities

The audiovisual experience of observing birds in cities provides numerous benefits to residents, but their diversity is endangered by urbanization. Although the magnitude of the surface urban heat island effect (hereafter SUHI) has grown in recent years, its impact on bird diversity has not been adequately investigated. Here, we calculate the SUHI in 336 Chinese cities and we document the implications of the SUHI for avian species richness and functional diversity during the 2001, 2011, and 2019 breeding and non-breeding seasons. We predict that the SUHI will result in greater species richness and functional diversity in urban areas during the non-breeding season, especially for cities located within colder regions of China where the SUHI is more likely to relax thermoregulatory costs and reduce the propensity of some species to migrate. We predict that the SUHI will result in decreased species richness and functional diversity during the breeding season due to increased physiological stress, especially for cities located within warmer regions of China. Our findings showed that the SUHI was associated with lower species richness and lower functional diversity of birds in urban areas compared to suburban areas during both the breeding and non-breeding seasons. These results suggest that the SUHI induced birds to avoid urban areas or to move to cooler suburban areas during both the breeding and non-breeding seasons. This effect persisted irrespective of a city's size or geographical location. Our findings suggest that the SUHI is degrading bird diversity in Chinese cities.

基于计算机网络的多媒体技术运用分析

In recent years, with the rapid development of computer network technology, multimedia technology has emerged. Based on computer network, multimedia technology can meet people's needs for life and production, improve the efficiency of computer network operation, and improve the effect and scope of network services, which is of great significance. Based on this, this article analyzes computer technology and multimedia technology, proposes application strategies for computer network-based multimedia technology, analyzes key elements of computer network-based multimedia technology application, and studies simulation and simulation signal elements, graphic and sound elements. At the same time, it proposes the application approach of computer network-based multimedia technology, aiming to enhance the fusion effect of computer network technology and multimedia technology through the application of intelligent multimedia terminals, efficient integration and transmission of information, and the improvement of network audio-visual experience.

8K Ultra HD TV broadcast system: challenge, architecture and implementation

The size of the audio and video (AV) content of the 8K program is four times larger than that of 4K content, providing viewers with a more ideal audiovisual experience while placing higher demands on the capability and efficiency of document preparation and processing, signal transmission, and scheduling. However, it is difficult to meet the high robustness requirements of 8K broadcast services because the existing broadcast system architecture is limited by efficiency, cost, and other factors. In this study, an 8K Ultra-High-Definition (UHD) TV program broadcast scheme was designed. The verification results show that the scheme is high quality, highly efficient, and robust. In particular, in the research, the file format normalizing module was first placed in the broadcast area instead of the file preparation area, and the low-compression transmission scheme of the all-IP signal JPEG XS was designed in the signal transmission area for improving the efficiency of the scheme. Next, to reduce the impact on the robustness of broadcast services, the broadcast control logic of the broadcast core components is optimized. Finally, a series of 8K TV program broadcasting systems have been implemented and their performance has been verified. The results show that the system meets the efficiency and robustness requirements of a high-quality 8K AV broadcast system, and thus has a high degree of practicability.

Experimental science-fiction films as filmic heterotopia

This paper questions the concept of the possible heterotopia of cinema by making a creative reading of a corpus of contemporary experimental science-fiction films. We think heterotopia in direct relation to utopia. If utopia can be linked to a form of thought, then heterotopia would be a form of realised or achievable utopia. Heterotopian action would then allow us to experiment subversive, if not new social configurations, where utopian thought allows us to dream of better (or at least other) societies. We propose to look at these issues starting from experimental science-fiction films. The aesthetic and narrative resorts as well as the modes of production of works like Slow Action and Urth by Ben Rivers, Meteor by Mathias Müller and Christoph Girardet, Momoko Seto’s Planet Series or Jérôme Cognet’s Guerilla Hubble, indeed offer us with an audiovisual experience that invites us to re-evaluate our human relation to the world by appealing to our capacity for imagination and by stimulating our free will, notably through their staging of historicity and multiplicity.

Encountering unsettling stories of sport coaching violence: practitioner reflections on attending an interactive and immersive installation on the topic of abuse in sport

ABSTRACT This study examines sport practitioner experiences of an interactive installation, bringing to life athlete voices on the experience of abuse in sport. Guided by art-informed pedagogy, an immersive audio-visual experience was constructed. Sport practitioners, including sport coaches and sport psychologists, were invited to attend the exhibition. Sixty participants attended, 31 (n = 31, 15 females, 16 males, Mage = 27.4) provided post-event qualitative questionnaire reflections and seven (n = 7, 2 males, 5 females, Mage = 37.1) participated in semi-structured interviews to develop an in-depth insight into their experiences of the event. Our findings demonstrate that: (1) practitioners experienced the physical space of the event as “moving” and “difficult” both physically and emotionally, (2) the experience reverberated beyond the event, compelling participants to reflexively make sense of their emotions, and (3) empowered thoughts around practice and change. We reflect on the potential of interactive approaches to sharing data on sensitive topics within practitioner education.

Acoustic effects of elevated platforms for standing audiences in an indoor music venue

The live music industry has grown significantly over the last decade, making live music not only an important component of the cultural scene but also a major economic engine. There is little research or guidance regarding acoustic design for amplified music venues, especially for improvements in the design of the indoor standing audience area. This investigation aimed to determine the acoustic effects and potential benefits to the audience, of elevated platforms in an indoor music venue. Objective parameters such as reverberation (T30), Early Decay Time (EDT), Clarity (C80), Definition (D50), and Sound Pressure Levels (SPL) were analysed through computer simulations for twelve platform arrangements of different platform heights and audience densities. Results from all possible combinations were compared and evaluated for improved acoustical and sound quality. It was shown that the use of elevated platforms reduced reverberation time parameters and increased C80 and D50. These changes in acoustic parameters appeared also to be dependent on audience density. It is expected that the novel information and guidance provided by this research will assist acoustic designers, sound engineers, and other relevant decision-makers to improve the audio-visual experience of standing audiences.

A modality-independent proto-organization of human multisensory areas

The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.