Multimedia Reality Research Articles

Metaverse VR technologies in contemporary Chinese music education

ABSTRACT The research purpose is to explore the need to introduce innovations in the curriculum and the classroom in music colleges and universities influenced by virtual reality multimedia environments with elements of metaverse VR technologies. Particular attention is paid to the metaverse platforms with VR games in academic disciplines such as Applied Music, Fundamentals of Composition, and Learning to Play Musical Instruments. The practical part involves the analysis of the experimental and control groups of 240 individuals, selected and structured using the sampling method and the quasi-experimental method. Method Questioning is used by scholars to summarise the information and survey results collected from students. The experiment reveals that up to 72.2% of students suppose that the introduction of the art course based on digital multimedia virtual reality is effective, and their music teachers prefer to use multimedia virtual reality learning tools. The gamification elements in different musical disciplines are interesting for 78% of students. The results’ significance is the possibility to adapt the music curriculum in colleges to students’ needs. Further research is needed to evaluate the use of VR technologies for musical workshops as part of playing musical instruments and the basics of musical composition.

Applying augmented reality multimedia technology to construct a platform for translation and teaching system

This paper investigates the integration of augmented reality (AR) technology into English translation teaching for college students, emphasizing the pivotal role of innovative teaching methods in enhancing students' translation skills and learning experiences. To address the issue of insufficient interest in English translation teaching, the paper initially assesses the purpose and significance of learning English translation through a questionnaire survey, elucidating challenges encountered in English language acquisition. Subsequently, adhering to AR principles, a teaching demonstration platform rooted in AR technology is conceived and developed, intricately aligned with English translation instruction. The platform serves as a solution to issues in English learning, such as inadequate course comprehension, low utilization of teaching resources, and instructors' lack of experience. The research culminates in the analysis of survey results, wherein the quantitative disparities in translation ability between students utilizing the research platform and those subjected to traditional teaching methods are examined. The findings underscore the positive impact of the AR-based research platform on improving students' translation proficiency. The AR platform heightens learners' engagement in the learning process, contributes to constructing a robust knowledge framework, and enhances overall learning outcomes. The platform offers educators opportunities to optimize experimental courses and elevate teaching standards. The paper's outcomes present novel pedagogical scenarios for learners, propose technical solutions for other technical disciplines and furnish a theoretical foundation and application model for a new generation of experimental demonstration platforms.

Investigation of virtual reality multimedia interaction technology based on wireless network

<p>In recent years, with the continuous development of wireless communication and virtual reality technology, multimedia interaction technology has received more and more attention. However, due to the limitations of bandwidth, delay, packet loss, and other problems in wireless networks, multimedia interaction technology also faces many challenges. In this paper, the virtual reality multimedia interaction technology will be studied in combination with a wireless network, in which the virtual environment is first constructed. Then, the interaction is carried out through data transmission and user interaction, and then the existing virtual reality multimedia interaction is optimized by using a data compression algorithm. In order to test the effectiveness and performance of virtual reality multimedia interaction under different network environments and determine the optimal network environment, this paper compares the multimedia interaction effect under three network environments using a wireless network, mobile network, and Bluetooth network as the research object, with download speed, loading speed, image quality, smoothness and real-time as the test variables, and 10 VR software as the constraints. The research results indicated that, under the same other conditions, taking real-time performance as an example, the delay time and feedback speed of wireless networks were between 26 ms–37 ms and 105 KB/s–115 KB/s. The delay time and feedback speed of mobile networks (3G/4G/5G, generation) were between 66 ms–75 ms and 46 KB/s–55 KB/s, while the delay time and feedback speed of Bluetooth networks were between 120 ms–130 ms and 25 KB/s–35 KB/s; this indicated that VR multimedia interaction technology in the wireless network had better performance. Virtual reality multimedia interaction technology based on wireless networks is a promising high technology that can bring users a more realistic, vivid, and intuitive communication and entertainment experience. At the same time, it will expand the application scenarios and promote the development and progress of the technology.</p>

It’s All About “Being There”

Ethnomusicologists often move into the field to observe, analyse, and describe the knowledge creation and negotiation practices of a musical tradition. However, the scenarios caused by the COVID-19 pandemic have proven to be a challenge to the practice of our ethnographic work. We were prevented from going to the field and musicians could not meet physically to develop their musicking, partially transferring their practices to various digital platforms. Although the pandemic confronts us with previously unthinkable challenges, some of these situations are not new if we think about musical practices like those of TikTok. Beyond the time of the pandemic, these practices have already shown to be a challenge for various theoretical and methodological conceptions of our ethnographic work, since they do not materialize in concrete practices in a given place. In this article, drawing on my ethnographic research on TikTok musicking from an Austrian perspective, as well as my reflections as an ethnomusicologist during the time of the COVID-19 pandemic, I will discuss the idea of musical geography through practice, as well as the concepts of presence and co-presence, to critically reflect on the ideas of “being there” or “being present”, so important in ethnographic work. In addition to these reflections, I will examine and discuss various experiences lived throughout the musicking of TikTok under a multimedia reality before and during the pandemic, in order to discuss the idea that musical geography through practice can change our perspectives on the field pre- and post-pandemic.

Multicasting Over 6G Non-Terrestrial Networks: A Softwarization-Based Approach

Multicast/broadcast delivery is a critical challenge of future 6G mobile networks where massive Internet of Things (IoT) deployment and extended reality multimedia such as teleportation are target application scenarios. Non-terrestrial networks (NTNs) are considered essential for the success of 6G, which aims to provide true “global” services by extending mobile access worldwide, thus overcoming the coverage limit of current terrestrial networks (TNs). This article discusses how the main distinguishing features of NTNs can be effectively exploited for 6G multicasting. Furthermore, in line with the evolution of future 6G networks toward softwarized systems, we evaluate the potential of using the softwarization paradigm in the heterogeneous TN–NTN architecture to deliver multicast services.

Effect of Remote Control Augmented Reality Multimedia Technology for Postoperative Rehabilitation of Knee Joint Injury.

This study was aimed at exploring the application value of augmented reality (AR) in postoperative rehabilitation training for patients with knee joint injury. 40 patients who underwent knee joint injury surgery were selected as the research objects, and the patients were randomly divided into two groups: an experimental group (20 cases) and a control group (20 cases). Patients in the experimental group were treated with AR-based rehabilitation methods, while those in the control group were treated with traditional rehabilitation methods. Afterwards, the two groups of patients were compared with various indicators such as pain value, swelling, structural and functional recovery, time to complete weight bearing, time to return to work, and X-ray examination results. The main evaluation tools used were Hospital for Special Surgery (HSS) score and Visual Analogue Scale (VAS) score. The results showed that after six weeks, the HSS score of the control group was 82.88 ± 3.07, and the HSS score of the experimental group was 85.46 ± 3.21. The difference between the two groups was statistically significant (P < 0.05). After three months, the HSS score of the control group was 89.96 ± 3.76, and that of the experimental group was 93.21 ± 4.33. The difference between the two groups was statistically significant (P < 0.05). There was a significant difference in pain scores between the two groups at 7 days (3.81 ± 0.48 vs. 5.06 ± 0.66) and 14 days (2.03 ± 0.45 vs. 3.61 ± 0.63) after surgery, with statistical significances (P < 0.05). There were statistically significant differences between the two groups in terms of time to complete weight bearing (7 ± 0.87 weeks vs. 8.82 ± 0.88 weeks) and time to return to work (8.69 ± 0.94 vs. 9.93 ± 0.88 weeks) (P < 0.05). One month after surgery, the X-ray examination results of both groups showed recovery. The AR-based rehabilitation training system showed a good application effect and prospect in the postoperative structural and functional recovery of patients with knee joint injury.

The Influence of Different Learning Strategies on Pupils' Learning Motivation: Is Augmented Reality Multimedia Learning Consistent With Traditional Text Learning?

How to reduce pupils’ burden and improve learning efficiency? Research shows that non-intelligence factors and learning strategies are the key factors in the effective learning process, and external intervention can play a greater role in these two aspects. The purpose of this study is to explore the effects of different learning strategies on learning motivation under the presentation of augmented reality (AR) multimedia or traditional text learning. Sixty third-grade pupils in Hebei Province were selected, and 2 (learning materials: AR materials and text materials) × 3 (learning strategies: restudying strategies, retrieval practicing strategies, and self-generated drawing strategies) between-subjects design was adopted. The dependent variable is learning motivation, which includes three dimensions: surface motivation, deep motivation and achievement motivation. The results showed that (1) Learning strategies had a significant impact on deep motivation. The deep motivation aroused by retrieval practicing strategies was significantly higher than that aroused by restudying strategies and self-generated drawing strategies. (2) The interaction between learning materials and learning strategies was marginally significant. When learning with AR materials, the achievement motivation of pupils in the restudying strategy group was higher (marginal significant) than that in the retrieval practicing strategy group. Retrieval practicing strategies have positive significance in cultivating deep motivation. The combination of different learning modes and learning strategies will impact achievement motivation.

Linguosemiotic peculiarities of the text in TikTok: “the word of others” in the new multimedia reality

The subject of this research is the tendency towards formation of a new semiotic code of entertainment content, observed in the Russian segment of Tiktok social network. The goal of this research is to determine the new trends in recreational segment of the modern social network, the popularity of which depends on the number users&amp;rsquo; likes and reposts. The research material contains the continuous sampling of videos for the period from February to March 2021. The analysis of videos of the Russian-speaking users allows revealing the tendency towards the emergence of a new type of recreational content at the intersection of plagiarism and parody. This implies voice-covering of the fragments of stand-up show in a different context: for example, a fragment from comedy show is lip-synced by a woman while preparing meal. In other words, the authors of such content do not claim to be original, they virtually lip-sync with synchronization of another person's speech (moreover, the TikTok format allows seeing the link to the original soundtrack). At the same time, such content is far from parodic, as there is no mimicking or gesturing of the original. This rather implies the renovation of the open text tradition, which historically accompanies the emergence of a new form of broadcasting information. Such content also indicates common features with the folklore: the author's story&amp;nbsp; is voice-covered by various users repeatedly, like an anecdote or the history of urban folklore. The conclusion is made on the emerging semiotic tendency of the polycode multimedia text, which on the one hand has deep historical roots, while on the other hand is substantiated by the modern technological capabilities and ways of broadcasting information.

Dense Light Field Coding: A Survey

Light Field (LF) imaging is a promising solution for providing more immersive and closer to reality multimedia experiences to end-users with unprecedented creative freedom and flexibility for applications in different areas, such as virtual and augmented reality. Due to the recent technological advances in optics, sensor manufacturing and available transmission bandwidth, as well as the investment of many tech giants in this area, it is expected that soon many LF transmission systems will be available to both consumers and professionals. Recognizing this, novel standardization initiatives have recently emerged in both the Joint Photographic Experts Group (JPEG) and the Moving Picture Experts Group (MPEG), triggering the discussion on the deployment of LF coding solutions to efficiently handle the massive amount of data involved in such systems. Since then, the topic of LF content coding has become a booming research area, attracting the attention of many researchers worldwide. In this context, this paper provides a comprehensive survey of the most relevant LF coding solutions proposed in the literature, focusing on angularly dense LFs. Special attention is placed on a thorough description of the different LF coding methods and on the main concepts related to this relevant area. Moreover, comprehensive insights are presented into open research challenges and future research directions for LF coding.

The research of process of applying mobile ICT by university students: mobile testing systems and mobile means of multimedia development

The study is aimed at theoretical substantiation, development and experimental testing of methods of applying mobile technologies by university students. The objectives of the study imply adapting mobile testing systems and mobile means of multimedia development for using in the classroom environment at universities. The research object is application of mobile ICT to the educational process. The research subject is methods of applying mobile testing systems and mobile means to conduct practical classes at the University. The studies of Ukrainian and foreign researchers dedicated to the question of using mobile ICT for the university educational process were analyzed. Mobile testing systems are defined as a variety of mobile software support aimed firstly to measure students’ academic results, which enables to automatize the process of both current and final control through applying modern testing means, and secondly to intensify the educational process comprehensively. It is found that mobile means of multimedia development are to fulfill the principles of multimedia, space vicinity, time contiguity, coherence, modality, excessiveness, personalization, interactivity signalization and individual distinctions. The authors have developed the methods of applying mobile testing systems by taking Plickers system, as the one providing the opportunity to arrange a rapid feedback between a lecturer and both an academic group and an individual student. The system also allows conducting mobile surveys, in-class general questioning and instant control of students’ attendance. The authors have developed methods of applying mobile tools of multimedia development through using augmented reality. The comparative assessment of functionality of mobile testing systems and mobile means of developing augmented reality multimedia was held. Efficiency of the developed technology was experimentally tested and confirmed.

Multimedia Based on Virtual Reality in Indonesian for Foreign Speakers Learning

Virtual Reality technology can manifest 3D virtual environments that are computer-simulated, and allows for the emergence of various interactions in 360° space. Virtual Reality is a technology that allows users to interact with an environment simulated by a computer. This study aims to create multimedia in the form of videos and photos based on Virtual Reality in the context of learning Indonesian for Foreign Speakers (BIPA). This research is based on Research and Development (R & D). The steps taken in this research process were: (1) research and data collection, (2) planning, (3) product development, (4) initial field trials, (5) revision of trial results, (6) product improvement and (7) final field implementation test. Based on the validation of experts, both Indonesian linguists and media experts, this Virtual Reality multimedia is feasible to be used as BIPA learning media. In addition, based on limited test results, this Virtual Reality multimedia fulfills three variables, namely: functionality, efficiency, and usability.

Contemporary Understanding of Education in the Rift between Ontological Relativity and the Transformed Media Culture

The transformation of the developmental process from animal rationale, through homo communicans into the(un)aware homo symbolicum and the man receiving and distributing media information today, available throughmultimedia tools in his everyday life, encourages thought on the contemporary man, as well as the purpose, point andsense in contemporary education. The fact is that an individual’s life today cannot function deprived of virtualcommunication. It is possible to state that the world of mass and new media, changed the perception of reality in anessential way. Given the ontic nature of new media being based on technology i.e. the matrix of technical mediation ofthe real, fiction becomes reality and facts are (re)interpreted as media information. They not only aren’t the measure orthe guide in a theoretical context, they can also lead to an uncontrolled and unpredictable course of media information,due to their truthfulness not being questioned. That is how the global presence of media sets the forms of social life andsometimes relativizes the unquestionable nature of information, thus hiding the fundamental questions of the survivalof humane values. In such a context, ontology and ontological relativity provide a landmark in the review of thetruthfulness of facts, theories and scientific theoretical settings, especially when (re)defining the notion ofcontemporary education in the so-called “cyber” world. For those reasons precisely, taking into consideration thecausality of the relationship between contemporary media and the multimedia reality in which an individual is located,and in the context of ontological relativity, this paper attempts to search for the understanding of contemporaryeducation of man and of the true, without which true education as such is not possible.

Facial Animations: Future Research Directions &amp; Challenges

Nowadays, computer facial animation is used in a significant multitude fields that brought human and social to study the computer games, films and interactive multimedia reality growth. Authoring the computer facial animation, complex and subtle expressions are challenging and fraught with problems. As a result, the current most authored using universal computer animation techniques often limit the production quality and quantity of facial animation. With the supplement of computer power, facial appreciative, software sophistication and new face-centric methods emerging are immature in nature. Therefore, this paper concentrates to define and managerially categorize current and emerged surveyed facial animation experts to define the recent state of the field, observed bottlenecks and developing techniques. This paper further presents a real-time simulation model of human worry and howling with detail discussion about their astonish, sorrow, annoyance and panic perception.

A new multimedia classification approach: Bayesian of inductive cognition algorithm based on Dirichlet process

In this paper, we propose a Bayesian of inductive cognition algorithm based on Dirichlet process used in virtual reality multimedia information data classification. We present a Bayesian of inductive cognition algorithm framework model for classifying scenes in virtual reality multimedia data. The multimedia can switch between different shots, the unknown objects can leave or enter the scene at multiple times, and the scenes can be classified. The proposed algorithm consists of Bayesian inductive cognition part and Dirichlet process part. This algorithm has several advantages over traditional distance-based agglomerative classifying algorithms. Bayesian of inductive cognition algorithm based on Dirichlet process hypothesis testing is used to decide which merges are advantageous and to output the recommended depth of the scenes. The algorithm can be interpreted as a novel fast bottom-up approximate inference method for a Dirichlet process mixture model. We describe procedures for learning the model hyperparameters, computing the predictive distribution and extensions to the Bayesian of inductive cognition algorithm. Experimental results on virtual reality multimedia datasets demonstrate useful properties of the Bayesian of inductive cognition algorithm.

Learning science in virtual reality multimedia environments: Role of methods and media.

Learning science in virtual reality multimedia environments: Role of methods and media.

Learning science in virtual reality multimedia environments: Role of methods and media.

College students learned about botany through an agent-based multimedia game. In Experiment 1, students received either spoken or identical on-screen text explanations; in addition, the lesson was presented either via a desktop display (D), a head-mounted display (HMD) used while sitting, or an HMD used while walking (W). In Experiment 2. we examined the effects of presenting explanations as narration (N), text (T), or both (NTj within the D and W conditions. Students scored higher on retention, transfer, and program ratings in N conditions than in T conditions. The NT condition produced results in between. Students gave higher ratings of presence when learning with HMDs, but media did not affect performance on measures of retention, transfer, or program ratings.

Evaluating Technology-Supported Teaching Learning: A Catalyst to Organizational Change

Lessons Learned1 1 The name of the project was deliberately chosen to focus attention on the organizational learned outcomes expected from the initiative. The paper makes an adjective from the project title to form, lessons learned team, lessons learned project and lessons learned materials. This was a feature of the project and we hope it does not distract the reader. was a provincially funded educational technology project based at the University of Calgary in Canada. Within a broader technology-enhanced learning program, Lessons Learned set out to provide project development support, evaluation support, and dissemination mechanisms. The paper describes some of the resources and communication structures provided. A short case study reviews the benefit of the approach through the experience of evaluating a virtual reality multimedia toolkit developed for use in biological science. We make several observations about the role of evaluation as a catalyst to improved teaching and learning as well as its contribution to desirable organizational change.