Virtual And Augmented Reality Research Articles

Understanding Learning Technology In the Industrial Revolution Era 5.0

The concept of learning technology in the Industrial Revolution 4.0 and 5.0 eras has undergone significant changes, including personalization. This concept views that learning technology in the Industrial Revolution 5.0 era prioritizes personalization, namely providing a learning experience that is in accordance with the needs and abilities of individual students. There are several new concepts in learning technology, including: (1) Artificial Intelligence (AI). AI is used to improve the efficiency and effectiveness of the teaching and learning process, such as data analysis, performance evaluation, and development of learning materials; (2) Internet of Things (IoT) which allows the use of sophisticated devices and sensors to collect data and monitor student performance, so that it can be used as evaluation and development material; (3) Virtual and Augmented Reality (VR/AR). VR/AR technology is used to create a more interactive and immersive learning experience, so that students can be more motivated and involved; (4) Big Data, namely big data technology used to collect and analyze data from various sources, so that it can be used as evaluation and development material for the teaching and learning process; (5) Cloud Computing which allows wider accessibility of learning materials and learning platforms, so that students can learn anytime and anywhere; (6) Gamification is used to create a more engaging and interactive learning experience, so that students can be more motivated and involved; (7) Microlearning allows students to learn in a short time, but remains effective and efficient; (8) Mobile Learning which allows students to learn using mobile devices, so they can learn anywhere and anytime; and (9) Open Educational Resources (OER). OER allows students to access learning materials that are widely available and free. Unlike in previous industrial revolution eras, the Industrial Revolution 5.0 era makes learning technology adaptable to current business and industry needs, such as: (1) Skills Development, namely learning technology must be able to improve students' abilities in various fields, such as technology, data analysis, and communication; (2) Learning technology must be able to improve students' abilities in various industrial fields, such as robotics, artificial intelligence, and IoT; and (3) Digital Literacy, namely learning technology must be able to improve students' abilities in using digital technology effectively and efficiently.Overall, learning technology in the Industrial Revolution 5.0 era must be able to adapt to these changes and provide a more effective, efficient, and focused learning experience.

Decentralized Identity Management for Metaverse-Enhanced Education: A Literature Review

As we transition into the era of Web 3.0, where decentralized information and user privacy are paramount, emerging technologies are reshaping the way in which personal data are managed. This paper focuses on decentralized identity management (DID) in the metaverse, particularly within the education sector, which has rapidly embraced digital tools for e-learning, especially since the COVID-19 pandemic. Technologies such as blockchain, artificial intelligence (AI), and virtual and augmented reality (VR/AR) are increasingly integrated into educational platforms, raising questions about privacy, security, and interoperability. This literature review examines the current landscape of DID in metaverse-based educational applications. Through a systematic methodology, relevant academic papers were identified, filtered, and analyzed based on four key criteria: standardization, interoperability, application scalability, and security/privacy considerations. The paper provides a comparative analysis of these papers to assess the maturity of DID implementations, highlight existing challenges, and suggest future research directions in the intersection of decentralized identity and educational metaverse applications.

Enhancing Customer Engagement through Marketing 5.0: An Empirical Analysis

This study explores the impact of Marketing 5.0 techniques—Artificial Intelligence and Machine Learning (AIML), Big Data Analytics (BDA), Internet of Things (IoT), Augmented Reality and Virtual Reality (ARVR), Blockchain Technology (BT), and Voice Search Optimization (VSO)—on customer engagement (CE). The research employs a regression model with a sample of 250 respondents to examine the correlations and significance between these technologies and CE.The analysis reveals that AIML, BT, and ARVR significantly enhance CE, with AIML and BT showing the strongest positive correlations. Conversely, VSO is associated with a negative impact on CE. The regression model demonstrates an adjusted R-squared value of 0.489, indicating that these predictors explain a substantial portion of the variability in CE. ANOVA results confirm the model's statistical significance, emphasizing the importance of AIML, BT, and ARVR in improving customer interaction and brand involvement. The findings highlight the transformative potential of Marketing 5.0 technologies in delivering personalized and immersive experiences that drive customer loyalty and business growth in a competitive digital landscape. Organizations should strategically integrate AIML, BT, and ARVR into their marketing efforts to enhance customer engagement and gain a competitive edge.

Promoting the "Cempaka Tegal Slumpring Market" Tourism Through E-Tourism : Benchmarking Approach

This community service aims to socialize the concept of digital promotion to introduce the Cempaka Tegal tourist village to the community in a wider area, both locally, nationally and internationally. The method of implementing this service uses socialization and benchmarking. Data collection was carried out through observation and interviews which were then analyzed descriptively. The results of this activity showed that the practice of implementing digital promotion of tourist attractions in the Samara province of Moscow, Russia can be applied to introduce Cempaka Tegal Slumpring Market Tourism to all corners of the world. The digital promotional practices include creating official websites for tourist attractions, utilizing social media such as Facebook, Instagram, and Twitter, utilizing virtual and augmented reality (VR/AR) technology, collaborating with influencers and travel bloggers, optimizing search engines (SEO) and provide a tourist village tourism application. Some of these promotional media have now been implemented, such as Facebook (Desa Wisata Cempaka, n.d.), Instagram (instagram.com/explore/locations/351643408686716/), collaboration with travel bloggers (Agus Fadilah, n.d.).

Next-Gen Dynamic Hand Gesture Recognition: MediaPipe, Inception-v3 and LSTM-Based Enhanced Deep Learning Model

Gesture recognition is crucial in computer vision-based applications, such as drone control, gaming, virtual and augmented reality (VR/AR), and security, especially in human–computer interaction (HCI)-based systems. There are two types of gesture recognition systems, i.e., static and dynamic. However, our focus in this paper is on dynamic gesture recognition. In dynamic hand gesture recognition systems, the sequences of frames, i.e., temporal data, pose significant processing challenges and reduce efficiency compared to static gestures. These data become multi-dimensional compared to static images because spatial and temporal data are being processed, which demands complex deep learning (DL) models with increased computational costs. This article presents a novel triple-layer algorithm that efficiently reduces the 3D feature map into 1D row vectors and enhances the overall performance. First, we process the individual images in a given sequence using the MediaPipe framework and extract the regions of interest (ROI). The processed cropped image is then passed to the Inception-v3 for the 2D feature extractor. Finally, a long short-term memory (LSTM) network is used as a temporal feature extractor and classifier. Our proposed method achieves an average accuracy of more than 89.7%. The experimental results also show that the proposed framework outperforms existing state-of-the-art methods.

The Effectiveness of Virtual and Augmented Reality in Surgical Pain Management: A Systematic Review of Randomized Controlled Trials.

Satisfactory management of postoperative pain remains challenging. Nonpharmacological modalities such as virtual and augmented reality (VR/AR) offer potential benefits and are becoming increasingly popular. This systematic review evaluates the effectiveness and safety of VR/AR interventions on postoperative pain and recovery. MEDLINE, Embase, CINAHL, Web of Science, and CENTRAL databases were searched from inception to July 27, 2023, for randomized controlled trials (RCTs), published in English, evaluating the use of VR/AR interventions for surgical pain relief. Study selection and data extraction were performed by pairs of reviewers independently and in duplicate, and potential risk of bias was determined using the Risk of Bias-version 2 (RoB 2) tool. Our outcomes included pain relief, reduction of anxiety, satisfaction, and adverse effects. Due to substantial heterogeneity, a narrative synthesis without meta-analysis was performed. We included 35 trials among 2257 citations, categorized as surgery (n = 12), minor procedures (n = 15), and postoperative physiotherapy (n = 8). Surgical group included various surgeries, with 11 using immersive VR predominantly in the postoperative period, and most reporting no differences in pain, but potential for reduced anxiety and sedation requirements. In the minor procedures group, most studies reported decreased pain and anxiety during the procedural performance. Two studies reported increased heart rate, while 2 others reported better hemodynamic stability. Home-based AR physiotherapy achieved (n = 6) similar pain and functional outcomes after knee replacement, with 1 large study (n = 306) reporting reduction of mean costs by $2745 for provision of 12 weeks physiotherapy. There were some concerns around potential bias for most studies, as the nature of interventions make it challenging to blind assessors and participants. No important adverse effects were noted using VR/AR technology. Evidence from RCTs indicates that the use of immersive VR during minor procedures may reduce procedural pain, decrease anxiety, and improve satisfaction. However, small studies, inconsistent effect, and variation in the application of interventions are important limitations. Evidence to support the application of AR/VR for major surgeries is limited and needs to be further investigated. Use of home-based physiotherapy with AR likely has economic advantages, and facilitates virtual care for appropriate patients who can access and use the technology safely.

Employing gamification strategies to prepare school students for journalism competitions

This paper aims to conduct a thorough analysis of the effectiveness of incorporating gamification elements in the preparation of school students for journalism competitions. The authors have examined eighteen competitions facilitated by prominent institutions including the National Research University Higher School of Economics (HSE), Moscow State University named after M.V. Lomonosov (MSU), and Saint Petersburg State University (SPbSU). Drawing from openly available sources, a classification of seven gamification formats for student preparation has been proposed: quizzes, interactive storytelling, games employing virtual and augmented reality (VR/AR), process tracking, role-playing games, textual expansions, and games that utilize artificial intelligence (AI) algorithms. Furthermore, the authors have delineated the primary stages of the journalism competitions, which are categorized into theoretical and practice-oriented segments. The theoretical segment encompasses tasks in a test format that assess basic factual knowledge, while the practice-oriented segment comprises written tasks. These tasks are designed to evaluate the students’ proficiency in creating and writing informational materials, encompassing mastery of text style, literacy, and structured logical narration. The results indicate that gamification not only enriches the educational landscape, rendering learning more engaging and interactive, but also significantly enhances students’ proficiency in refining complex journalistic skills.

The Impact of Virtual and Augmented Reality on Enhancing Higher Order Thinking Skills (HOTS) of Students: A Bibliometric Analysis Study

This paper presents a bibliometric analysis study focusing on the impact of virtual and augmented reality (VR/AR) technologies on the enhancement of Higher Order Thinking Skills (HOTS) among students. In recent years, VR/AR has gained significant attention in educational contexts due to its immersive and interactive nature, offering unique opportunities for fostering critical thinking, problem-solving, and creativity among learners. This research aimed to systematically analyze the existing literature on the subject to identify trends, key themes, influential authors, and significant research gaps. Through comprehensive bibliometric analysis, encompassing citation networks, co-authorship patterns, and thematic clusters, this study provides insights into the evolution and current state of research in the intersection of VR/AR and HOTS enhancement. Furthermore, it seeks to elucidate the theoretical frameworks, methodologies, and pedagogical approaches employed in these studies, shedding light on effective strategies for integrating VR/AR technologies into educational practices. By synthesizing and evaluating the scholarly output in this field, this research contributes to the understanding of the potential of VR/AR in promoting HOTS development and informs future directions for research and practice in educational technology and curriculum design.

Enhancing Body Measurement Accuracy and Immersive Experience with Virtual/Augmented Reality in E – Commerce Platform

n the realm of e-commerce, achieving accurate body measurements for clothing is a persistent challenge. This project utilizes Virtual and Augmented Reality (VR/AR) technologies to revolutionize online shopping. It introduces a feature where users can enhance cloth fitting based on their measurements, reducing sizing issues and improving customer satisfaction. Users can input measurements like bust, waist, and hips to customize their fit, leading to a more seamless shopping experience and reducing returns. The project also includes a VR-based prototype for a virtual clothing store, enhancing engagement and aesthetics while redefining online apparel retailing standards. IndexTerms - Online Shopping,E-Commerce,ill-fiting,Virtual Reality,HTML,CSS,JavaScript

Interactive Human 3D Model with Conventional AI

Abstract: The convergence of interactive human 3D models with conventional artificial intelligence (AI) represents a groundbreaking fusion of computer graphics and intelligent systems. This interdisciplinary field combines advanced 3D modeling techniques with classical AI methodologies to create interactive virtual representations of humans. Rigorous studies in 3D modeling and animation form the basis for lifelike avatars, while conventional AI empowers these models with the ability to understand user inputs, make contextually relevant decisions, and engage in dynamic and responsive interactions. At the heart of this innovation is the emphasis on human-computer interaction (HCI), leveraging principles such as gesture recognition, voice commands, and user-friendly interfaces to enhance user experiences. The integration extends into virtual and augmented reality (VR/AR), providing users with immersive and engaging environments where interactive 3D human models come to life. Applications of this technology span a wide array of fields, including virtual companionship, education, healthcare simulations, entertainment, and training scenarios. The impact is transformative, offering new possibilities for human-machine interactions and redefining traditional approaches to AI applications. However, the burgeoning field is not without challenges. Privacy concerns, ethical considerations related to realistic human representation, and the societal impact of interactive 3D models necessitate careful examination. This abstract provides a glimpse into the technical intricacies of creating lifelike models, the intelligence driving their interactive capabilities, and the broader implications for diverse applications and industries. As research and development progress, the collaboration of computer graphics and AI not only opens new avenues but also prompts a thoughtful reevaluation of the evolving relationship between humans and intelligent, interactive 3D representations.

Multimodal 5‐DOF Stretchable Electromagnetic Actuators toward Haptic Information Delivery

AbstractThe rapid advancements in artificial intelligence, particularly in the domains of robotics, prosthetics, and virtual and augmented reality (VR/AR), have driven an escalating demand for intuitive and effective human–machine interactions. Consequently, haptic devices, being electronic displays for the sense of touch, have drawn increasing attention. More efforts are in demand to develop stretchable and lightweight haptic devices that can trigger multiple mechanical cutaneous receptors using a single device. This work presents a new 3‐modal 5‐DOF stretchable haptic interface that is enabled by electromagnetic actuators and high‐fidelity multi‐layer metal printing. The haptic device renders rich haptic sensations (i.e., normal force, vibration, angular force, skin dragging) in one device, allowing for the comprehensive delivery of tactile information through the excitation of multiple cutaneous receptors. Additionally, haptic devices are designed to be compact, lightweight, and skin‐compatible. The skin‐like softness and stretchability enable intimate skin contact, which is crucial for efficient haptic information delivery. This feature prevents the impediment to natural movements of the skin and ensures the functional integrity of the device during daily deformations of the skin. Finally, three proof‐of‐concept demonstrations illustrate the potential of the reported multimodal haptic devices for advanced haptic interactions across various domains.

Fabrication and Characterization of Pneumatic Unit Cell Actuators

In the realm of virtual and augmented reality (VR/AR) and teleoperation applications, haptic feedback plays a role in enhancing task performance. One of the main goals of this study is to simplify haptic device hardware while improving its capacity to provide various stimuli at different intensities. In response to these challenges, this research introduces the Pneumatic Unit Cell (PUC), a soft pneumatically driven device—a hollow silicone cylinder with the ability to provide both static-pressure and vibrotactile feedback. Furthermore, the Pneumatic Unit Cell’s design simplicity has the potential for scalability, modularity, and the flexibility to mount the device on any part of the human body. The focus of the current paper is to study PUCs as actuators and lay the foundation for future perceptual studies. The characterization studies encompass the fabrication and verification of the fabrication accuracy through dimensional measurements, characterizing PUCs under static-pressure conditions (measuring the free deflection and blocking force) and frequency conditions (measuring the free deflection). In the static-pressure conditions, we applied pressures ranging from 0 to 40 kPa to measure the free deflection and from 0 to 30 kPa to measure the blocking force. In the frequency conditions, we applied pressures of 10, 20, and 30 kPa with inflation/deflation rates varying between 0.5 Hz and 100 Hz. The measurements of free deflection under static-pressure conditions revealed that 0.9 mm and 1.2 mm PUCs exhibit a linear increase in free deflection with an increase in inflation pressure. The results of free-deflection measurements under the frequency conditions indicate a direct relationship between the free-deflection magnitude and applied pressure. The results also demonstrate an inverse relationship to the frequency of inflation/deflation. The characterization results demonstrate a broad range of free deflection observed under both static-pressure and frequency conditions, encouraging the potential application of Pneumatic Unit Cell actuators as haptic devices.

Human Resource Management Analysis in the AR/VR Industry: A Case Study on Meta Company

This research paper delves into the complex landscape of human resource (HR) management within the Augmented Reality and Virtual Reality (AR/VR) industry, using Meta Company as a prime focal point. The study thoroughly examines key challenges facing the industry, including critical skill gaps, mismatches in talent demand and supply, high rates of employee turnover, and the intricacies of cross-cultural management. It delves into the various methods employed for recruitment and selection, the strategies implemented for training and development, and the initiatives taken for effective employee retention within the AR/VR industry. The findings of this study reveal that despite the unique and rapidly evolving challenges of the AR/VR landscape, deploying effective and strategic HR management can significantly enhance talent acquisition, foster skill development, and ensure successful retention of employees. This research paper contributes valuable academic and practical insights to the understanding and management of human resources in the burgeoning field of AR/VR, providing a comprehensive perspective that could potentially facilitate sustainable growth and development within the industry.

NEW CONTENT OF EDUCATION FOR FUTURE OCCUPATIONAL SAFETY SPECIALISTS IN MODERN CONDITIONS

Purpose. To develop proposals and recommendations for the modern digital technology tools usage in the educational process in the training of bachelors and masters in the educational and professional program «Occupational Safety and Health», specialty 263 «Civil Security» to improve the quality of education, taking into account the requirements of the labor market. Methodology. General scientific (comparison, classification, generalization, systematization) and empirical (observation, search, description, analysis, SWOT analysis) research methods were used. Results. As a result of the literature review, new learning technologies were analyzed: virtual and augmented reality (VR/AR) technologies containing educational games and behavioral simulation, artificial intelligence, cloud technologies, video instructions, which allow to eliminate the discrepancy between the required and existing competencies of future occupational safety and health specialists. A SWOT analysis was conducted to assess the main problems and risks of introducing modern digitalization tools into the educational process when teaching under the educational and professional program «Occupational Safety and Health». During the analysis of cases of digital technologies use, data that allowed us to identify the weaknesses and strengths of technologies have been obtained, the possibilities of their application and the threats that all participants in the educational process may face in modern conditions have been determined. With the proper use of the potential of technology, all participants will be able to achieve the desired results by increasing labor productivity, improving work processes, effectively building a labor management system, and deepening the professional competencies of their employees and future specialists. Scientific novelty. The article shows the use of modern digital technologies: virtual and augmented reality (VR/AR), artificial intelligence, cloud technologies to solve problems in the training of future occupational safety and health specialists under martial law, taking into account modern labor market requirements. Practical significance. Increasing the level of modern digital technologies application by all participants in the educational process under the educational and professional program «Occupational Safety and Health» will help to improve the quality of education under martial law and increase the professional level of future specialists. Keywords: digitalization, digital learning technologies, educational process, occupational safety and health, SWOT analysis.

Automated system of monitoring professional skills development of food production operators based on a computer simulator

Research is devoted to the development of a computer simulator complex (CSC) to develop the professional skills of food production operators. The structure (conceptual model) of CSC for training of food production operators is developed, the distinctive features of which for solving the problem of professional training of operators is the integration of the simulator, which allows to reproduce real technological processes of food production for training purposes, with the automated information system (AIS) of control over the formation of professional skills in the course of exercise courses on CSC. The sets of parameters that determine: the structure and properties of the technological operation modeled in the exercise on CSC for the generation of individual exercise variants; the actions performed by the trainee in the exercise depending on the features of the simulated technological operation with the use of physical models of real equipment or elements of virtual and augmented reality (VR/AR); evaluation of the process and results of the exercise in the virtual automated training environment CSC are described. The application of CSC in the training process allows to flexibly customize exercises for professional training of operators of different branches of food industry (meat, dairy, bakery, confectionery, etc.), which helps to improve the quality of training results, as well as to reduce the labor intensity of creating and controlling the implementation of training courses in CSC by operators.

Pose2Gaze: Eye-Body Coordination During Daily Activities for Gaze Prediction From Full-Body Poses.

Human eye gaze plays a significant role in many virtual and augmented reality (VR/AR) applications, such as gaze-contingent rendering, gaze-based interaction, or eye-based activity recognition. However, prior works on gaze analysis and prediction have only explored eye-head coordination and were limited to human-object interactions. We first report a comprehensive analysis of eye-body coordination in various human-object and human-human interaction activities based on four public datasets collected in real-world (MoGaze), VR (ADT), as well as AR (GIMO and EgoBody) environments. We show that in human-object interactions, e.g. pick and place, eye gaze exhibits strong correlations with full-body motion while in human-human interactions, e.g. chat and teach, a person's gaze direction is correlated with the body orientation towards the interaction partner. Informed by these analyses we then present Pose2Gaze- a novel eye-body coordination model that uses a convolutional neural network and a spatio-temporal graph convolutional neural network to extract features from head direction and full-body poses, respectively, and then uses a convolutional neural network to predict eye gaze. We compare our method with state-of-the-art methods that predict eye gaze only from head movements and show that Pose2Gaze outperforms these baselines with an average improvement of 24.0% on MoGaze, 10.1% on ADT, 21.3% on GIMO, and 28.6% on EgoBody in mean angular error, respectively. We also show that our method significantly outperforms prior methods in the sample downstream task of eye-based activity recognition. These results underline the significant information content available in eye-body coordination during daily activities and open up a new direction for gaze prediction.

Practical Aspects of Hotel and Restaurant Business Development in Ukraine Based on the Use of the jSolutions Restaurant Module

The article conducts a practical study of the aspects of the development of the hotel and restaurant business in Ukraine and reviews the jSolutions module «Restaurant». Its functionality, main characteristics and advantages in comparison with other software solutions for the restaurant business (RB) are described. The main aspects of the dynamics of development of the RB are allocated, which includes: introduction of POS-systems; online ordering and delivery; use of CRM systems; analytics and Big Data; social media and digital marketing; virtual and augmented reality (VR/AR), kitchen automation and inventory, cybersecurity. A list of functions provided by the jSolutions module «Restaurant» is provided. It is noted that the module consists of two parts: BACK OFFICE and FRONT OFFICE. BACK OFFICE allows users to create calculation cards, create menus, set up outlets for implementation in FRONT OFFICE, works with invoices and orders. It is also possible to set up a discount or bonus system for visitors to the establishment. Users of FRONT OFFICE are bartenders, cashiers or administrators who work in TouchScreen mode, taking orders from visitors, creating invoices and settling customers. The module includes 4 TouchScreen modes, each of which is designed for different aspects of work, namely: automation of the cook’s workplace (the cook can mark the preparation of each dish to order, which helps to optimize the process of work in the kitchen and ensures timely processing of orders); TouchScreen self-service (the interface allows users to independently create orders from the menu without the help of a waiter, cashier or administrator); Cashier’s TouchScreen (the interface allows the bartender, cashier or administrator to create a customer account and make payments on this account); Waiter’s TouchScreen (the interface is used to record food orders and their delivery). Such additional unique functions of the jSolutions «Restaurant» module as «Cash Collection», «Cancellation of Bills», «Table Reservation», «WEB-Interface for Ordering Meals» (the functionality is intended for registration in the database of food orders in places where the desktop version of jCatering is not installed), «Mobile version of the waiter’s workplace», etc. Attention is focused on the fact that IT significantly affects the increase in restaurant revenues due to the optimization of operations, improvement of the quality of service, effective marketing and expansion of sales channels. Investing in modern IT solutions will help restaurants stay competitive, improve operational efficiency, and ensure sustainable revenue growth.

Navigating the Future Landscape of Gamified Education

Gamified education is undergoing a transformative shift, heralding a new era in the landscape of learning. This evolution is characterized by the advent of personalized learning experiences, underpinned by artificial intelligence (AI), and the seamless integration of virtual and augmented reality (VR/AR) technologies. These trends are not merely additive but are synergistically enhancing the learning experience, making it more dynamic, engaging, and effective than ever before. Personalized learning through AI is at the forefront of this transformation. AI algorithms are being leveraged to tailor educational content to the individual learner’s needs, preferences, and learning pace. This ensures that each student receives a customized learning experience that is optimized for their personal learning journey, maximizing engagement and efficacy. The integration of VR and AR technologies into gamified education is another significant trend. These technologies provide immersive learning environments that can simulate real-world scenarios or abstract concepts, thereby facilitating a deeper understanding and retention of knowledge. VR and AR make learning more interactive and enjoyable, which in turn, increases motivation and engagement among learners. Data-driven insights are playing a crucial role in the evolution of gamified education. By analyzing data on learner performance and behavior, educators can gain valuable insights into the effectiveness of teaching strategies and learning materials. This enables continuous improvement of the learning experience, ensuring that it remains relevant, engaging, and effective. Ethical considerations are paramount as gamified education continues to evolve. Issues such as privacy, data security, and equitable access to educational technologies are critical and must be addressed to ensure that gamified education benefits all learners, without compromising their rights or well-being. As technology, pedagogy, and game design converge, gamified education is evolving from a passive to an active, participatory model. This transformation empowers students to take charge of their educational journeys, offering a path to personalized, engaging, and data-driven learning experiences. The future of gamified education promises to be dynamic and inclusive, reshaping the future of learning in profound ways.

Determining the effects of AR/VR HMD design parameters (mass and inertia) on cervical spine joint torques

This study aimed to determine gravitational and dynamic torques and muscle activity of the neck across a series of design parameters of head mounted displays (mass, center of mass, and counterweights) associated with virtual and augmented reality (VR/AR). Twenty young adult participants completed five movement types (Slow and Fast Flexion/Extension and Rotation, and Search) while wearing a custom-designed prototype headset that varied the three design parameters: display mass (0, 200, 500, and 750 g), distance of the display's center of mass in front of the eyes (approximately 1, 3, and 5 cm anteriorly), and counterweights of 0, 166, 332, and 500 g to balance the display mass of 500 g at 7 cm. Inverse dynamics of a link segment model of the head and headset provided estimates of the torques about the joint between the skull and the occiput-first cervical vertebrae (OC1) and joint between the C7 and T1 vertebrae (C7). Surface electromyography (EMG) measured bilateral muscle activity of the splenius and upper trapezius muscles. Adding 750 g of display mass nearly doubled root mean square joint torques across all movement types. Increasing the distance of the display mass in front of the eyes by 4 cm increased torques about OC1 for the Slow and Fast Rotation and Search movements by approximately 20%. Adding a counterweight decreased torques about OC1 during the rotation and search tasks but did not decrease the torques experienced in the lower cervical spine (C7). For the flexion/extension axis, the magnitude of the dynamic torque component was 20% or less of the total torque experienced whereas for the rotation axis the magnitude of the dynamic torque component was greater than 50% of the total torque. Surface EMG root mean square values significantly varied across movement types with the fast rotation having the largest values; however, they did not vary significantly across the headset configurations.

Shaping the auditory peripersonal space with motor planning in immersive virtual reality

AbstractImmersive audio technologies require personalized binaural synthesis through headphones to provide perceptually plausible virtual and augmented reality (VR/AR) simulations. We introduce and apply for the first time in VR contexts the quantitative measure called premotor reaction time (pmRT) for characterizing sonic interactions between humans and the technology through motor planning. In the proposed basic virtual acoustic scenario, listeners are asked to react to a virtual sound approaching from different directions and stopping at different distances within their peripersonal space (PPS). PPS is highly sensitive to embodied and environmentally situated interactions, anticipating the motor system activation for a prompt preparation for action. Since immersive VR applications benefit from spatial interactions, modeling the PPS around the listeners is crucial to reveal individual behaviors and performances. Our methodology centered around the pmRT is able to provide a compact description and approximation of the spatiotemporal PPS processing and boundaries around the head by replicating several well-known neurophysiological phenomena related to PPS, such as auditory asymmetry, front/back calibration and confusion, and ellipsoidal action fields.