Unity Platform Research Articles

Exploring the SoundVizVR Plugin in the Development of Sound-Accessible Virtual Reality Games: Insights from Game Developers and Players

Based on a virtual reality (VR) sound visualization indicator system named “SoundVizVR” proposed and evaluated in previous research, we developed a plugin for the Unity platform, enabling developers to adopt the SoundVizVR system in their VR applications and games. Next, we worked with two VR game developers to explore the usability of the plugin and how it impacted the view on accessibility from the game developers’ perspectives. The developers used the plugin for one week to integrate it into their current projects or design new games with the plugin. Then, we recruited ten Deaf or Hard-of-Hearing (DHH) participants and five hearing participants to play the two developed VR games to evaluate the user experience and effectiveness of the SoundVizVR system in advancing audio accessibility in VR games. According to the findings of the study process, we provide game design practices for making sounds in VR games accessible and suggestions on optimizing the developers’ and players’ experiences of a sound accessibility plugin for the Unity platform.

PENGEMBANGAN MEDIA PEMBELAJARAN BERBABIS PERMAINAN DIGITAL ”BARET” BERDASARKAN KEMAMPUAN PENALARAN MATEMATIS BERBANTUAN UNITY

Effective education that supports future development is the type of education that focuses on developing students' abilities. Developing digital game-based learning media can be an innovative choice to expand digital media and add variety to the learning process, especially in mathematics education. This digital media development uses the Unity platform and follows the Research and Development (RD) method with the 4D model. The research results show that the development of the "baret" digital game media is very practical, as evidenced by the assessments from media and content experts, and the majority of students also find this media very practical to use in the teaching and learning process.

Transformasi digital museum seni rupa berbasis 3D virtual tour interaktif dengan Unity

Affandi Museum, located on the banks of the Gajah Wong River at Jalan Laksda Adisucipto No. 167, Yogyakarta, occupies a strategic location that is easily accessible to both domestic and international tourists. However, the museum currently lacks a virtual version for remote visits. To remain relevant and accessible to the digital generation, this research aims to transform Affandi Museum into a 3D Virtual Tour and develop its interactivity using the prototype method. This approach allows for rapid and iterative development, focusing on interactive elements such as navigation, pop-up information, and audio guides, using the Unity platform. Usability testing involves various users to ensure an intuitive interface and optimal experience, resulting in highly valued aspects such as ease of navigation, visual quality, and interactively presented information, with an average rating of 4.7/5. This digital transformation enables Affandi Museum to reach a wider audience and strengthen its position as a center of cultural and art education.

The Design of the Nusantara Quest Game on Mobile Platforms for the Cultural Arts Subject for Grade X Students

This research aims to design a mobile-based game called Nusantara Quest to enhance student engagement and learning outcomes in Arts Education for 10th-grade students. The educational game is developed using the Unity platform and follows the ADDIE model (Analyze, Design, Development, Implementation, Evaluation). The analysis phase involves studying student characteristics and material needs. During the design phase, game flow, user interface, and educational content are created. The development phase includes game creation and validation by media and content experts. Implementation involves trials with students from SMK Negeri 5 Sidrap, and the evaluation phase assesses the effectiveness of the game in improving student interest and understanding of Arts Education material. The research findings indicate that the quiz-based educational game is valid and effective as an interactive learning media S

Study on the Development of a Virtual Reality Application for Skeletal Anatomy Learning Using Rapid Application Development (RAD)

The use of innovative multimedia technology continues to evolve and has now become a primary technology tool in education. Currently, the utilization of virtual reality (VR) technology is being used as an immersive medium for learning, especially in the field of medicine. Immersive technology is presented in 3D visualization, approaching real and relevant objects in medical education as an alternative to traditional teaching aids such as cadavers. In this research, an exploration of the VR environment was conducted in a case study of the skeletal system using 3D skull bone objects. The exploration involved tasks such as preparing the 3D skull bone object data assets in the 3D development environment, exporting data assets to the 3D-VR environment, and configuring aspects related to visualization and object control based on visual C#. So far, documentation of the 3D-VR application development environment and the trial results of the case study object development on the Unity platform have been produced. Additionally, documentation of the interface design application using Rapid Application Development (RAD) has also been generated. The Android-based VR application has functioned well in accommodating the skull object, designed with 3 layers of the skeletal system adjusted to their respective depths. The skull consists of 22 components, including cranium.

Bio-Inspired Intelligent Swarm Confrontation Algorithm for a Complex Urban Scenario

This paper considers the confrontation problem for two tank swarms of equal size and capability in a complex urban scenario. Based on the Unity platform (2022.3.20f1c1), the confrontation scenario is constructed featuring multiple crossing roads. Through the analysis of a substantial amount of biological data and wildlife videos regarding animal behavioral strategies during confrontations for hunting or food competition, two strategies are been utilized to design a novel bio-inspired intelligent swarm confrontation algorithm. The first one is the “fire concentration” strategy, which assigns a target for each tank in a way that the isolated opponent will be preferentially attacked with concentrated firepower. The second one is the “back and forth maneuver” strategy, which makes the tank tactically retreat after firing in order to avoid being hit when the shell is reloading. Two state-of-the-art swarm confrontation algorithms, namely the reinforcement learning algorithm and the assign nearest algorithm, are chosen as the opponents for the bio-inspired swarm confrontation algorithm proposed in this paper. Data of comprehensive confrontation tests show that the bio-inspired swarm confrontation algorithm has significant advantages over its opponents from the aspects of both win rate and efficiency. Moreover, we discuss how vital algorithm parameters would influence the performance indices.

Neural Network-Based Detection of OCC Signals in Lighting-Constrained Environments: A Museum Use Case

This research presents a novel approach by applying convolutional neural networks (CNNs) to enhance optical camera communication (OCC) signal detection under challenging indoor lighting conditions. The study utilizes a smartphone app to capture images of an LED lamp that emits 25 unique optical codes at distances of up to four meters. The developed CNN model demonstrates superior accuracy and outperforms traditional methodologies, which often struggle under variable illumination. This advancement provides a robust solution for reliable OCC detection where previous methods underperform, particularly in the tourism industry, where it can be used to create a virtual museum on the Unity platform. This innovation showcases the potential of integrating the application with a virtual environment to enhance tourist experiences. It also establishes a comprehensive visible light positioning (VLP) system, marking a significant advance in using CNN for OCC technology in various lighting conditions. The findings underscore the effectiveness of CNNs in overcoming ambient lighting challenges, paving the way for new applications in museums and similar environments and laying the foundation for future OCC system improvements.

Virtual reality cricothyrotomy - a case-control study on gamification in emergency education

BackgroundCricothyrotomy is an invasive and rare emergency intervention to secure the airway in a “cannot intubate, cannot ventilate” situation. This leads to lack of routine. Cricothyrotomy is performed only hesitantly. Therefore, we aim to improve teaching by including a virtual reality (VR) cricothyrotomy as a learning tool.MethodsWe programmed the VR cricothyrotomy in the C# programming language on the open-source Unity platform. We could include 149 students that we randomly assigned to either a study group (VR cricothyrotomy) or control group (educational video). We asked the study group to subjectively rate the VR cricothyrotomy. To evaluate our intervention (VR cricothyrotomy) we took the time participants needed to perform a cricothyrotomy on a plastic model of a trachea and evaluated the correct procedural steps.ResultsThe majority of students that performed the VR simulation agreed that they improved in speed (81%) and procedural steps (92%). All participants completed the cricothyrotomy in 47s ± 16s and reached a total score of 8.7 ± 0.7 of 9 possible points. We saw no significant difference in time needed to perform a cricothyrotomy between study and control group (p > 0.05). However, the total score of correct procedural steps was significantly higher in the study group than in the control group (p < 0.05).ConclusionsVirtual reality is an innovative learning tool to improve teaching of emergency procedures. The VR cricothyrotomy subjectively and objectively improved correct procedural steps. Digitized education fills an educational gap between pure haptic experience and theoretical knowledge. This is of great value when focusing on extension of factual knowledge.Trial registrationDRKS00031736, registered on the 20th April 2023.

Development of Mobile App as an Educational Tool for Understanding Nanomedicine

Nanomedicine, an emerging field at the intersection of nanotechnology and medicine, holds great promise for revolutionizing healthcare by enabling targeted diagnostics and treatments at the molecular level. However, due to its complex nature, understanding nanomedicine concepts and applications can be challenging for healthcare professionals, researchers, and the general public. To bridge this knowledge gap and promote awareness, a mobile application was developed to enhance the understanding of nanomedicine, and named it "MyNanoRia". The MyNanoRia was developed by initially designing suitable content, compiling information and creating the apps using Unity platform, specifically for the Android operating system. The MyNanoRia provides users with readily available knowledge about nanomedicine's concepts, methods, and applications as an interactive educational tool. Specific facets of nanotechnology, nanomedicine, nanomaterials, and cancer are covered in this app. MyNanoRia also includes definitions for particular keywords. This app's creation required consulting and validation by subject-matter specialists, such as chemists, biologists, and medical scientists. The development of MyNanoRia is challenging since nanotechnology is a multidiscipline topic that indeed emphasizes scientific understanding, but the intended users are those who know little to nothing about it. Creating the MyNanoRia app for understanding nanomedicine seeks to close the knowledge and awareness gap between science and the general public, enabling researchers, healthcare professionals, and the general public to fully value nanotechnology's potential in healthcare.

Pengembangan Aplikasi Augmented Reality sebagai Media Pembelajaran Anatomi Tubuh Manusia Berbasis Android

Augmented reality (AR) provides intriguing opportunities to enhance the learning experience by merging the real world with interactive virtual elements. This research aims to develop an interactive learning application using augmented reality technology to introduce human body anatomy in a more engaging manner. The development method follows the waterfall system with stages of needs analysis, design, implementation, and testing. The researcher employs UML models, flowcharts, and wireframes in the system analysis and design. The application is built on the Unity platform with AR plugins such as Vuforia and ARCore. The AR model utilized in this development involves marker-based tracking and markerless tracking. Testing is conducted to measure the success level of the application, employing black box testing methods to ensure the application's usability without issues. The outcome of this research is an Android-based human body anatomy learning application utilizing augmented reality technology, with the expectation that it will facilitate a better understanding of the human anatomy system.

Концепция верификации работы клеточных автоматов при вариации геометрических решёток для модели диффузионного процесса

The methodology of cellular automata occupies one of the key positions in the discrete dynamic simulations. The adequacy of the results of solving applied problems is largely determined by the choice of the type of geometric lattice of the cellular automaton. The article presents a formalization and numerical verification of the concept of verification of the operation of a cellular automata model of the classical diffusion process for a set of basic two-dimensional geometric lattices. The approach is based on a direct comparison of the space-time solution of the diffusion equation obtained by the finite element method with the solution of a discrete analogue of this equation based on the operation of a cellular automata algorithm. The software implementation of the cell-automation was performed with the C+ using the Unity platform while the finite element solution of the evolutionary problem of mathematical physics was carried out using the Matlab tools. Cellular automaton lattices were constructed using various cell geometric primitives traditionally used in diffusion modeling applications. Obtained findings indicate that the hexagonal cellular automaton demonstrates the minimum error in the numerical implementation.

Augmented Reality Knowledge Management for Industrial Transformation and Innovation

In today’s global industry characterised by increasing competition, the knowledge and skills possessed by experienced human operators play a crucial role in a company’s business operation. The retirement of qualified operator from an organisation often leads to a substantial disruption in its operational effectiveness. As a result, companies working in the engineering sector strive to provide the necessary training to as many employees as possible. A qualified operator has to devote a portion of his/her time to employee training, which costs the business time and resources. Furthermore, industrial organisations face difficulties in efficiently monitoring operators’ performance in certain jobs. Traditional paper-based, or more recently video instructions and time-tracking software are used in companies, but each has limits and may not fully meet the company’s unique requirements. This is the rationale behind the creation of an application that uses emerging augmented reality technologies to capture and disseminate knowledge. In order to accomplish this goal, the paper reports research carried out using the Microsoft Dynamics 365 Guides for knowledge management application, drawing upon insights obtained from a thorough case study. The process allowed for the recognition of shortcomings and areas requiring improvement, resulting in the development of an exclusive application on the Unity platform, which was carefully created to provide maximum user friendliness.

Virtual 3D Simulation Technology for Interprofessional Team Training

Background In the hospital, interprofessional team members must work collaboratively. That creates a gap in medical practice, particularly in a hectic emergency that may lead to medical errors, with associated ethical, legal, and financial consequences. Mannequin-based simulation can be a solution to bridge this gap in team training. While mannequin-based simulations are effective as a synchronous method, they are expensive, time and space-bound, use hospital resources, and require the whole team to be present. Objective To develop a prototype of a 3D virtual simulation emergency room (ER) environment for interprofessional team training. And to assess the usability of the prototype in a simulation environment for team training using a clinical scenario. Methods Tools and technologies used for this prototype included the Unity platform, C# programming language, and Photon Voice 2. With 3DS Max, we modified and created 3d assets in the ER simulation room. Adobe XD was used to create interactive prototype iterations. Clinical cases were developed with simple algorithms to prove the concepts. We used complex algorithms with Artificial Intelligence and Machine Learning capabilities for the final product. We conducted two usability tests (n = 10, n = 9) using a think-aloud method, a semi-structured follow-up interview, and a survey. Results A prototype was built to achieve asynchronous team training with easy user access from anywhere in the world. The prototype, which includes voice communication and control of the avatars by players from a distance, supported the usability of the technology for asynchronous team training in health education. Conclusions CyberPatientER can be used as an additional tool to support team training and communication skills in the health education and healthcare environment.

Augmented reality guided autonomous assembly system: A novel framework for assembly sequence input validations and creation of virtual content for AR instructions development

In recent years, industries are striving to adapt immersive technologies in the real-time assembly shop floor setting to achieve effective outcomes in terms of enabling the worker to handle the complex cognitive assembly task execution/training circumstances. The manufacturers are presently facing difficulties with the process of Augmented reality (AR) instruction creation for the required product assembly system. The existing AR instruction development process demands highly skilled experts and more time consumption. Hence, the manufacturers are presently relying on third parties to acquire the required AR instructions by providing the necessary assembly particulars as input. Where, the cost of developing AR instruction is another big challenging concern. Predominantly, the significance of providing exact assembly input is vital for the experts to develop the appropriate AR content without any errors. An automated approach is developed in this study to resolve the difficulties with assembly sequence input for the AR instructions development process. The automated approach affords four different provisions that include validation of an assembly sequence input prior to the AR instructions development stage, suggestions for assembly sequence input generation, simulation of validated assembly sequence in the Virtual reality (VR) environment for user perception, and generation of virtual content for AR visualizations. Subsequently, the generated digital contents from the automated approach are imparted into the AR Unity platform to develop the required AR instructions for the product assembly system. Notably, this study explores the AR customized marker technique to visualize the AR content in the user’s view of the physical context. Finally, the AR guidelines are built as apps for the selected 11-part assembly and deployed on the shop floor for the user to perceive the AR content through visualization devices for execution of assembly operations in a real-time context. In addition, the effectiveness of the automated approach is analyzed with the existing approach, and the consequences are explored through the process of receiving feedback from the experts about the error rate, cognitive level, and creation time.

Using EtherCAT technology to launch online automated guided vehicle manipulation with unity‐based platform for smart warehouse management

AbstractIn Industry 4.0, the innovative concept of a smart warehouse is defined as a progressive development in logistics and operations management. Numerous advanced techniques are recommended for integration, including wearable devices, communication, loading/unloading, optimization, robotics, and automated transportation, among others. Currently, the growing demand for swift cargo distribution, cost‐effective labour utilization, and enhanced productivity stands as an urgent topic for both enterprises and scholars. This paper presents an EtherCAT‐based model of automated guided vehicle (AGV)‐manipulation introduced within the Unity platform for smart warehouse management. The working environment selected for this model is a cross‐docking warehouse with a chessboard layout. Initially, theoretical computations pertaining to mechanical design are established to provide accurate parameters. Subsequently, the structure of the TwinCAT Human–Machine Interface Server and the configuration within the Unity environment are outlined. Following that, the software architecture, encompassing data exchange and a set of motion commands, is meticulously explained. To validate the proposed approach, several laboratory tests are conducted under identical conditions. This research offers several contributions: firstly, it introduces the innovative use of real‐time technology to represent AGV systems; secondly, it elucidates the potential connection between virtual reality and the physical model; and thirdly, it employs fluid motion techniques to illustrate and visualize driving performance. These findings hold significant promise not only for the advancement of smart warehouse management but also for the broader landscape of digital trade.

A novel intelligent collision avoidance algorithm based on deep reinforcement learning approach for USV

Enhancing the efficiency of unmanned surface vehicles (USVs) collision avoidance can yield a significant impact, as it can result in safer navigation and lower energy consumption. This paper introduces a robust approach employing deep reinforcement learning theory to facilitate informed collision avoidance decisions within intricate maritime environments. The restrictions on USV maneuverability and international regulations for preventing collisions at sea are studied and quantified, particularly focusing on the shape and size changes of the ship’s domain caused by USV speed. Based on the deep Q network, an improved methodology is designed, incorporating a noisy network, prioritized experience replay, dueling neural network architecture, and double Q learning, resulting in a highly efficient sampling, exploration, and learning process. To curtail computational expenses associated with USVs, a novel dynamic area restriction technique is proposed. Furthermore, an innovative USV state clipping method is introduced to mitigate training complexities. By utilizing the Unity platform, a virtual environment characterized by complexity and stochasticity is constructed for training and testing the collision avoidance of USVs This novel approach surpasses the performance of the pre-improvement algorithm across multiple collision avoidance effectiveness indicators and performance metrics.

An Agent-Based Modeling and Virtual Reality Application Using Distributed Simulation: Case of a COVID-19 Intensive Care Unit.

Hospitals and other healthcare settings use various simulation methods to improve their operations, management, and training. The COVID-19 pandemic, with the resulting necessity for rapid and remote assessment, has highlighted the critical role of modeling and simulation in healthcare, particularly distributed simulation (DS). DS enables integration of heterogeneous simulations to further increase the usability and effectiveness of individual simulations. This article presents a DS system that integrates two different simulations developed for a hospital intensive care unit (ICU) ward dedicated to COVID-19 patients. AnyLogic has been used to develop a simulation model of the ICU ward using agent-based and discrete event modeling methods. This simulation depicts and measures physical contacts between healthcare providers and patients. The Unity platform has been utilized to develop a virtual reality simulation of the ICU environment and operations. The high-level architecture, an IEEE standard for DS, has been used to build a cloud-based DS system by integrating and synchronizing the two simulation platforms. While enhancing the capabilities of both simulations, the DS system can be used for training purposes and assessment of different managerial and operational decisions to minimize contacts and disease transmission in the ICU ward by enabling data exchange between the two simulations.

Three-Dimensional Cellular Automaton for Modeling of Self-Similar Evolution in Biofilm-Forming Bacterial Populations

Bacterial populations often form colonies and structures in biofilm. The paper aims to design suitable algorithms to simulate self-similar evolution in this context, specifically by employing a hybrid model that includes a cellular automaton for the bacterial cells and their dynamics. This is combined with the diffusion of the nutrient (as a random walk), and the consumption of nutrients by biomass. Lastly, bacterial cells divide when reaching high levels. The algorithm computes the space-time distribution of biomass under limited nutrient conditions, taking into account the collective redistribution of nutrients. To achieve better geometry in this modified model approach, truncated octahedron cells are applied to design the lattice of the cellular automaton. This allows us to implement self-similar realistic bacterial biofilm growth due to an increased number of inner relations for each cell. The simulation system was developed using C# on the Unity platform for fast calculation. The software implementation was executed in combination with the procedure of surface roughness measurements based on computations of fractional dimensions. The results of the simulations qualitatively correspond to experimental observations of the population dynamics of biofilm-forming bacteria. Based on in silico experiments, quantitative dependencies of the geometrical complexity of the biofilm structure on the level of consumed nutrients and oxygen were revealed. Our findings suggest that the more complex structure with a fractal dimension of the biofilm boundaries (around 2.6) corresponds to a certain range of nutrient levels, after which the structure degenerates and the biofilm homogenizes, filling the available space provided and tending towards a strictly 3D structure. The developed hybrid approach allows realistic scenario modeling of the spatial evolution of biofilm-forming bacterial populations and specifies geometric characteristics of visualized self-similar biofilm bacterial structures.

ВИРТУАЛЬНЫЙ СТЕНД ДЛЯ РЕАЛИЗАЦИИ ПРОЦЕДУРЫ ПОВЕРКИ РАСХОДОМЕРОВ

Development of a virtual bench for verification of flowmeters based on the UNITY platform, taking into account the actual operating conditions of the verification facility

Implementasi Generate Map dan Pemunculan Objek secara Acak pada Game 3D menggunakan Bahasa C# dan Metode Perlin Noise di Unity: Studi Kasus pada Game Development

&lt;p&gt;&lt;span style="text-decoration: underline;"&gt;&lt;em&gt;Perlin noise algorithm is used to generate noise on the map surface, creating natural effects in 3D games. In this research, a C# script code has been implemented in Unity that can generate maps and spawn random objects in the game. The research results demonstrate that the implementation of map generation and random object spawning techniques can enhance gameplay quality and provide a more immersive playing experience for users. This research aims to contribute to game development on the Unity platform as well as the development of map This research explores the implementation of procedural content generation (PCG) techniques using C# programming language and Perlin noise method in Unity to generate map and random object spawning in 3D games. The main objective of this research is to develop PCG techniques that can be applied to game development. The generation and random object spawning techniques in 3D games using Perlin noise method.&lt;/em&gt;&lt;/span&gt;&lt;/p&gt;