Unity3D Software Research Articles

HeritageRoots: Developing Interconnected Immersive Experiences for Cultural Preservation and Education

In this paper, we present technical implementation details, describe the virtual world procedural generation pipeline, and discuss potential uses in cultural preservation, museum exhibits, and education of HeritageRoots, an innovative software infrastructure designed for preserving indigenous narratives and oral histories. HeritageRoots consists of two interconnected systems - (1) a web-based knowledge graph (KG) data collection and management system which stores, connects, and presents indigenous traditional knowledge (ITK) in the form of narratives, myths, and testimonies from multiple cultures and languages; (2) a virtual environment rendering pipeline which utilizes large language models (LLM), Unity3D, and Meta Quest software development kit (SDK) to procedurally generate virtual worlds from the KG data. Preliminary system evaluation with Ecuadorian Kichwa narratives showed promising results in (1) academic community interest and support, (2) the possibility of developing an infrastructure capable of connecting indigenous narratives with modern scientific knowledge via KGs and (3) procedurally generating virtual worlds from KG.

Virtual Reality Software: empowering tourism marketing through technology

ABSTRACT The dynamic evolution of consumer demands in the tourism sector necessitates continual adaptation and innovation in marketing strategies to counter increasing competitiveness. To address these shifts, emerging technologies play a pivotal role. This study focuses on the investigation of Information and Communication Technologies (ICTs) in shaping tourism marketing, culminating in the development of Tour View 360° software. Employing qualitative research methods, including bibliographical analysis and technological prospecting, the study identified prerequisites for the software's creation. Leveraging the Scrum framework for its adaptability, the software was meticulously designed using C# programming language with Unity 3D software. Findings reveal the early-stage adoption of interactive virtual reality technologies for promoting tourism. Nonetheless, Tour View 360° emerges as an innovative tool. The study comprehensively details the software's attributes, functionalities, interfaces, requirements, usability configurations, and final modeling, offering insights into ICT integration in enhancing tourism marketing strategies.

Design and teaching application of a virtual simulation training system for bridge engineering drawing recognition based on Unity3D

In response to the common issues in practical training in vocational engineering construction courses, such as dangerous operation of training equipment, insufficient number of training equipment, and ineffective teaching, a vivid and interactive virtual simulation training system was developed using Unity3D software, taking the U-shaped bridge abutment in the course of Bridge Engineering as an example. Detailed introduction to the development and design process of 3D model establishment, ZSpace device adaptation, file format conversion, model rendering and disassembly, model zooming in and out, script writing and function implementation, UI interface design, etc., in order to achieve immersive interaction functions such as free observation, assembly disassembly, and ZSpace integrated VR virtual experience in the virtual simulation training system. The practical results show that the interactive effect simulated through the simulation training system is superior to that of the physical system, which can enhance the sense of experience, improve learning enthusiasm, and deepen the understanding of the knowledge points in Bridge Engineering Drawing Recognition. After the system is successfully established and applied in the training and teaching process, it will provide an important reference for the training and teaching of relevant courses for students majoring in road and bridge engineering, and also enhance the cultivation of high-quality skilled personnel in engineering majors in vocational colleges.

Real-time Finite Element Analysis based on surrogate model

In the field of engineering, Finite Element Analysis (FEA) serves as a pivotal numerical simulation tool. Nevertheless, its inherent offline nature and dependency on real-time data pose limitations on its versatility. To confront this challenge, a real-time FEA approach centered on surrogate modeling has been developed. This method enables the instantaneous prediction of critical performance parameters, thereby providing crucial support for real-time decision-making and process monitoring. In the context of this study, the focus is on the glass compression molding process, a process that is not easily observable. The research commences with preliminary thermal conduction simulations conducted using ABAQUS software. Subsequently, a surrogate model is constructed to facilitate real-time FEA for the temperature field of the glass preform. Finally, Unity 3D software is harnessed for visualization, offering an effective tool for the real-time monitoring and control of the glass-forming process.

Augmented Horizons: Development and Impact of Augmented Reality on Atmospheric Education

Educational media serve as a supporting component in learning, offering benefits to enhance student engagement, interactivity, and interest in learning. The media employed should align with current advancements in science and technology, one of which is Augmented Reality (3D), a medium capable of projecting virtual objects into reality. This study aims to 1) Produce an AR media design for high school geography education on atmospheric topics, 2) Determine the feasibility of using AR-based media for such geography education. The creation of the Augmented Reality (3D) educational media utilizes the Borg and Gall (1989) model, which comprises ten development steps. This media creation employs Unity 3D software and supporting applications such as Vuforia, Cinema 4D, and Corel Draw. The development of this educational media resulted in two products: a smartphone application (for Android and iOS) named Cloud AR and its accompanying book, both of which meet UNESCO standards. Based on the research findings, the developed educational media is deemed suitable for use, with a score of 85.16% and classified in the suitable category.

The system of headlights operation recognition using the digital twin method

Virtual digital representation of a physical object or system, created with precision through computer simulations, data analysis, and various digital technologies can be used as training set for real life situations. The principal aim behind creating a virtual representation is to furnish a dynamic, data-fueled, and digital doppelgänger of the physical asset. This digital counterpart serves multifaceted purposes, including the optimization of performance, the continuous monitoring of its well-being, and the augmentation of informed decision-making processes. Main advantage of employing a digital twin is its capacity to facilitate experimentation and assessment of diverse scenarios and conditions, all without impinging upon the actual physical entity. This capability translates into substantial cost savings and superior outcomes, as it allows for the early identification and mitigation of issues before they escalate into significant problems in the tangible world. Within our research endeavors, we've meticulously constructed a digital twin utilizing the Unity3D software. This digital replica faithfully mimics vehicles, complete with functioning headlamp toggles. Our lighting system employs polygons and normal vectors, strategically harnessed to generate an array of dispersed and reflected light effects. To ensure realism, we've meticulously prepared the scene to emulate authentic road conditions. For validation and testing, we integrated our model with the YOLO (You Only Look Once) neural network. A specifically trained compact YOLO model demonstrated impressive capabilities by accurately discerning the status of real vehicle headlamps. On average, it achieved an impressive recognition probability of 80%, affirming the robustness of our digital twin.

Augmented Reality Based Tajwid Reading Law Android Application

The learning method used in learning the subjects of the Qur'an and Hadith in Schools is a common teaching method, which uses books as a source of knowledge and teachers as teachers. In this problem, the author uses a learning method using Augmented Reality (AR) as the basic law of reading aloud so that students don't get bored. Augmented Reality (AR) is a combination of real and virtual objects displayed simultaneously on a screen. Augmented Reality is created with Unity 3D, Vuforia and Android software. The application of new learning methods should increase students' interest in serious and straightforward learning. This research aims to build a recitation science learning application for children 5-10 years old using an Android-based device "so that with this application it is hoped that it will have an attractive design, as well as complete features and have materials and examples of legal reading and pronunciation." easy for children to understand and can make children understand the science of recitation from a young age. The results of this research are applications for learning the science of Tajweed for children 5-10 years old which can display the hijaiyah letters accompanied by their pronunciation and how to pronounce them, the laws of the science of Tajweed which consist of the law of nun mati/tanwin, qalqalah and the law of mad, games as material for evaluating children. The Tajwid science learning application succeeded in increasing children's understanding of Tajweed science by 57.9%. Application feasibility testing uses white box and black box methods with several test requirements. Based on the test results, functionally the application is appropriate, feasible, and can be used as a learning medium for Tajwid science and is in the "Very Good" category.

Pengembangan Media Pembelajaran Interaktif Berbasis Android Pada Mata Pelajaran PJOK Untuk Siswa Kelas VII

This study aims to develop interactive learning media based on android in physical education, sports and health subjects for class VII SMP Tamansiswa Malang with the help of Unity 3D software. This study used the Borg & Gall Research and Development method. The subjects used were all students of class VII SMP Tamansiswa Malang. For data collection instruments in the form of observation, by observing the process of learning activities directly on subjects of physical education, sports, and health on health material. This research was validated by physical education, sports and health learning experts, learning media experts, and physical education, sports and health teachers for class VII SMP Tamansiswa with a very decent category. Then the results of the overall product trial involving all VII grade students of Tamansiswa Malang Middle School were divided into two small group trials with a sample of 10 students obtaining 83.37% results and large group trials with all VII grade students obtaining 95.34% results so very worthy. Based on the data that has been obtained, it can be concluded that the android-based interactive learning media developed for class VII students of SMP Tamansiswa Malang is categorized as very feasible and can be used without revision.

Research on Teaching Methods of Integrating Watercolor Techniques and Information Technology in Higher Education Art Education

Abstract Watercolor painting is a visual and creative discipline, which is closely related to the development of digital technology, which also affects the methods and means of basic art education in China. In this paper, we detect the trajectory of gesture movement after preprocessing the gesture data collected from students in watercolor painting using a Leap Motion sensor. We use Euclidean distance and nearest neighbor laws to identify and classify gesture movements in order to recognize students’ gesture movements in art education. Then, the virtual interactive system is designed with Unity 3D software, and finally, the art teaching method combining watercolor techniques and information technology is established. The results of teaching practice show that the level of students’ watercolor technique skills in all dimensions under innovative teaching is much higher than that of students under traditional teaching, and the significance values are all less than 0.05, which indicates that the use of VR technology has a very obvious impact on the teaching of watercolor painting. Meanwhile, the scores of students’ watercolor painting works were also improved with the assistance of VR technology. This study can provide a case reference for the subsequent research on the application of augmented reality technology and related teaching resources to art education and can enrich the construction of a new model of art learning activities in colleges and universities with technical support.

Research on the optimization of interior design of architectural space considering user perception

Abstract This paper integrates the concept of user perception into the presentation of architectural interior spaces. It posits that by employing virtual presentation modes, interior design products are fully demonstrated to users, enhancing their perception of the available information and thereby facilitating the optimization of interior design. The research systematically extracts the influencing factors of user perception by conducting a thorough analysis and synthesis of the literature pertinent to architectural interiors. Additionally, this study combines findings from a questionnaire survey with methods of correlation and regression analysis to further substantiate the identified factors influencing user perception. On this basis, combined with the establishment of a refined model based on real data sources and an indoor modeling method based on tree hierarchy, an indoor 3D virtual scene is constructed with the help of Unity3D software to realize the optimization of architectural space interior design. Overall style of architectural interior space = −2.304 + 0.381*furniture + 0.274*soft furnishing color + 0.205*hard furnishing material + 0.165*lamps + 0.183*hard furnishing color + 0.106*accessories + 0.124*soft furnishing material + 0.115*fabric. Senior and graduate users of higher education had the same attitude towards “personalization” of interior design (both scored 4.33, close to “approved”), while faculty members had the lowest rating (2.6). This study can serve as a guide for the presentation of architectural interiors.

Game Application as Teaching Tool to Assist Mastering Installation of Three-Phase Motor Control Topic: Expert Perception

The learning and teaching process using conventional methods might cause students to be unable to highlight their true potential. Besides, it can be more difficult for teachers to choose the types of games that suit the curriculum and students' needs. Hence, this study aims to develop a game application as a teaching assistant tool for a three-phase direct online starter topic in Electrical Technology Malaysian Vocational Certificate subject for Vocational College students using the Android platform. Learning materials and games are developed using multimedia and interactive elements to attract students to be active in using the learning medium based on game applications as 21st-century learning tools. The development purpose of the game application is to give early exposure to students to the installation of three-phase motor control before going through the laboratory session. The behaviorism learning theory and Game development Life Cycle (GDLC) model, were implemented in the game application development in this research. The researcher used Unity 3D software is online software such as Canva and Microsoft PowerPoint design tools interactively to make a game-based learning application for the three-phase motor control installation subject. Based on the analysis of the findings, the experts agreed that the functionality of this three-phase Motor Control game application can be used well and is suitable to be used as a teaching aid. In addition, these research results can be used by teachers to increase students' interest and further make the learning process more interesting to improve student understanding.

Fault diagnosis of electrical equipment based on virtual simulation technology

Abstract In order to efficiently and accurately diagnose train electrical faults, we propose a fault diagnosis method for electrical equipment based on virtual simulation technology. First, Creo software was used to build a subway train model. Then, 3DMAX software was used to make animation and demonstrate the working principle and action process of the train electrical system. Finally, using Unity 3D software, a human–computer interaction mechanism was established, achieving presence and realism. This system realizes the functions of knowledge learning, student assessment, principal display, and troubleshooting of the electrical system of subway trains and is compared with the method of manual diagnosis. Experimental results show that in the designed fault diagnosis system, the detection time for various types of faults is shorter than 30 s, whereas the diagnosis time of the manual diagnosis method is 30–52 s. It shows that the electrical equipment fault diagnosis system based on virtual simulation has the advantages such as short fault diagnosis time and high efficiency. In addition, the highest diagnostic accuracy of the manual diagnosis method is 75.48%, which is far lower than the accuracy of the diagnostic system. Conclusion: It is proved that the designed fault diagnosis system has the advantages such as short detection time and high accuracy and can meet the safety requirements of industrial production.

Research on collision avoidance simulation for autonomous underwater vehicles using ant colony optimization algorithm

Autonomous Underwater Vehicles (AUVs) are increasingly crucial in exploiting and exploring marine resources. Route building and obstacle avoidance are the core technologies that help this device perform aquatic processes. Collision avoidance methods use acoustic sensors and sonar systems to help detect targets, but these devices have difficulty seeing at short distances. This article proposes a method to simulate the autonomous process of a Remotely Operated Vehicle (ROV) or AUV in a virtual environment based on several path planning and obstacle avoidance algorithms. At the same time, the author used sonar data and optimization algorithms in the route construction process to address the limitations of AUVs and ROVs and the influence of the marine environment. Finally, through Unity 3D software, simulate the underwater operation of the AUV and check the algorithm results.

Research and application of a teaching platform for combined spinal-epidural anesthesia based on virtual reality and haptic feedback technology

BackgroundIntraspinal anesthesia poses significant teaching challenges and inadequate teaching resources, which ultimately limit students’ opportunities for practice. To address this issue, we aimed to develop a virtual platform for combined spinal-epidural anesthesia that merges virtual reality technology with haptic feedback technology, while assessing its educational impact and learning outcomes.MethodsWe utilized MIMICS, 3Ds MAX, and UNITY 3D software to perform 3D reconstruction based on lumbar CT/MRI data from a standard male volunteer. The haptic coefficients were configured on each layer by 20 experienced anesthesiologists in accordance with the Geomagic Touch X force feedback device. A total of 20 anesthesiology interns completed 30 virtual puncture training sessions. Two experienced anesthetists evaluated the efficacy of the platform and the level of mastery achieved using the Global Rating Scale (GRS) and a Checklist score, respectively. Finally, a questionnaire survey was conducted to gather feedback on the virtual platform.ResultsAfter the 10th session, the puncture time stabilized at 2.4 min. As the number of sessions increased, the Global Rating Scale (GRS) score stabilized by the 8th session, and the Checklist scores tended to stabilize by the 10th session. Results from questionnaires indicated that over half of the anesthesiology interns (70%) believed that the platform, which exhibited strong repeatability, improved their anatomical recognition and provided a strong sense of breakthrough in identifying the ligamentum flavum. The majority of them (80%) expressed satisfaction with the virtual platform.ConclusionsThe platform effectively facilitated the acquisition of basic and accurate puncture skills on a virtual patient.

ParallelEye Pipeline: An Effective Method to Synthesize Images for Improving the Visual Intelligence of Intelligent Vehicles

Virtual simulated scenes are becoming a critical part of autonomous driving. In the context of knowledge automation and machine learning, simulated images are widely used for visual environmental perception. However, even the most inspirational applications have not fully exploited the potential of simulated images in solving real-world problems. In this article, we propose a novel framework “ParallelEye Pipeline”, which uses image-to-image translation and simulated images to automatically generate realistic synthetic images with multiple ground-truth annotations. Specifically, this method has three steps: first, we use Unity3D software to simulate driving scenarios and generate simulated image pairs (including raw images and six ground-truth labels) from the simulated scenes; second, advanced image-to-image translation algorithms can generate realistic and high-resolution synthetic images from simulated image pairs; third, we exploit publicly datasets, simulated images, and synthetic images to conduct experiments for visual perception. The experimental results suggest: 1) synthetic images and simulated images can improve the performance of detectors in real autonomous driving scenarios and 2) image-to-image translation algorithms can be affected by occlusion condition.

Design of the unmanned surface vehicle simulation system using unity 3D software

Design of the unmanned surface vehicle simulation system using unity 3D software

MODELLING OF ELECTRICAL GSS USING AR-VR TECHNOLOGY

This project aims to develop a 3D model of a GRID Sub Station using Augmented Reality (AR) and Virtual Reality (VR). The 3D model will allow users to explore and interact with the GRID Sub Station in a virtual environment. The project will use Unity 3D software and the AR/VR SDK to create the 3D model. The model will include features such as electrical components, wiring, and other elements of a GRID Sub Station. This will enable users to interact with the 3D model in an immersive environment, allowing them to explore the Grid Sub Station in detail. The project will also develop a web-based interface to allow users to access the 3D model from any browser. This project will provide a cost-effective and user-friendly way to explore GRID Sub Stations and their components

Augmented Reality-Based Ruler Application

The goal of this project is to develop an algorithm for estimating the size and placement of objects in the classroom utilising beacon-based AR technology for location management. The application was designed and built using the Unity 3D software game engine with Open CV memory stored in the library. Devices running on assets that build different operating systems such as Windows, iOS and Android were intended to use it. Concept evaluation is carried out in 3 scenarios, in this application we can capture the image with the help of lenses and localization and mapping algorithms. This application aims to find the length of any object or help to design interior design or take measures, the object with it can detect horizontal and vertical planes that can capture in the particular app. It can work simply in one tap on the particular screen, the algorithm is working on the environment after that we can drag or simply second tap, and then we can take a measure of any object.

Identification of tomato ripeness levels (Lycopersicum esculentum Miil) using android-based digital image processing

The process of identifying tomato ripeness is generally done based on human perception, which is subjective and takes a long time. Color is one indicator of the tomato ripeness level. The color of tomato skin is an important indicator in determining the level of ripeness [1]. The development of image processing methods allows the identification of tomato ripeness levels more accurately, precisely and quickly. Digital image processing refers to processing two-dimensional images using a computer and using digital image processing techniques to obtain information that can be processed by a computer and the results are more precise, fast and automatic. One of the reasons for using Android-based applications as a platform is because it is easily accessible anywhere. Based on the results of the research, the identification of the ripeness level of tomatoes using image processing methods with the C# programming language with Unity 3D software can be implemented to determine the ripeness level of tomatoes. The validation of the chromameter and digital image obtained the coefficient of determination La*b*, respectively 0.9979, 0.9999, 0.9978 and the correlation value of La*b* is 0.998, 0.999 and 0.998. The designed application can be implemented with RMSE (Root Mean Squared Error) values at L a*b* of 0.171, 0.530, 0.537.

Development of Android-based Augmented Reality Spplications as a Food Promotion Medium

The development of technology at this time is very rapidly developing in the era of the industrial revolution 4.0, therefore we as the next generation of the nation must make the best use of it. Therefore, one of the uses of this technology is by carrying out food promotion activities using augmented reality technology. Augmented reality itself is the technology that is being widely used for object recognition in the multimedia field. Augmented reality is a technology that combines the virtual world with the real world, with it the virtual world displays objects that will be displayed to the real world. The result of this study is to create an application called scan ar only and make it easier for restaurants to promote their food to be promoted on social media. The application of this technology can increase food sales promotional methods that are different from others, namely, by utilizing the ar scan application only users will be directed to scan the food product, and interesting animations and sounds will appear as a promotional method of the food to be sold. The purpose of this study is to develop an augmented reality mobile application as a promotional medium that aims to introduce food to be promoted to customers. augmented reality in the application which will be built using unity3D software is carried out using a different way of presenting information to other media. The method of using the application is by the way the user sees the image in 2D and or 3D by using the application on a smartphone device. These developed applications can provide an interesting informational and moving animation experience for users of these applications.