Unity3D Software Research Articles

Retracted] Reconstruction Design of Existing Residential Buildings Based on 3D Simulation Method

The existing building reconstruction methods exist after three‐dimensional building modeling information is not complete, and the wall insulation performance improvement effect is not obvious. Therefore, a reconstruction method of existing residential buildings based on 3D simulation is proposed. This paper analyzes the present situation of energy consumption of existing residential buildings, analyzes the fuzziness characteristic in the process of testing the thermal performance of existing residential buildings by the method of spatially distributed fusion and feature extraction, uses the fuzzy equilibrium scheduling method to decompose the fuzziness characteristic scale of the thermal performance of the thermal insulation of existing residential buildings, and optimizes the design of the thermal performance of the thermal insulation transformation of existing residential buildings. The 3D simulation software is a 3D modeling tool named 3DS Max. The real‐time simulation software Unity3D engine is used to reconstruct the building scene and complete the reconstruction of existing residential buildings. The experimental results show that the information integrity of the building model reconstructed by 3D simulation technique is nearly 100%, and the insulation performance of the building wall is better.

Synthetic Data Generation to Speed-Up the Object Recognition Pipeline

This paper provides a methodology for the production of synthetic images for training neural networks to recognise shapes and objects. There are many scenarios in which it is difficult, expensive and even dangerous to produce a set of images that is satisfactory for the training of a neural network. The development of 3D modelling software has nowadays reached such a level of realism and ease of use that it seemed natural to explore this innovative path and to give an answer regarding the reliability of this method that bases the training of the neural network on synthetic images. The results obtained in the two proposed use cases, that of the recognition of a pictorial style and that of the recognition of men at sea, lead us to support the validity of the approach, provided that the work is conducted in a very scrupulous and rigorous manner, exploiting the full potential of the modelling software. The code produced, which automatically generates the transformations necessary for the data augmentation of each image, and the generation of random environmental conditions in the case of Blender and Unity3D software, is available under the GPL licence on GitHub. The results obtained lead us to affirm that through the good practices presented in the article, we have defined a simple, reliable, economic and safe method to feed the training phase of a neural network dedicated to the recognition of objects and features to be applied to various contexts.

Implementasi Realitas Berimbuh pada Antarmuka Manusia-Mesin di Industri Proses

Process industries such as oil refineries, petrochemical plants, and power plants require a human-machine interface system to monitor continuously. The operator usually carries out monitoring via a human-machine interface. However, it is difficult to know the condition of process equipment in real-time. The implementation of augmented reality allows engineers to visualize process equipment in real-time when conducting field inspections. The implementation of augmented reality at the human-machine interface to the fluid catalytic cracking process in an oil refinery is discussed in this paper. The design was started by developing a three-dimensional process equipment model using Autodesk Inventor. The result of the three-dimensional model then using Unity 3D software connected to the Vuforia Engine was implemented on a gadget into an augmented reality application. Data communication performance analysis was carried out using inferential statistics methods to test variations in service quality at levels 0, 1, and 2. The result of the Tukey test showed that the communication network latency value in level 2 was significantly higher than levels 0 and 1, which was 0.704±0.108 seconds. These results indicate that augmented reality can be implemented on human-machine interfaces by ensuring the quality of data communication services using Message Queue Telemetry Transport (MQTT) protocol at levels 0 or 1.

Virmentalness: Prototype of Therapy for Dysthymia Patients Using Virtual Reality

AbstractDepressive disorders can happen to anyone and will affect the pattern of life. However, there are still people who underestimate depression itself. Generally, depression problems or mental disorders are carried out with psychotherapy, a method for treating problems to find out the experienced problem and using anti-depressants. This study aims to produce a therapeutic aid for depression sufferers in this dysthymia by using Virtual Reality technology, which can be used by patients and medical experts, namely psychologists and psychotherapists, to use Virtual Reality-based therapy methods. The research method used is the prototyping method. The way to collect data is by interview and scientific literature. Researchers used Unity3D Software to create Virtual Reality applications. Virmentalness application is expected to help people with dysthymia symptoms in doing therapy to reduce symptoms. The application displays a 3D viewing environment of a room, a 360-degree atmosphere, and content video and audio for therapy methods. Keywords— Depressive disorders, Dysthymia, Virtual Reality, Therapy, Android

Impact of context in visual evaluation of design pastry: Comparison of real and virtual

Virtual reality is becoming an opportunity for multidisciplinary collaboration, including sensory science. The main objective of this work was to compare visual expectations generated by five real cakes evaluated in a laboratory testing booth with their virtual versions in a virtualized sensory booth. Real cakes were designed following the current pastries trends, and virtualization was made using a photogrammetric process. The virtual sensory booth was designed using Unity3D software. The participants were immersed in the 3D virtual environment through a head-mounted display (HMD). Data were analyzed using ANOVA mixed model, internal preference mapping and cluster analysis. The effects of context (real and virtual), the order in test session (crossover design), and socio-demographic factors were studied. The results showed no statistically significant differences within real and virtual studied cakes. These results create new perspectives of the potential of this methodology to be used to rate virtual foods in an immersive environment at the same level as real foods. Regarding the impact of the socio-demographic factors on the acceptance of the cakes, only the effects of gender and sweet-tooth were statistically significant. Males assessed all variables associated with the cakes significantly higher (p < 0.05) than females. In the same way, all variables in all cakes were better evaluated by participants with a self-declared sweet-tooth (p < 0.05). In the internal preference map, participants were segmented into three clusters that could be identified with the different trends in the pastries market. These results may help companies build tailor-made marketing strategies using Immersive technologies to evaluate new food products to satisfy different consumer segments.

APLIKASI PENAMPIL WARNA PELITUR PRODUK FURNITURE DENGAN AUGMENTED REALITY DI TOKO UD. CIPTA KARYA DENGAN ALGORITMA FAST CORNER DETECTION

The furniture industry is very much sought after by consumers because of its many uses and plays an important role in household life and daily activities. In its development, consumers want results that are as expected, therefore augmented reality is created which can be scanned on the camera so that objects appear in 3D and consumers can get a picture and producers can provide additional explanations. This augmented reality android application was developed using Unity 3D software and an engine from Vuforia by applying the fast corner detection algorithm method. The results of the target image detection test are influenced by several factors such as light intensity, distance and angle of detection, these affect the marker detection process. When the light intensity is low, the marker detection process is getting more difficult. The farthest distance that can be achieved to detect markers is around 70cm. The test results of the marker's point of view can be detected with a slope angle of +45o. And based on the test results on the ar system of this application, the accuracy level of marker detection is very good

PENERAPAN AUGMENTED REALITY BERBASIS ANDROID SEBAGAI MEDIA PENAMPIL INFORMASI TAMBAHAN PADA BROSUR PENERIMAAN MAHASISWA BARU UNIVERSITAS PANCA MARGA

Augmented Reality is a type of interactive technology that combines real objects and virtual objects at the same time and is displayed on the screen. Augmented Reality has been applied as a way of working based on image detection and it is commonly called a marker. By using the smartphone's camera and then detects the marker that has been printed. Augmented Reality is widely used in various purposes, the example is for advertising or promotion. In advertising, Augmented Reality can be used as a promotion or information that can make it more interesting. This research aims to apply AR technology to the campus promotion media on the University of Panca Marga's new student admission brochure. The stages taken in this research are literature study as well as observation, design, and implementation stages. The application of Augmented Reality was built using Unity 3D software, Android SDK, Vuforia SDK, and Sweet Home 3D. The results of the application of Augmented Reality technology can display 3D virtual objects, 2D, and video using the new student admission brochure used as a marker. The marker that is detected by the camera on the Android smartphone can display 3D UPM buildings, location plans, UPM profile videos, and faculty digital brochures. So users can see how the campus buildings are in real-time as well as some other information that has been provided. Based on the tests, all features can run well.

Pengembangan Buku Ajar Simulasi dan Pemodelan Fisika dengan Unity3D Berbasis Self Regulated Learning

This study aims to develop a simulation and modeling physics textbook assisted by Unity3D software with a self-regulated learning approach. This research uses Development and Research method through 4D Model. The definition stage is carried out by determining the characteristics of the textbook that will be developed through the initial study. The design stage is done by choosing the format and design of the textbook to produce the first correction (draft). The development stage is carried out to have the second draft, third correction, and the final product of the textbook. The second correction is obtained through the revised expert validation results that have been recommended. The third correction is the acquisition of small group test results by taking them randomly. Based on the results of field tests on students who are taking Physics Simulation and Modeling courses, the final product of the textbook is obtained. One of the textbook features and tools developed is the project assignment feature and the video tutorial tool. Based on the validation of the textbook and its supporting devices, the criteria are very feasible and ready to be used and can guide student learning independently through the features in the textbook. The development of this textbook is expected to assist in developing simulations and modeling in physics and other fields of science, such as engineering and health.

P‐3.4: VR Scene Display of Emergencies in Snow Field

Avalanche scene simulation is an emergency method that can be used to experience panic in advance of emergencies and to respond to emergencies in medical treatment through virtual reality simulation. Therefore, for the emergencies of the avalanche of the Winter Olympics snow field, virtual reality simulation is of great significance.This article takes the Winter Olympics snow field as the main line to show the medical rescue simulation after the avalanche. The entire design relies on the Unity3D engine, and the final test.stage will use the HTC interactive device for 3D scene evolution testing. First, using Unity's own mountain processing software, based on the original terrain, on the whole, a realistic outdoor ski resort model can be realized. Secondly, based on the Unity3D software design, it is mainly to construct the 3D model of the snow mountain and the subsequent emergency rescue animation module. The entire project C # language used as the scripting language of the entire project. After the avalanche scenario, virtual emergency medical rescue be realized. Finally, regarding the formulation of emergency levels and different rescue measures taken at different levels, and make emergency medical emergency response basedon avalanche scenarios.

OPTIMALISASI PENERAPAN TEKNOLOGI VIRTUAL REALITY TOUR KAMPUS UNIVERSITAS MAJALENGKA MENGGUNAKAN METODE MULTIMEDIA DEVELOPMENT LIFE CYCLE

Campus introduction media in general still use billboards and brochures or advertisements, therefore the use of Virtual Reality technology is very good to use. Optimizing the application of this technology is made to build an interactive application that can visualize the facilities and infrastructure at University Majalengka in the form of 360 images and videos to make it easier for users to digitally view the facilities and infrastructure of the University Majalengka Campus. The method used in this research is MDLC (Multimedia Development Life Cycle). This method can optimize the manufacturing process and application of technology used in a smartphone media that is integrated with other media or 3D media. MDLC rule pattern itself by prioritizing interactive rests on the user. This application was built using the C # programming language with Unity 3D software. The final result of this research is the creation of a virtual tour application of the University Majalengka Campus which can be used by users to view interactive digital facilities and infrastructure on campus with a 360 degree angle using a smartphone that has a Gyroscope sensor which can be integrated with the paired virtual reality technology. into virtual reality glasses.

Research on case virtual simulation teaching system for automobile engine based on Web 3D

At present, the traditional teaching methods rely on paper teaching and specific physical equipment, which is a lack of immersion. Moreover, it is experimentally costly and the teaching effect is not good. Therefore, this paper proposes a Web 3D virtual simulation teaching system for automobile engine based on case teaching method. The system mainly includes three modules: account management, 3D virtual simulation teaching based on typical cases and document reading. Unity3D software and database technology are used to build a realistic virtual experiment scene, so that students can simulate interactive experiments online and master learning skills to achieve teaching objectives. The experimental results show that the 3D virtual simulation teaching system proposed in this paper can realize online simulation of specific interactive experiments of disassembly and assembly for automobile engine. In addition, students can learn independently, so as to achieve the purpose of immersive learning, improve teaching efficiency and reduce costs. Most importantly, it can avoid teachers and students from being hurt in the actual experiment and provide a new way for teaching.

Use of Augmented Reality App as a means of motivation for high secondary education in times of COVID-19

As the COVID-19 health crisis continues, schools have been forced to close their doors, leading school systems to find innovative ways to reach and teach their students. A novel way of reaching students is Augmented Reality. High secondary level students have abandoned their studies and / or the idea of studying at a college, this derived from the methodology of teaching and monitoring their learning. The virtual environment developed in this research is intended to motivate the student of high secondary education of specialty related to the career of engineering in computer systems to continue with their studies at a college by showing them the applications that can develop themselves with the tools technologies and the knowledge to be acquired within the computer systems engineering study program. For this proposal, the Unity 3D software was used, since it presents flexibility for the creation of any type of environment. An initial and final survey was implemented after presenting the AR app to determine whether after its use the students feel motivated to continue with their studies.

Creative Intervention for Acrophobia Sufferers through AIVE Concept

This research applies exposure to the visual appearance technology of virtual reality (VR). The motivation for this research is to generate a creative intervention by using regular smartphone devices and implementing them in VR using Google Cardboard as a medium visual display for exposure therapy at high altitudes. The VR application in this research is called acrophobia immersive virtual exposure (AIVE), which utilizes the Unity3D software to develop this treatment therapy application. The utilization of exposure therapy was carried out as a therapeutic medium for acrophobia sufferers. A commissioner was given to measure the usefulness of applications and devices in the VR environment created, and as many as 20 users had tested the VR device. The existing questionnaire was revised to develop a questionnaire for acrophobia sufferers, which was then used as an index measurement in the VR environment. The research is expected to be used to design a simulator and as a therapeutic medium using immersive VR devices in future studies.

Interactive mobile equipment safety task-training in surface mining

Improving the quality of equipment training for the Heavy Equipment Operators (HEO) is a critical task in improving safety and eliminating equipment-related injuries in mining. One of major responsibilities for the HEOs is proper machine inspection. Traditional miner safety training includes the use of hardcopy documents and video instructions. However, modern mobile and computer technology offers tremendous potential to improve the training process. In this study, we apply a 360-degree camera, open-source platform WordPress™, and the software Unity3D in order to create materials and tools for the HEOs safety training to help trainees better understand the pre-shift safety machine inspection. The computer-based safety task training developed in this research is tested and implemented at a surface mine in the southern United States.

Research on 3D Modeling Software Maya Digital Media Animation Assisted Brain Surgery Technology

Abstract This article uses the three-dimensional (3D) modeling software Maya and the 3D interactive software Unity3D to develop an interactive teaching system that integrates the display of the human brain, the display of the principle pathology of cerebral thrombosis, and the simulation of stent surgery in the brain. The use of this system can result in unlimited learning by multiple people, avoiding shortcomings such as insufficient resources, and strengthening the characteristics of interaction. For human brain models, functions such as zoom-in, rotation, and observation of a single part can be implemented, and text descriptions are provided. For the demonstration of cerebral thrombosis, animation is provided for simulation. For intra-brain stent surgery, the system can automatically demonstrate the surgical process, and it can be actually operated by the user, thereby enhancing the convenience and fun of student learning. This system uses Unity3D software as the main development tool. It uses the software’s advanced lighting system, particle system, and algorithms such as edge detection and screen post effects to establish the main frame of the system. It utilizes C # language for programming, thus enriching the functions of the system. On testing, the virtual interactive teaching system realized by the above method exhibits high interactivity, fun, and practicability.

Design and Development of “VR + Arduino” Immersion Interactive Experiment Case

In order to guide students to master Arduino development board, sensors, unity3d and other software and hardware application methods, familiar with the development process of virtual reality and intelligent hardware control platform. Learning from the WeChat "jump and jump" finger game, based on virtual reality technology and Arduino intelligent hardware control platform, the virtual intelligent fitness device with good immersion, strong interactivity, and combining entertainment, exercise and virtual experience is developed and designed. The "virtual reality + Arduino" immersion interactive experimental platform provides immersive and interactive immersive helmet and desktop screen display modes, uses a variety of intelligent control methods such as in-situ jumping action or grip to replace the finger pressing action in WeChat to control the jump of the game model, and can choose the sky, ocean, land and other fitness Scene, to achieve physical exercise and intellectual purposes. In the process of case design and production, virtual reality immersion equipment, grip and running pad are combined with fitness to cultivate students’ comprehensive practical innovation ability.

Development of Augmented Reality (AR) Based Trompong

In gamelan, one of the most important instruments is trompong. Trompong is an idiphones instrument that has 10 rows of round shaped metal called pencon. Every pencon has its own sound. As a traditional music instrument, of course gamelan especialy trompong must be preserved continuously. But unfortunately, playing Balinese gamelan with real instrument is hard to do because the difficulty to finding gamelan in the real world. By using technolgy such as Augmented Reality, playing trompong possible to do even without having the real instrument. Augmented Reality will be develop using Unity 3D software along with Vuforia SDK, and also this application using Android smartphone as a base of Augmented Reality application. This Augmented Reality application called TrompongAR and will be marker based Augmented Reality, by using a target marker will help Augmented Reality to place where the 3-dimensional trompong will placed. The 3-dimensional trompong will have 10 pencon that can played by tapping the pencon, the touched pencon will produce sound like the real instrument.

Virtual laboratory application based on virtual reality simulation as training tool of turning machine using goal-directed design method

This study aims to develop a virtual laboratory application based on virtual reality simulation as a training tool for turning machines. The application is built as a solution for manufacturing engineering education problems at the Production System Laboratory (PSL) in the Industrial Engineering Department, Diponegoro University. Problem based on work accident data shows human error from the student when using turning machines. The data shows that lack of student understanding due to insufficient of preliminary training at the beginning of manufacturing engineering education especially physical skills training. Virtual Reality Simulation is chosen because conventional machining training has some restrictions in execution. Furthermore, virtual reality simulation can reduce cost, improve safety, and add flexibility along with advances in computer technology. For this Research the Goal-Directed Design (GDD) method was chosen to develop VR simulation. This method is used as a procedure to accomplish the good design of application which including research, modelling, requirements, framework, refinement, and support. The application is built using Unity 3D software and run on Oculus Quest hardware. At the evaluation phase for assessing the needs, researchers use functional and non-functional requirements. Functional requirements consist of interaction, visualization, and information. Non-functional requirements consist of usability, performance, and reliability.

Virtual rehabilitation system for fine motor skills using artificial neural networks

This work presents a rehabilitation system for upper limbs performed by the acquisition of electromyographic signals (EMG) of a patient with movement limitation after stroke. To determine the physical gestures of the arm, the MYO Armband is used, and to increase the default number of movements (4 gestures), a recognition algorithm is performed using artificial neural networks. MATLAB has been used for the extraction of a vector containing the characteristics through probabilistic signals treatment and to determinate the angles of rotation. In addition, an immersive environment is developed in Unity 3D software allowing the user to experience a more motivating therapy. As a peripheral output, HTC VIVE glasses and binaural hearing aids were chosen. To validate this proposal, five users with an age range of 49 to 69 years have made 200 tests in total with the proposed physical gestures (7). In addition, the qualitative validation of the system is done through the SUS usability test and as a result it is obtained (55.25 ± 0.18), demonstrating good acceptance.

Virtual Reality Simulation to Help Decrease Stress and Anxiety Feeling for Children during COVID-19 Pandemic

The occurrence of COVID-19 pandemic has changed people’s life in every aspect, such as applying social distancing, the transition from offline to online activity are applied in order to decrease and stop the spread of the virus. This sudden change causes a fairly high level of anxiety and stress in society, especially for children because of activity restrictions. Various innovations, especially technology have been carried out to overcome the problems in distance restrictions that have arisen due to the COVID-19 pandemic. Virtual reality believes becoming one of the innovations that can be used to reduced anxiety levels and boredom during activity rectrictions, because it creates an artificial environment for humans to socialize. In this research, combine the Unity3D and blender software to build a virtual reality simulation with the help of virtual glassed to give a real impression of the virtual room that has been created. This VR application consists of three environments that children can use it to explore the virtual room without need being in crowded atmosphere. Based on the result of pretest and posttest questionnaire in 30 participants with the range age from seven to ten, it concludes that this VR applications can decrease the level of stress and anxiety in children by one to two levels. Besides that, this application located in acceptable area based on SUS score system.