Unity3D Engine Research Articles

Visualization of indoor thermal environment on mobile devices based on augmented reality and computational fluid dynamics

Abstract Augmented reality (AR) based visualization of computational fluid dynamics (CFD) simulation on mobile devices is important for the understanding and discussion of indoor thermal environments in the design process. However, utilizing AR-based mobile device for indoor thermal environment understanding still encounters problems due to limited computational power and lack of efficient interaction methods. To improve the performance of AR-based CFD visualization on a mobile device and provide the users with intuitive interaction with indoor environment, an integrated approach based on client-server framework is established. Within the approach, a new mobile friendly data format (cfd4a) with low computational complexity is proposed for CFD simulation results representation. Server-side data pre-processing method is also introduced to reduce the computational power and time needed on the client side. Furthermore, interactive section view selection and time-step animation methods are proposed for intuitive interaction with the AR environment. Then, a prototype system is developed with Unity3D engine and Tango Tablet. Demonstration in some typical scenarios shows that the proposed method and prototype system provide an intuitive and fluent AR-based environment for interactive indoor thermal environment visualization. Comparing to the widely used vtk format, a data compression ratio of 63.4% and a loading time saving ratio of 89.3% are achieved in the performance test with the proposed method. The proposed approach also shows good flexibility and extensibility in supporting different AR devices through exposing standard web services and utilizing the widely used Unity3D engine. Source code of the developed prototype and relevant testing data are also shared through github, enabling other researchers to compare our work with theirs. It is also suggested that stability of AR-based mobile devices, new interaction methods and integration with cloud computing still need further investigation and improvement.

DIGITAL TWIN BASED SYNCHRONISED CONTROL AND SIMULATION OF THE INDUSTRIAL ROBOTIC CELL USING VIRTUAL REALITY

During the years common understanding of the possibilities and perspectives of Virtual Reality (VR) usage has been changed. It is thought that VR is mainly used in entertainment purposes, but it is being used already for many years in different industries, and now with easier access to the hardware it became a helpful and accessible tool that could be used and developed in any field of human activities. In manufacturing, immersive technologies are mainly used nowadays for the visualisation of processes and products combining those visuals into the factory Digital Twin (DT) which is possible to view from the inside look. This feature is already being used in several manufacturing simulation tools, which enable to view onto industrial line / robotic cells via Virtual Reality glasses. However, the potential of using simulations with VR in manufacturing is not fully uncovered. The main aim of this, industrial robotics targeted research is to enable besides simulation also universal control algorithms through Virtual Reality experience, produced by game engine Unity3D, which can be easily modified for a wide range of industrial equipment. The primary outcome of this work is the development of the synchro-nisation model of real and virtual industrial robots and experimental testing the developed model in Virtual Reality and shop floor labs

Audiovisual Cartography: Established and New Multimedia Approaches to Represent Soundscapes

Since the mid-1990s, sound has been discussed and used in multimedia cartography. There are four main variants of auditory map elements that have been established in the theory and practice of audiovisual cartography, i.e. abstract sounds/abstract sound sequences, speech, music and, especially, audiorealistic sequences representing so-called “soundscapes”. In cartography, soundscapes are often addressed in large-scale representations. The term originates in multidisciplinary landscape research. Empirical findings of landscape research, and especially those of social constructivist landscape research, have shown the relevance of non-visual stimuli for people’s individual impressions and meanings of the experienced landscape. Amongst the non-visual landscape dimensions, the auditory dimension is the most prominent one. As 3D cartography offers new methods and techniques of designing and experiencing highly realistic, incl. photo- and audiorealistic landscape representation, this discipline becomes more and more interesting for simulating and presenting multisensory landscapes and for presenting the results of empirical findings in landscape research. After an introduction to traditional means of audiovisual cartography and the relevance of auditory stimuli for social constructivist approaches of landscape research, a modern software-based method is presented which highlights the opportunity to imbed 3D sound data representing a location’s soundscape into audiovisual 3D environments in Virtual Reality (VR). It is technically based on the cross-platform game engine Unity3D.

Crowd Navigation in an Unknown and Dynamic Environment Based on Deep Reinforcement Learning

This paper presents an approach for solving the crowd navigation problem in an unknown and dynamic environment based on deep reinforcement learning. In our approach, we first make four leader agents learn how to reach their goals and avoid collisions with static and dynamic obstacles in an unknown environment by use of proximal policy optimization combined with Long short-term memory and a collision prediction algorithm. In the second stage, we make each leader agent arrive at a specific goal several times and record its trajectory as the guiding path so that the members in its group know how to reach their goals. We adopt the Reciprocal Velocity Obstacle algorithm to make agents not collide with others. Finally, we simulate the scenario of four groups moving towards their goals simultaneously using the Unity 3D engine. The experimental results demonstrate self-learning ability of a crowd who can reach their goals successfully in an unknown and dynamic environment.

Evaluating Hazard Response Behavior of a Driver Using Physiological Signals and Car-Handling Indicators in a Simulated Driving Environment

Road traffic accidents are a major cause of casualties and costly implications to all the stakeholders. Research focusing on the driver as one of the causal agent of accidents has been studied for centuries and with the advent of modernized driver assistance technologies. This paper sought to evaluate response of a driver using active-driving performance indicators like reaction time and physiological signal response (surface electromyogram), to understand hazard response behavior. Simulation of driving scenes was done using Unity3D engine and VR Head mounted display. The driver was presented with stimulus (collision objects) of different size and distance. From the results, an event scene that the driver considered hazardous was marked with increased electromyography response distinct from non-event scenes. From the results, we noted an increase in pedal misapplication during hazard response. The proposed approach is applicable in a real time driving analysis for on-road risk level classification.

An application to simulate and control industrial robot in virtual reality environment integrated with IR stereo camera sensor

The main goal of this research is to test for potential ways to control KUKA KR10 industrial arm manipulator using Virtual Reality technology and check for the advantages of applying this control methods. The final version of this application aims to achieve this goal by establishing an interaction between the user and the manipulator inside a virtual environment developed using the game engine Unity3D and the HTC VIVE Pro headset for the virtual visualization. By applying this control method, the user does not have to operate on site and instead he can work remotely. In addition to the ability to use off-line programming of the manipulator. The application is designed to simplify the controlling ways by displaying a complete virtual environment where the tridimensional model of the robotic arm can be visualized and programmed according to the real manipulator’s parameters and specifications. All the movements and parameters in the virtual environment can be synchronized with the real robot in an on-line or off-line path planning depending on the application or the task. The system integrates a set of virtual reality controllers and Leapmotion sensor as options to allow the user to control and see the robot and its parameters in the virtual environment. As a result of this research, the manipulator moves on the planned trajectory in a smooth way after applying some filtering techniques without losing its accuracy.

Computer simulation and system realization of jacquard weft-knitted fabric

Jacquard weft-knitted fabric is a type of multilayer knitting fabric which has a stereoscopic surface with complex patterns. A computer simulation system was established, based on a virtual fabric Unity3D platform, to minimize the time required for computer simulation and to enhance the simulation results. The three-dimensional fabric data were unified and coordinate data were obtained to achieve the establishment. Three factors of simulation algorithm for jacquard weft-knitted fabric were used to establish and control the effect of a fabric model. By integrating three-dimensional model data, two-dimensional spatial data, and gray model, virtual simulation based on three-dimensional engine Unity3D platform was realized. Based on the real-fabric data, the final fabric patterns were predicted from macroscopic angle instead of two-dimensional and microscopic simulations. The system is proved to be more effective for the prediction and simulation of jacquard weft-knitted fabric and other fabrics having similar stereoscopic surfaces.

Research on the Design and Production of Digital Animation Based on Unity3D - Centered on the Theme of the Idiom Story the Dream in the World of Lute

Digital media design, thanks to its unique interactivity, makes the display of cultural abundance rich and diversified. Stimulated by the policy of vigorously boosting the development of cultural and creative industries laid down by the country, the forms of digital media design have emerged in an endless stream. Digital media design, with the aim of serving the whole society, seeks the quintessence of Chinese traditional culture, explores the profound cultural abundance, and displays its cultural charm with humanistic feelings. This article, taking the Chinese idiom story as the basis of design, focuses on the design and production of traditional idiom stories, by means of the Unity3D engine. It, with the aid of the design and production of digital animation interactions, integrates cultural connotations into digital design and education service, and explores the ways to enrich the users’ digital interactive experience and to raise their cultural awareness.

Development of AR/VR Project Based on Unity3D Engine

This article expounds and analyzes the development based on Unity3D engine. This paper discusses the analysis and development of the 2048 game projects and the simulation city in the development environment of U3D by using C# language technology.

The Simulation System of Ship Fixed Water Extinguishing Training Based on Virtual Reality Technique

Because it is rough to teach and train students in real environment, the ship fixed water extinguishing simulation training system is built, which can not only restore the environment but also reduce the training cost. The modeling software (3D Max) is used to establish fixed water fire-fighting equipment models. Meanwhile, the HTC VIVE helmet is used to enhance the sense of reality and the Unity3D engine is used to set up the virtual scene of the ship. The students’ movement is realized by Bezier curve. The operation to virtual equipment is realized by the collision detection. The route of the virtual crew is realized by the A* algorithm. The examination result illustrates that the training system can be applied to the firefighting training.

Fire-fighting Training System Based on Virtual Reality

Applying virtual reality technique to fire-fighting training can effectively solve waste of manpower, material, money and so on. In this paper, we will combine HTC Vive and Unity3D engine to carry out the design and development of fire-fighting training system. Particle system, navigation grid, animation system and collision detection technology are applied to achieve flame flus gas diffusion simulation, non- experiencer follow, animation production, interaction functions between characters and objects respectively, to save time for rendering spent and meet the real-time demand of virtual scenes generation, this paper optimizes virtual scenes by using LOD technology and occlusion culling technique. The results show that the fire-fighting training system has a good sense of immersion, and it can meet the demand of fire-fighting training.

Virtual Tour for Smart House Developed in Unity 3D Engine and Connected with Microcontroller

Virtual Tour for Smart House Developed in Unity 3D Engine and Connected with Microcontroller

Research on Bounding Volume Boxes Collision Detection Algorithm in Virtual Reality Technology

Abstract This paper take the development of virtual campus roaming system as an example. Aiming at the defects of the different kinds of bounding boxes collision detection technology, analyzes the advantages of the hybrid hierarchical bounding box collision detection algorithm based on spheres and oriented bounding box, and described the way to construct it. Finally, the algorithm is tested in the VC and Unity3d engine, a good result is obtained.

基于Unity3D的500 kV变电站倒闸操作仿真研究

本项目基于Unity3D这款多平台的综合游戏开发工具建立了一个虚拟的500 kV变电站倒闸操作仿真系统，该项目具有很强的实用性。通过使用Unity3D引擎和3dsMax软件，并结合C#和JavaScript脚本语言的开发，实现了虚拟500 kV变电站的场景设计和交互式漫游等功能。通过Unity3D游戏开发工具所设计的该仿真系统扩展性好，真实感强，可模拟各种变电站的电气设备分布。在虚拟变电站中进行模拟倒闸操作的训练，满足了对变电站倒闸操作的培训需要。 This project builds a virtual simulation system of switching operation in 500 kV substation based on Unity3D, which has strong practicability. Using Unity3D engine and 3dsMax software, combined with C# and JavaScript script language, the functions such as scene design, interactive walkthrough in this virtual 500 kV substation are realized. With the use of Unity3D game tool, this simulation system has good expansibility and a strong sense of reality; it can simulate any distribution of electrical equipment in substation. Users can train the simulative switching operation in virtual substation to satisfy the need of switching operation training.

Virtual Prototyping Technologies Enabling Resource-Efficient and Human-Centered Product Development

In modern production environments employees work progressively closer together with autonomous robots and vehicles. Besides the technical specifications, the development of these products focuses on the human-machine interaction. Within the federally funded Project FOLLOWme an automated guided vehicle (AGV) for intralogistics that follows and interacts with the user is developed using virtual reality based prototypes. The benefits in comparison to using only physical prototypes are on the one hand specific user feedback regarding ergonomics and trust. On the other hand the validation of navigation and collision avoidance algorithms and optimization of technical parameters is achieved considering complex environmental conditions. This paper focuses on the latter in detail and deals with the optimization of a fuzzy logic controller using the game engine Unity3D to create the required virtual setup. This approach saves valuable time at early project stages and allows the optimization of a larger number of parameters compared to just physical tests. Furthermore it reduces resources like occupied physical infrastructure and improves the comprehension by using virtual reality.

Performance analysis of Unity3D engine in the context of applications run in web browsers

The aim of the work is the performance analysis of the Unity3D engine in the contex of applications running with a web browser and WebGL technology.. The paper presents literature review was carried out in the scope of creating multimedia applications run in web browsers, graphics engines and WebGL technology . Additionally, technical issues related with converting Unity3D application to WebGL technology are discussed. The research are performed based on computer simulations with five scenes created with Unity3D environment, which include the main capabilities of this engine. Finally, it was presented the results of these studies and the conclusions.

FPS Game Design and Implementation Based on Unity3D

This paper describes the planning process of a first person shooter game (FPS in short), including game scenario design, playing method design, game passed condition, the enemy AI intelligent system logic design and energy system design. Meanwhile the main implementation technologies of the game are introduced here by the mainstream Unity3D engine. Practice shows that a picture lifelike realism, movements’ smooth game works can be efficiently made using the unity3D engine.

Efficiency analysis of Unity3D engine in terms of particle simulation

This document reviews research in efficiency analysys of particles created by Unity 3D built-in particle system compared to those created via sctript written in C# language. Author focused his research on examining the impact of the various tasks on the speed of rendering frames, a difference which occur during the generation of particle by particle system and those generated by a script, and how influential is the complexity of the mesh particles generated on the application performance. For this purpose, using Unity3D, Microsoft Visual Studio and Blender, an applications for computers that are ruunniong on Windows system was created, application allows to adjust the simulation parameters (the number of generated particles, particle shape - sphere, cube).

Development and Design of the Application of Logistic Growth Curve for Mobile Terminal

According to the characteristics of normal education experimental teaching, theory and practice, combined with the biological and ecological characteristics, we design and develop a virtual simulation application using the Unity3D engine, which is an application of logistic growth curve for a mobile terminal. Practice has proved that by adjusting the corresponding parameters students can set parameters for different experiments.

物联网智能浇灌控制系统

传统果园种植低效且工作繁重，物联网技术+传统果园种植的模式有利于提高果园管理效率。本文采用STM32系类单片机、2.4 G无线模块，结合Unity3D引擎移动开发平台，设计和开发了一种物联网+Unity3D可交互智能化虚拟现实果园种植远程监控控制系统。该系统由底层部分和顶层部分组成，底层部分设计使用土壤湿度传感器和空气温湿度传感器检测果园土壤温度和外部环境温度和湿度信息，控制器根据不同果树土壤湿度设定值，调节电磁阀，控制浇水量。顶层部分设计建立三维虚拟场景，实现场景漫游、实时监视、信息显示功能。底层部分与顶层部分建立协议，通过查询果树养殖专业信息设定智能浇灌，同时也建立远程手动控制浇灌，方便管理人员随时查看数据和远程控制浇灌，降低果园养护难度。 Traditional orchard cultivation is inefficient and heavy work, and the Internet of Things technol-ogy + traditional orchard cultivation mode is conducive to improving the efficiency of the orchard management. In this paper, with STM32 series of single-chip microcomputer, 2.4 G wireless module, and Unity3D engine mobile development platform, we design and develop an orchard planting remote monitoring and control system of Internet of Things + Unity3D interactive intelligent virtual reality. The system consists of the bottom part and the top part of the composition. The bottom part of the design uses soil moisture sensors and air temperature and humidity sensors to detect the soil temperature and outdoor environment temperature and humidity information. According to different fruit soil moisture settings, the controller adjusts the solenoid valve and controls the amount of irrigation. The top part of the design establishes three-dimensional virtual scene to achieve roaming, real-time monitoring, and information display. The bottom part establishes protocols with the top part, then we can investigate fruit tree farming professional information to set the intelligent watering, and establish remote manual control watering, which facilitate the management staff at any time to view the data and remotely control watering, thus reducing the difficulty of orchards maintenance.