Unity Game Engine Research Articles

Development of a virtual reality application for the Old Harran School

The objective of this project that is described in this paper was to introduce the little-known Harran School of the medieval Islamic period located in Southeast Türkiye to a broader audience using virtual reality technologies. 3D models of the medieval Inner Castle in the Harran archaeological site and one of its saloons were created using photogrammetric methods. In this main saloon, 3D models of artifacts found during excavation works on this site that were used in medieval and earlies times were placed in a museum-like style. Additional objects, illumination and paintings of great Islamic scholars were appended to create a more realistic setting in the saloon. All these 3D models were transferred to the game engine Unity to generate a virtual environment, in which the visitor can immerse. Currently, this virtual museum can be experienced by PC-based head-mounted devices. While different implementations of virtual museums are already available in Türkiye with this project, a museum deploying virtual reality technology has been realized for the first time.

Open-source 3D discrete event simulator based on the game engine unity

ABSTRACT In this paper, we present the development of an open-source discrete event simulator (DES) using the cross-platform game engine Unity and C#. Our goal is to provide a robust DES engine that can be seamlessly integrated with a game engine, leveraging its modularity and reusability. We built a standalone DES simulator in C# and integrated it with Unity through a custom code layer. This integration allowed us to leverage Unity’s capabilities and explore potential applications while providing a basic set of assets tailored for manufacturing processes. Verification tests against commercial DES software and experiments validated our approach. Additionally, we showcase examples that explore the advantages and limitations of using game engines as platforms for manufacturing digital twins. While further development is required to transform the simulator into a ready-to-use OS simulator, our approach enables future developments and seamless integration with other tools while maintaining the project’s open-source nature.

A Comparison of One- and Two-Handed Gesture User Interfaces in Virtual Reality—A Task-Based Approach

This paper presents two gesture-based user interfaces which were designed for a 3D design review in virtual reality (VR) with inspiration drawn from the shipbuilding industry’s need to streamline and make their processes more sustainable. The user interfaces, one focusing on single-hand (unimanual) gestures and the other focusing on dual-handed (bimanual) usage, are tested as a case study using 13 tasks. The unimanual approach attempts to provide a higher degree of flexibility, while the bimanual approach seeks to provide more control over the interaction. The interfaces were developed for the Meta Quest 2 VR headset using the Unity game engine. Hand-tracking (HT) is utilized due to potential usability benefits in comparison to standard controller-based user interfaces, which lack intuitiveness regarding the controls and can cause more strain. The user interfaces were tested with 25 test users, and the results indicate a preference toward the one-handed user interface with little variation in test user categories. Additionally, the testing order, which was counterbalanced, had a statistically significant impact on the preference and performance, indicating that learning novel interaction mechanisms requires an adjustment period for reliable results. VR sickness was also strongly experienced by a few users, and there were no signs that gesture controls would significantly alleviate it.

Pengembangan Gim Serius Untuk Pengenalan Jamu Menggunakan Metodologi Putaran Permainan

Jamu is a traditional herbal beverage that represents a cultural heritage with various health benefits. Despite this, adolescents tend to turn to chemical medications. This research proposes the development of an educational and engaging serious game to introduce jamu to the adolescent age group. The gameplay loop methodology is employed to ensure optimal connectivity between the game system and jamu educational content. The game design has been successfully implemented in the development of the game using the Unity game engine, resulting in an educational game based on significance testing and GUESS validation. The game is also deemed engaging based on the correlation test results. The Gameplay Loop method successfully maintains the connectivity between educational content and the game system, indicating that the game effectively imparts understanding of jamu to its players.

GeaVR: An open-source tools package for geological-structural exploration and data collection using immersive virtual reality

We introduce GeaVR, an open-source package containing tools for geological-structural exploration and mapping in Immersive Virtual Reality (VR). GeaVR also makes it possible to carry out quantitative data collection on 3D realistic, referenced and scaled Virtual Reality scenarios. Making use of Immersive Virtual Reality technology through the Unity game engine, GeaVR works with commercially available VR equipment. This allows VR to be accessible to a broad audience, resulting in a revolutionary tool package for Earth Sciences. Users can explore various 3D datasets, spanning from freely available Digital Surface Models and Bathymetric data to ad-hoc 3D high-resolution models from photogrammetry processing. The user can navigate the 3D model in first person, walking or flying above the surrounding environment, mapping the main geological features such as points, lines and polygons, and collecting quantitative data using the provided field survey tools. Such data, including geographic coordinates, can be exported for further spatial analyses. Here we describe three different case studies aimed at showing the potential of our tools. GeaVR is revolutionary as it can be used worldwide, with no spatial limitations, both for geo-education and Earth Science popularization, as well as for research purposes. Secondly, it makes it possible to safely access dangerous areas, such as vertical cliffs or volcanic terrains, virtually from a computer screen or Virtual Reality headset. Furthermore, it can help to reduce carbon emissions by avoiding the use of flights and vehicles to conduct field trips.

Preserving Southern Thai Traditional Manora Dance Through Mobile Role-Playing Game Technology

Manora or Nora has been added to the heritage list of UNESCO as Thailand's intangible cultural heritage since 2021. This performance has been presented as a regional form of entertainment and traditionally passed down through generations within certain families. Nowadays, young people are able to learn and practice Manora instructed by their masters or their successors. However, there is currently no digital content of Manora that could support awareness and enrichment of cultural safeguarding, so this article proposes the design and development of a mobile 3D game representing Manora, which is Southern Thai dance-drama performing art. The aim of this game is to increase citizens’ engagement with their intangible cultural heritage and preservation by delivering novel digital heritage content specifically designed for a role-playing mobile game called Nara. The Nara game is used to enhance the perception of Manora dance and provide new experience of playing a culture-based game through costume and its material items. The game design process takes Manora's significant identities, including the costume, dance postures, and music along with players’ requirements to create a game player character, non-player characters, storytelling, challenges, and level design. The development of the game is done on Unity game engine, which provides a mobile 3D game platform to integrate all the designed content and generate the interactive Nara game. The experimentation results conclude that utilizing the unique identity of Manora in gameplay successfully enhances the audience's experience and recognition. This result indicates the effective use of creativity and interactive multimedia technology to create attractive content and enjoyment that can encourage intangible cultural heritage preservation in an innovative manner.

The Nāṭyaśāstra and virtual metatheatre

ABSTRACT In this practice-based project, workshops were conducted in and out of virtual reality, exploring the transitional processes of the Nāṭyaśāstra, an ancient Sanskrit dramaturgical treatise. This project is an intercultural and technological investigation of ancient tools of liminality and how they can be applied in a virtual theatre. A virtual cave theatre was built to the design of the Nāṭyaśāstra and inhabited with seventh-century farce, Bhagavadajjukam, created in Unity game engine for VRchat, a social VR application. The project posits three positions of focus: (1) Investigating parallels of the Nāṭyaveda and the metaverse, comparing the Nāṭyaveda an ancient spiritual performance space, described in the Nāṭyaśāstra with the modern metaverse, showing them to be spaces of liminal transition in which community can explore conflict and resolution. (2) Exploring the Nāṭyaśāstra's rasa theory, codified emotional performance to engender the liminal self, creating moments akin to virtual anchors. (3) Exploring the metatheatre of the Nāṭyaśāstra applied in the virtual and its parallels to the modern concept of liminal performance. Participants explored these concepts first physically in a performance studio and then in a virtual space. These workshops were recorded, and their experiences discussed and thematically analyzed after.

Enhancing Upper Limb Stroke Rehabilitation with Electromyography‐Monitored Virtual Reality–Based Games

Stroke is a significant global health concern, ranking among the top causes of death and disability. Timely poststroke recovery hinges on structured upper limb rehabilitation within the first 24–48 hr. Although virtual reality (VR) rehabilitation is promising, its accessibility is complex and cost‐limited, especially in less developed regions. In this study, we developed and assessed nonimmersive VR rehabilitation games using the Kinect Xbox One and UNITY game engine, targeting upper limb movement sequences vital for poststroke recovery. The developed games involved simple to progressively challenging movements, engaging the deltoid, biceps, and triceps muscles and aligning with poststroke rehabilitation criteria. We used peak‐to‐peak electromyography signal detection with a 20% threshold and three distinct feature extractions to represent muscle contractions during gameplay. Our cosine similarity analysis revealed the efficacy of games in meeting movement sequence criteria, benefiting mostly the shoulder motor and deltoid muscles (93% improvement) with more moderate improvements in the biceps (73%) and triceps (47%). Our results suggest that these games could contribute to upper limb stroke rehabilitation, particularly that of the deltoid muscle. This study highlights the potential of VR‐based rehabilitation games in poststroke upper limb recovery, emphasizing muscle engagement, target distances, and rehabilitation criteria in game design. Although healthy participants were involved here, future research involving poststroke patients and the exploration of more immersive, multiplanar movements hold the potential for a more comprehensive rehabilitation experience. Our study contributes to advancing the common knowledge related to VR‐based stroke rehabilitation, focusing on upper limb movement sequences with implications for therapeutic engagement and recovery.

3D Unity Snake Game to Demonstrate Control System Transfer Function in Both Time and S-Domain

The transfer function, a key concept in control systems, is essential for undergraduate engineering students. This study aims to enhance the understanding and appreciation of control systems by visualizing transfer functions. The 3D Snake Game, developed using the Unity game engine, offers a real-time gaming experience that integrates both s and t domain transfer functions. It follows the function path using activated quantization, time, and input settings. The game features customizable settings, including game speed, pin tail, joystick, and collision toggle. It is deployable on Android, computers, and the WebGL online platform. The game was highly effective in the target population of 48 Electronics Engineering students enrolled in Control Systems. The majority of students reported that the game helped them visualize control systems (83.04%, x̄=4.15, p=0.004), appreciate their applications (89.13%, x̄=4.46, p<0.001), and apply various transfer functions (85.65%, x̄=4.28, p<0.001). Additionally, the game was considered presentable (80.00%, x̄=4.00, p<0.001), aided in obtaining correct settling times (83.91%, x̄=4.20, p<0.001), and was user-friendly (82.50%, x̄=4.13, p<0.001). Overall, the 3D Snake Game is a valuable educational tool, enhancing the learning experience by making complex control system concepts more accessible and engaging for students. The game's ability to provide a hands-on, interactive approach to learning allows students to grasp theoretical concepts better and see their practical applications in real-time. This innovative teaching method improves comprehension and increases student interest and motivation in the subject matter.

Research on software and hardware for the implementation of virtual reality technology

Virtual reality (VR) technology is rapidly entering the life space of humanity. Modern VR is not only entertainment and games. This technology is used in education, marketing, medicine, and the military industry, which gives a great impetus to its further development. With the help of this technology, it is possible to change the ways of communication between people, using all the charms of the virtual world. This article is devoted to the problem of studying various software and hardware tools for the implementation of virtual reality, in particular, as an example, the development of a VR application for the organization of personal computer maintenance training is presented. The article substantiates the relevance of the research, reviews scientific and methodical literature on the implementation of VR in various spheres of society. The existing software and hardware components of virtual reality technology, tools and frameworks are described. A comparative analysis of the created VR simulators for training in computer maintenance was conducted, their characteristics were presented, which made it possible to improve some operations in the developed application: the process of assembling computer components was detailed. The Unity game engine was used to develop this training, as it is quite simple and cross-platform. Processing of 3D models was carried out with the help of the «Blender» program. The C# programming language was used for development. The application was developed for the Oculus Quest 2 glasses, so the Oculus Integration SDK was used. After writing the project, a build was created for the «Android» platform, which is a file with the «apk» extension that can be installed on the end device. The main types of interaction are represented using a UML diagram of use cases. Currently, the following training tasks are implemented in the application: replacing the BIOS battery, RAM, applying thermal paste to the processor. In the further stages of development, it is planned to add other maintenance tasks, thereby expanding the functionality of the application. This application can be used in the educational process for students of the field of «Information Technologies» .

Approaches to automating VR applications porting using common techniques

The problem of automatic porting of virtual reality applications developed in the Unity game engine using native libraries of different virtual reality headsets to other headsets is considered. The problems arising during porting are identified and the algorithm of their solution is described. The presented solution is tested in the work on porting VR-applications developed earlier by the authors to different headsets, on the basis of the obtained results the general conclusion is made about the feasibility of using the developed tool for automatic porting of VR-applications. Problems yet to be solved are described and scalability possibilities are presented. With the demonstrated growth of VR use in education and in industry, the task of porting is quite broad, so the presented solution allows to achieve a significant effect if it is necessary to expand the range of headsets used.

Direct Solid Modelling in Virtual Reality for Systems Architecting

Virtual reality (VR) is gaining more and more interest in multidisciplinary early design activities, from eliciting stakeholder needs to designing a system architecture. The design of a system architecture can be simplified as the definition of three views: functional, behavioural, and structural. The geometric modelling capabilities needed for the embodiment design are still based on desktop-based parametric CAD models, which were eventually transformed into a polyhedral model that can be visualised in VR. When a multidisciplinary team gets together to generate candidate design architecture, they need to create conceptual 3D shapes and determine the layout of components. In this paper, we propose the Virtual Reality Shape Modelling (VRSM) environment for the immersive direct modelling of 3D shapes in VR. VRSM integrates the open-source FreeCAD shape modeller with the game engine Unity. FreeCAD enables the user to capture the history of feature-based operations and to create a parametric representation needed for detailed CAD activities, whereas Unity allows the interaction with polyhedral models in a 3D environment. The current version of VRSM offers modelling capabilities to create, delete, move and resize canonical shapes and apply Boolean operators on a polyhedral model in VR. At the same time, the parametric definition in FreeCAD evolves synchronously.

Exploring Ragdoll Physics in Crowd Disaster Simulation

Abstract Objective This study explores the feasibility of applying ragdoll physics, a procedural animation, and related game-engine technologies to create real-time simulations for investigating crowd disasters. Methods We harnessed the power of the Unity Game Engine to develop real-time simulation for the dynamics of a crowd disaster with rendering of scene objects and user interface (UI) elements. Humanoid agents with trigger colliders were linked to color schemes representing impact forces sustained with lethal thresholds ranging from 500 to 550 pounds force for males and 450 to 500 pounds force for females. The simulation enables users to manipulate parameters such as population, crowd density, directional movement and forces applied. Results Our simulation showcases an animated real-time depiction of a crowd disaster and enables visualization of casualties, both injured and dead, based upon a quantitative evaluation of the forces sustained. Conclusions Utilization of the Unity Game Engine for the development of visually-engaging real-time crowd disaster simulation has promising outcomes. This novel approach for modeling and analysis of crowd dynamics may provide valuable insights with applications in mass gatherings, crowd management, safety, and preparedness.

Optimal 2D Placement of Virtual Objects in Physical Space for Augmented Reality Applications

Optimal 2D Placement of Virtual Objects in Physical Space for Augmented Reality Applications

DESIGNING A 3D ROGUELIKE GAME WITH PROCEDURAL CONTENT GENERATION USING THE GRAPH GRAMMARS METHOD

Roguelike is a genre of role-playing video game in which the player explores dungeons through procedurally generated levels. If they lose, the player loses progress, and the character starts over again. Procedural Content Generation (PCG) is a computer program that can create game content automatically, randomly, and uniquely, either by itself or with human assistance. In this study, the 3D roguelike game was designed with players playing a character to explore dungeons. Players will enter at one point, explore the surrounding environment, defeat the enemies encountered, avoid traps, collect treasure, and finally exit at another point. Each time the player starts a new game session, the game will generate a dungeon with a mission structure that changes randomly to create a variety of gameplay. This mission generation is implemented using the Graph Grammar method. The game is built using the Unity game engine and is intended to run on Android devices. Based on the black box test results, all the game's features are running well according to their functions. The built games will be evaluated using the GUESS-18 to determine the level of player satisfaction. Based on the evaluation results, the game is included in the "GOOD" category, with an overall score of 49.07 out of 63 maximum scores. The game that has been built is superior in the aspect of personal gratification, while it is weak in the aspect of social connectivity.

Pembuatan Gim Edukasi Sejarah Pertempuran Tiga Hari Surabaya Menggunakan Interactive Digital Narrative

The rapid development of technology has impacted various aspects of life, including educational institutions, which are increasingly utilizing information technology to enhance the quality of learning. One significant advancement in information technology is the use of games as an educational tool. This research explores the Interactive Digital Narrative (IDN) design method in the development of history-based educational games. The game created in this study is set against the historical backdrop of the Pertempuran Tiga Hari Surabaya, which is one of the events leading up to the historic Pertempuran 10 November 1945 in Surabaya. Adapting a previously proposed methodology, the game is built using the Unity Game Engine and tested through Likert scale assessments. The test results reveal a positive average percentage of 80%, indicating that the IDN approach can make history-based educational games more engaging and effective. This research provides a valuable contribution to educational technology development, aiding educators in designing more efficient and meaningful lessons, particularly in the field of Social Sciences, which plays a crucial role in students' understanding of history and values like patriotism.

Design and Implementation of Puzzle Adventure Game Based on Unity

With the progress of Gaming industry, the classic genre Puzzle adventure games, due to their friendly difficulty level, low learning curve, and interesting game mechanics, have been favored by a large number of players. This paper follows the guiding principles of software engineering and game development, designs and implements an adventure puzzle game using the Unity game engine. The game design is carried out through multiple aspects such as game art style, plot, sound effects, and game puzzles to provide players with an interesting gameplay experience. For the implementation part of the game, various plugins and functions of the Unity engine are integrated to complete the development of the game system, such as using Unitys navigation system to bake navigation meshes and implement automatic pathfinding for game characters. The animation state machine is used to arrange and control game character animations, and the Unity event system is used to implement click-based interactive functions in the game. At the same time, optimization was carried out based on the test results, improving the experience of user interface and the stability of game program, further enhancing the players gameplay experience. Finally, players can experience thrilling adventure in a mysterious world, and achieve a sense of accomplishment by solving puzzles and overcoming obstacles.

Augmented reality implementation as a media for product promotion to reduce paper use

The use of paper as a media for product promotion is still widely used by companies in introducing their products. Promotional media used include brochures and flyers which are indeed printed to be distributed to potential customers. This way of promotion has an impact on the large number of paper-based promotional media which are then discarded after viewing. As it is known that paper comes from trees, currently, there are many environmental problems originating from illegal logging of forest trees and deforestation, which have an impact on ecosystems and the natural environment. During the current use of technology, the use of product introduction promotional media can use Augmented Reality (AR) technology. With AR, potential consumers can see 3D objects from products being marketed so that paper use can be reduced. In building AR, we use Game Engine Unity and Vuforia to be able to display 3-dimensional objects. This research is also based on Android as the base of the operating system. For the case study, we use four furniture products such as tables, chairs, and sofas as a subject of implementation. The purpose of this research is to reduce the use of paper as a medium for product promotion. The results of the research are in the form of media applications for promotion of Augmented Reality-based furniture products. Testing uses black box testing to test the performance of the AR along with testing various marker conditions, such as in low light and high light condition.

Development of a remotely applied app‐based cognitive training for early Alzheimer’s disease

AbstractBackgroundCognitive training (CT) has been proposed to attenuate cognitive decline in early Alzheimer’s disease and can be administered remotely. Here, we describe the design and development of an adaptive app‐based CT to remotely train cognitive functions that are affected early in the course of Alzheimer’s disease. We furthermore present interim results of CT acceptance and adherence in a group of participants with subjective cognitive decline (SCD).MethodWe used the Unity Game Engine software and the programming language C# to design a CT app with 16 games that target AD‐typical impairments in episodic and semantic memory and spatial processing, including working memory tasks to facilitate transfer processes (Figure 1). During each training session three games (each 10 min) are played. The training is adaptive to ensure a constant level of challenge, i.e., players progress to higher levels when they win rounds and decrease to lower levels when they lose rounds. The broad range of tasks ensures continued motivation and adherence of the participants over a prolonged training period. We aimed to design the game interfaces and navigation as user‐friendly as possible to maximize usability. Via an integrated help button participants can furthermore ask for help during home training. CT adherence can be assessed remotely.ResultPreliminary results on adherence and game experience show that participants with SCD (n = 62) like the games (5.49±0.13) and are motivated to perform well (6.3±0.08), despite being challenged (5.84±0.09) (7‐point Likert scale). After a 10‐week CT intervention, cognitive improvement is rated at 4.94±0.24 and participants would recommend the CT to a friend at 7.01±0.37 (9‐point Likert scale). Moreover, they would recommend that the games should be played for 32±2.64 min per day. The drop‐out rate is very low (4.6%). At the time of AAIC we will present additional data on acceptance/adherence and feasibility.ConclusionRemotely administered app‐based CT is applicable in the home setting and successful in motivating participants with early AD, which is also reflected in high adherence rates and acceptability. Future research should extend app‐based interventions to also target individuals with advanced cognitive impairment and applications for use in care‐home settings.

“Fox Fables” an Adventure based 2D Game in Unity Game Engine

Abstract: This research paper explores "Fox Fables," a 2D adventure game developed with the Unity game engine, emphasizing dynamic storytelling and AI-driven gameplay. Players assume the role of Felix, a clever fox navigating an intricately designed world with unique characters and narratives. The Unity engine serves as the project's backbone, enabling the creation of visually stunning environments, 2D characters, and seamless gameplay mechanics. NPC characters, including Grunt Eagles, Frogs, and the formidable Gorilla, are brought to life through specific AI algorithms, such as pathfinding, Finite State Machines, and Behaviour Trees. A standout feature is the dynamic narrative system, adapting to player choices and influencing character alliances. Sparrow, Turtle, and Cat, as static NPCs, offer guidance, items, and in-game purchases. Player choices shape alliances, conflicts, and distinct outcomes in the climactic Dark Theme, where Felix faces the Gorilla in a final battle. Unity's user-friendliness and scalability contributed to an immersive and engaging gaming experience. AI algorithms effectively create realistic NPC behaviours, enriching gameplay. The dynamic narrative system enhances player engagement, providing unique storylines. In conclusion, "Fox Fables" exemplifies the fusion of narrative-driven gameplay and AI-driven character interactions. It underscores the potential of the Unity game engine and dynamic storytelling in modern game development, contributing insights to the broader field.