Immersive 3D Research Articles

3D Virtual Reality Smartphone Training for Chemotherapy Drug Administration by Non-oncology Nurses: A Randomized Controlled Trial.

Chemotherapy agents are cytotoxic materials. Thus, there is a need for the operators to be familiar with the knowledge and procedures before operation. We conducted a randomized controlled trial investigating the effectiveness of an immersive 3D VR teaching of chemotherapy administration operated in a smartphone coupled with a visual and audio device. We adopted a two-arm single-blind design and recruited 83 nurses, and they were randomized using a cluster approach. The VR group learned chemotherapy administration through VR, while the controlled group learned through document reading. The Knowledge and Attitude of Chemotherapy Administration (KACA) was administrated before the intervention, while the Objective Structured Clinical Examination (OSCE) and the Checklist of Action Accomplishment (CAA) were administrated one month after the intervention. The VR group scored higher than the controlled group in the CAA (95.69 ± 5.37 vs. 91.98 ± 9.31, p = 0.02) and the OSCE (73.07 ± 10.99 vs. 67.44 ±10.65, p = 0.02). Stepwise regression demonstrated that service years, an education level of undergraduate or above, and VR exposure contributed positively to the OSCE score (adjusted R2 = 0.194, p = 0.028). The use of VR improves the learning efficacy of chemotherapy administration in non-oncology nurses. We recommend using VR as a teaching tool for chemotherapy administration and other chemotherapy-related skills in a VR learning group with senior nurses with higher education levels as advisors. The study provides an approach to online training, especially during the COVID-19 pandemic. (CONSORT 2010 guidelines, registry number: NCT 04840732).

Designing Guided User Tasks in VR Embodied Experiences

Virtual reality (VR) offers extraordinary opportunities in user behavior research to study and observe how people interact in immersive 3D environments. A major challenge of designing these 3D experiences and user tasks, however, lies in bridging the inter-relational gaps of perception between the designer, the user, and the 3D scene. Paul Dourish identified three gaps of perception: ontology between the scene representation and the user and designer interpretation, intersubjectivity of task communication between designer and user, and intentionality between the user's intentions and designer's interpretations. We present the GUsT-3D framework for designing Guided User Tasks in embodied VR experiences, i.e., tasks that require the user to carry out a series of interactions guided by the constraints of the 3D scene. GUsT-3D is implemented as a set of tools that support a 4-step workflow to (1) annotate entities in the scene with navigation and interaction possibilities, (2) define user tasks with interactive and timing constraints, (3) manage interactions, task validation, and user logging in real-time, and (4) conduct post-scenario analysis through spatio-temporal queries using ontology definitions. To illustrate the diverse possibilities enabled by our framework, we present two case studies with an indoor scene and an outdoor scene, and conducted a formative evaluation involving six expert interviews to assess the framework and the implemented workflow. Analysis of the responses show that the GUsT-3D framework fits well into a designer's creative process, providing a necessary workflow to create, manage, and understand VR embodied experiences.

Enhancing Intrinsic Motivation of Librarian Students using Virtual Reality for Education in the Context of Culture Heritage Museums

In this study the effects of intrinsic motivation and learning competency of virtual realitybased learning is compared to traditional text-based learning. In the study 28 students were involved from the second and third years of the library and information science faculty. The application of the fully immersive virtual 3D environment of Wieng Yong House was developed to support the virtual realitybased learning in the context of museums for culture heritage. To verify the hypothesis, the control group (traditional text-based learning), consisted of 14 students, used the course module of metadata for culture heritage in the museum whereas the experimental group (control group), consisted of 14 students, was provided virtual reality-based learning in the virtual museum. The tools of measurement were the pre-test/post-test quiz for learning competency and Intrinsic Motivation Inventory (IMI) with interview. The statistical model of paired sampled t-test assumptions was chosen for the statistical investigation for the hypothesis. The results suggest that constructing a virtual reality for learning in the context of a museum for cultural heritage might be a good way to enhance intrinsic motivation but cannot sufficiently and significantly improve the student's learning competency.

Development and Validation of a Novel Methodological Pipeline to Integrate Neuroimaging and Photogrammetry for Immersive 3D Cadaveric Neurosurgical Simulation.

BackgroundVisualizing and comprehending 3-dimensional (3D) neuroanatomy is challenging. Cadaver dissection is limited by low availability, high cost, and the need for specialized facilities. New technologies, including 3D rendering of neuroimaging, 3D pictures, and 3D videos, are filling this gap and facilitating learning, but they also have limitations. This proof-of-concept study explored the feasibility of combining the spatial accuracy of 3D reconstructed neuroimaging data with realistic texture and fine anatomical details from 3D photogrammetry to create high-fidelity cadaveric neurosurgical simulations.MethodsFour fixed and injected cadaver heads underwent neuroimaging. To create 3D virtual models, surfaces were rendered using magnetic resonance imaging (MRI) and computed tomography (CT) scans, and segmented anatomical structures were created. A stepwise pterional craniotomy procedure was performed with synchronous neuronavigation and photogrammetry data collection. All points acquired in 3D navigational space were imported and registered in a 3D virtual model space. A novel machine learning-assisted monocular-depth estimation tool was used to create 3D reconstructions of 2-dimensional (2D) photographs. Depth maps were converted into 3D mesh geometry, which was merged with the 3D virtual model’s brain surface anatomy to test its accuracy. Quantitative measurements were used to validate the spatial accuracy of 3D reconstructions of different techniques.ResultsSuccessful multilayered 3D virtual models were created using volumetric neuroimaging data. The monocular-depth estimation technique created qualitatively accurate 3D representations of photographs. When 2 models were merged, 63% of surface maps were perfectly matched (mean [SD] deviation 0.7 ± 1.9 mm; range −7 to 7 mm). Maximal distortions were observed at the epicenter and toward the edges of the imaged surfaces. Virtual 3D models provided accurate virtual measurements (margin of error <1.5 mm) as validated by cross-measurements performed in a real-world setting.ConclusionThe novel technique of co-registering neuroimaging and photogrammetry-based 3D models can (1) substantially supplement anatomical knowledge by adding detail and texture to 3D virtual models, (2) meaningfully improve the spatial accuracy of 3D photogrammetry, (3) allow for accurate quantitative measurements without the need for actual dissection, (4) digitalize the complete surface anatomy of a cadaver, and (5) be used in realistic surgical simulations to improve neurosurgical education.

Geological Survey of South Australia: 3D immersion for land access negotiations

Geological Survey of South Australia: 3D immersion for land access negotiations

IEEE VR 2022 [2 awards

The 2021 VGTC Virtual Reality Best Dissertation Award goes to Mayra Donaji Barrera Machuca, a 2019 graduate from Simon Fraser University, for her dissertation entitled, “Towards More Accurate Immersive 3D Sketching.”. The 2021 VGTC Virtual Reality Best Dissertation Honorable Mention goes to Javad Fotouhi. Dissertation Title: Augmented reality and artificial intelligence in image-guided and robot-assisted interventions.

Application of Real and Virtual Radial Arm Maze Task in Human.

Virtual Reality (VR) emerges as a promising technology capable of creating different scenarios in which the body, environment, and brain are closely related, proving enhancements in the diagnosis and treatment of several spatial memory deficits. In recent years, human spatial navigation has increasingly been studied in interactive virtual environments. However, navigational tasks are still not completely adapted in immersive 3D VR systems. We stipulate that an immersive Radial Arm Maze (RAM) is an excellent instrument, allowing the participants to be physically active within the maze exactly as in the walking RAM version in reality modality. RAM is a behavioral ecological task that allows the analyses of different facets of spatial memory, distinguishing declarative components from procedural ones. In addition to describing the characteristics of RAM, we will also analyze studies in which RAM has been used in virtual modality to provide suggestions into RAM building in immersive modality.

Eye MG 3D Application - A comprehensive ocular anatomy and pathophysiology 3D atlas with real-time true color confocal images to enhance ophthalmology education and e-Counseling.

Concepts pertaining to ophthalmology have lots of theoretical frameworks. Neophyte residents and novice surgeons may have to mentally visualize these concepts during the initial days of training. Only a powerful cognitive tool such as a three-dimensional (3D) eyeball model, with real-time TrueColor confocal images (and not animated images or models), can fill in these intellective mental gaps. Giving the users (i.e., residents and students) the power to choose and visualize various parts of the eye, with multiple magnitudes of zoom, is mandatory for optimal e-learning. To make ophthalmic concept learning better, we have developed a 3D app Eye MG 3D (patent pending) comprising ocular anatomy and pathophysiological 3D models, built on an advanced interactive 3D touch interface, by using patient’s real-time confocal images to serve as a new-age pedagogical tool and e-counseling. According to our knowledge, there are no applications to date that incorporate real-time high-resolution multimodal confocal fundus images and photoreal visuals for interactive and immersive 3D learning.

Developing an immersive 3D video for lumbar puncture teaching.

Medical EducationVolume 56, Issue 5 p. 579-580 REALLY GOOD STUFF Developing an immersive 3D video for lumbar puncture teaching Agathe Vrillon, Corresponding Author Agathe Vrillon agathe.vrillon@aphp.fr orcid.org/0000-0002-0761-7885 Correspondence Agathe Vrillon, Université de Paris, Cognitive Neurology Centre, GHU APHP Nord University, Hospital Lariboisière-Fernand Widal, Paris, France. Email: agathe.vrillon@aphp.frSearch for more papers by this authorLaurent Gonzales-Marabal, Laurent Gonzales-MarabalSearch for more papers by this authorClaire Paquet, Claire PaquetSearch for more papers by this authorJulien Dumurgier, Julien DumurgierSearch for more papers by this author Agathe Vrillon, Corresponding Author Agathe Vrillon agathe.vrillon@aphp.fr orcid.org/0000-0002-0761-7885 Correspondence Agathe Vrillon, Université de Paris, Cognitive Neurology Centre, GHU APHP Nord University, Hospital Lariboisière-Fernand Widal, Paris, France. Email: agathe.vrillon@aphp.frSearch for more papers by this authorLaurent Gonzales-Marabal, Laurent Gonzales-MarabalSearch for more papers by this authorClaire Paquet, Claire PaquetSearch for more papers by this authorJulien Dumurgier, Julien DumurgierSearch for more papers by this author First published: 02 March 2022 https://doi.org/10.1111/medu.14761Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinked InRedditWechat No abstract is available for this article. Volume56, Issue5May 2022Pages 579-580 RelatedInformation

Teaching Students About Plagiarism Using a Serious Game (Plagi-Warfare): Design and Evaluation Study.

BackgroundEducational games have been proven to support the teaching of various concepts across disciplines. Plagiarism is a major problem among undergraduate and postgraduate students at universities.ObjectiveIn this paper, we propose a game called Plagi-Warfare that attempts to teach students about plagiarism.MethodsTo do this at a level that is beyond quizzes, we proposed a game storyline and mechanics that allow the player (or student) to play as a mafia member or a detective. This either demonstrated their knowledge by plagiarizing within the game as a mafia member or catching plagiarists within the game as a detective. The game plays out in a 3D environment representing the major libraries of the University of Johannesburg, South Africa. In total, 30 students were selected to evaluate the game.ResultsEvaluation of the game mechanics and storyline showed that the student gamers enjoyed the game and learned about plagiarism.ConclusionsIn this paper, we presented a new educational game that teaches students about plagiarism by using a new crime story and an immersive 3D gaming environment representing the libraries of the University of Johannesburg.

Effects on Co-Presence of a Virtual Human: A Comparison of Display and Interaction Types

Recently, artificial intelligence (AI)-enabled virtual humans have been widely used in various fields in our everyday lives, such as for museum exhibitions and as information guides. Given the continued technological innovations in extended reality (XR), immersive display devices and interaction methods are evolving to provide a feeling of togetherness with a virtual human, termed co-presence. With regard to such technical developments, one main concern is how to improve the experience through the sense of co-presence as felt by participants. However, virtual human systems still have limited guidelines on effective methods, and there is a lack of research on how to visualize and interact with virtual humans. In this paper, we report a novel method to support a strong sense of co-presence with a virtual human, and we investigated the effects on co-presence with a comparison of display and interaction types. We conducted the experiment according to a specified scenario between the participant and the virtual human, and our experimental study showed that subjects who participated in an immersive 3D display with non-verbal interaction felt the greatest co-presence. Our results are expected to provide guidelines on how to focus on constructing AI-based interactive virtual humans.

Internet of Things-based Digital Twins, Immersive 3D and Spatial Computing Technologies, and Virtual Data Modeling Tools in Urban Geopolitics

Internet of Things-based Digital Twins, Immersive 3D and Spatial Computing Technologies, and Virtual Data Modeling Tools in Urban Geopolitics

A Novel Integrated Eye-Tracking System with Stereo Stimuli for 3D Gaze Estimation

Eye-tracking technology is increasingly used in applications such as 3D displays and human-computer interaction (HCI). However, most current eye trackers focus on 2D point-of-gaze (PoG) estimation and cannot provide accurate gaze depth. Concerning future applications such as HCI with 3D displays, we propose an integrated binocular eye-tracking device with stereo stimuli to provide highly accurate 3D PoG estimation. In our device, the 3D stereo imaging system can provide users with a friendly and immersive 3D visual experience without wearing any accessories. The eye-capturing system can directly record the users’ eye movements under 3D stimuli without disturbance, which can realize front views of eye images while ensuring the user’s wide field of view (FOV). A regression-based 3D eye-tracking model is built based on collected eye movement data under stereo stimuli. Our model estimates users’ 2D gaze with features defined by eye region landmarks and further estimates 3D gaze with a multi-source feature set constructed by comprehensive eye movement features and disparity features from stereo stimuli. Two test stereo scenes with different depths of field are designed to verify the model’s effectiveness. Experimental results of four-fold cross-validation show that the average error for 2D gaze estimation was 0.65°. For 3D gaze estimation, the average errors are 1.69 cm over the workspace volume 50 × 30 × 75 cm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> and 0.14 m over the workspace volume 2.4 × 4.0 × 7.9 m <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> . Two preliminary validation experiments also demonstrate that our system has broad application prospects, such as 3D vision technologies and medical applications related to neurological diseases.

Metaverse Engagement Metrics, Workplace Monitoring and Tracking Systems, Behavioral Predictive Analytics in Immersive 3D Virtual Reality Environments

Metaverse Engagement Metrics, Workplace Monitoring and Tracking Systems, Behavioral Predictive Analytics in Immersive 3D Virtual Reality Environments

Digital Twin-based Cyber-Physical Production Systems in Immersive 3D Environments: Virtual Modeling and Simulation Tools, Spatial Data Visualization Techniques, and Remote Sensing Technologies

Digital Twin-based Cyber-Physical Production Systems in Immersive 3D Environments: Virtual Modeling and Simulation Tools, Spatial Data Visualization Techniques, and Remote Sensing Technologies

Immersive 3D Technologies, Spatial Computing and Visual Perception Algorithms, and Event Modeling and Forecasting Tools on Blockchain-based Metaverse Platforms

Immersive 3D Technologies, Spatial Computing and Visual Perception Algorithms, and Event Modeling and Forecasting Tools on Blockchain-based Metaverse Platforms

Digital Twin Simulation and Modeling Tools, Computer Vision Algorithms, and Urban Sensing Technologies in Immersive 3D Environments

Digital Twin Simulation and Modeling Tools, Computer Vision Algorithms, and Urban Sensing Technologies in Immersive 3D Environments

Virtual Prototyping: Evaluating the Digital Twin Based Virtual Factory for New Product Introduction

Shortening lifecycles and increasing complexity make product and production lifecycle processes more challenging than ever for manufacturing enterprises. Virtual Prototyping (VP) technologies promise a viable solution to handle such challenges in reducing time and physical builds as well as increasing quality. In previous studies, the Digital Twin (DT) based Virtual Factory (VF) concept showed significant potential to handle co-evolution by integrating 3D factory and product models with immersive and interactive 3D Virtual Reality (VR) simulation technology as well as real-time bidirectional data synchronisation between virtual and physical production systems. In this article, we present an extension to the paper “Demonstrating and Evaluating the Digital Twin Based Virtual Factory for Virtual Prototyping” presented at CARV2021. The study presents an evaluation by industry experts of the DT based VF concept for VP in the context of New Product Introduction (NPI) processes. The concept is demonstrated in two cases: wind turbine blade manufacturing and nacelle assembly operations at Vestas Wind Systems A/S. The study shows that the VF provides an immersive virtual environment, which allows the users to reduce the time needed for prototyping. The industry experts propose several business cases for the introduced solution and find that the phases that would have the most gain are the later ones (production) where the product design is more mature.

Virtual reality as a new tool for transport data collection

Transport studies that adopt complex analyses present methodological challenges that lead to the use of innovative techniques to address the limitations of traditional methods. In the Latin American context, people consider security as a relevant variable in their daily lives. Thus, when people travel around the city and choose a mode of transport, secu-rity becomes an important factor and should therefore be included in transport studies. However, the definition of security in terms of transport in the Colombian context remains unclear. Therefore, we examined the security percep-tion effect on transport mode choice by addressing security as a latent variable consisting of three elements: environ-ment, subject and transport mode. We proposed the use of virtual reality (VR) to recreate travel routes and offer partic-ipants a scenario of choice closer to the natural conditions of a trip. The participants were provided routes in the form of immersive 3D videos recreating natural trip conditions to identify their choices and travel behaviour. Recordings were made of daily scenarios and existing urban environments portraying real and active modes of transport, giving respondents an almost-natural experience. The use of 360-degree immersive videos offers a multisensory experience allowing both the capture of socioeconomic and travel information and the collection of journey perception. The experiment evaluated two environments in Medellín, Colombia (secure (E1) and insecure (E2)) and studied the effects of lighting conditions (day (D) and night (N)). A total of four videos (E1D, E1N, E2D and E2N) depicting six transport modes in tandem were assessed by 92 participants from Medellín and Bogotá, Colombia. We found that environment-associated security perception varies depending on the time of the journey (day/night) and one’s familiarity with the environment. The research results position VR as a tool that offers high potential to support transport studies. We found that people’s movements, gestures and expressions while participating in the VR experiments resembled what was expected from journeys in reality. VR constitutes a relevant tool for transport studies, as it allows for an assessment of active transport mode perceptions. It prevents participants from being exposed to the risk associated with travel to specific places and carries out several routes in different transport modes even when participants cannot or have never undertaken journeys in the modes under assessment.

Investigation of Metaverse in cryptocurrency

Metaverse is an immersive 3D virtual environment, a true virtual artificial community in which avatars act as the user's alter ego and interact with each other. If we do not manage the hype for the metaverse, which has recently been receiving a surge in interest, the metaverse will fail to cross the chasm. This article conducts a comprehensive survey on computational arts, in which seven critical topics are relevant to the metaverse, describing novel artworks in blended virtual-physical realities. The topics first cover the building elements for the metaverse, e.g. Virtual scenes and characters, auditory, textual elements. Next, several remarkable types of novel creations in the expanded horizons of metaverse cyberspace have been reflected, such as immersive arts, robotic arts, and other user-centric approaches fuelling contemporary creative outputs.