Immersive 3D Virtual Environment Research Articles

Multi-source point cloud registration for urban areas using a coarse-to-fine approach

ABSTRACT The foundational step in constructing a digital twin involves transforming the physical world into an immersive 3D virtual environment. Unmanned aerial vehicle (UAV)-based photogrammetry, mobile mapping system (MMS), and terrestrial laser scanning (TLS) serve as powerful tools for 3D reconstruction of urban environments. Given the distinctive strengths and weaknesses of each sensor, a multi-source point cloud registration technique is imperative to achieve a detailed and precisely geolocated 3D urban model. Hence, we developed coarse-to-fine approach methods, called building exterior wall-based (BEWB) and building outline-based (BOB) algorithms, to register point clouds captured by diverse sensors in urban scenes. The BEWB algorithm coarsely registers urban point clouds by extracting building exterior walls, establishing correspondence points, and effectively removing outliers within this correspondence point set. The BOB algorithm precisely registers the urban point clouds acquired from multiple sensors by leveraging building outlines and points corresponding to the ground of the point clouds. To validate the proposed algorithms, we initially registered a UAV-based photogrammetry point cloud with the MMS point cloud and subsequently registered the TLS point clouds. Comprehensive quantitative and qualitative analyzes of the results demonstrate that our algorithms outperform existing methods in achieving precise registration. By successfully registering three distinct point clouds, we generated a comprehensive urban scene point cloud characterized by enhanced precision, point density, and geolocation accuracy.

Exploring the implications of the metaverse: opportunities and challenges for dance movement therapy

This paper explores the integration of emerging technologies, specifically the metaverse and virtual reality (VR), into the field of dance movement therapy (DMT). The metaverse is conceptualised as a unified, immersive 3D virtual environment that transcends the limitations of the physical world. The author includes vignettes illustrating the practical application of VR in therapy and relaxation as used currently and speculates about the potential future applications of multi-sensory virtual environments. The paper reflects on the concept of embodiment in VR and its potential implications for DMT, discussing the convergence and divergence of principles. The paper concludes with a discussion on the ethical considerations, highlighting privacy, data security, informed consent, accessibility, inclusivity, psychological impact, therapeutic boundaries, cultural sensitivity, efficacy, evidence-based practice, and ethical development and deployment.

Metaverse integration challenges: An in-depth ISM and MICMAC analysis

Though metaverse is gaining popularity as a highly interactive, immersive, and collaborative 3D virtual environment having the potential to enhance consumer experience in multiple spheres of life, its adoption significantly depends on resolving the consumer perceived adoption barriers. Through a thorough examination of the extensive literature on metaverse and with the assistance of domain experts from academia and industry, this study identifies nine key adoption barriers and presented a five-layered interpretive structure representing the causal relationship between these barriers using Interpretive Structural Modeling (ISM) and Matrice d'Impacts Croisés Multiplication Appliquée à un Classement (MICMAC) as methodological approaches. While telepresence, privacy and security, culture, unfamiliarity with metaverse technology, regulations ambiguity, payment method, ethical considerations, perceived cost, and lack of immersive platforms are identified as key barriers; culture and unfamiliarity with metaverse technology are identified as the most influential adoption barriers for metaverse. Metaverse design must take into account these barriers for acceptance of this platform.

Digital Twin and Metaverse Technologies, Cognitive Mapping and Navigation Tools, and Image Processing Computational and Object Tracking Algorithms in Immersive 3D Virtual Reality Environments

Digital Twin and Metaverse Technologies, Cognitive Mapping and Navigation Tools, and Image Processing Computational and Object Tracking Algorithms in Immersive 3D Virtual Reality Environments

Metaverse Engagement Metrics, Workplace Monitoring and Tracking Systems, Behavioral Predictive Analytics in Immersive 3D Virtual Reality Environments

Metaverse Engagement Metrics, Workplace Monitoring and Tracking Systems, Behavioral Predictive Analytics in Immersive 3D Virtual Reality Environments

Investigation of Metaverse in cryptocurrency

Metaverse is an immersive 3D virtual environment, a true virtual artificial community in which avatars act as the user's alter ego and interact with each other. If we do not manage the hype for the metaverse, which has recently been receiving a surge in interest, the metaverse will fail to cross the chasm. This article conducts a comprehensive survey on computational arts, in which seven critical topics are relevant to the metaverse, describing novel artworks in blended virtual-physical realities. The topics first cover the building elements for the metaverse, e.g. Virtual scenes and characters, auditory, textual elements. Next, several remarkable types of novel creations in the expanded horizons of metaverse cyberspace have been reflected, such as immersive arts, robotic arts, and other user-centric approaches fuelling contemporary creative outputs.

A Study on Metaverse Hype for Sustainable Growth

Metaverse is an immersive 3D virtual environment, a true virtual artificial community in which avatars act as the user's alter ego and interact with each other. If we do not manage the hype for the metaverse, which has recently been receiving a surge in interest, the metaverse will fail to cross the chasm. In this study, to provide stakeholders with insights for the successful introduction and growth of the 3D immersive next-generation virtual world, metaverse, we analyzed user-side interest, media-side interest, and research-side interest. For this purpose, in this study, search traffic, news frequency and topic, and research article frequency and topic were analyzed. The methodology and results of this study are expected to provide insight for the stable success of metaverse transformation and the coexistence of the real world and the virtual world through hyper-connection and hyper-convergence.

Does the Size-Arrival Effect Occur With an Active Collision-Avoidance Task in an Immersive 3D Virtual Reality Environment?

Determine whether the size-arrival effect (SAE) occurs with immersive, 3D visual experiences and active collision-avoidance responses. When a small near object and a large far object approach the observer at the same speeds, the large object appears to arrive before the small object, known as the size-arrival effect (SAE), which may contribute to crashes between motorcycles and cars. Prior studies of the SAE were limited because they used two dimensional displays and asked participants to make passive judgments. Participants viewed approaching objects using a virtual reality (VR) headset. In an active task, participants ducked before the object hit them. In a passive prediction-motion (PM) judgment, the approaching object disappeared, and participants pressed a button when they thought the object would hit them. In a passive relative TTC judgment, participants reported which of two approaching objects would reach them first. The SAE occurred with the PM and relative TTC tasks but not with the ducking task. The SAE can occur in immersive 3D environments but is limited by the nature of the task and display. Certain traffic situations may be more prone to the SAE and have higher risk for collisions. For example, in left-turn scenarios (e.g., see Levulis, 2018), drivers make passive judgments when oncoming vehicles are far and optical expansion is slow, and binocular disparity putatively is ineffective. Collision-avoidance warning systems may be needed more in such scenarios than when vehicles are near and drivers' judgments of TTC may be more accurate (DeLucia, 2008).

Does the Size-Arrival Effect Occur with an Active Collision- Avoidance Task in an Immersive 3D Virtual Reality Environment?

ObjectiveDetermine whether the size-arrival effect (SAE) occurs with immersive, 3D visual experiences and active collision-avoidance responses.BackgroundWhen a small near object and a large far obj...

AeroVR: An immersive visualisation system for aerospace design and digital twinning in virtual reality

ABSTRACTOne of today’s most propitious immersive technologies is virtual reality (VR). This term is colloquially associated with headsets that transport users to a bespoke, built-for-purpose immersive 3D virtual environment. It has given rise to the field of immersive analytics—a new field of research that aims to use immersive technologies for enhancing and empowering data analytics. However, in developing such a new set of tools, one has to ask whether the move from standard hardware setup to a fully immersive 3D environment is justified—both in terms of efficiency and development costs. To this end, in this paper, we present AeroVR—an immersive aerospace design environment with the objective of aiding the component aerodynamic design process by interactively visualizing performance and geometry. We decompose the design of such an environment into function structures, identify the primary and secondary tasks, present an implementation of the system, and verify the interface in terms of usability and expressiveness. We deploy AeroVR on a prototypical design study of a compressor blade for an engine.

Beyond Fitts's Law: A Three-Phase Model Predicts Movement Time to Position an Object in an Immersive 3D Virtual Environment.

The study examines the factors determining the movement time (MT) of positioning an object in an immersive 3D virtual environment. Positioning an object into a prescribed area is a fundamental operation in a 3D space. Although Fitts's law models the pointing task very well, it does not apply to a positioning task in an immersive 3D virtual environment since it does not consider the effect of object size in the positioning task. Participants were asked to position a ball-shaped object into a spherical area in a virtual space using a handheld or head-tracking controller in the ray-casting technique. We varied object size (OS), movement amplitude (A), and target tolerance (TT). MT was recorded and analyzed in three phases: acceleration, deceleration, and correction. In the acceleration phase, MT was inversely related to object size and positively proportional to movement amplitude. In the deceleration phase, MT was primarily determined by movement amplitude. In the correction phase, MT was affected by all three factors. We observed similar results whether participants used a handheld controller or head-tracking controller. We thus propose a three-phase model with different formulae at each phase. This model fit participants' performance very well. A three-phase model can successfully predict MT in the positioning task in an immersive 3D virtual environment in the acceleration, deceleration, and correction phases, separately. Our model provides a quantitative framework for researchers and designers to design and evaluate 3D interfaces for the positioning task in a virtual space.

Design of an immersive simulator for assisted power wheelchair driving.

Driving a power wheelchair is a difficult and complex visual-cognitive task. As a result, some people with visual and/or cognitive disabilities cannot access the benefits of a power wheelchair because their impairments prevent them from driving safely. In order to improve their access to mobility, we have previously designed a semi-autonomous assistive wheelchair system which progressively corrects the trajectory as the user manually drives the wheelchair and smoothly avoids obstacles. Developing and testing such systems for wheelchair driving assistance requires a significant amount of material resources and clinician time. With Virtual Reality technology, prototypes can be developed and tested in a risk-free and highly flexible Virtual Environment before equipping and testing a physical prototype. Additionally, users can "virtually" test and train more easily during the development process. In this paper, we introduce a power wheelchair driving simulator allowing the user to navigate with a standard wheelchair in an immersive 3D Virtual Environment. The simulation framework is designed to be flexible so that we can use different control inputs. In order to validate the framework, we first performed tests on the simulator with able-bodied participants during which the user's Quality of Experience (QoE) was assessed through a set of questionnaires. Results show that the simulator is a promising tool for future works as it generates a good sense of presence and requires rather low cognitive effort from users.

The efficacy of an immersive 3D virtual versus 2D web environment in intercultural sensitivity acquisition

Relatively few studies have empirically tested computer-based immersive virtual environments’ efficacy in teaching or enhancing pro-social attitudes, such as intercultural sensitivity. This channel study experiment was conducted (N = 159) to compare what effects, if any, an immersive 3D virtual environment would have upon subjects’ intercultural sensitivity, compared to a 2D web environment. Significant gains in intercultural sensitivity were found, with subjects exposed to the Second Life-based immersive virtual environment scoring higher than web-based subjects, both toward other cultures in general and toward Chinese culture in particular. An interaction effect for gender and channel was found, with males experiencing greater intercultural sensitivity outcomes than in a web environment. These empirical findings add to our theoretical understanding of channel effects and intercultural sensitivity. The results can guide cultural instructors or trainers toward the best platforms for content delivery to learners. These findings are worthy of future investigation to better understand their application in educational endeavors as well as in other fields.

Influence of changing frequency and various sceneries on stabilometric parameters and on the effect of adaptation in an immersive 3D virtual environment.

The aim of the study was to examine the influence of different types of virtual sceneries and frequencies of movement of visual disturbances on stabilometric values as well as whether individual sceneries and changing frequency can minimize effect of adaptation of tested person to applied disturbances. There were 23 healthy participants. A person has been standing on a Zebris stabilometric platform. Virtual 3D environment was displayed by means of HMD Oculus Rift system. An open (a meadow) and closed (a room) sceneries were used. The sceneries moved along the sagittal axis and rotated around horizontal axis. The measurement lasted 30 seconds and in the middle of it frequency of translational movement was changed from 0.7 Hz to 1.4 Hz or from 1.4 Hz to 0.7 Hz. The data were reported as medians of COP velocity and ellipse area. Visual disturbances caused the increase of these values in comparison with the tests conducted with open eyes. Results divided into periods (the first and the second 15 seconds) showed that in the first half of the test values were higher compared to the second half. The comparison of values obtained for open and closed scenery showed that higher values were recorded for open scenery. The comparison of both types of sceneries on the basis of COP velocity and ellipse area showed that open scenery had a greater impact on the measured stabilometric values. It was found out as well that people got accustomed to the applied disturbances, but this effect was lower in the open scenery.

Organics unpacked: The influence of packaging on the choice for organic fruits and vegetables

In many supermarkets throughout Europe, it has become common practice in the fruit and vegetable department to offer options in plastic packaging. Recent trends, however, move towards the removal of packaging. The current study examines whether offering fruit and vegetables without primary packaging increases the likelihood that consumers choose these products. This is especially relevant for organic fruit and vegetables, given that plastic may be perceived as contrary to the sustainable nature of these products. A first experiment, using a student sample and an immersive 3D virtual supermarket environment, shows that choice for organic fruit and vegetables indeed increases when organics are offered without packaging. A second experiment with the virtual supermarket generalizes these findings to a sample of supermarket patrons, additionally showing that unpacked fruit and vegetables are preferred over packed options overall, both for organic and non-organic products. We conclude that removing the primary packaging of organic fruit and vegetables appears to be a promising intervention in attempts to increase organic sales.

Understanding emotional bond between the creator and the avatar: Change in behavioral intentions to engage in alcohol-related traffic risk behaviors

This study examines the joint impact of an individual's relationship with his or her avatar and negative consequences to the avatar on changing the individual's behavioral intentions (BI) in terms of alcohol-impaired driving. One hundred eleven participants volunteered to participate in several experimental conditions where the degree of choice of avatar features and the degree of control of the avatar's actions were manipulated in Second Life, an immersive 3D virtual environment. Participants who were allowed to customize their avatars viewed their avatars not only more similar but also emotionally closer to themselves, and perceived their avatars to be physically more attractive than those who were assigned basic avatars. After observing a car crash caused by drunk driving, participants in the choice and control condition were more likely to change BI positively when they identified their avatars to be similar to themselves, and regarded their avatars more attractive. Furthermore, participants who were allowed to control their avatars were more likely to attribute the responsibility of the car accident to themselves than those who observed someone else's avatar playing. Implications for the use of virtual reality games in promoting healthy behaviors are discussed in detail.

Immersive visualization of visual data using nonnegative matrix factorization

Over the last two decades, dimension reduction for visualization has gained a high amount of attention in visual data mining where the data is represented by high-dimensional features. Basically, this approach leads to an unbalanced and occluded distribution of visual data in display space, giving rise to difficulties in browsing the data. In this paper we propose an approach for the visualization of image collections in such a way as (1) images are not occluded by each other, and the provided space is used as much as possible; (2) the similar images are positioned close together; (3) an overview of data is feasible. To fulfill these requirements, we propose to use regularized Nonnegative Matrix Factorization (NMF) controlled by parameters to reduce the dimensionality of data. Experiments performed on optical and radar images confirm the flexibility of proposed method in visualizing large-scale visual data. Finally, an immersive 3D virtual environment is suggested, to visualize the images, to allow the user to navigate and explore the data.

Populating a 3D virtual learning environment for interpreting students with bilingual dialogues to support situated learning in an institutional context

The point of departure of this article is an immersive (avatar-based) 3D virtual environment which was developed in the European project IVY – Interpreting in Virtual Reality – to simulate interpreting practice. Whilst this environment is the first 3D environment dedicated to interpreter-mediated communication, research in other educational contexts suggests that such environments can foster learning. The IVY 3D environment offers a range of virtual ‘locations’ (e.g. business meeting room, tourist office, doctor’s surgery) which serve as backdrops for the practice of consecutive and dialogue interpreting in business and public service contexts. The locations are populated with relevant objects and with robot-avatars who act as speakers by presenting recorded monologues and bilingual dialogues. Students, represented by their own avatars, join them to practise interpreting. This article focuses on the development of the bilingual dialogues, which are at the heart of many interpreter-mediated business and public service encounters but which are notoriously difficult to obtain for educational purposes. Given that interpreter training institutions usually need to offer bilingual resources of comparable difficulty levels in many language combinations, ad hoc approaches to the creation of such materials are normally ruled out. The approach outlined here was therefore to start from available corpora of spoken language that were designed with pedagogical applications in mind. The article begins by explaining how the dialogues were created and then discusses the benefits and potential shortcomings of this approach in the context of interpreter education. The main points of discussion concern (1) the level of systematicity and authenticity that can be achieved with this corpus-based approach; and (2) the potential of a 3D virtual environment to increase this sense of authenticity and thus to enable students to experience the essence of dialogue interpreting in a simulated environment.

The Use of Virtual Environments as an Extended Classroom – A Case Study with Adult Learners in Tertiary Education

Abstract This study was conducted in immersive 3D virtual environment Second Life®, with the support of web 2.0 tools as a complement to physical classroom - extended classroom. It was assumed that socialization is a key factor for collaborative learning and knowledge construction. The study aims to identify the variables that may influence knowledge sharing in learning contexts using virtual environments; with the aim of contributing to the improvement of learning situations using the online tools. This research is exploratory in nature and falls within the field of phenomenological studies. The study was implemented in a tertiary education institution involving regular and adult learners. We conclude that in virtual environments learners tend to feel more confident, open, participatory, creative, understanding and seem to participate in training sessions because they are indeed interested in learning. On the other hand, the possibility of providing online tutorial session allows reaching a larger number of learners. These online sessions can be established in a time and place (virtual) free of constraints and can be tailored, allowing a more effective participation from learners.

IMMERSIVE VISUALIZATION OF THE QUALITY OF DIMENSIONALITY REDUCTION

Abstract. Dimensionality reduction is the most widely used approach for extracting the most informative low-dimensional features from highdimensional ones. During the last two decades, different techniques (linear and nonlinear) have been proposed by researchers in various fields. However, the main question is now how well a specific technique does this job. In this paper, we introduce a qualitative method to assess the quality of dimensionality reduction. In contrast to numerical assessment, we focus here on visual assessment. We visualize the Minimum Spanning Tree (MST) of neighborhood graphs of data before and after dimensionality reduction in an immersive 3D virtual environment. We employe a mixture of linear and nonlinear dimension reduction techniques to apply to both synthetic and real datasets. The visualization depicts the quality of each technique in term of preserving distances and neighborhoods. The results show that a specific dimension reduction technique exhibits different performance in dealing with different datasets.