3D Virtual Space Research Articles

The Impact of the Metaverse on the Future Development of Enterprises

Since the outbreak of COVID-19, the leeway of people has been restricted, so that the desire of virtual world has been further deepened. With the advance of digital technologies such as blockchain and digital twin, the concept of Metaverse has been mentioned again. Metaverse refers to a 3D virtual space based on the future Internet and characterized by connection, perception and sharing. It presents a collective virtual open space, created by the convergence of virtually enhanced physical and digital reality. It is physically persistent and provides enhanced immersive experiences. This study concludes that the application of the Metaverse can bring a new path to brand promotion and marketing, create new needs of users and help enterprises to achieve cost reduction and benefit increase while there are risks of privacy, property rights and economy. At presents, the Metaverse is still an unripe concept. It needs the development of technology, legal constraints and government supervision to make it be widely used in life.

Evaluation Methods and Differences between Three Dimensional And Two Dimensional Movies by Physiological Measurements Using A Commercial 6-Axis Sensor

The term "metaverse" has become a common word in recent years. This term, a virtual space on the Internet, is gaining importance in various fields in today's era of remarkable progress toward the fusion of virtual space and real space using digital science. The authors have been engaged in a project to develop educational applications using experiences in 3D virtual space with headset-type goggles. In this study, we investigated the physiological effects on the viewer by observing and analyzing the blink and discussed its applicability.

Dr. KID: Direct Remeshing and K-Set Isometric Decomposition for Scalable Physicalization of Organic Shapes.

Dr. KID is an algorithm that uses isometric decomposition for the physicalization of potato-shaped organic models in a puzzle fashion. The algorithm begins with creating a simple, regular triangular surface mesh of organic shapes, followed by iterative K-means clustering and remeshing. For clustering, we need similarity between triangles (segments) which is defined as a distance function. The distance function maps each triangle's shape to a single point in the virtual 3D space. Thus, the distance between the triangles indicates their degree of dissimilarity. K-means clustering uses this distance and sorts segments into k classes. After this, remeshing is applied to minimize the distance between triangles within the same cluster by making their shapes identical. Clustering and remeshing are repeated until the distance between triangles in the same cluster reaches an acceptable threshold. We adopt a curvature-aware strategy to determine the surface thickness and finalize puzzle pieces for 3D printing. Identical hinges and holes are created for assembling the puzzle components. For smoother outcomes, we use triangle subdivision along with curvature-aware clustering, generating curved triangular patches for 3D printing. Our algorithm was evaluated using various models, and the 3D-printed results were analyzed. Findings indicate that our algorithm performs reliably on target organic shapes with minimal loss of input geometry.

Cognitive Aspects of 2D Content Integration and Management in 3D Virtual Reality Spaces

The advent of 2D graphical user interfaces in the 1980s shifted user interactions from line-based terminals to icon-based interfaces. As smartphones emerged in the 2010s, portable 2D graphical interfaces became a reality, liberating users from being confined to a single location when accessing digital services. These transformations have profoundly altered our understanding of digital information systems, with impacts that cannot be easily quantified. Current advancements in virtual and augmented reality (VR/AR), the Internet of Things (IoT), and artificial intelligence (AI) are on the verge of ushering in the next significant leap in cognitive expansion, introducing portable and highly contextual spatial interfaces, also sometimes referred to as Digital Realities (DRs). As a result, users now anticipate the ability to engage with an increasing array and variety of digital content in ways that are more contextualized and tailored to their needs, taking into account factors such as time, location, personalized goals and user-specific histories. In this paper, we aim to give an overview of cognitive aspects relevant to content integration and management specifically in DR environments, and to propose solutions and / or best practices to address them. Our discussion is centered around a paradigm called the Doing When-Seeing (DWS) paradigm, which we propose for the design of Digital Reality interfaces. We demonstrate the applicability of this paradigm to the design of interfaces for creating content, organizing content, and semantically representing and retreiving content within 3D Digital Reality environments.

Development of Social Virtual Reality (SVR) as Collaborative Learning Media to Support Merdeka Belajar

Merdeka Belajar (the freedom to learn) in Indonesia emerged indirectly with the COVID-19 pandemic. Merdeka Belajar is a form of learning that aims to create an innovative, non-restrictive learning culture. With this idea, the development of online education is growing rapidly from online meetings to a virtual format and the development of online resources, rapidly available and broadly accessible. Social virtual reality (SVR) refers to popular 3D virtual spaces in which multiple people can engage with one another. This research aims to develop an SVR application as learning media by implementing Meta Avatar SDK with voice chat and lip sync features to mimic facial expressions. Based on the performance testing results, the application can render at an average of 76 frames per second. Based on the results of trials to 14 respondent, we measure satisfaction and interest level using the PIECES (performance, information and data, economics, control and security, efficiency, and service) Framework. The average value of interest is 4.19 and the average value of satisfaction is 4.13. This proves that the respondents are interested

Holographic Telepresence and Digital Twin Simulation Technologies, 3D Virtual Space Networking and Machine Learning-based Image Recognition Tools, and Environment Mapping and Cognitive Artificial Intelligence Algorithms in a Fully Connected Metaverse

Holographic Telepresence and Digital Twin Simulation Technologies, 3D Virtual Space Networking and Machine Learning-based Image Recognition Tools, and Environment Mapping and Cognitive Artificial Intelligence Algorithms in a Fully Connected Metaverse

Immersive Metaverse and Digital Twin Technologies, Deep Learning-based Image Processing and Motion Planning Algorithms, and 3D Virtual Space Networking and Data Visualization Tools in Interactive Digital Worlds

Immersive Metaverse and Digital Twin Technologies, Deep Learning-based Image Processing and Motion Planning Algorithms, and 3D Virtual Space Networking and Data Visualization Tools in Interactive Digital Worlds

Virtual Teamwork in Gamified 3D Environment

Virtual teamwork has spread strongly in various fields in recent times. COVID lockdown measures radically boosted the use of distance-independent remote collaboration methods. Although there are many modern virtual 3D spaces available for teamwork today, they lack additional motivational factors other than the visual 3d experience. Based on this, we tried to research the possible benefits of using gamification technics in 3D virtual collaboration environments to increase virtual team members' motivation. This article attempts to explore and highlight the possibilities of this area, and propose a model framework for implementation of gamified elements in 3D virtual teamwork environments.

GDOM: An Immersive Experience of Intangible Heritage through Spatial Storytelling

This paper presents the design, development, and evaluation of GDOM (Geelong Digital Outdoor Museum) application that integrates intangible heritage stories into places of public significance through a 3D virtual immersive environment. The project makes an important contribution to community-centered intangible heritage, while bridging the gap between theory and practice of location-based, non-linear storytelling. Research by Design methodology has been adopted to integrate highly cross-disciplinary insights into the creation, reproduction, and evaluation of a tangible application. A web-based 360° panoramic image viewer platform has been utilised to design and curate an interactive heritage experience, by spatially linking stories (content) to specific locations. The key innovation is the location-based, non-linear and spatial storytelling inside a 3D immersive virtual space where users have the opportunity to interact with intangible heritage stories. GDOM application opened up new opportunities to connect people with intangible heritage to facilitate new forms of environmental knowing, spatial and cultural understanding, and the creation of a sense of place. An in-depth evaluation of GDOM, with both expert and non-expert user groups, confirmed the GDOM application as an effective tool to experience intangible heritage to facilitate better understanding of places compared to a physical experience of heritage in a museum. Potential context of application with immediate benefits have been reported as education and cultural tourism sectors.

The Readiness of Lasem Batik Small and Medium Enterprises to Join the Metaverse

Today’s business competitiveness necessitates the capacity of all company players, particularly small and medium enterprises (SMEs), to enter a broader market through information technology. However, the Lasem Batik SMEs have endured a great deal of turmoil during the COVID-19 pandemic. Marketing has been conducted through physical and internet channels, but the results have not been maximized. The purpose of this research was to consider the possibilities of Lasem Batik SMEs adopting metaverse technology as a marketing medium to enhance sales. The investigation was conducted on 40 Lasem Batik SMEs who met the requirements of using online media to sell their products, having a medium-sized firm, and displaying marketing that has reached the provincial level. The findings of this study are as follows: (1) The majority of participants stated that the metaverse is a virtual 3D space. This understanding is deepened by discussions about virtual 3D spaces that combine VR and AR, which today is often referred to as the metaverse. (2) Batik business owners hope that by using the metaverse, they will be able to obtain many benefits, especially related to market expansion. (3) Lasem Batik SMEs show great interest in expanding their marketing channels to a wider area; Lasem Batik entrepreneurs also accept the challenge of studying the metaverse with new knowledge and techniques they have never considered. (4) Overall, 75% of participants were ready to use the metaverse, and 25% still required guidance. (5) Local communities, universities, and large corporations provide great support for the use of the metaverse. (6) The commercial success of Lasem Batik SMEs is defined by product quality; ongoing online and offline advertising; originality and innovation; and the capacity to capitalize on possibilities, retain local wisdom, and preserve strong customer connections. The main conclusion is that the readiness of batik entrepreneurs to use the metaverse is highly dependent on the support of various parties. A strong desire to progress and develop one’s business is the main factor determining one’s intention to use the metaverse. As a result of the research, a prototype of a metaverse platform for Lasem Batik exhibitions has been developed. SMEs can use the room template provided by the platform and join other SMEs to hold a metaverse exhibition to attract global customers. These results can be connected to create a metaverse exhibition to attract global customers.

A novel immersive virtual reality environment for the motor rehabilitation of stroke patients: A feasibility study.

We designed and implemented an immersive virtual reality (VR) environment for upper limb rehabilitation, which possesses several notable features. First, by exploiting modern computer graphics its can present a variety of scenarios that make the rehabilitation routines challenging yet enjoyable for patients, thus enhancing their adherence to the therapy. Second, immersion in a virtual 3D space allows the patients to execute tasks that are closely related to everyday gestures, thus enhancing the transfer of the acquired motor skills to real-life routines. Third, in addition to the VR environment, we also developed a client app running on a PC that allows to monitor in real-time and remotely the patients’ routines thus paving the way for telerehabilitation scenarios. Here, we report the results of a feasibility study in a cohort of 16 stroke patients. All our patients showed a high degree of comfort in our immersive VR system and they reported very high scores of ownership and agency in embodiment and satisfaction questionnaires. Furthermore, and notably, we found that behavioral performances in our VR tasks correlated with the patients’ clinical scores (Fugl-Meyer scale) and they could thus be used to assess improvements during the rehabilitation program. While further studies are needed, our results clearly support the feasibility and effectiveness of VR-based motor rehabilitation processes.

Blockchain Technologies and Media Transformation

In this paper we start from the assumption that social dynamics and cultural-civilizational progress cannot be viewed separately from the social history of the media as complex technological-communication structures. In this paper we deal with the influence of new disruptive technologies DLT (Distributed Ledger Technologies) better known as blockchain technologies which, thanks to the latest technological solutions, have great potential for transforming the media and journalism as a profession, thus we have explained the technological concept on which they are based. We will discuss the concept of personalized blockchain journalism and propose a user economy model that guarantees the financial sustainability of the platform. Observing information as a user experience, we have discussed the possibility of adequate cognitive response of users in conditions of information saturation, and raised the issue of structuring information in designing a journalistic platform on the blockchain, as an ecosystem that will distance itself from existing polluted media space. Finally, we have proposed a topic for further reflection and scientific research, which is the latest technological transition based on quantum computing, artificial intelligence and the Metaverse, which will provide a completely new user experience in 3D virtual space, where user avatars will rely less and less on traditional media and journalism as we know it today.

A Wearable In-home Tremor Assessment System via Virtual Reality Environment for the Activities in Daily Lives (ADLs).

Currently available diagnostic methods for tremor movements are mostly subjective measurements, and clinicians and researchers typically diagnose patients' symptoms with provocative maneuvers, and the inter-rater and intra-rater variabilities of those methods have been always reported. Even though various sensor-based quantitative approaches have been explored, most of the tools are limited to the tremor metrics (i.e., severity and frequency). A consistent environment that can provide a test setup to evaluate how their performance is affected by the tremor movement for activities of daily living would be needed for a smart tremor diagnosis. Therefore, we developed a virtual reality environment with a custom designed wearable sensor module to quantify tremor characteristics with performance-based assessment while they perform the activities of daily living, and correlated the performance to existing tremor scores (i.e., The Essential Tremor Rating Assessment Scale (TETRAS)). We evaluated this approach with five healthy participants (no tremor), and applied an artificial tremor using a vibration motor to mimic tremor movements as a pilot study. We analyzed three categorized tremor scenarios: resting, postural, and kinetic tremor tasks using six different tasks in virtual 3D space. All the artificial tremor was score as TETRAS=1, and we successfully analyzed the tremor metrics for different tasks by comparing them with TETRAS score, and verified the different tremor characteristics with the artificial tremor. Additionally, we analyzed the performance of 3D spiral drawing on the virtual reality track using "outside area" and "completion time" as the accuracy and speed of the performance. Clinical Relevance- This can be applied to quantify and track the tremor symptom at the patients' home, and ultimately this method can be synchronized with their current treatment parameters (i.e., dosage of medication, and parameters of the stimulation) to optimize/maximize the effect of treatment.

Visualization system in a third-person view for the teleoperation of a snake-like robot

This study presents a visualization system in a third-person view for the teleoperation of a snake-like robot. The proposed system visualizes the robot, its surroundings, past path, and predicted path. The visualization is achieved by drawing a robot at self-position and the sensor information, such as a point cloud around the robot, in a virtual 3D space. Therefore, localization plays a key role in visualization. We propose a new localization method that relies only on the information from joint angles and an IMU. We evaluated the proposed method by comparing it with other methods on a flat ground and on a combination of a plane and a slope with a rough surface. The results demonstrated the effectiveness of the proposed method in both cases. Then, we examined the visualization system in room environments. The results showed that the proposed system successfully visualized the robot and its surroundings. We also confirmed the effectiveness of the visual aid by the predicted path.

Development and Validation of a Novel Methodological Pipeline to Integrate Neuroimaging and Photogrammetry for Immersive 3D Cadaveric Neurosurgical Simulation.

BackgroundVisualizing and comprehending 3-dimensional (3D) neuroanatomy is challenging. Cadaver dissection is limited by low availability, high cost, and the need for specialized facilities. New technologies, including 3D rendering of neuroimaging, 3D pictures, and 3D videos, are filling this gap and facilitating learning, but they also have limitations. This proof-of-concept study explored the feasibility of combining the spatial accuracy of 3D reconstructed neuroimaging data with realistic texture and fine anatomical details from 3D photogrammetry to create high-fidelity cadaveric neurosurgical simulations.MethodsFour fixed and injected cadaver heads underwent neuroimaging. To create 3D virtual models, surfaces were rendered using magnetic resonance imaging (MRI) and computed tomography (CT) scans, and segmented anatomical structures were created. A stepwise pterional craniotomy procedure was performed with synchronous neuronavigation and photogrammetry data collection. All points acquired in 3D navigational space were imported and registered in a 3D virtual model space. A novel machine learning-assisted monocular-depth estimation tool was used to create 3D reconstructions of 2-dimensional (2D) photographs. Depth maps were converted into 3D mesh geometry, which was merged with the 3D virtual model’s brain surface anatomy to test its accuracy. Quantitative measurements were used to validate the spatial accuracy of 3D reconstructions of different techniques.ResultsSuccessful multilayered 3D virtual models were created using volumetric neuroimaging data. The monocular-depth estimation technique created qualitatively accurate 3D representations of photographs. When 2 models were merged, 63% of surface maps were perfectly matched (mean [SD] deviation 0.7 ± 1.9 mm; range −7 to 7 mm). Maximal distortions were observed at the epicenter and toward the edges of the imaged surfaces. Virtual 3D models provided accurate virtual measurements (margin of error <1.5 mm) as validated by cross-measurements performed in a real-world setting.ConclusionThe novel technique of co-registering neuroimaging and photogrammetry-based 3D models can (1) substantially supplement anatomical knowledge by adding detail and texture to 3D virtual models, (2) meaningfully improve the spatial accuracy of 3D photogrammetry, (3) allow for accurate quantitative measurements without the need for actual dissection, (4) digitalize the complete surface anatomy of a cadaver, and (5) be used in realistic surgical simulations to improve neurosurgical education.

Research on the Application of VR Technical Ability in Political Education in Colleges and Universities

As an emerging multimedia technology, VR technical ability has gradually become the discuss direction of many scholars. The 3d virtual space created by computer allows users to get the feeling and depth of the real environment in VR interaction.. The application of VR technical ability in relevant disciplines that integrate both ideological and political aspects is to promote ascension of the limitations of time and space in the teaching process, to add more impetus to politics, and to continuously innovate ideas in academies and universities. The diversification of political teaching models is heightened, and teaching effects in multiple dimensions are improved.

Immersive XR Anatomy Teaching Tools: Review of four custom‐built virtual spaces, their deployments and educational value

Use of digital anatomical teaching resources mitigate trends of decreased anatomy contact hours, elimination of cadaveric specimens or student‐led dissections of them, remote or hybrid learning in response to COVID‐19, and to integrate anatomy content with radiology, surgery and other clinical applications. While there are a plethora of atlases built with cadaveric images, radiology, and artist‐rendered 3D models, we often find a disconnect between the complex geometry of many anatomical structures and the 2D screen interfaces used by students to access these digital resources. The open‐source Mozilla Hubs platform allows for the creation of customizable 3D virtual spaces, accessible via URL on a mobile, desktop, or virtual reality (VR) device. This platform was used to create four educational experiences deployed to first and second year medical students during pre‐clerkship courses: a desktop‐based tour of the surface and chambers of the heart; a VR tour of the chambers of the heart; a desktop‐based foregut escape room integrated with questions and multimedia clinical supplements; and a VR tour of the structure and neurovasculature of the pterygopalatine fossa. In each experience, the students are immersed within these anatomical spaces, encouraged to explore and appreciate the spatial relationships and orientations of key internal structures. When applicable, radiological imaging, videos, and animations display physiologic processes, the flow of blood and other fluids, and the functionality of a given structure in vivo. Audio and text instructions, labels, and additional information guide student learning, encouraging directed exploration while immersed in the experience. This presentation will discuss the four experiences, display real‐time video capture of the interactions and spaces, their deployment, educational value, and student reception. Students’ feedback suggests that the context and timing of the deployment of these experiences is crucial for student learning and appreciation, including the role of faculty assistance and training on how to navigate the interface prior to the educational intervention. Qualitative feedback and performance on pre‐ and post‐ experience quizzes show that these experiences are both statistically and perceptually valuable educational resources, and that the novel nature of this experience is engaging and exciting to students when deployed appropriately. This presentation will conclude with suggestions for best practices in choosing, developing, and deploying custom immersive educational interventions to anatomy learners.

Open‐source terrestrial laser scanner for the virtualization of geometrical entities in AEC classrooms

AbstractThis paper depicts a case study that shows an open‐source Terrestrial Laser Scanner (TLS) for use on the virtualization of simple yet precise geometrical entities in AEC classrooms. For bringing this technology to AEC classrooms, an open‐source TLS was developed. The physical model was built using digital fabrication, its connectivity was established using accessible, affordable, open‐source sensors and actuators and its digital representation was developed using generative design tools. All elements together are synchronized in real‐time and the TLS becomes live, digitally twinned, geometry generator. The points that are generated by the TLS are gathered in a 3D virtual space in the form of virtual points. The present digitally twinned vision of laser scanning has thus three identified educational uses: (i) illustration of the measuring principle using open‐source hardware together with mathematics and statistics, (ii) illustration of the generation and visualization of point clouds in real‐time within a CAD environment, and (iii) perhaps with a vaster scope in AEC classrooms, illustration of the usage, analysis and identification of these point clouds. The development of this tool belongs to a vaster project for infusing Construction 4.0 technologies in AEC classrooms under development at the School of Civil Engineering of UPC‐BarcelonaTech. The illustration to students of all these concepts with accessible technological tools is expected to enlarge their vision of more advanced constructional technologies such as cyber‐physical systems for monitoring and surveying as well as digital technologies for reproducing “As‐Built” models.

Immersive Metaverse Experiences in Decentralized 3D Virtual Clinical Spaces: Artificial Intelligence-driven Diagnostic Algorithms, Wearable Internet of Medical Things Sensor Devices, and Healthcare Modeling and Simulation Tools

Immersive Metaverse Experiences in Decentralized 3D Virtual Clinical Spaces: Artificial Intelligence-driven Diagnostic Algorithms, Wearable Internet of Medical Things Sensor Devices, and Healthcare Modeling and Simulation Tools

How to Promote User Purchase in Metaverse? A Systematic Literature Review on Consumer Behavior Research and Virtual Commerce Application Design

Virtual commerce applies immersive technology such as augmented reality and virtual reality into e-commerce to shift consumer perception from 2D product catalogs to 3D immersive virtual spaces. In virtual commerce, the alignment of application design paradigms and the factors influencing consumer behavior is paramount to promote purchase of products and services. The question of their relation needs to be answered, together with the possible improvement of application design. This paper used a systematic literature review approach to synthesize research on virtual commerce from both application design and consumer behavior research, considering the promotion of purchase in virtual commerce settings. Throughout the review, influential factors to purchase and preeminent design artifacts were identified. Then, the research gaps were discovered by mapping the design artifacts to the influential factors, which can inspire future research opportunities on the synergy of these two research directions. Moreover, the evolution of virtual commerce research along with multiple directions were discussed, including the suggestion of meta-commerce as a future trend.