Interactive 3D Research Articles

Viki LibraRy: collaborative hypertext browsing and navigation in virtual reality

ABSTRACT We present Viki LibraRy, a dynamically built library in virtual reality (VR) designed to visualise hypertext systems, with an emphasis on collaborative interaction and spatial immersion. Viki LibraRy goes beyond traditional methods of text distribution by providing a platform where users can share, process, and engage with textual information. It operates at the interface of VR, collaborative learning and spatial data processing to make reading tangible and memorable in a spatially mediated way. The article describes the building blocks of Viki LibraRy, its underlying architecture, and several use cases. It evaluates Viki LibraRy in comparison to a conventional web interface for text retrieval and reading. The article shows that Viki LibraRy provides users with spatial references for structuring their recall, so that they can better remember consulted texts and their meta-information (e.g. in terms of subject areas and content categories).

Do gravity data justify a rifted “Liguro-Provençal Basin”?

The geodynamic evolution of the Liguro-Provençal Basin and its crust and upper mantle structure remain debated, especially regarding the role of rifting in continental break-up and seafloor spreading. Our study incorporates updated datasets, including new gravity maps from the AlpArray Gravity Working Group (complete Bouguer, free air, and isostatic anomalies) for 3D modeling and gravity field analysis, seismic data from Lobster offshore campaigns for direct comparison, and geodynamic models, supplemented by seismic profiles from previous French and Italian campaigns to constrain the interpretation. We used GFZ’s IGMAS + software for interactive 3D modeling, creating a density model extending to 300 km depth that includes crustal and upper mantle inhomogeneities based on prior geodynamic models. This hybrid approach, with polygonal structures for the crust and voxels for the upper mantle, clarifies individual contributions to the gravity field. Extending initial gravity modeling from the SPP MB4D project INTEGRATE, our work provides a consistent 3D density model for the Alps and Ligurian Basin. The constrained 3D modeling and numerical analyses (terracing, clustering, filtering, curvature), along with vertical stress and gravitational potential energy calculations, suggest that rifting has significantly influenced the basin’s geological evolution.

Developmental mouse brain common coordinate framework

3D brain atlases are key resources to understand the brain’s spatial organization and promote interoperability across different studies. However, unlike the adult mouse brain, the lack of developing mouse brain 3D reference atlases hinders advancements in understanding brain development. Here, we present a 3D developmental common coordinate framework (DevCCF) spanning embryonic day (E)11.5, E13.5, E15.5, E18.5, and postnatal day (P)4, P14, and P56, featuring undistorted morphologically averaged atlas templates created from magnetic resonance imaging and co-registered high-resolution light sheet fluorescence microscopy templates. The DevCCF with 3D anatomical segmentations can be downloaded or explored via an interactive 3D web-visualizer. As a use case, we utilize the DevCCF to unveil GABAergic neuron emergence in embryonic brains. Moreover, we map the Allen CCFv3 and spatial transcriptome cell-type data to our stereotaxic P56 atlas. In summary, the DevCCF is an openly accessible resource for multi-study data integration to advance our understanding of brain development.

ALHK: Integrating 3D Holograms and Gesture Interaction for Elementary Education

The integration of technology in elementary education offers innovative ways to enhance learning. One such advancement is the use of three-dimensional holograms (3DH), which provide immersive displays that merge seamlessly with the learner’s environment, creating a dynamic and engaging atmosphere. Educators have found that 3D visual tools significantly improve student comprehension, with 94.4% agreeing in a preliminary study. However, using interactive 3D holography alone has limitations, such as the inability for students to physically touch or manipulate holographic objects. To address this, Active Learning with Holo-Kid (ALHK) is introduced as a desktop application for elementary school students (grades 1 to 6). ALHK combines Leap Motion technology’s precision with interactive 3D holography to overcome these limitations. The combination allows students to interact with virtual objects in a more immersive and realistic manner. Holograms provide visual representation, while Leap Motion enables precise gesture recognition and hand tracking, resulting in a seamless and intuitive user experience. Initial evaluations demonstrate improved student engagement and comprehension. Future iterations aim to enhance scalability by incorporating features like custom object upload, multi-user interaction, and broader age applicability. ALHK shows promise as a tool for creating an immersive and intuitive learning environment using 3D holograms and interactive technology in elementary education.

Weak and strong solutions for a fluid‐poroelastic‐structure interaction via a semigroup approach

A filtration system comprising a Biot poroelastic solid coupled to an incompressible Stokes free‐flow is considered in 3D. Across the flat 2D interface, the Beavers‐Joseph‐Saffman coupling conditions are taken. In the inertial, linear, and non‐degenerate case, the hyperbolic‐parabolic coupled problem is posed through a dynamics operator on a chosen energy space, adapted from Stokes‐Lamé coupled dynamics. A semigroup approach is utilized to circumvent issues associated to mismatched trace regularities at the interface. The generation of a strongly continuous semigroup for the dynamics operator is obtained via a non‐standard maximality argument. The latter employs a mixed‐variational formulation in order to invoke the Babuška‐Brezzi theorem. The Lumer‐Philips theorem then yields semigroup generation, and thereby, strong and generalized solutions are obtained. For the linear dynamics, density obtains the existence of weak solutions; we extend to the case where the Biot compressibility of constituents degenerates. Thus, for the inertial linear Biot‐Stokes filtration system, we provide a clear elucidation of strong solutions and a construction of weak solutions, as well as their regularity through associated estimates.

Performance study of GaN-based betavoltaic nuclear batteries with 3D interfaces

This study presents a design of a 3D interface simulation model featuring an inverted pyramid structure. Our objective is to forecast the performance of GaN-based betavoltaic nuclear batteries with the PN junction 3D interface structures comparing a practical machining process. Initially, we computed the electron-hole pairs (EHPs) generation rate in GaN materials irradiated by both 63Ni and 147Pm sources using Geant4. Furthermore, we employed COMSOL Multiphysics, a finite element analysis software, to simulate the EHPs transport phenomena within the battery and investigate the influence of structural parameters on the output performance. Despite maintaining thicknesses of the P- and N-regions and consistent doping concentrations (Hp-GaN, Hn-GaN, Na, and Nd) as constants, the simulation results revealed notable disparities in the short-circuit current density (Jsc), open-circuit voltage (Voc), and maximum output power density (Pmax) among batteries irradiated with various radioactive sources. Subsequently, we investigated the output performance of the nuclear battery by altering parameters such as the number of inverted pyramid structures, junction depth, and type of radioactive source. Our investigation revealed that selecting 63Ni as the radioactive source, with Na at 1017 cm−3, Nd at 1014 cm−3, a junction depth of 0.1 μm, and inverted pyramid structures of 25, resulted in the following battery performance parameters: a short-circuit current density (Jsc) of 0.648 μA/cm2, an open-circuit voltage (Voc) of 2.3481 V, and a maximum output power density (Pmax) of 1.2949 μW/cm2. Substituting the radioactive source with 147Pm, the average short-circuit current density, Jsc, increased to 56.865 μA/cm2, and the maximum output power density, Pmax, increased to 94.975 μW/cm2, It's a significant enhancement in output performance.

Size Selection of Crack Front Defects: Multiple Fracture-Plane Interactions and Intrinsic Length Scales.

Material failure is mediated by the propagation of cracks which, in realistic 3D materials, typically involves multiple coexisting fracture planes. Multiple fracture-plane interactions create poorly understood out-of-plane crack structures, such as step defects on tensile fracture surfaces. Steps form once a slowly moving, distorted crack front segments into disconnected overlapping fracture planes separated by a stabilizing distance h_{max}. Our experiments on numerous brittle hydrogels reveal that h_{max} varies linearly with both a nonlinear elastic length Γ(v)/μ and a dissipation length ξ. Here, Γ(v) is the measured crack velocity v-dependent fracture energy, and μ is the shear modulus. These intrinsic length scales point the way to a fundamental understanding of multiple-crack interactions in 3D that lead to the formation of stable out-of-plane fracture structures.

Modelling the effects of perceived system quality and personal innovativeness on the intention to use metaverse: a structural equation modelling approach

The metaverse, an interactive and immersive 3D virtual environment, has recently become popular and is widely used in several fields, including education. However, the successful use of metaverse relies on the extent to which users intend to adopt and use it. Close examination of this critical issue reveals a lack of research that examines the effects of certain factors on users’ intentions toward using metaverses. Thus, this study extends the technology acceptance model by integrating two constructs—perceived system quality and students’ personal innovativeness. Using a survey to collect data, 164 responses were received from students at the University of Ha’il in Saudi Arabia. Two steps in structural equation modelling (SEM) using the AMOS software were applied to analyse the data and test the research hypotheses. The results revealed that perceived system quality had a significant effect on students’ intentions to use metaverses through perceived ease of use. Furthermore, personal innovativeness had a significant effect on students’ intentions through the perceived usefulness of the metaverse. In addition, perceived usefulness affected students’ intentions to use a metaverse. Surprisingly, perceived ease of use had an insignificant effect on students’ intentions to use the metaverse. Although the proposed model and its findings contribute to the technology acceptance model (TAM) literature, the study’s practical value is significant because it can help educational policymakers and authorities to understand the effect of each factor and plan future strategies. Additionally, the findings of this study can assist practitioners, designers, and developers in designing and promoting the utilisation of metaverses.

Improve Usability of Multidimensional DataExploration with Water Fountain Based 3D UserInterface Metaphor

Improve Usability of Multidimensional DataExploration with Water Fountain Based 3D UserInterface Metaphor

VR Simulation: Advancing Practical Skills in Computer Science Education

This study presents the successful integration of Virtual Reality (VR) tools as an element in the computer science curriculum at the German University of Technology, Oman. The research study investigates the use of MyScore, a VR application developed by RWTH Aachen University - Teaching & Research Field Engineering Hydrology as an environment for computer hardware assembly and troubleshooting exercises. The VR simulation utilized in this study acts as a gamified environment, incorporating elements like scorekeeping and interactive challenges to enhance practical learning in computer science, akin to game-based strategies that engage and motivate students. Over some weeks, the project involved seven students and one tutor in immersive learning sessions to develop applied skills in computer hardware assembly with VR technology over conventional teaching methods. Structured surveys and direct observations were used for data collection through students' interactions with the VR sessions. We also evaluated the student's learning experiences as well as the usability of technology. The results showed that the user-friendliness of the VR interface and its ability to accurately simulate real-world tasks associated with computer assembly received both positive and negative reactions. While some students praised the technology for being pretty cutting-edge, some criticized it as unrealistic or non-interactive. We also received complaints that ranged from actually moving around in the virtual space to navigating only through teleportation spark points. Specifically, two students got motion sickness, which is a well-known obstacle associated with VR environments, and consequently left the sessions prematurely. The feedback of the instructor pointed out that setting up the VR equipment is straightforward and described some potential methods. Still, a call for more reliability in simulations and better interfaces began to surface as nevertheless less controversial agenda items. However, the instructor saw how VR has the potential to revolutionize educational practices. Providing interactive views between the VR device and students that can act as new learning methods. The present study extends the discussion on educational technology by providing empirical evidence of the benefits and challenges experienced in deploying VR for technical education implementation. These findings thus support the continued development and validation of VR technologies in pursuit of improved commitment, cost-effectiveness, immersion, and environment quality that may maximize learning outcomes in future educational applications.

Stabilization of RRBP1 mRNA via an m6A-dependent manner in prostate cancer constitutes a therapeutic vulnerability amenable to small-peptide inhibition of METTL3

Mounting evidence has implicated the RNA m6A methylation catalyzed by METTL3 in a wide range of physiological and pathological processes, including tumorigenesis. The detailed m6A landscape and molecular mechanism of METTL3 in prostate cancer (PCa) remains ill-defined. We find that METTL3 is overexpressed in PCa and correlates with worse patient survival. Functional studies establish METTL3 as an oncoprotein dependent on its m6A enzymatic activity in both AR+ and AR− PCa cells. To dissect the regulatory network of m6A pathway in PCa, we map the m6A landscape in clinical tumor samples using m6A-seq and identify genome-wide METTL3-binding transcripts via RIP-seq. Mechanistically, we discover RRBP1 as a direct METTL3 target in which METTL3 stabilizes RRBP1 mRNA in an m6A-dependent manner. RRBP1 positively correlates with METTL3 expression in PCa cohorts and exerts an oncogenic role in aggressive PCa cells. Leveraging the 3D structural protein-protein interaction between METTL3 and METTL14, we successfully develop two potential METTL3 peptide inhibitors (RM3 and RSM3) that effectively suppress cancer cell proliferation in vitro and tumor growth in vivo. Collectively, our study reveals a novel METTL3/m6A/RRBP1 axis in enhancing aggressive traits of PCa, which can be therapeutically targeted by small-peptide METTL3 antagonists.

An immersive labeling method for large point clouds

3D point clouds, such as those produced by 3D scanners, often require labeling – the accurate classification of each point into structural or semantic categories – before they can be used in their intended application. However, in the absence of fully automated methods, such labeling must be performed manually, which can prove extremely time and labor intensive. To address this we present a virtual reality tool for accelerating and improving the manual labeling of very large 3D point clouds. The labeling tool provides a variety of 3D interactions for efficient viewing, selection and labeling of points using the controllers of consumer VR-kits. The main contribution of our work is a mixed CPU/GPU-based data structure that supports rendering, selection and labeling with immediate visual feedback at high frame rates necessary for a convenient VR experience. Our mixed CPU/GPU data structure supports fluid interaction with very large point clouds in VR, what is not possible with existing continuous level-of-detail rendering algorithms. We evaluate our method with 25 users on tasks involving point clouds of up to 50 million points and find convincing results that support the case for VR-based point cloud labeling.

Measurement of anisotropic airflow resistance characteristics of mineral wool samples

In the field of acoustics, the airflow resistance of a porous materials like stone wool is one of the governing parameters. As a starting point, measuring the airflow resistance in the normal direction can be used for good estimations of sound-absorbing abilities when using empirical models. However, more complex models, like equivalent fluid models and Biot models, need more input parameters. The next natural step is to move into 2D and 3D interactions. An obstacle to overcome is obtaining accurate input parameters to qualify the models. The production process of stone wool introduces an inherent geometric anisotropy in the material. The aim of the study is hence to develop test and sample preparation methods that enable the measurement of the airflow resistance of stone wool sample in 3 directions by means of testing a cubic specimen. The airflow resistance was measured using a modified unidirectional static airflow apparatus. The paper presents test results obtained with the apparatus for a range of stone wool samples of varying densities. The results show noticeable differences in airflow resistance of more than 1.5 times between testing directions. This paper also, includes comparisons to results obtained using an alternating airflow method as per ISO 9053-2:2020.

An Interactive Vision-Based 3D Augmented Reality System for In-Home Physical Rehabilitation: A Qualitative Inquiry to Inform System Development.

Postoperative physical rehabilitation is crucial after total joint replacement (TJR). However, completing the recommended levels of postoperative physical exercise is challenging for many older adults with TJR. Lack of adequate postoperative physical exercise has negative consequences on rehabilitation outcomes. Innovative rehabilitation tools for postoperative physical exercises are needed to ensure successful rehabilitation outcomes among older adults with TJR. The aim of this study is to explore key knowledge users' perspectives about how to design an interactive vision-based three-dimensional augmented reality system (3D ARS) to support in-home postoperative physical rehabilitation for older adults with TJR. We conducted a qualitative descriptive study involving 11 semi-structured interviews and six focus groups with 42 older adults with TJR and four unrelated family caregivers. Data were analysed using thematic analysis. Participant insights were grouped into two main themes: (1) dreaming up possibilities and (2) being pragmatic. The first theme captured participants' reflections on the potential utility of a 3D ARS for postoperative physical rehabilitation and features that could be embedded in the 3D ARS to support successful postoperative physical rehabilitation. The second theme captured participants' reflections on practical issues and considerations that could impact access and usage of the 3D ARS. These findings provide researchers, rehabilitation providers and system developers with the foundations for designing, implementing and evaluating innovative augmented reality tools that support effective in-home physical rehabilitation among older adults with TJR. Research users (i.e., individuals and organisations invested in and using the research findings) were actively engaged throughout this work. Specifically, a meeting was held between the research team and representatives of an Expert by Experience team (individuals with lived experience), which was established to support the National Research Council's (organisation) Aging in Place programme. During this meeting, the idea to develop and evaluate an ARS for postoperative physical rehabilitation of older adults with TJR was supported. Research users had the opportunity to review the current study protocol and provide feedback on the study design, offering direction to maximize the relevance and usefulness of our findings to the National Research Council Canada's Aging in Place programme. Research users contributed to participant recruitment efforts and the development of the interview guide. Two Experts by Experience also agreed to be on the Advisory Panel for this multi-phased study, supporting active engagement and centring the voice of research users in knowledge creation and implementation. These experts reviewed a brief report of the current study findings, and continue to guide how the study findings are used to inform the next phase of this multi-phased research.

Comparing continuum and direct fiber models of soft tissues: An ocular biomechanics example reveals that continuum models may artificially disrupt the strains at both the tissue and fiber levels

Collagen fibers are the main load-bearing component of soft tissues but difficult to incorporate into models. Whilst simplified homogenization models suffice for some applications, a thorough mechanistic understanding requires accurate prediction of fiber behavior, including both detailed fiber-level strains and long-distance transmission. Our goal was to compare the performance of a continuum model of the optic nerve head (ONH) built using conventional techniques with a fiber model we recently introduced which explicitly incorporates the complex 3D organization and interaction of collagen fiber bundles [1]. To ensure a fair comparison, we constructed the continuum model with identical geometrical, structural, and boundary specifications as for the fiber model. We found that: 1) although both models accurately matched the intraocular pressure (IOP)-induced globally averaged displacement responses observed in experiments, they diverged significantly in their ability to replicate specific 3D tissue-level strain patterns. Notably, the fiber model faithfully replicated the experimentally observed depth-dependent variability of radial strain, the ring-like pattern of meridional strain, and the radial pattern of circumferential strain, whereas the continuum model failed to do so; 2) the continuum model disrupted the strain transmission along each fiber, a feature captured well by the fiber model. These results demonstrate limitations of the conventional continuum models that rely on homogenization and affine deformation assumptions, which render them incapable of capturing some complex tissue-level and fiber-level deformations. Our results show that the strengths of explicit fiber modeling help capture intricate ONH biomechanics. They potentially also help modeling other fibrous tissues. Statement of SignificanceUnderstanding the mechanics of fibrous tissues is crucial for advancing knowledge of various diseases. This study uses the ONH as a test case to compare conventional continuum models with fiber models that explicitly account for the complex fiber structure. We found that the fiber model captured better the biomechanical behaviors at both the tissue level and the fiber level. The insights gained from this study demonstrate the significant potential of fiber models to advance our understanding of not only glaucoma pathophysiology but also other conditions involving fibrous soft tissues. This can contribute to the development of therapeutic strategies across a wide range of applications.

3D characterization of the Mila 18 archaeological site in Warsaw, Poland: From imaging to excavation

Archaeological site investigations in urban environments are often beset with challenges such as (1) an absence of buried artifacts due to recent disturbance from infrastructure development or (2) community concerns about potential site impacts from excavations. Noninvasive geophysical surveys that use a combination of methods can help mitigate the risks of uncertain outcomes by identifying areas where culturally significant features are more likely to be uncovered. We show how new technology and traditional geophysical survey methods were used to characterize the subsurface of the Mila 18 Memorial site in Warsaw, Poland. This site is one of the most important places of remembrance for the Holocaust and coincides with the location of an underground bunker that was used by Jewish resistance groups during the 1943 Warsaw Ghetto Uprising. In this case study, we showcase the use of drone multispectral imaging and handheld lidar scanning in conjunction with other geophysical techniques including electrical resistivity tomography, ground-penetrating radar, magnetic gradiometer, twin-probe resistance, and fixed-frequency electromagnetic surveying. The geophysical results were included in an interactive 3D site model to help identify a suitable site for excavation. To document the excavation and to validate and further interrogate the geophysical survey results, we used lidar-based photo-textured scans of the excavation that were incorporated into the 3D site model.

415 - Interactive 3D Models and Animations for Cardiac Imaging Education

415 - Interactive 3D Models and Animations for Cardiac Imaging Education

Enhancing User Experience in VR Environments through AI-Driven Adaptive UI Design

This paper presents a new approach to improving user experience in virtual reality (VR) environments using AI-driven user interface (UI) design. The proposed system uses advanced machine learning techniques to update UI content based on user interaction and real-time context. A comprehensive literature review examines the current state of VR interfaces, AI applications in UI/UX design, and evolving UI technologies. Data is a multi-layered process combining data collection, processing, and editing over time. The design was developed and evaluated through a rigorous study involving 50 participants, comparing a modified UI against a static UI control. The results showed a significant improvement in performance, experience reduction, and overall user satisfaction. The modified UI group showed an 18.6% reduction in completion time, a 47.8% reduction in errors, and a 34.9% increase in user satisfaction scores compared to the static UI group. Physiological data analysis supports these findings, showing reduced stress and increased engagement. This research contributes to the field of VR interface design by providing empirical evidence for the effectiveness of AI-driven adaptive UIs in improving user experience and field performance. Virtual.

Multi-sensor fusion for biomechanical analysis: evaluation of dynamic interactions between self-contained breathing apparatus and firefighter using computational methods

Understanding the complex three-dimensional (3D) dynamic interactions between self-contained breathing apparatus (SCBA) and the human torso is critical to assessing potential impacts on firefighter health and informing equipment design. This study employed a multi-inertial sensor fusion technology to quantify these interactions. Six volunteer firefighters performed walking and running experiments on a treadmill while wearing the SCBA. Calculations of interaction forces and moments from the multi-inertial sensor technology were validated against a 3D motion capture system. The predicted interaction forces and moments showed good agreement with the measured data, especially for the forces (normal and lateral) and moments (x- and z-direction components) with relative root mean square errors (RMSEs) below 9.4%, 7.7%, 7.7%, and 7.8%, respectively. Peak pack force reached up to 150 N, significantly exceeding the SCBA’s intrinsic weight during SCBA carriage. The proposed multi-inertial sensor fusion technique can effectively evaluate the 3D dynamic interactions and provide a scientific basis for health monitoring and ergonomic optimization of SCBA systems for firefighters.

Cohesin organizes 3D DNA contacts surrounding active enhancers in C. elegans.

In mammals, cohesin and CTCF organize the 3D genome into topologically associated domains (TADs) to regulate communication between cis-regulatory elements. Many organisms, including S. cerevisiae, C. elegans, and A. thaliana contain cohesin but lack CTCF. Here, we used C. elegans to investigate the function of cohesin in 3D genome organization in the absence of CTCF. Using Hi-C data, we observe cohesin-dependent features called "fountains", which are also reported in zebrafish and mice. These are population average reflections of DNA loops originating from distinct genomic regions and are ~20-40 kb in C. elegans. Hi-C analysis upon cohesin and WAPL depletion support the idea that cohesin is preferentially loaded at NIPBL occupied sites and loop extrudes in an effectively two-sided manner. ChIP-seq analyses show that cohesin translocation along the fountain trajectory depends on a fully intact complex and is extended upon WAPL-1 depletion. Hi-C contact patterns at individual fountains suggest that cohesin processivity is unequal on each side, possibly due to collision with cohesin loaded from surrounding sites. The putative cohesin loading sites are closest to active enhancers and fountain strength is associated with transcription. Compared to mammals, average processivity of C. elegans cohesin is ~10-fold shorter and NIPBL binding does not depend on cohesin. We propose that preferential loading and loop extrusion by cohesin is an evolutionarily conserved mechanism that regulates the 3D interactions of enhancers in animal genomes.