Web Graphics Library Research Articles

Digital twin-based structural health monitoring by combining measurement and computational data: An aircraft wing example

Digital twin is a concept that utilizes digital technologies to mirror the real-time states of physical assets and extract the hidden yet valuable information of physical assets for optimization, decision-making or scheduling. By combining measurement and computational data, this paper presents a digital twin-based structural health monitoring framework of physical assets. The process for building the measurement-computation combined digital twin (MCC-DT) involves four steps. First, an artificial intelligence-driven load identification method combining measurement and computational data is employed to recognize the loads applied on physical assets. Two approaches were proposed to realize load identification, based on single fidelity surrogate models and deep learning techniques, respectively. Second, multi-fidelity surrogate (MFS) models are applied to improve the accuracy in the MCC-DT. Two routes for implementing the MFS models are introduced and the advantages and shortcomings of both are analyzed. Third, an online rainflow counting algorithm is developed to calculate the degradation of the physical assets. The main advantage of the algorithm is that it can provide a near real-time estimation for the damage accumulated of physical assets. Finally, the data generated from the first three steps can be fused into a three-dimensional scene using Web graphics library to provide an intuitive view of the MCC-DT. To describe the implementation details of the framework and verify its applicability and effectiveness, the MCC-DT was established using an aircraft model as an example.

Large scale medical image online three-dimensional reconstruction based on WebGL using four tier client server architecture

The development of medical device technology has led to the rapid growth of medical imaging data. The reconstruction from two-dimensional images to three-dimensional volume visualization not only shows the location and shape of lesions from multiple views but also provides intuitive simulation for surgical treatment. However, the three-dimensional reconstruction process requires the high performance execution of image data acquisition and reconstruction algorithms, which limits the application to equipments with limited resources. Therefore, it is difficult to apply on many online scenarios, and mobile devices cannot meet high-performance hardware and software requirements. This paper proposes an online medical image rendering and real-time three-dimensional (3D) visualization method based on Web Graphics Library (WebGL). This method is based on a four-tier client-server architecture and uses the method of medical image data synchronization to reconstruct at both sides of the client and the server. The reconstruction method is designed to achieve the dual requirements of reconstruction speed and quality. The real-time 3D reconstruction visualization of large-scale medical images is tested in real environments. During the interaction with the reconstruction model, users can obtain the reconstructed results in real-time and observe and analyze it from all angles. The proposed four-tier client-server architecture will provide instant visual feedback and interactive information for many medical practitioners in collaborative therapy and tele-medicine applications. The experiments also show that the method of online 3D image reconstruction is applied in clinical practice on large scale image data while maintaining high reconstruction speed and quality.

THREE-DIMENSIONAL ENABLEMENT OF PLACE-BASED, PANDEMIC BEHAVIORS

Abstract. Harvesting usable and meaningful disaster-related, spatio-temporal data at a highly granular level poses major challenges in its cleaning and aggregation. This paper presents a strategy related to those challenges with respect to individual behavior near COVID-19 laden healthcare facilities. This is done to enable the visualizing of egress behavior data as interactive, three-dimensional (3D) scenes to investigate human behavior patterns regarding touch-based, disease transmission. Therefore, the aim is to demonstrate how this concept of 3D epidemiology may provide new mechanisms to understand the relative risk and exposure prevalence for data analysis. This paper demonstrates 3D enablement of disaster-related field data through use of first-hand observations of 1,936 individuals egressing New York City healthcare facilities during the onset of COVID-19 in the Spring of 2020. The observations capture egress behavior in terms of where people go (e.g. coffee shop, Subway) and how they physically interact with the surroundings (i.e. what they touch and how long they remain). This paper introduces a mechanism for automated extraction and 3D visualization of such data in Potree, an open-source Web Graphics Library (WebGL) point cloud viewer. Distinctive vertex shaders are used to distinguish specific destination selection and behavioral patterns (e.g. personal protective equipment usage). Two-dimensional heatmaps are paired with 3D scenes to demonstrate the potential of using 3D visualization of spatio-temporal patterns for visualizing disease transmission potential.

SLAM 3D Digital Terrain Mapping with SqueezeNet Driven by Road Traffic Data

In order to improve the efficiency of dynamic visualization of large-scale road traffic data in a web environment, this paper proposes a SLAM 3D digital terrain map visualization method using SqueezeNet in a web environment. We propose a hierarchical organization method of the road network, taking into account road attributes and drawing roads at different view heights; a multiroad merging method based on the line segment indexing feature of WebGL (web graphics library) technology, and optimizing the scene by combining view rejection and multithreading technology. The prototype system was developed and case studies were carried out using the national road network data as an example. The experimental results show that the frame rate of large-scale road traffic data visualization in the network environment is above 40 frames/second, which is 20–30 frames/second higher than that of Baidu’s ECharts GL visualization method.

Distributed Path Planning Classification with Web-based 3D Visualization using Deep Neural Network for Internet of Robotic Things

Internet of Robotic Things (IoRT) distributes heterogeneous intelligences among devices and platforms. A distributed control of a three-degree-of-freedom (3-DOF) robot manipulator is integrated with web-based 3D visualization. An asynchronous protocol was utilized to broadcast kinematic data of a 3-DOF robot manipulator between platforms. However, kinematic data computed using inverse kinematic equations directly cannot identify the singularity issue of robot manipulator. Singularity avoidance required to prevent robot component or joint from damage. Therefore, this study proposed a deep neural network approach as a classification-based of manipulator robot path planning to avoid singularity issues. Deep neural network (DNN) was trained in 12 minutes, 52 seconds in 500 iterations. Training accuracy measured with value 96,23 percent, validation accuracy measured with value 96,13 percent, and testing accuracy measured with value 96,48 percent Additionally, 3 DOF manipulator robot web-based 3D visualization was made using Web Graphics Library (WebGL). The distributed platform was tested successfully and can distribute and classify 2352 motions per second.

NEW POTREE SHADER CAPABILITIES FOR 3D VISUALIZATION OF BEHAVIORS NEAR COVID-19 RICH HEALTHCARE FACILITIES

Abstract. While data on human behavior in COVID-19 rich environments have been captured and publicly released, spatial components of such data are recorded in two-dimensions. Thus, the complete roles of the built and natural environment cannot be readily ascertained. This paper introduces a mechanism for the three-dimensional (3D) visualization of egress behaviors of individuals leaving a COVID-19 exposed healthcare facility in Spring 2020 in New York City. Behavioral data were extracted and projected onto a 3D aerial laser scanning point cloud of the surrounding area rendered with Potree, a readily available open-source Web Graphics Library (WebGL) point cloud viewer. The outcomes were 3D heatmap visualizations of the built environment that indicated the event locations of individuals exhibiting specific characteristics (e.g., men vs. women; public transit users vs. private vehicle users). These visualizations enabled interactive navigation through the space accessible through any modern web browser supporting WebGL. Visualizing egress behavior in this manner may highlight patterns indicative of correlations between the environment, human behavior, and transmissible diseases. Findings using such tools have the potential to identify high-exposure areas and surfaces such as doors, railings, and other physical features. Providing flexible visualization capabilities with 3D spatial context can enable analysts to quickly advise and communicate vital information across a broad range of use cases. This paper presents such an application to extract the public health information necessary to form localized responses to reduce COVID-19 infection and transmission rates in urban areas.

Implementation of BIM + WebGIS Based on Extended IFC and Batched 3D Tiles Data: An Application in RCC Gravity Dam for Republication of Design Change Model

The construction of hydropower project is a complex management process, whose management covers the entire construction site. Building information modeling (BIM) + Web Geographic Information System (WebGIS) is an effective means to solve the management of the construction site and main structures. Industry foundation classes (IFC) is commonly used in architecture, engineering and construction (AEC) industry as a standard for BIM data exchange. However, as the components of hydropower projects have not been included in IFC standards, IFC needs to be extended in application. At the same time, WebGIS pays more attention to display whole scene and ignores the processing of high-precision models. There will be deficiencies in network transmission and browser rendering in WebGIS environment of elaborate BIM model. Therefore, the batched three dimensions (3D) Tiles data format, which uses Web Graphics Library (WebGL) as the standard for 3D model rendering, has been widely considered in recent years. At present, in the field of BIM and GIS fusion, the conversion of extended IFC to 3D Tiles data is still blank, and none of the current BIM modeling software has the ability to export the components of hydropower projects. This paper proposes an extended IFC export method based on Autodesk Revit and a data exchange from extended IFC to batched 3D Tiles. Finally, the effectiveness of this method is verified by a design modification case of roller compacted concrete (RCC) gravity dam.

Modern Scientific Visualizations on the Web

Modern scientific visualization is web-based and uses emerging technology such as WebGL (Web Graphics Library) and WebGPU for three-dimensional computer graphics and WebXR for augmented and virtual reality devices. These technologies, paired with the accessibility of websites, potentially offer a user experience beyond traditional standalone visualization systems. We review the state-of-the-art of web-based scientific visualization and present an overview of existing methods categorized by application domain. As part of this analysis, we introduce the Scientific Visualization Future Readiness Score (SciVis FRS) to rank visualizations for a technology-driven disruptive tomorrow. We then summarize challenges, current state of the publication trend, future directions, and opportunities for this exciting research field.

A web‐based integrated GUI for 3D modeling, kinematic study, and control of robotic manipulators

AbstractThe simulation‐based analysis of any robotic system has emerged broadly in the past few years for application in educational and research enhancement. Currently, many simulation tools are available for different research areas on robotics with some advantages and limitations. In this study, the methodology of creating a web‐based graphical user interface is proposed for motion simulations and kinematic study of industrial robotic manipulators. It describes simple and straightforward modeling techniques using Web Graphics Library for creating any three‐dimensional virtual model of the robots within an HTML canvas for its motion simulation and different kinds of analysis. The positional kinematic study of the programmable universal machine for assembly 560 (PUMA 560) industrial robot through the developed interface is presented here, which helps in understanding the whole framework and can be implemented quickly for any other simulation system development. An essential aspect of the kinematic study of these serial chain robots is inverse kinematic analysis demonstrated with PUMA 560 robot with all the possible solutions. Finally, the interface is connected to an actual system following web‐based communication architecture for remote control of the actual PUMA robot.

Combining IFC and 3D tiles to create 3D visualization for building information modeling

Abstract Integrating two critical technologies, Building Information Modeling (BIM) and Geographic Information System (GIS), can bring excellent results into digital construction. However, a point of contention in this integration has yet to be resolved. In view of the shortcomings of the network transmission and browser rendering of current integrated BIM-GIS schemes, accordingly the 3D Tiles data format using Web Graphics Library (WebGL) as the standard for rendering 3D models has been widely considered in recent years. This study provides an implementation plan for data integration and information interaction between BIM and GIS. It aims to improve the traditional model simplification processing solution, analyze the current insufficient network transmission and browser rendering ability of the BIM and GIS integration scheme, and transform the BIM model from the Industry Foundation Classes (IFC) into the 3D Tiles data format. In this study, IFC standard files are first exported as the data source, and the mapping relationship between BIM files and 3D Tiles files is analyzed. The integral IFC model is then reorganized to form JSON files associated with semantic attributes and building component models with geometric information. The proposed relationship mapping allows the attribute contained in the IFC models to be delivered to 3D tiles. Meanwhile, the coordinate transformation, data mapping, spatial index, and Level of Details (LOD) hierarchical division are completed during conversion to ensure fast and efficient rendering interaction of BIM data and geographical features in the 3D WebGIS framework. The experiment results indicated that users can quickly load the BIM model on the Web site, which may be viewed as a feasible solution for the large-scale data integration of GIS and BIM on the Web site.

Web-Based GPU-Accelerated Application for Multiplanar Reconstructions from Conventional 2D Ultrasound.

In ultrasound education there is a need for interactive web-based learning resources. The purpose of this project was to develop a web-based application that enables the generation and exploration of volumetric datasets from cine loops obtained with conventional 2D ultrasound. JavaScript code for ultrasound video loading and the generation of volumetric datasets was created and merged with an existing web-based imaging viewer based on JavaScript and HTML5. The Web Graphics Library was utilized to enable hardware-accelerated image rendering. The result is a web application that works in most major browsers without any plug-ins. It allows users to load a conventional 2D ultrasound cine loop which can subsequently be manipulated with on-the-fly multiplanar reconstructions as in a Digital Imaging and Communications in Medicine (DICOM) viewer. The application is freely accessible at (http://www.castlemountain.dk/atlas/index.php?page=mulrecon&mulreconPage=sonoviewer) where a demonstration of web-based sharing of generated cases can also be found. The developed web-based application is unique in its ability to easily perform loading of one's own ultrasound clips and conduct multiplanar reconstructions where interactive cases can be shared on the Internet.

Dynamically loading IFC models on a web browser based on spatial semantic partitioning

Industry foundation classes (IFC) is an open and neutral data format specification for building information modeling (BIM) that plays a crucial role in facilitating interoperability. With increases in web-based BIM applications, there is an urgent need for fast loading large IFC models on a web browser. However, the task of fully loading large IFC models typically consumes a large amount of memory of a web browser or even crashes the browser, and this significantly limits further BIM applications. In order to address the issue, a method is proposed for dynamically loading IFC models based on spatial semantic partitioning (SSP). First, the spatial semantic structure of an input IFC model is partitioned via the extraction of story information and establishing a component space index table on the server. Subsequently, based on user interaction, only the model data that a user is interested in is transmitted, loaded, and displayed on the client. The presented method is implemented via Web Graphics Library, and this enables large IFC models to be fast loaded on the web browser without requiring any plug-ins. When compared with conventional methods that load all IFC model data for display purposes, the proposed method significantly reduces memory consumption in a web browser, thereby allowing the loading of large IFC models. When compared with the existing method of spatial partitioning for 3D data, the proposed SSP entirely uses semantic information in the IFC file itself, and thereby provides a better interactive experience for users.

Modeling friction in robotic systems using the moving frame method in dynamics

This paper reports on the new moving frame method in dynamics that has proven to excite students and reduce student attrition. It applies the moving frame method to the analysis of a two-body system. The moving frame method is founded on Lie Group Theory to model rotations of bodies, Cartan’s moving frames to model the change of a frame in terms of the frame, and a new notation from the discipline of geometrical physics. However, we have distilled these mathematical tools to matrix multiplications. The moving frame method presents a consistent notation for single bodies, linked systems, and robotics and from 2D problems and 3D problems. This paper demonstrates that this new method makes advanced 3D dynamics accessible to undergraduate students and inspires them to engage in learning beyond expectations. In this paper, we use the Principle of Virtual work to extract the equations of motion. While others have applied pieces and aspects of these mathematical tools, the notation presented here integrates them; it is accessible, programmable, and simple. Most importantly, this paper presents a restricted variation of the angular velocity to use in Hamilton’s Principle to extract the equations of motion. In addition, this project inspired students to research the energy losses due to friction in a system of linked rigid bodies. This project also builds the physical hardware and compares the theory and experiment using 3D visualization. This project demonstrates the power of Web Graphics Library to supplement analyses with visualization, so students can see the discipline of dynamics in action. It is imperative to study this student project while viewing the 3D animations, perhaps on cell phones.

Large-scale Interactive Numerical Experiments of Chaos, Solitons and Fractals in Real Time via GPU in a Web Browser.

The study of complex systems has emerged as an important field with many discoveries still to be made. Computer simulation and visualization provide important tools for studying complex dynamics including chaos, solitons, and fractals, but available computing power has been a limiting factor. In this work, we describe a novel and highly efficient computing and visualization paradigm using a Web Graphics Library (WebGL 2.0) methodology along with our newly developed library (Abubu.js). Our approach harnesses the power of widely available and highly parallel graphics cards while maintaining ease of use by simplifying programming through hiding implementation details, running in a web browser without the need for compilation, and avoiding the use of plugins. At the same time, it allows for interactivity, such as changing parameter values on the fly, and its computing is so fast that zooming in on a region of a fractal like the Mandelbrot set can incur no delay despite having to recalculate values for the entire plane. We demonstrate our approach using a wide range of complex systems that display dynamics from fractals to standing and propagating waves in 1, 2 and 3 dimensions. We also include some models with instabilities that can lead to chaotic dynamics. For all the examples shown here we provide links to the codes for anyone to use, modify and further develop with other models. Overall, the enhanced visualization and computation capabilities provided by WebGL together with Abubu.js have great potential to facilitate new discoveries about complex systems.

An Evaluation of HTML5 and WebGL for Medical Imaging Applications.

Despite the fact that a large number of web applications are used in the medical community, there are still certain technological challenges that need to be addressed, for example, browser plug-ins and efficient 3D visualization. These problems make it necessary for a specific browser plug-in to be preinstalled on the client side when launching applications. Otherwise, the applications fail to run due to the lack of the required software. This paper presents the latest techniques in hypertext markup language 5 (HTML5) and web graphics library (WebGL) for solving these problems and an evaluation of the suitability of the combination of HTML5 and WebGL for the development of web-based medical imaging applications. In this study, a comprehensive medical imaging application was developed using HTML5 and WebGL. This application connects to the medical image server, runs on a standard personal computer (PC), and is easily accessible via a standard web browser. The several functions required for radiological interpretation were implemented, for example, navigation, magnification, windowing, and fly-through. The HTML5-based medical imaging application was tested on major browsers and different operating systems over a local area network (LAN) and a wide area network (WAN). The experimental results revealed that this application successfully performed two-dimensional (2D) and three-dimensional (3D) functions on different PCs over the LAN and WAN. Moreover, it demonstrated an excellent performance for remote access users, especially over a short time period for 3D visualization and a real-time fly-through navigation. The results of the study demonstrate that HTML5 and WebGL combination is suitable for the development of medical imaging applications. Moreover, the advantages and limitations of these technologies are discussed in this paper.

OmicsNet:a web-based tool for creation and visual analysis of biological networks in 3D space.

Biological networks play increasingly important roles in omics data integration and systems biology. Over the past decade, many excellent tools have been developed to support creation, analysis and visualization of biological networks. However, important limitations remain: most tools are standalone programs, the majority of them focus on protein-protein interaction (PPI) or metabolic networks, and visualizations often suffer from ‘hairball’ effects when networks become large. To help address these limitations, we developed OmicsNet - a novel web-based tool that allows users to easily create different types of molecular interaction networks and visually explore them in a three-dimensional (3D) space. Users can upload one or multiple lists of molecules of interest (genes/proteins, microRNAs, transcription factors or metabolites) to create and merge different types of biological networks. The 3D network visualization system was implemented using the powerful Web Graphics Library (WebGL) technology that works natively in most major browsers. OmicsNet supports force-directed layout, multi-layered perspective layout, as well as spherical layout to help visualize and navigate complex networks. A rich set of functions have been implemented to allow users to perform coloring, shading, topology analysis, and enrichment analysis. OmicsNet is freely available at http://www.omicsnet.ca.

VR Interactive Feature of HTML5-based WebVR Control Laboratory by Using Head-mounted Display

The development of web-based online laboratory for engineering education has made big progress in recent years with state-of-the-art technologies. In order to further promote the effectiveness within an online virtual environment, the virtual reality (VR) interactive feature of WebVR Control laboratory based on HTML5 is presented in this paper. The educational objective is to assist the students or researchers to conduct a realistic and immersive experiment of control engineering with a head-mounted display (HMD) equipped. The implementation of the VR technique mainly relies on the Three.js graphic engine based on Web Graphics Library (WebGL) which has been supported by most of the mainstream web browsers in their latest version without a plugin embedded. At the end of the paper, the ball and beam system is taken as an example to illustrate the whole operational approach of the novel VR experiment in detail. While such a VR interactive feature hasn’t been integrated into some of the current web-based online laboratories, the technical solution could be inspirational for them.

General-Purpose Computation on GPUs in the Browser Using gpu.js

gpu.js is a client-side general-purpose computing on graphics processing units (GPGPU) library for the browser written entirely in JavaScript. Unlike some of the earlier implementations of client-side GPGPU, gpu.js does not require browser support through an explicit GPGPU API or an installation of a custom native runtime browser extension to enable such support. This allows the library to run on all modern platforms, including on mobile devices such as smartphones. It achieves this by using the already widely adopted Web Graphics Library graphics API in a manner that it is not designed for by making use of JavaScript-to-Open GL Shading Language transpilation. The library abstracts away all the unnecessary implementation details of awkwardly performing GPGPU on a graphics API and, at the same time, provides an API that was designed specifically for GPGPU.

Web-Scale Multidimensional Visualization of Big Spatial Data to Support Earth Sciences—A Case Study with Visualizing Climate Simulation Data

The world is undergoing rapid changes in its climate, environment, and ecosystems due to increasing population growth, urbanization, and industrialization. Numerical simulation is becoming an important vehicle to enhance the understanding of these changes and their impacts, with regional and global simulation models producing vast amounts of data. Comprehending these multidimensional data and fostering collaborative scientific discovery requires the development of new visualization techniques. In this paper, we present a cyberinfrastructure solution—PolarGlobe—that enables comprehensive analysis and collaboration. PolarGlobe is implemented upon an emerging web graphics library, WebGL, and an open source virtual globe system Cesium, which has the ability to map spatial data onto a virtual Earth. We have also integrated volume rendering techniques, value and spatial filters, and vertical profile visualization to improve rendered images and support a comprehensive exploration of multi-dimensional spatial data. In this study, the climate simulation dataset produced by the extended polar version of the well-known Weather Research and Forecasting Model (WRF) is used to test the proposed techniques. PolarGlobe is also easily extendable to enable data visualization for other Earth Science domains, such as oceanography, weather, or geology.

Web-based visualization for 3D data in archaeology: The ADS 3D viewer

The solid geometry of archaeological deposits is fundamental to the interpretation of their chronological sequence. However, such stratigraphic sequences are generally viewed as static two-dimensional diagrammatic representations which are difficult to manipulate or to relate to real layers. The ADS 3D Viewer is a web-based resource for the management and analysis of archaeological data. The viewer was developed to take advantage of recent developments in web technology, namely the adoption of WebGL (Web Graphics Library) by current web browsers. The ADS 3D Viewer combines the potential of the 3D Heritage Online Presenter (3DHOP), a software package for the web-based visualization of 3D geometries, with the infrastructure of the Archaeology Data Service (ADS) repository, in the attempt to create a platform for the visualization and analysis of 3D data archived by the ADS.Two versions of the viewer have been developed to answer the needs of different users. The first version, the Object Level 3D Viewer, was implemented to extend the browsing capability of ADS project archives by enabling the visualization of single 3D models. The second version, the Stratigraphy 3D Viewer, is an extension which allows the exploration of a specific kind of aggregated data: the multiple layers of an archaeological stratigraphic sequence. This allows those unable to participate directly in the fieldwork to access, analyse and re-interpret the archaeological context remotely. This has the potential to transform the discipline, allowing inter-disciplinary, cross-border and ‘at-distance’ collaborative workflows, and enabling easier access to and analysis of archaeological data.