Non-intrusive Reduced Order Model Research Articles

A non-intrusive reduced-order model for finite element analysis of implant positioning in total hip replacements.

Sophisticated high-fidelity simulations can predict bone mass density (BMD) changes around a hip implant after implantation. However, these models currently have high computational demands, rendering them impractical for clinical settings. Model order reduction techniques offer a remedy by enabling fast evaluations. In this work, a non-intrusive reduced-order model, combining proper orthogonal decomposition with radial basis function interpolation (POD-RBF), is established to predict BMD distributions for varying implant positions. A parameterised finite element mesh is morphed using Laplace's equation, which eliminates tedious remeshing and projection of the BMD results on a common mesh in the offline stage. In the online stage, the surrogate model can predict BMD distributions for new implant positions and the results are visualised on the parameterised reference mesh. The computational time for evaluating the final BMD distribution around a new implant position is reduced from minutes to milliseconds by the surrogate model compared to the high-fidelity model. The snapshot data, the surrogate model parameters and the accuracy of the surrogate model are analysed. The presented non-intrusive surrogate model paves the way for on-the-fly evaluations in clinical practice, offering a promising tool for planning and monitoring of total hip replacements.

Application of a non-intrusive reduced order modeling approach to magnetohydrodynamics

Magnetohydrodynamics (MHD) investigates the intricate relationship between electromagnetism and fluid dynamics, offering a complete insight into the behavior of conducting fluids under the influence of magnetic fields. This theory plays a pivotal role in the framework of magnetic confinement fusion, where it can be applied to describe both thermonuclear plasmas confined inside the vacuum vessel and operating fluids, such as liquid metals and molten salts, flowing within the blanket of future tokamaks. Currently, the state-of-the-art numerical modeling of MHD scenarios employs a multi-physics framework to examine the interplay between magnetic fields and thermal hydraulics; however, due to the complexity of the involved physics, detailed models are required, resulting in a significant computational burden. In this regard, reduced order modeling (ROM) techniques may represent a promising solution, as they enable approximating complex systems with lower-dimensional models. Indeed, ROM methodologies can significantly reduce the required computational time while maintaining accuracy in capturing the convoluted physics involved in fusion reactors, especially in the contexts of sensitivity analysis, uncertainty quantification, and control. Despite their potential, ROM methods are relatively under-explored within the MHD framework; this study applies ROM techniques to MHD scenarios, focusing on their capabilities and possible limitations. To this aim, the backward-facing step, which is well suited for exploring the effects of different magnetic fields on turbulent dynamics, is adopted as case study. In particular, this work evaluates the potentialities of the ROM approach in enhancing computational efficiency within the MHD domain. Each of the methods evaluated was effective in precisely reconstructing flow dynamics at any given time and across the full range of magnetic field values tested while significantly reducing computational costs compared to full-order simulations. Practically, this study demonstrates the feasibility to create simplified models that accurately represent the magnetohydrodynamic flows of fluids within the blanket.

Enhancing non-intrusive reduced-order models with space-dependent aggregation methods

AbstractIn this manuscript, we combine non-intrusive reduced-order models (ROMs) with space-dependent aggregation techniques to build a mixed-ROM, able to accurately capture the flow dynamics in different physical settings. The flow prediction obtained using the mixed formulation is derived from a convex combination of the predictions of several previously trained reduced-order models (ROMs), with each model assigned a space-dependent weight. The ROMs incorporated in the mixed model utilize different reduction methods, such as proper orthogonal decomposition and autoencoders, and various approximation techniques, including radial basis function interpolation (RBF), Gaussian process regression, and feed-forward artificial neural networks. Each model’s contribution is given higher weights in regions where it performs best and lower weights where its accuracy is lower compared to the other models. Additionally, a random forest regression technique is used to determine the weights for previously unseen conditions. The performance of the aggregated model is assessed through two test cases: the 2D flow past a NACA 4412 airfoil at a 5-degree angle of attack, with the Reynolds number ranging between $$1 \times 10^{5}$$ 1 × 10 5 and $$1 \times 10^{6}$$ 1 × 10 6 , and a transonic flow over a NACA 0012 airfoil, with the angle of attack as the varying parameter. In both scenarios, the mixed-ROM demonstrated improved accuracy compared to each individual ROM technique, while providing an estimate for the predictive uncertainty.

TwinLab: a framework for data-efficient training of non-intrusive reduced-order models for digital twins

TwinLab: a framework for data-efficient training of non-intrusive reduced-order models for digital twins

Non-intrusive reduced-order model for time-dependent stochastic partial differential equations utilizing dynamic mode decomposition and polynomial chaos expansion

In this study, we present a novel non-intrusive reduced-order model (ROM) for solving time-dependent stochastic partial differential equations (SPDEs). Utilizing proper orthogonal decomposition (POD), we extract spatial modes from high-fidelity solutions. A dynamic mode decomposition (DMD) method is then applied to vertically stacked matrices of projection coefficients for future prediction of coefficient fields. Polynomial chaos expansion (PCE) is employed to construct a mapping from random parameter inputs to the DMD-predicted coefficient field. These lead to the POD–DMD–PCE method. The innovation lies in vertically stacking projection coefficients, ensuring time-dimensional consistency in the coefficient matrix for DMD and facilitating parameter integration for PCE analysis. This method combines the model reduction of POD with the time extrapolation strengths of DMD, effectively recovering field solutions both within and beyond the training time interval. The efficiency and time extrapolation capabilities of the proposed method are validated through various nonlinear SPDEs. These include a reaction–diffusion equation with 19 parameters, a two-dimensional heat equation with two parameters, and a one-dimensional Burgers equation with three parameters.

A novel LSTM-integrated non-intrusive ROM for reliability analysis of hysteretic systems with large stochastic dimension

Failure probability estimation of hysteretic systems subjected to random process excitation appears in many practical engineering applications, such as structures subjected to earthquake and vibration control. This task is computationally challenging due to the need for repeated solutions of a high-resolution model. This cost grows significantly with the stochastic dimension — characterized by the number of random variables, in this case, arising from the discretization of the random excitation. To address this issue, a novel non-intrusive reduced order model (ROM) is proposed in this paper. Accordingly, the complexity due to spatial discretization is first reduced using proper orthogonal decomposition. However, interpolation among response time histories in the resulting reduced solution space is computationally infeasible due to large stochastic dimensionality. An existing ROM developed by the authors is now improved by adopting a long short-term memory (LSTM) network for this interpolation. Furthermore, this adoption required two additional modifications in the mathematical structure of the ROM related to data compression and nonlinear coupling. The proposed methodology can be seamlessly integrated with black-box nonlinear solvers. Through detailed numerical studies on a beam on Winkler foundation and a multi-storied building frame subjected to stationary and non-stationary excitations, the proposed ROM is found to be accurate, efficient, and robust with respect to the frequency band of interest. The ROM has shown reduction of two orders of magnitude in the computational time. Furthermore, the proposed ROM is inherently parallelizable and holds promise to be scaled to other types of nonlinear systems with large stochastic dimensionality.

Non-intrusive reduced order models for partitioned fluid–structure interactions

The main goal of this work is to develop a data-driven Reduced Order Model (ROM) strategy from high-fidelity simulation result data of a Full Order Model (FOM). The goal is to predict at lower computational cost the time evolution of solutions of Fluid–Structure Interaction (FSI) problems. For some FSI applications, the elastic solid FOM (often chosen as quasi-static) can take far more computational time than the fluid one. In this context, for the sake of performance one could only derive a ROM for the structure and try to achieve a partitioned FOM fluid solver coupled with a ROM solid one. In this paper, we present a data-driven partitioned ROM on two study cases: (i) a simplified 1D-1D FSI problem representing an axisymmetric elastic model of an arterial vessel, coupled with an incompressible fluid flow; (ii) an incompressible 2D wake flow over a cylinder facing an elastic solid with two flaps. We evaluate the accuracy and performance of the proposed ROM-FOM strategy on these cases while investigating the effects of the model’s hyperparameters. We demonstrate a high prediction accuracy and significant speedup achievements using this strategy.

Data assimilation with machine learning for dynamical systems: Modelling indoor ventilation

Data assimilation is a method of combining physical observations with prior knowledge (for instance, a computational simulation) in order to produce an improved estimate of the state of a system; that is, improved over what the physical observations or the computational simulation, alone, could offer. Recently, machine learning techniques have been deployed in order to address the significant computational burden that is associated with the procedures involved in data assimilation.In this paper we propose an approach that uses a non-intrusive reduced-order model (NIROM) as a surrogate for a high-resolution model thereby saving computational effort. The mismatch between observations and the surrogate model is propagated forwards and backwards in time in a manner similar to 4D-variational data assimilation methods. The observations and prior are reconciled in a new way which takes full advantage of the neural network used in the NIROM and also means that there is no need to form the sensitivities explicitly when propagating the mismatch. Instead, the observations are part of the input and output of the network. The key advantages of this data assimilation approach are its simplicity (as we can avoid differentiating the forward model and bypass the use of an optimisation method), and its ability to integrate with control and uncertainty quantification methodologies.Modelling the air quality in a school classroom is the test case for our demonstration. After comparing the proposed data assimilation approach with 4D Variational Data Assimilation, we investigate two scenarios. The first of these is a dual-twin type experiment, for which the proposed approach is shown to perform very well, and the second is a test case which assimilates predictions from the NIROM with observations collected from a classroom in Houndsfield Primary School.

Non-intrusive reduced order models for the accurate prediction of bifurcating phenomena in compressible fluid dynamics

The present works is focused on studying bifurcating solutions in compressible fluid dynamics. On one side, the physics of the problem is thoroughly investigated using high-fidelity simulations of the compressible Navier–Stokes equations discretised with the Discontinuous Galerkin method. On the other side, from a numerical modelling point of view, two different non-intrusive reduced order modelling techniques are employed to predict the overall behaviour of the bifurcation. Both approaches showed good agreement with full-order simulations even in proximity of the bifurcating points where the solution is particularly non-smooth.

Reduced-order modelling for real-time physics-based variation simulation enhanced with adaptive sampling and optimized interpolation

AbstractManufacturing industries require a right-first-time paradigm to remain competitive. Variation simulation (VS) is a key tool to predict variation of the final shape of flexible assemblies, allowing to reduce defects and waste. VS models involving compliant sheet-metal parts commonly integrate physics-based simulation with statistical approaches (usually Monte Carlo simulation). Although increasingly used as a backbone of synthesis techniques for (stochastic) optimization of assembly systems, the main roadblock of VS methods is the intense computational costs due to time-intensive simulations and high-dimensional design space. Driven by the need of time reduction, this paper presents an innovative real-time physics-based VS model of assembly systems with compliant sheet-metal parts. The proposed methodology involves a non-intrusive reduced-order model (niROM), empowered by a novel adaptive sampling procedure for dataset generation, and a cross-validation-based optimized radial basis function (RBF) formulation for interpolation. Demonstrated through two case studies—(i) a remote laser welding operation to predict mechanical distortions, with two input parameters, and (ii) the assembly of an aircraft vertical stabilizer with five input parameters—the methodology achieves accurate real-time results, with up to a 43% improvement in accuracy compared to traditional sampling techniques. Findings highlight the critical influence of the sampling strategy and the number of input parameters on ROM accuracy. Better results are reached by employing adaptive sampling in combination with optimum RBF, which additionally disengages the user from the choice of the interpolation settings. This study unlocks new avenues in the field of variation simulation and dimensional/quality monitoring by narrowing the gap between any advanced CAE solver and VS models with real-time physics-based simulations.

Adjacency-based, non-intrusive model reduction for vortex-induced vibrations

Vortex-induced Vibrations (VIV) pose computationally expensive problems of high practical interest to several engineering fields. In this work we develop a non-intrusive, reduced-order modeling methodology, applied to two-dimensional (2D), VIV cases subject to a laminar, incompressible flow. Performing a physics-informed approximation of the Arbitrary Lagrangian–Eulerian (ALE) incompressible Navier–Stokes (NS), we derive a discrete-time, quadratic-bilinear model structure for the velocity flowfield on a reference domain. This structure, along with a predefined sparsity pattern motivated by the adjacency-based sparsity of the discretized NS-ALE operators, leads to the formulation of a sparse, full-order model (sFOM) inference problem. Thus, the data-driven inference task requires solving many “local” least squares (LS) problems, isolating the contribution of geometrically “nearest neighbours” for each degree of freedom. Numerical aspects of inference such as data centering and regularization, as well as the direct enforcement of boundary conditions under the sFOM formulation are extensively discussed. The inferred, sFOM operators are then projected to a non-intrusive reduced-order model (ROM) for the velocity flowfield via the Proper Orthogonal Decomposition (POD). The resulting non-intrusive ROM (sFOM-POD) is coupled with the first-principle, 2D solid oscillation equations, resulting to a hybrid physics-informed/first-principle VIV dynamics model, simulated using an implicit time integration scheme. The mapping of the coupled solution from the ALE reference domain to the current configuration is also presented. This methodology is applied to two testcases of an elliptical, non-deformable solid mounted on springs, subject to Re=90,180 flows. Numerical results indicate a successful coupling between the data-driven flowfield and solid dynamics, with prediction errors of less than 3% for both the flowfield and the solid oscillation. A comparative study with respect to the sFOM-POD dimension indicates the robustness and potential of the approach.

Domain Decomposition Strategy for Combining Nonlinear and Linear Reduced-Order Models

Increasingly ubiquitous reliance on expensive, high-fidelity numerical simulations has led to the emergence of reduced-order modeling as an effective method to predict high-dimensional, spatially discretized field outputs in an efficient manner. This study presents a method to construct parametric, nonintrusive reduced-order models (ROMs) by leveraging domain decomposition (DD) to enable using multiple dimension reduction (DR) techniques within different spatial subdomains of the field to construct a single predictive ROM. To enforce smoothness of solutions across subdomains, points at domain interfaces are reconstructed using the data-driven gappy proper orthogonal decomposition method. The method is assessed on three high-dimensional test cases with shocks, including one with two-dimensional turbulent flow around the RAE2822. Results show that fully nonlinear ROMs predict fields more accurately in the vicinity of discontinuous features compared to their linear counterparts, which are more accurate in regions that are far from these discontinuities. Furthermore, irrespective of the DR method, DD-based ROMs outperformed their global counterparts in all test cases. Finally, models that used a combination of DR methods simultaneously showed superior performance near shockwaves and a significant improvement in total error compared to existing approaches that employ a single DR method in all subdomains.

A system identification approach for non-intrusive reduced order modeling of radiation-induced photocurrents

A system identification approach for non-intrusive reduced order modeling of radiation-induced photocurrents

Data driven reduced modeling for fluidized bed with immersed tubes based on PCA and Bi-LSTM neural networks

The fast and accurate reduced-order modeling of fluidized beds is a challenging task in the field of fluid dynamics, owing to their high dimensionality and nonlinear dynamic behavior. In this study, a nonintrusive reduced order modeling method, the reduced order model based on principal component analysis and bidirectional long short-term memory networks (PBLSTM ROM), was developed to capture complex spatio-temporal dynamics of fluidized beds. By combining principal component analysis and Bidirectional long- short-term memory networks, the PBLSTM ROM effectively extracted dynamic evolution information without any prior knowledge of governing equations, enabling reduced-order modeling of unsteady flow fields. The PBLSTM ROM was validated using the solid volume fraction and gas velocity flow fields of a fluidized bed with immersed tubes, showing superior performance over both the PLSTM and PANN ROMs in accurately capturing temporal changes in the fluidization fields, especially in the region near immersed tubes where severe fluctuations appear. Moreover, the PBLSTM ROM improved the simulation speed by five orders of magnitude compared to traditional computational fluid dynamics simulations. These findings suggest that the PBLSTM ROM presents a promising approach for analyzing the complex fluid flows in engineering practice.

Non-Intrusive Reduced-Order Modeling Based on Parametrized Proper Orthogonal Decomposition

A new non-intrusive reduced-order modeling method based on space-time parameter decoupling for parametrized time-dependent problems is proposed. This method requires the preparation of a database comprising high-fidelity solutions. The spatial bases are extracted from the database through first-level proper orthogonal decomposition (POD). The algebraic relationship between the time trajectory/parameter positions and the projection coefficient is described by the linear superposition of the second-level POD bases (temporal bases) and the second-level projection coefficients (parameter-dependent coefficients). This decomposition strategy decouples the space-time parameter effects, providing a stable foundation for fast predictions of parametrized time-dependent problems. The mappings between the parameter locations and the parameter-dependent coefficients are approximated as Gaussian process regression (GPR) models. The accuracy and efficiency of the PPOD-ROM are demonstrated through two numerical examples: flows past a cylinder and turbine flows with a clocking effect.

A novel non-intrusive ROM for randomly excited linear dynamical systems with high stochastic dimension using ANN

Analyzing large stochastic dynamical systems is computationally very expensive. A statistical simulation framework requires invoking the solver multiple times — ranging from thousands to millions. A non-intrusive reduced order model (ROM) serves as a computationally efficient alternative in this framework. Uncertainties in dynamical systems originate from two sources: system parameters and excitation. However, all the existing ROMs have been developed for uncertainty only in the system parameters. To the best of the authors’ knowledge, no ROM exists for dynamical systems under random excitation. A discretization of the input process increases the stochastic dimensionality, typically by a few hundred or thousand. This leads to a high dimensional interpolation or regression in the ROM, which is practically infeasible. This issue is addressed in this work by proposing a novel non-intrusive ROM that bypasses the need for such discretization. Accordingly, a regression is carried out directly on the random excitation using a neural network-based surrogate model. A principal component-based data compression is used in tandem to reduce the stochastic dimensionality of excitations. Detailed numerical studies are conducted to study the accuracy and efficiency of the proposed ROM using two examples: a mistuned bladed disk problem and a soil–structure interaction. The numerical results show that the proposed ROM is accurate and gains a significant speed-up of more than sixty for both examples. Using the proposed ROM, the cost of uncertainty quantification can be reduced significantly within the framework of Monte Carlo simulation.

Deep convolutional architectures for extrapolative forecasts in time-dependent flow problems

Physical systems whose dynamics are governed by partial differential equations (PDEs) find numerous applications in science and engineering. The process of obtaining the solution from such PDEs may be computationally expensive for large-scale and parameterized problems. In this work, deep learning techniques developed especially for time-series forecasts, such as LSTM and TCN, or for spatial-feature extraction such as CNN, are employed to model the system dynamics for advection-dominated problems. This paper proposes a Convolutional Autoencoder(CAE) model for compression and a CNN future-step predictor for forecasting. These models take as input a sequence of high-fidelity vector solutions for consecutive time steps obtained from the PDEs and forecast the solutions for the subsequent time steps using auto-regression; thereby reducing the computation time and power needed to obtain such high-fidelity solutions. Non-intrusive reduced-order modeling techniques such as deep auto-encoder networks are utilized to compress the high-fidelity snapshots before feeding them as input to the forecasting models in order to reduce the complexity and the required computations in the online and offline stages. The models are tested on numerical benchmarks (1D Burgers’ equation and Stoker’s dam-break problem) to assess the long-term prediction accuracy, even outside the training domain (i.e. extrapolation). The most accurate model is then used to model a hypothetical dam break in a river with complex 2D bathymetry. The proposed CNN future-step predictor revealed much more accurate forecasting than LSTM and TCN in the considered spatiotemporal problems.

Data-driven reduced-order modelling for blood flow simulations with geometry-informed snapshots

Parametric reduced-order modelling often serves as a surrogate method for hemodynamics simulations to improve the computational efficiency in many-query scenarios or to perform real-time simulations. However, the snapshots of the method require to be collected from the same discretisation, which is a straightforward process for physical parameters, but becomes challenging for geometrical problems, especially for those domains featuring unparameterised and unique shapes, e.g. patient-specific geometries. In this work, a data-driven surrogate model is proposed for the efficient prediction of blood flow simulations on similar but distinct domains. The proposed surrogate model leverages group surface registration to parameterise those shapes and formulates corresponding hemodynamics information into geometry-informed snapshots by the diffeomorphisms constructed between a reference domain and original domains. A non-intrusive reduced-order model for geometrical parameters is subsequently constructed using proper orthogonal decomposition, and a radial basis function interpolator is trained for predicting the reduced coefficients of the reduced-order model based on compressed geometrical parameters of the shape. Two examples of blood flowing through a stenosis and a bifurcation are presented and analysed. The proposed surrogate model demonstrates its accuracy and efficiency in hemodynamics prediction and shows its potential application toward real-time simulation or uncertainty quantification for complex patient-specific scenarios.

Non-intrusive data-driven reduced-order modeling for time-dependent parametrized problems

Reduced-order models are indispensable for multi-query or real-time problems. However, there are still many challenges to constructing efficient ROMs for time-dependent parametrized problems. Using a linear reduced space is inefficient for time-dependent nonlinear problems, especially for transport-dominated problems. The non-linearity usually needs to be addressed by hyper-reduction techniques, such as DEIM, but it is intrusive and relies on the assumption of affine dependence of parameters. This paper proposes and studies a non-intrusive reduced-order modeling approach for time-dependent parametrized problems. It is purely data-driven and naturally split into offline and online stages. During the offline stage, a convolutional autoencoder, consisting of an encoder and a decoder, is trained to perform dimensionality reduction. The encoder compresses the full-order solution snapshots to a nonlinear manifold or a low-dimensional reduced/latent space. The decoder allows the recovery of the full-order solution from the latent space. To deal with the time-dependent problems, a high-order dynamic mode decomposition (HODMD) is utilized to model the trajectories in the latent space for each parameter. During the online stage, the HODMD models are first utilized to obtain the latent variables at a new time, then interpolation techniques are adopted to recover the latent variables at a new parameter value, and the full-order solution is recovered by the decoder. Some numerical tests are conducted to show that the approach can be used to predict the unseen full-order solution at new times and parameter values fast and accurately, including transport-dominated problems.

The use of GANs and transfer learning in model-order reduction of turbulent wake of an isolated high-rise building

The high cost of computational fluid dynamics (CFD) simulations has limited their use for real-time and long-term simulations. To address this limitation, reduced-order modeling has been developed, and recent advancements in artificial intelligence (AI) algorithms have led to the creation of non-intrusive reduced-order models (NIROMs). The present study proposes a framework for using various AI techniques to develop NIROMs for the turbulent wake of an isolated high-rise building. The framework is demonstrated using datasets from two different flow conditions, isothermal and unstable thermal stratification. A residual adversarial autoencoder (AAE) network with convolutional layers and Wasserstein generative adversarial network (WGAN) is first used to reduce the dimensionality of the unstable dataset. Afterward, a parallel bidirectional long short-term memory (BiLSTM) network computes its evolution through time. The proposed framework provides commendable predictions of the airflow field. The weights of the trained model are utilized to create a NIROM based on transfer learning (TL) for a smaller dataset that represents the isothermal condition. The results showed that when the training dataset is limited and the model cannot be trained on sufficient vortex shedding cycles, the proper use of TL can lead to better outcomes compared to the traditional training method (i.e., training from scratch).