Physics-informed Neural Networks Research Articles

TDOR-MPINNs: Multi-output physics-informed neural networks based on time differential order reduction for solving coupled Klein–Gordon–Zakharov systems

With the continuous development in the field of deep learning, in recent years, it has also been widely used in the field of solving partial differential equations, especially the physics-informed neural networks (PINNs) method. However, the PINNs method has some limitations in solving coupled Klein–Gordon–Zakharov (KGZ) systems. To this end, in this article, inspired by the PINNs method and combined with the characteristics of the coupled KGZ systems, we design a neural network model, named multi-output physics-informed neural networks based on time differential order reduction (TDOR-MPINNs), to solve the coupled KGZ systems. Compared with the PINNs, the TDOR-MPINNs first reduces the time derivatives, and thus can increase supervised learning tasks. And through comparing the numerical results obtained by using TDOR-MPINNs and PINNs for solving the one-dimensional (1-D) and two-dimensional (2-D) coupled KGZ systems, we further validate the effectiveness, accuracy and reliability of the TDOR-MPINNs.

Research on Modeling Method of Autonomous Underwater Vehicle Based on a Physics-Informed Neural Network

Research on Modeling Method of Autonomous Underwater Vehicle Based on a Physics-Informed Neural Network

Physics-informed neural networks for high-resolution weather reconstruction from sparse weather stations

Background The accurate provision of weather information holds immense significance to many disciplines. One example corresponds to the field of air traffic management, in which one basis for weather detection is set upon recordings from sparse weather stations on ground. The scarcity of data and their lack of precision poses significant challenges to achieve a detailed description of the atmosphere state at a certain moment in time. Methods In this article, we foster the use of physics-informed neural networks (PINNs), a type of machine learning (ML) architecture which embeds mathematically accurate physics models, to generate high-quality weather information subject to the regularization provided by the Navier-Stokes equations. Results The application of PINNs is oriented to the reconstruction of dense and precise wind and pressure fields in areas where only a few local measurements provided by weather stations are available. Our model does not only disclose and regularize such data, which are potentially corrupted by noise, but is also able to precisely compute wind and pressure in target areas. Conclusions The effect of time and spatial resolution over the capability of the PINN to accurately reconstruct fluid phenomena is thoroughly discussed through a parametric study, concluding that a proper tuning of the neural network’s loss function during training is of utmost importance.

Predicting transformer temperature field based on physics‐informed neural networks

AbstractThe safe operation of oil‐immersed transformers is critical to the safety and stability of the power grid. As the operating time increases, the failure rate of oil‐immersed transformers shows an increasing trend, posing serious challenges to safe operation. It is necessary to investigate the internal state of the oil‐immersed transformer to improve the digital degree and achieve digitalisation and intelligent operation and maintenance. A physics‐informed neural network (PINN) for oil‐immersed transformers was introduced to reconstruct the temperature distribution inside the transformer. According to the approach, the loss function of the network would be optimised by incorporating physical constraint loss terms including heat transfer equations, initial conditions and boundary conditions. The results show that the method proposed can be used to reconstruct and predict the temperature field of transformers in a few seconds with satisfactory accuracy. In conclusion, the PINN proposed outperforms deep neural networks in terms of accuracy, reliability and interpretability, especially in data‐poor cases.

Physics-informed neural networks for an optimal counterdiabatic quantum computation

A novel methodology that leverages physics-informed neural networks to optimize quantum circuits in systems with NQ qubits by addressing the counterdiabatic (CD) protocol is introduced. The primary purpose is to employ physics-inspired deep learning techniques for accurately modeling the time evolution of various physical observables within quantum systems. To achieve this, we integrate essential physical information into an underlying neural network to effectively tackle the problem. Specifically, the imposition of the solution to meet the principle of least action, along with the hermiticity condition on all physical observables, among others, ensuring the acquisition of appropriate CD terms based on underlying physics. This approach provides a reliable alternative to previous methodologies relying on classical numerical approximations, eliminating their inherent constraints. The proposed method offers a versatile framework for optimizing physical observables relevant to the problem, such as the scheduling function, gauge potential, temporal evolution of energy levels, among others. This methodology has been successfully applied to 2-qubit representing H2 molecule using the STO-3G basis, demonstrating the derivation of a desirable decomposition for non-adiabatic terms through a linear combination of Pauli operators. This attribute confers significant advantages for practical implementation within quantum computing algorithms.

Swirling flow field reconstruction and cooling performance analysis based on experimental observations using physics-informed neural networks

The design of thermal protection modules (such as film cooling) for combustion chambers requires a high-fidelity swirling flow field. Although numerical methods provide insights into three-dimensional mechanisms of swirling flow, their predictions of key features such as recirculation zones and swirling jets are often unsatisfactory due to inherent anisotropy and the isotropic nature of the Boussinesq hypothesis. Experimental methods, such as hot wire, laser Doppler velocimetry, and planar particle image velocimetry (PIV), offer more accurate reference data but are limited by sparse or planar observations. In this study, considering the outperformed capability of solving inverse problems, physics-informed neural network (PINN) was adopted to reconstruct the mean swirling flow field based on limited experimental observations from two-dimensional and two-component (2D2C) results. It was found that adding partial information characterizing the swirling flow, such as the swirling jet, could significantly improve the reconstruction of flow field. In addition, film cooling effectiveness was the key variable to evaluate the film cooling performance, which was relatively measurable in the scalar field. To further improve the accuracy of the reconstruction, the multi-source strategy was adopted into the neural network, where the film cooling effectiveness (FCE) of the effusion plate was imported as the scalar source. It was found that the prediction of the flow field near the target plate was improved, where the highest error reduction could reach 76.5%. Finally, through the reconstructed three-dimensional vortex distribution, it was found that swirling flow vortex structures near the swirler exit had a significant impact on cooling effectiveness, causing a non-uniform cooling distribution. This study aims to diagnose the three-dimensional swirling flow field with deep learning by leveraging limited experimental data and deepen the understanding of effusion cooling under swirling flow condition so that obtains a more accurate reference in the design of thermal protection modules.

Weak-formulated physics-informed modeling and optimization for heterogeneous digital materials

Abstract Numerical solutions to partial differential equations (PDEs) are instrumental for material structural design where extensive data screening is needed. However, traditional numerical methods demand significant computational resources, highlighting the need for innovative optimization algorithms to streamline design exploration. Direct gradient-based optimization algorithms, while effective, rely on design initialization and require complex, problem-specific sensitivity derivations. The advent of machine learning offers a promising alternative to handling large parameter spaces. To further mitigate data dependency, researchers have developed physics-informed neural networks (PINNs) to learn directly from PDEs. However, the intrinsic continuity requirement of PINNs restricts their application in structural mechanics problems, especially for composite materials. Our work addresses this discontinuity issue by substituting the PDE residual with a weak formulation in the physics-informed training process. The proposed approach is exemplified in modeling digital materials, which are mathematical representations of complex composites that possess extreme structural discontinuity. This paper also introduces an interactive process that integrates physics-informed loss with design objectives, eliminating the need for pre-trained surrogate models or analytical sensitivity derivations. The results demonstrate that our approach can preserve the physical accuracy in data-free material surrogate modeling but also accelerates the direct optimization process without model pre-training.

Hypersonic inlet flow field reconstruction dominated by shock wave and boundary layer based on small sample physics-informed neural networks

High Mach number inlets face complex challenges such as shock wave/boundary layer interference, adversely impacting the aerodynamic characteristics and stable operating boundaries. Traditional computational fluid dynamics (CFD) simulations for performance and flow field analysis are slow, and data-driven deep learning technologies struggle with predicting flow fields in complex aerodynamic phenomena like shock wave/boundary layer interactions, boundary layer separation, and Mach disks. This study introduces a rapid, robust method for reconstructing hypersonic viscous inlet flow fields using inlet geometry design parameters. This method is called shock wave and boundary layer dominated two-dimensional multiphysical field reconstruction model based on multi-scale sensory field fusion residual physical information neural network (PIMSRF_ResNet), ensuring high-precision training data. Using the optimal Pareto solution set from multi-objective optimization with a small sample intelligence method, 150 sets of multi-physics fields under Ma10 conditions with varying geometric design parameters are calculated. Compared to traditional pure data-driven models, PIMSRF_ResNet's structural similarity in the test set reaches 0.9773, with a peak signal-to-noise ratio close to 30 dB and a correlation coefficient exceeding 98%. These experimental results demonstrated that the proposed method is a promising tool for real-time prediction of complex internal flow fields dominated by high Mach number shock waves and boundary layers.

A peridynamic-informed deep learning model for brittle damage prediction

Physics-informed Neural Network (PINN) has been introduced recently to predict and understand complex physical phenomena by directly incorporating feedback from governing equations. While PINNs offer remarkable capabilities, challenges arise when addressing discontinuities and heterogeneity, potentially compromising accuracy and reliability in prediction outcomes. In this study, a novel approach that combines the principles of peridynamic (PD) theory with PINN is presented to predict quasi-static damage and crack propagation in brittle materials. To achieve high prediction accuracy and convergence rate, the linearized PD governing equation is enforced in the PINN’s residual-based loss function. The proposed PD-INN is able to learn and capture complicated displacement patterns associated with different geometrical parameters, such as pre-crack position and length. The computational method presented in this study can be implemented to any PD constitutive model like Bond-Based PD or State-Based PD as well as any horizon factor. Several enhancements like cyclical annealing schedule and deformation gradient aware optimization technique are proposed to ensure the model would not get stuck in its trivial solution. The model’s performance assessment is conducted by monitoring the behavior of loss function throughout the training process. The results obtained through PD-INN demonstrate a satisfactory level of agreement in 2D and 3D when compared with the ground truth deformation from high-fidelity techniques like PD direct numerical method and Extended finite element method (X-FEM). Our results show the ability of the nonlocal PD-INN to predict damage and crack propagation accurately and efficiently.

Physics-informed generator-encoder adversarial networks with latent space matching for stochastic differential equations

We propose a new class of physics-informed neural networks, called Physics-Informed Generator-Encoder Adversarial Networks, to effectively address the challenges posed by forward, inverse, and mixed problems in stochastic differential equations (SDEs). In these scenarios, while governing equations are known, the available data consist of only a limited set of snapshots for system parameters. Our model consists of two key components: the generator and the encoder, both updated alternately by gradient descent. In contrast to previous approaches that directly match approximated solutions with real snapshots, we employ an indirect matching operating within the lower-dimensional latent feature space. This method circumvents challenges associated with high-dimensional inputs and complex data distributions in solving SDEs. Numerical experiments indicate that, compared to existing deep learning solvers, our proposed approach not only demonstrates superior accuracy but also exhibits advantages in both computational efficiency and model complexity.

Predicting positon solutions of a family of nonlinear Schrödinger equations through deep learning algorithm

We consider a hierarchy of nonlinear Schrödinger equations (NLSEs) and forecast the evolution of positon solutions using a deep learning approach called Physics Informed Neural Networks (PINN). Notably, the PINN algorithm accurately predicts positon solutions not only in the standard NLSE but also in other higher order versions, including cubic, quartic and quintic NLSEs. The PINN approach also effectively handles two coupled NLSEs and two coupled Hirota equations. In addition to the above, we report exact second-order positon solutions of the sextic NLSE and coupled generalized NLSE. These solutions are not available in the existing literature and we construct them through generalized Darboux transformation method. Further, we utilize PINNs to forecast their behaviour as well. To validate PINN's accuracy, we compare the predicted solutions with exact solutions obtained from analytical methods. The results show high fidelity and low mean squared error in the predictions generated by our PINN model.

The Potential for Material Property Characterization Using Physics-Informed Neural Networks and Ultrasonic Wave Data

ABSTRACT There is a need for reliable nondestructive test methods that can collect data from structural members and analyze the results in a rapid and efficient manner. Large amounts of test data are needed to achieve such characterization, which provides additional challenges because of their heterogeneity and complexity. Advances in machine learning, in particular physics-informed neural networks (PINN), offer potential to address these problems. PINN is a particular form of artificial neural networks (ANN) and portends notable advantages over traditional measurand analysis or purely data-driven approaches. Here, we explore the potential of heterogeneous material property characterization using PINN and ultrasonic wave data. First, several types of 1-D ultrasonic wave data are numerically simulated for a spatially heterogeneous material, and then PINN is applied to predict wave velocity, defect location, and energy dissipation. Then, three different types of defects are simulated and all defects are detected using the corresponding 2-D ultrasonic wave data and PINN. The presented results demonstrate the promise of PINN to assist with heterogeneous material characterization methods.

Improving the Efficiency of Training Physics-Informed Neural Networks Using Active Learning

Improving the Efficiency of Training Physics-Informed Neural Networks Using Active Learning

A certified wavelet-based physics-informed neural network for the solution of parameterized partial differential equations

Abstract Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error, which is particularly relevant for model reduction of Parameterized PDEs (PPDEs). To this end, we suggest to use a weighted sum of expansion coefficients of the residual in terms of an adaptive wavelet expansion both for the loss function and an error bound. This approach is shown here for elliptic PPDEs using both the standard variational and an optimally stable ultra-weak formulation. Numerical examples show a very good quantitative effectivity of the wavelet-based error bound.

Prediction of Dynamic Ni Morphology Changes in Patterned Ni-YSZ Anode with Physics-Informed Neural Networks

Abstract Nickel (Ni) film on patterned Ni- yttria-stabilized zirconia (YSZ) anode shows dynamic spreading and splitting during solid oxide fuel cell (SOFC) operation, where wettability of Ni on YSZ is greatly enhanced (Z. Jiao, N. Shikazono, J. Power Sources 396 119–123, 2018). In the present study, a physics-informed neural network (PINN) constrained by Cahn-Hilliard equation of phase field model is proposed to estimate the unknown parameters for predicting dynamic Ni movements of the patterned Ni-YSZ anode. The unknown parameters such as interface thickness and mobility are inversely inferred by PINN using top-view images obtained from the operando experiments. Obtained excess surface diffusivity values were three to four orders of magnitude larger than the values reported for surface diffusion in the literature. It is therefore considered that Ni spreading and splitting of patterned anode cannot be simply explained by surface diffusion, and other mechanisms should be introduced.

Solving forward and inverse problems of contact mechanics using physics-informed neural networks

This paper explores the ability of physics-informed neural networks (PINNs) to solve forward and inverse problems of contact mechanics for small deformation elasticity. We deploy PINNs in a mixed-variable formulation enhanced by output transformation to enforce Dirichlet and Neumann boundary conditions as hard constraints. Inequality constraints of contact problems, namely Karush–Kuhn–Tucker (KKT) type conditions, are enforced as soft constraints by incorporating them into the loss function during network training. To formulate the loss function contribution of KKT constraints, existing approaches applied to elastoplasticity problems are investigated and we explore a nonlinear complementarity problem (NCP) function, namely Fischer–Burmeister, which possesses advantageous characteristics in terms of optimization. Based on the Hertzian contact problem, we show that PINNs can serve as pure partial differential equation (PDE) solver, as data-enhanced forward model, as inverse solver for parameter identification, and as fast-to-evaluate surrogate model. Furthermore, we demonstrate the importance of choosing proper hyperparameters, e.g. loss weights, and a combination of Adam and L-BFGS-B optimizers aiming for better results in terms of accuracy and training time.

Physics-Informed Machine Learning of Argon Gas-Driven Melt Pool Dynamics

Abstract Melt pool dynamics in metal additive manufacturing (AM) is critical to process stability, microstructure formation, and final properties of the printed materials. Physics-based simulation including computational fluid dynamics (CFD) is the dominant approach to predict melt pool dynamics. However, the physics-based simulation approaches suffer from the inherent issue of very high computational cost. This paper provides a physics-informed machine learning method by integrating the conventional neural networks with the governing physical laws to predict the melt pool dynamics such as temperature, velocity, and pressure without using any training data on velocity. This approach avoids solving numerically the non-linear Navier-Stokes equation, which significantly reduces the computational cost (if including the cost of velocity data generation). The difficult-to-determine parameters' values of the governing equations can also be inferred through data-driven discovery. In addition, the physics-informed neural network (PINN) architecture has been optimized for efficient model training. The data-efficient PINN model is attributed to the extra penalty by incorporating governing PDEs, initial conditions, and boundary conditions in the PINN model.

Analyzing magnetic dipole impact in fluid flow with endothermic/exothermic reactions: neural network simulation

The consequence of exothermic/endothermic chemical reactions and Arrhenius activation on the heat and mass transport of the liquid flow past a cylinder in the incidence of a magnetic dipole is considered in the current investigation. Magnetic dipoles are used in medical applications such as magnotherapy and spectroscopy, to produce static magnetic fields. Scientists and engineers can improve the effectiveness of chemical reactions or heat transfer operations by analyzing the impact of reactions on flow and building systems with optimized flows. The modelled equations are converted into non-dimensional ordinary differential equations (ODEs) by using similarity variables. The resultant equations are solved by employing the physics-informed neural network (PINN) technique. Additionally, the comparison of PINN with the numerical method Runge–Kutta Fehlberg’s fourth-fifth order (RKF-45) is studied. The effects of different parameters on the temperature, concentration, and velocity profiles for endothermic/exothermic instances are shown graphically. The thermal, velocity, and concentration profiles get stronger as the curvature parameter values increase for both endothermic and exothermic cases. The influence of activation energy parameters, chemical reaction parameters, and endothermic/exothermic reaction parameters on the thermal and concentration is also depicted.

Modified failproof physics-informed neural network framework for fast and accurate optical fiber transmission link modeling

Physics-informed neural networks (PINNs) have recently emerged as an important and ground-breaking technique in scientific machine learning for numerous applications including in optical fiber communications. However, the vanilla/baseline version of PINNs is prone to fail under certain conditions because of the nature of the physics-based regularization term in its loss function. The use of this unique regularization technique results in a highly complex non-convex loss landscape when visualized. This leads to failure modes in PINN-based modeling. The baseline PINN works very well as an optical fiber model with relatively simple fiber parameters and for uncomplicated transmission tasks. Yet, it struggles when the modeling task becomes relatively complex, reaching very high error, for example, numerous modeling tasks/scenarios in soliton communication and soliton pulse development in special fibers such as erbium-doped dispersion compensating fibers. We implement two methods to circumvent the limitations caused by the physics-based regularization term to solve this problem, namely, the so-called scaffolding technique for PINN modeling and the progressive block learning PINN modeling strategy to solve the nonlinear Schrödinger equation (NLSE), which models pulse propagation in an optical fiber. This helps PINN learn more accurately the dynamics of pulse evolution and increases accuracy by two to three orders of magnitude. We show in addition that this error is not due to the depth or architecture of the neural network but a fundamental issue inherent to PINN by design. The results achieved indicate a considerable reduction in PINN error for complex modeling problems, with accuracy increasing by up to two orders of magnitude.

Physics-informed neural networks for solving flow problems modeled by the 2D Shallow Water Equations without labeled data

This paper investigates the application of physics-informed neural networks (PINNs) to solve free-surface flow problems governed by the 2D shallow water equations (SWEs). Two types of PINNs are developed and analyzed: a physics-informed fully connected neural network (PIFCN) and a physics-informed convolutional neural network (PICN). The PINNs eliminate the need for labeled data for training by employing the SWEs, initial and boundary conditions as components of the loss function to be minimized. Results from a set of idealized and real-world tests showed that the prediction accuracy and computation time (i.e., training time) of both PINNs may be less affected by the resolution of the domain discretization when compared against solutions by a Finite Volume (FV) model. Overall, the PICN shows a better trade-off between computational speed and accuracy than the PIFCN. Also, our results for the idealized problems indicated that PINNs can provide more than 5 times higher prediction accuracy than the FV model, while the FV simulation with coarse resolution (e.g., 10 m) can provide sub-centimeter accurate (RMSE) solutions at least one order of magnitude faster than the PINNs.Results from a river flood simulation showed that PINNs delivered better speed-accuracy trade-off than the FV model in terms of predicting the water depth, while FV models outperformed the PINNs for predictions of total flow discharge.