Non-intrusive data-driven models are promising class of methodologies to build surrogate models for challenging parametric engineering problems. POD-DL [1,2], a method from this class uses deep neural networks as the main data-driven ingredient. Following a first linear dimensionality reduction, based on a POD basis, it applies a second nonlinear dimension reduction, in this case a deep autoencoder, and a nonlinear regression using a forward neural network to account for the temporal and parametric coefficients. This setting generates a large number of hyperparameters, such as the number of modes of the POD basis, the number of layers and amount of neurons per layer for each network (the autoencoder one and the regression one), besides all typical hyperparameters of neural networks, as learning rate, batch size, etc. This all impacts the amount of time for the training process and the surrogate model accuracy.Based on our previous experience with this methodology for coupled transport-fluid problems, we decided to study the Rayleigh-Bénard convection problem [3] with a fixed Prandtl number, a well documented heat transfer problem coupled with fluid flow. Besides the temporal character of the problem, the Rayleigh number serves as a parameter, i.e., each different number generates a different dynamic that is learned by the surrogate model. Then, the regression neural network can predict the dynamics for an unseen Rayleigh number. In order to understand the contribution of each component of the method, we perform an ablation study in this controlled setup. [1] - M. Cracco et al., Deep learning-based reduced-order methods for fast transient dynamics, Arxiv Preprint 2212.07737, 2022.[2] - S. Fresca and A. Manzoni, POD-DL-ROM: Enhancing deep learning-based reduced order models for nonlinear parametrized PDEs by proper orthogonal decomposition, Comput. Methods Appl. Mech. Engrg., 2022.[3] - R. Kessler, Nonlinear transition in three-dimensional convection, Journal of Fluid Mechanics, 1987.
Read full abstract