A new approach is proposed of adaptively selecting emulators for emulator embedded neural networks. Emulators typically take the form of physics-based low-fidelity models. If querying a low-fidelity model incurs significant computational costs, an emulator can still be constructed by training a surrogate model, such as a Gaussian process model or neural network, on data gathered from the low-fidelity model. These emulators are embedded into the neural network architecture and play an important role in boosting neural network accuracy with limited training data. However, in some practical situations finding a suitable low-fidelity emulator model is challenging. Use of an improper emulator can fail to improve learning performance, and in some cases no viable emulator is available. To address this technical gap, this study proposes using the decomposed functions of the actual physics-based model as emulators. Global sensitivity analysis is performed to compute the Sobol indices of the decomposed functions, which reveal their contribution ranks to the system response of interest. Based on the contribution ranks, the decomposed functions are embedded as emulators in an adaptive and iterative process. The proposed method is demonstrated with fundamental analytical examples. Additionally, a representative hypersonic vehicle design problem is included as a practical engineering example.
Read full abstract