Asynchronous Multi-Information Source Bayesian Optimization

Abstract

Abstract Resource management in engineering design seeks to optimally allocate while maximizing the performance metrics of the final design. Bayesian optimization (BO) is an efficient design framework that judiciously allocates resources through heuristic-based searches, aiming to identify the optimal design region with minimal experiments. Upon recommending a series of experiments or tasks, the framework anticipates their completion to augment its knowledge repository, subsequently guiding its decisions toward the most favorable next steps. However, when confronted with time constraints or other resource challenges, bottlenecks can hinder the traditional BO’s ability to assimilate knowledge and allocate resources with efficiency. In this work, we introduce an asynchronous learning framework designed to utilize idle periods between experiments. This model adeptly allocates resources, capitalizing on lower fidelity experiments to gather comprehensive insights about the target objective function. Such an approach ensures that the system progresses uninhibited by the outcomes of prior experiments, as it provisionally relies on anticipated results as stand-ins for actual outcomes. We initiate our exploration by addressing a basic problem, contrasting the efficacy of asynchronous learning against traditional synchronous multi-fidelity BO. We then employ this method to a practical challenge: optimizing a specific mechanical characteristic of a dual-phase steel.