Implementing dynamic subset sensitivity analysis for early design datasets

Abstract

Engaging with performance feedback in early building design often involves building a custom parametric model and generating large datasets, which is not always feasible. Alternatively, large parametric datasets of general design problems and filtering methods could be used together to explore specific design decisions. This paper investigates the generalizability of a method that dynamically assesses variable importance and likely influence on performance objectives as a precomputed design space is filtered down. The method first trains linear model trees to predict building performance objectives across a generic design space. Leaf node models are then aggregated to provide feedback on variable importance in different design space regions. This approach is tested on three design problems that vary in number of variables, samples, and design space structure to reveal advantages and potential limitations of the method. Algorithm improvements are proposed, and general recommendations are developed to apply it on future datasets.