Interconnectivity of Deep Learning Models in AI-Driven Design Systems

Abstract

"The incorporation of deep learning models into architectural design poses challenges, despite their potential to inform new design processes. One of these issues is the oversimplification of the design problem when employing a discrete, single AI model to tackle a multifaceted, complex design activity. Importantly, the investigation of DL-driven systems requires the identification of components (parts) and relationships between these constituents of this new design workflow. The need to investigate a functional AI-driven design workflow structure with design intentions encoded and incorporated into a human-supervised process is an additional important issue identified by this research. How can specific levels of agency be identified and made explicit in the context of interacting with learning systems? This study investigates a novel human-AI collaborative workflow that combines machine and designer creativity within a comprehensive framework. The focus was on developing a design system, a ""prototype"" with interconnected AI and agent-based models (ABM) to address multiple architectural systems at various design levels (design tasks, design phases) while enacting the designer's varying degrees of agency. Curation of datasets, network types, and connection strategies are the design intentions when working with AI models. In developing a new design workflow, we employ systems theory and the need to deconstruct the design process into its component parts. Design is considered an ""exploration activity"" because it involves the modification and evolution of both the problem goals (design requirements) and the methods and means used to achieve the goals. The investigation centered on prototyping feasible workflows with the following objectives: (1) establishing successful interconnectivities between multiple DL models within the process to manage architectural systems and layers; (2) emphasizing design agency and embedding intentions within each design task within the process. The proposed prototype was applied to three case studies to demonstrate the framework's potential, evaluate its functionality, and assess the outcomes. The experiment described here followed the format of a three-month project (Figure 1). The framework included the use of DL models for (i) design exploration, (ii) generation, revision, and evaluation, and (iii) project development. To examine different types of DL model connections at a global level, the following strategies were identified and implemented: sequential/(unidirectional); parallel and linear; and branching (design problem is broken down into subtasks defined by separate sets of AI models), branching off, or/and merging into a design solution. Designers are the choreographers of how discrete AI models interact with other discrete AI models and human agents. Using this concept as a guide, we can determine the levels of autonomy that the proposed framework driven by interconnected AI can provide. (a) dataset curation: limited agency; (b) types of networks: supervised or unsupervised (StyleGAN, Pix2Pix, CycleGAN); (c) types of connections and combinations of those connections (sequential, parallel, branching)."