Coloring and fusing architectural sketches by combining a Y‐shaped generative adversarial network and a denoising diffusion implicit model

Abstract

AbstractSketch‐based architectural design tasks require considerable time and effort. However, developing an artificial intelligence agent to color and fuse architectural sketches is challenging due to the imaginative nature of the task and technical limitations. Here, we first introduce Y‐shaped generative adversarial networks (GANs), which can color sketches on the basis of temporarily specified reference images by embedding an attention mechanism model that can match spatial and color information and by maintaining a type of triangular equilibrium state. Then, we develop practicable methods for coloring and fusing the given sketches simultaneously using a combination of our Y‐shaped GANs and the denoising diffusion implicit model, yielding results with high quality and veracity. A novel interpolation process is developed as a necessary trick for realizing the fusion function. The testing results indicate that this method works better than the existing methods for the tasks of coloring and fusing architectural sketches.