In order to meet the challenges of increasingly diverse clothing styles and consumer demands in the market, traditional fabric design methods have become difficult to meet the needs of rapid iteration and innovation due to their time-consuming, costly, and subjective preferences of designers. In view of this, we propose an innovative fabric design optimization simulation strategy aimed at breaking through these bottlenecks through technological means. This strategy cleverly integrates advanced technologies of variational autoencoder (VAE) and generative adversarial network (GAN). First, VAE is used to capture and learn the complex distribution characteristics of existing clothing fabric designs, which include key information such as fabric texture, color matching, and structural details. Subsequently, GAN uses the hidden vectors obtained from VAE as input to generate brand new fabric design samples. During the training phase, GAN continuously iterates and optimizes, engaging in intense “adversarial” interactions between its generator and discriminator. The generator is dedicated to creating new samples that are as close to real fabric designs as possible, while the discriminator is responsible for identifying the authenticity of these samples. This process is implemented through backpropagation (BP) loss function, ensuring that the generated fabric design can visually simulate real fabrics. Experimental verification shows that this method can not only effectively generate high-quality and realistic clothing fabric designs, but also greatly shorten the design cycle and reduce costs.