Method Simultaneous Using GAN and RNN for Generating Web Page Program Code from Input Image

Abstract

The article presents an analysis of neural networks that can be used to generating web page program code from input image. As part of the research of the possibilities of modification of algorithms for generating code, the method of generating code simultaneous using the generative adversarial and recurrent neural networks based on the input image is proposed. Methods for creating source code using generative adversarial network (GAN) and recurrent neural networks (RNN) are analyzed. Using domain-specific language (DSL) for tree generation code method, it was possible to use GAN and RNN together, achieving on the average 10% productivity increase. Using GRID’s mesh, the generated code is adaptable. To implement the proposed method, software with a graphical user interface is created. Classes of GAN and RNN were considered, among which the feasibility of using a neural network with long-term short-term memory (LSTM) for analysis and forecasting of tags, blocks and HTML elements of the language in the input image was selected and substantiated. The stages of the research are presented. For the experiment datasets made on the basis of existing sites from open sources for 2018–2019 are used. The estimation of the effectiveness of the proposed method is described.