The image inpainting algorithm used on multi-scale generative adversarial networks and neighbourhood

Abstract

Various problems existed in the image inpainting algorithms, which can’t meet people's requirements visually. Aiming at the defects of the existing image inpainting algorithms, such as low accuracy, poor visual consistency, and unstable training, an improved image inpainting algorithm used on a multi-scale generative adversarial network (GAN) and neighbourhood model have been proposed in the paper. The proposed algorithm mainly improves the network structure of the discriminator, and introduces a multi-scale discriminator based on the global discriminator and the local discriminator. The multi-scale discriminators were trained on images of different resolutions. Discriminators of different scales have different receptive fields, which can guide the generator to generate more global image views and finer details. Aiming at the problem of gradient disappearance or gradient explosion that often occurs in GAN training, the method of WGAN (Wasserstein GAN) has been used to simulate the sample data distribution using EM distance. The proposed model has been trained and tested on the CelebA, ImageNet, and Place2. The experimental results show that compared with the previous algorithm model, the proposed algorithm improves the accuracy of image inpainting and can generate more realistic repairing images, and it is suitable for many types of images.