Text-Guided Image Manipulation for Desired Region Using Referring Image Segmentation

Abstract

We propose a novel text-guided image manipulation method using referring image segmentation. The referring image segmentation aims at segmenting the region relevant to the given text description. By introducing the referring image segmentation into an image manipulation method, our method enables image manipulation in the desired region and reconstruction in the regions irrelevant to the text description. Experimental results show that our text-guided image manipulation method can improve the accuracy compared to existing image manipulation methods.