Image Inpainting Detection Based on Multi-task Deep Learning Network

Abstract

ABSTRACT Image inpainting can effectively repair damaged areas, but it can also be a way of image tampering when it is used to remove meaningful content from an image. Therefore, this paper focuses on the research of inpainting forensics, and proposes a multi-task deep learning method. In order to enhance the learning of texture features, the corresponding local binary pattern channels are added to the input of the network. Furthermore, considering that the multi-task object detection network Mask R-CNN cannot fully utilize the features of all scale feature information during the FPN feature extraction phase, the network in this paper combines Feature Pyramid Networks and back connections to extract more features. This network model can detect not only the images tampered by traditional inpainting methods, but also the images inpainted by deep learning methods. Experimental results on two large public data sets demonstrate the superior performance of the proposed method.