Abstract

Exemplar-based image inpainting technology is a “double-edged sword”. It can not only restore the integrity of image by inpainting damaged or removed regions, but can also tamper with the image by using the pixels around the object region to fill in the gaps left by object removal. Through the research and analysis, it is found that the existing exemplar-based image inpainting forensics methods generally have the following disadvantages: the abnormal similar patches are time-consuming and inaccurate to search, have a high false alarm rate and a lack of robustness to multiple post-processing combined operations. In view of the above shortcomings, a detection method based on long short-term memory (LSTM)-convolutional neural network (CNN) for image object removal is proposed. In this method, CNN is used to search for abnormal similar patches. Because of CNN’s strong learning ability, it improves the speed and accuracy of the search. The LSTM network is used to eliminate the influence of false alarm patches on detection results and reduce the false alarm rate. A filtering module is designed to eliminate the attack of post-processing operation. Experimental results show that the method has a high accuracy, and can resist the attack of post-processing combination operations. It can achieve a better performance than the state-of-the-art approaches.

Highlights

  • In order to make up for the shortcomings of existing methods in the images inpainting forensics, reveal the image inpainting with post-processing attacks, this paper proposes an image inpainting forensics method based on long short-term memory (LSTM)-convolutional neural network (CNN), which uses a convolutional neural network (CNN) to identify suspicious similar patches in the tampered image, and exploits LSTM to distinguish the texture consistent regions from suspicious regions, so as to greatly reduce the false alarm rate

  • We present a CNN based nearest neighbor image patch matching algorithm to quickly search for abnormal similar patches in images; We design a false alarm removal module based on the CNN and LSTM network

  • In order to belongs to lossy compression, which will inevitably destroy the correlation of discrete cosine transform make CNN focus more on learning the trace features introduced by image tampering and reduce the (DCT) coefficients among pixels and other statistical features

Read more

Summary

A Detection Approach Using LSTM-CNN for Object

Beijing Key Lab of Intelligent Telecommunication Software and Multimedia, Beijing University of Posts and Telecommunications, Beijing 100876, China.

Motivation
Related
Main Contribution
Background
Schematic diagram of of criminisi’s algorithm:
The Solutions to Key Problems
The Search of Abnormal Similar Patches
Reduction of False Alarm Rate
Filtering of Post-Processing Features
Filtering of Post-Processing
4: Begin: 5
Gaussian Noise Feature Filtering
Network Architecture
Encoder Network
Convolution Layer
Residual Unit
Pooling Layer
Decoder Network
LSTM Network
Experimental Results and Analysis
Experimental Setup
The Detection for Image Object Removal Without Post-Processing
The detection results of tampered region irregular in shape:
The Detection for Image Object Removal with Single Post-Processing
The Detection for Object Removal with JPEG Compression
The Detection for Object Removal with Gaussian Noise
The Detection for Image Object Removal with Combined Post-Processing
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call