CNN based localisation of forged region in object‐based forgery for HD videos

Abstract

The location of the smallest object in a scene plays an essential role in the perception of a viewer. Any tampering with it, may evolve in adverse consequences especially with surveillance videos of banks, ATMs, traffic monitoring etc. Therefore, a scientific approach is required to thoroughly observe the fine details of tampering (forgery) in a video. A spatio-temporal detection method is proposed using convolutional neural network (CNN) to detect as well as localise the forged region in a forged video frame. The proposed method is employed in two stages. The first stage is detecting forged frames using proposed temporal CNN, while the second stage is localising the forged region in a novel way using proposed spatial CNN. The vital element of a video, i.e. motion residual is used to train the proposed network. Thus, making the network comprehensive in detecting the object-based forgery in HD videos. The performance of the proposed method is evaluated on SYSU-OBJFORG dataset (object-based video forgery dataset) and a derived test dataset of variable length and frame size videos. The results are compared with state-of-the-art methods to prove the efficacy of the proposed method.