Abstract

Over the last few decades, rapid progress in AI, machine learning, and deep learning has resulted in new techniques and various tools for manipulating multimedia. Though the technology has been mostly used in legitimate applications such as for entertainment and education, etc., malicious users have also exploited them for unlawful or nefarious purposes. For example, high-quality and realistic fake videos, images, or audios have been created to spread misinformation and propaganda, foment political discord and hate, or even harass and blackmail people. The manipulated, high-quality and realistic videos have become known recently as Deepfake. Various approaches have since been described in the literature to deal with the problems raised by Deepfake. To provide an updated overview of the research works in Deepfake detection, we conduct a systematic literature review (SLR) in this paper, summarizing 112 relevant articles from 2018 to 2020 that presented a variety of methodologies. We analyze them by grouping them into four different categories: deep learning-based techniques, classical machine learning-based methods, statistical techniques, and blockchain-based techniques. We also evaluate the performance of the detection capability of the various methods with respect to different datasets and conclude that the deep learning-based methods outperform other methods in Deepfake detection.

Highlights

  • T HE notable advances in artificial neural network (ANN) based technologies play an essential role in tampering with multimedia content

  • It considers the uncertainty of the prediction based on how much it varies from the actual label F1=2 * Recall * Precision / (Recall + Precision) False Positive Rate (FPR)= False Positive (FP) / (FP + True Negative (TN)) MCC, normalized cross-correlation, t-Test Mean Absolute Error (MAE) measures the average magnitude of the errors in a set of predictions, without considering their direction It converts similarities between data points to joint probabilities

  • The deep learning-based methods are widely used in detecting Deepfake

Read more

Summary

INTRODUCTION

T HE notable advances in artificial neural network (ANN) based technologies play an essential role in tampering with multimedia content. AI-enabled software tools like FaceApp [1], and FakeApp [2] have been used for realistic-looking face swapping in images and videos This swapping mechanism allows anyone to alter the front look, hairstyle, gender, age, and other personal attributes. The term “Deepfake” is derived from “Deep Learning” and “Fake,” and it describes specific photorealistic video or image contents created with DL’s support This word had been named after a Reddit user in late in late 2017, who applied deep learning methods for replacing a person’s face in pornographic videos using another person’s face and created photorealistic fake videos. Techniques, and datasets for Deepfake detection-related research by posing some research questions.

PROCESS OF SLR
Objectives
IEEE Access
Methods
OBSERVATIONS
LIMITATIONS AND CHALLENGES
Findings
CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call