A Differential Privacy protection-based federated deep learning framework to fog-embedded architectures

Abstract

Nowadays, companies collect massive quantities of data to enhance their operations, often at the expense of sharing user sensible information. This data is widely used to train Deep Learning (DL) neural networks to model, classify, or recognize complex data. These activities enable companies to offer an array of services to users, such as precise advertising and optimal location services. This study explores potential solutions for preserving privacy while utilizing DL applications.To address the privacy issue, we develop a privacy-preserving framework specifically designed for fog computing environments. Unlike traditional cloud computing architectures, fog embedded architectures only share a small portion of user data with a nearby fog node, ensuring that the majority of sensitive data remains secure. Within these fog nodes, we incorporate two additional algorithms, namely Generalization and Threshold, to enhance the privacy-preserving capabilities of the framework.The first algorithm, Generalization, introduces a validation dataset within the fog nodes which not only increases the accuracy of the fog-embedded framework but also ensures that user data is preserved. The second algorithm, Threshold, is responsible for protecting user data samples and reducing the amount of information sent to the server. By combining these two algorithms, we are able to provide an additional layer of protection for user privacy while still maintaining the accuracy of the model.We conduct an evaluation to test its effectiveness using two separate datasets. In addition, we analyze them through a Feed Forward Neural Network (FFNN) and compare the results with a traditional centralized architecture to validate the effectiveness of the proposed framework.The results of our evaluation demonstrate that the proposed privacy-preserving framework, when combined with the Generalization and Threshold algorithms, can preserve up to 38.44% of user data. Additionally, we were able to extend the framework to multiple fog nodes without compromising the network’s accuracy, as we only observed a 0.1% decrease in accuracy when using the proposed architecture.This study emphasizes the importance of preserving user information while using DL applications and provides a solution that trains the desired network without violating user privacy, hence preserving their anonymity. Overall, the study highlights the potential of Federated Deep Learning to improve the accuracy and privacy of DL applications in fog computing environments.