Abnormal Behavior Learning Based on Edge Computing toward a Crowd Monitoring System

Abstract

Abnormal behavior poses a great threat to social security and stability. The resulting violence or crime leads to terrible consequences. How to utilize reasonable means to predict the dangerous intentions of massive crowds and prevent the potential hazard to the public is significant for social security. A crowd monitoring and management system is an effective way to detect abnormal behavior. In this article, we release unmanned aerial vehicles as well as fixed ground devices to achieve multi-level and multi-modal behavioral sensing on a massive crowd, deploy a hybrid model in edge cloud to extract global features from behavioral data of a massive crowd, and then utilize these global features to construct decent classification algorithms for action recognition and behavioral semantic cognition. With the cooperation of behavioral data and cognitive algorithms, we can understand the instantaneous emotions of the crowd. On the basis of behavioral data and the emotional state of the crowd, the correlation between daily behavior and any dangerous intention of a massive crowd has been revealed by utilizing behavioral big data analysis, which is a key foundation for predicting people's dangerous intentions. Finally, we conduct a case study of abnormal behavior detection based on pix2pix and continuous video frames. The experimental results show that the performance of our method is better than other algorithms in both public datasets and the customized Hajj dataset. The proposed novel pattern for the effective learning of a massive crowd is validated to effectively eliminate some of the possible dangers caused by abnormal behavior.