Anomaly Detection in Heterogeneous Data Using Graph Convolutional Networks

Abstract

Closed-circuit television (CCTV) surveillance systems are ubiquitous tools for ensuring public and private safety. However, manual monitoring of surveillance footage is arduous and time-consuming, often resulting in delayed identification and response to potential threats. In this paper, we present a novel real-time threat detection system tailored for CCTV surveillance, employing cutting-edge deep learning methodologies, particularly graph convolutional networks (GCNs), to detect and classify high-movement levels within video frames. By treating videos as segments and delineating between anomalous (potentially threatening) and normal (safe) segments, our system facilitates continuous real-time monitoring of surveillance footage, enabling the timely identification of potential threats such as abuse, burglaries, explosions, shootings, fighting, shoplifting, road accidents, arson, robbery, stealing, assault, and vandalism. To assess the efficacy of our system, we conducted extensive experiments on a large-scale dataset comprising CCTV footage, yielding promising results. Additionally, we introduce a novel, comprehensive dataset comprising 128 hours of real-world surveillance videos, encompassing various anomalies and normal activities. This dataset serves dual purposes: general anomaly detection, and the recognition of specific anomalous activities. Our experimental findings demonstrate the superior performance of our method in anomaly detection compared to state-of-the-art approaches. Furthermore, we provide an analysis of several recent deep learning baselines for anomalous activity recognition, revealing the challenging nature of our dataset and the potential it holds for future research endeavors. Through the integration of advanced deep learning techniques and comprehensive dataset creation, our proposed system stands to significantly enhance the efficiency and effectiveness of CCTV surveillance, facilitating faster response times and bolstering security for individuals in diverse environments.