Design of a real-time crime monitoring system using deep learning techniques

Abstract

Criminal Activities and Crime Monitoring System has long been a research topic. In this paper, we propose an effective Crime Monitoring System (CMS) that can detect a crime in real-time using a camera surveillance system and notify the appropriate law enforcement officer. The CMS was proposed to counterbalance human weaknesses such as inattention, slow reaction, and slacking, for example, in detecting crimes. The proposed CMS detects crime scenes by combining the mechanisms and functionalities of closed-circuit television (CCTV) cameras with various deep-learning methods and image-processing techniques. The CMS operates in three stages: weapon detection, violence detection, and face recognition. We used transfer learning models to detect weapons, and violence and used a face recognition algorithm to recognize faces. More specifically, to detect weapons YOLOv5, and MobileNetv2 to detect violence and used face recognition algorithms to recognize faces. The image dataset is used in CMS, while the video dataset is used to train the MobileNet-based violence detection model. In this case, frame-by-frame images extracted from video files were used to train the model. All of the models performed admirably. The weapon detection model detected four different weapon classes with greater than 80% accuracy. The violence detection model is also 95% accurate. The face recognition model had a 97% accuracy rate in detecting faces. The CMS's combined model was tested in a variety of real-world scenarios, and its performance was found to be outstanding. It was able to detect crime incidents and generate timely alarms, demonstrating its effectiveness in providing security and safety.