Abnormal Crowd Behavior Detection Based on the Fusion of Macro and Micro Features

Abstract

There are two types of research on abnormal crowd behavior detection: micro modeling methods (e.g., crowd pose) and macro modeling methods (e.g., optical flow methods). In crowd evacuation, however, micro methods fail to solve the occlusion problem, while macro methods fail to address issues such as poor real-time performance and non-adaptive motion target detection. To address these issues, we propose a method that combines macro and micro methods to detect abnormal crowd behavior. Firstly, we extract the two-dimensional poses of moving people using the human pose estimation algorithm (OpenPose) and get the corresponding micro motion features. Secondly, we create an optical flow map of the video using the dense optical flow algorithm (Farneback) and a scene activity map by comparing the optical flow sizes between two consecutive frames. Then we derive the entropy change curve, which represents the macro motion features. Finally, we fuse micro and macro motion features and put the fused hybrid feature vectors into our classification network to train our model, and then find the transition time from micro to macro abnormal states in crowd evacuation videos. The experimental findings demonstrate that our proposed method can more accurately and quickly identify the abnormal behaviors that appear in evacuation scenes.