Accelerating real‐time object detection in high‐resolution video surveillance

Abstract

SummaryAs various algorithms and models spring up, object detection‐based deep learning for image analysis has become an established technology in the field of computer vision. Furthermore, object detection for high‐resolution videos derived from ubiquitous surveillance cameras draws many researchers' attention due to its practical significance and the challenge on detecting accuracy and speed. Existing object detection methods mainly resize and compress each frame in the video and then apply the detection algorithm, but with the method, the detection for small objects in dense scenes is far from satisfactory in terms of accuracy because small objects are reduced to pixel‐level sizes in compressed frame images. In order to fix this issue, we propose AROD, a parallel detection framework based on adaptive image cropping. Unlike the traditional first‐compression‐and‐then‐detection methods, AROD adopts adaptive image cropping for distributed parallel detection. In this way, AROD significantly improves the accuracy of small object detection in dense scenes with acceptable overhead. In our experimental evaluation, YOLOv2‐tiny model equipped with AROD reaches 29.29 FPS along with high detection accuracy. Experimental results verify that AROD ensures the high throughput of real‐time video analytics while maintaining high detection accuracy.