Tracking In Surveillance Videos Research Articles

Cross-Video Pedestrian Tracking Algorithm with a Coordinate Constraint

Pedestrian tracking in surveillance videos is crucial and challenging for precise personnel management. Due to the limited coverage of a single video, the integration of multiple surveillance videos is necessary in practical applications. In the realm of pedestrian management using multiple surveillance videos, continuous pedestrian tracking is quite important. However, prevailing cross-video pedestrian matching methods mainly rely on the appearance features of pedestrians, resulting in low matching accuracy and poor tracking robustness. To address these shortcomings, this paper presents a cross-video pedestrian tracking algorithm, which introduces spatial information. The proposed algorithm introduces the coordinate features of pedestrians in different videos and a linear weighting strategy focusing on the overlapping view of the tracking process. The experimental results show that, compared to traditional methods, the method in this paper improves the success rate of target pedestrian matching and enhances the robustness of continuous pedestrian tracking. This study provides a viable reference for pedestrian tracking and crowd management in video applications.

Object tracking in surveillance video based on Siamese network considering geographical spatiotemporal constraints

AbstractIdentifying and tracking objects in surveillance videos is an important means of mining information during surveillance. Currently, most object‐tracking methods rely only on image features, which cannot accurately express the motion of the tracked object in real geographical scenes and are easily influenced by occlusion and surrounding objects having similar features. However, tracked objects, such as pedestrians and vehicles, usually move in geographical space with fixed patterns of motion, and the motion in a short time is constrained by geographical space and time, the motion trajectory is predictable, and the range of motion is limited. Therefore, based on the SiamFC object tracking framework, this study introduces geographical spatiotemporal constraints into the tracking framework and proposes the GeoSiamFC method. The objective of this is to: (1) construct the mapping relationship between geographical space and image space to solve the problem that the pixel movement within the image after perspective imaging cannot accurately express the motion of the tracked object in a real geographical scene; (2) add candidate search areas according to the predicted trajectory location to correct the tracking errors caused by the occlusion of the object; and (3) focus on the search for the range of motion of the mapped pixel within the image space according to the limited geographical range of motion of the tracked objects in a certain time to reduce the interference of similar objects within the search area. In this study, separate experiments were conducted on a common test dataset using multiple methods to deal with challenges such as occlusion and illumination changes. In addition, a robust test dataset with noise addition and luminance adjustment based on the common test dataset was used. The results show that GeoSiamFC outperforms other object‐tracking methods in the common test dataset with a precision score of 0.995 and a success score of 0.756 compared with most other object‐tracking algorithms under the base condition of using only shallow networks. Moreover, GeoSiamFC maintained the highest precision score (0.970) and high success score (0.734) in the more challenging robust test dataset as well. The tracking speed of 59 frames per second far exceeds the real‐time requirement of 25 FPS. Geographical spatiotemporal constraints were considered to improve tracker performance while providing real‐time feedback on the motion trajectory of the target in geographical space. Thus, the proposed method is suitable for real‐time tracking of the motion trajectory of a target in real geographical scenes in various surveillance videos.

Road pollution estimation from vehicle tracking in surveillance videos by deep convolutional neural networks

Air quality and reduction of emissions in the transport sector are determinant factors in achieving a sustainable global climate. The monitoring of emissions in traffic routes can help to improve route planning and to design strategies that may make the pollution levels to be reduced. In this work, a method which detects the pollution levels of transport vehicles from the images of IP cameras by means of computer vision techniques and neural networks is proposed. Specifically, for each sequence of images, a homography is calculated to correct the camera perspective and determine the real distance for each pixel. Subsequently, the trajectory of each vehicle is computed by applying convolutional neural networks for object detection and tracking algorithms. Finally, the speed in each frame and the pollution emitted by each vehicle are determined. Experimental results on several datasets available in the literature support the feasibility and scalability of the system as an emission control strategy.

Object Tracking in Hyperspectral-Oriented Video with Fast Spatial-Spectral Features

This paper presents a correlation filter object tracker based on fast spatial-spectral features (FSSF) to realize robust, real-time object tracking in hyperspectral surveillance video. Traditional object tracking in surveillance video based only on appearance information often fails in the presence of background clutter, low resolution, and appearance changes. Hyperspectral imaging uses unique spectral properties as well as spatial information to improve tracking accuracy in such challenging environments. However, the high-dimensionality of hyperspectral images causes high computational costs and difficulties for discriminative feature extraction. In FSSF, the real-time spatial-spectral convolution (RSSC) kernel is updated in real time in the Fourier transform domain without offline training to quickly extract discriminative spatial-spectral features. The spatial-spectral features are integrated into correlation filters to complete the hyperspectral tracking. To validate the proposed scheme, we collected a hyperspectral surveillance video (HSSV) dataset consisting of 70 sequences in 25 bands. Extensive experiments confirm the advantages and the efficiency of the proposed FSSF for object tracking in hyperspectral video tracking in challenging conditions of background clutter, low resolution, and appearance changes.

Toward Scalable Video Analytics Using Compressed-Domain Features at the Edge

Intelligent video analytics systems have come to play an essential role in many fields, including public safety, transportation safety, and many other industrial areas, such as automated tools for data extraction, and analyzing huge datasets, such as multiple live video streams transmitted from a large number of cameras. A key characteristic of such systems is that it is critical to perform real-time analytics so as to provide timely actionable alerts on various tasks, activities, and conditions. Due to the computation-intensive and bandwidth-intensive nature of these operations, however, video analytics servers may not fulfill the requirements when serving a large number of cameras simultaneously. To handle these challenges, we present an edge computing-based system that minimizes the transfer of video data from the surveillance camera feeds on a cloud video analytics server. Based on a novel approach of utilizing the information from the encoded bitstream, the edge can achieve low processing complexity of object tracking in surveillance videos and filter non-motion frames from the list of data that will be forwarded to the cloud server. To demonstrate the effectiveness of our approach, we implemented a video surveillance prototype consisting of edge devices with low computational capacity and a GPU-enabled server. The evaluation results show that our method can efficiently catch the characteristics of the frame and is compatible with the edge-to-cloud platform in terms of accuracy and delay sensitivity. The average processing time of this method is approximately 39 ms/frame with high definition resolution video, which outperforms most of the state-of-the-art methods. In addition to the scenario implementation of the proposed system, the method helps the cloud server reduce 49% of the load of the GPU, 49% that of the CPU, and 55% of the network traffic while maintaining the accuracy of video analytics event detection.

Accurate vehicle location and tracking algorithms based on improved kernelized correlation motion model and Kalman filter in intelligent transport surveillance system

Vision-based traffic surveillance, an indispensable part of intelligent transport system (ITS), has been widely studied over past few years. Due to the factors such as visual occlusion, illumination change and pose variation, it is a challenging task to develop effective and efficient models for vehicle detection and tracking in surveillance videos. Although plenty of existing related models have been proposed, many problems still need to be resolved. A novel improved kernelized correlation tracking algorithm based on Kalman filter and motion model is proposed to solve the tracking accuracy deteriorated by fast-moving and severe occlusion. Firstly, an adaptive search region location method is proposed, where the optimal position is estimated by the uncertainty theory of the motion model so as to obtain the optimal search window. Secondly, a confidence strategy for similarity measurement is calculated by using the sharpness of the correlation peak and the smoothness constraint. Finally, the optimal confidence is introduced to get an adaptive update model. A large number of simulation experiments show that our proposed algorithm has more robust performance and anti-interference ability than the traditional KCF algorithm, which is suitable for intelligent transport system application.

A Face Tracking Method in Videos Based on Convolutional Neural Networks

Face tracking in surveillance videos is one of the important issues in the field of computer vision and has realistic significance. In this paper, a new face tracking framework in videos based on convolutional neural networks (CNNs) and Kalman filter algorithm is proposed. The framework uses a rough-to-fine CNN to detect faces in each frame of the video. The rough-to-fine CNN method has a higher accuracy in complex scenes such as face rotation, light change and occlusion. When face tracking fails due to severe occlusion or significant rotation, the framework uses Kalman filter to predict face position. The experimental results show that the proposed method has high precision and fast processing speed.

Pedestrian tracking in surveillance video based on modified CNN

With the prevalence of surveillance video, surveillance data can be used in a wide variety of applications where moving object detection, object recognition and pedestrian tracking has become a significant field of research. Especially for pedestrian tracking, it has become an urgent problem to be solved. This paper proposes a novel method based on convolutional neural network called Matching-Siamese network for pedestrian tracking. First, the pedestrians are detected from surveillance videos through Faster-R-CNN and are numbered sequentially. Second, Matching-Siamese network is designed by modifying the structure of the traditional Siamese network to calculate the similarity of two input images. Third, using the image similarity determines whether the probe image of the target pedestrian and each pedestrian images are of the same identity or not. Finally, we track the target pedestrian in all videos by using the identity of probe image and pedestrian images. The results in this paper show that the proposed method outperforms most popular algorithms in terms of accuracy, overlap rate and computational efficiency, especially in the circumstances of object disappearing and reappearing. In addition, our method could use a latest probe pedestrian image to accomplish its tracking in videos ranging from randomly selected time and regions well.

An improvement on an MCMC-based video tracking algorithm

This paper presents an approach to fully automatic people tracking in surveillance video recorded by stable camera. We propose an improvement on Benfold et al. tracking-by-detection algorithm [1]. We extend the basic algorithm through filtering of person detector results and the scene entrance/exit positions construction. Moreover, the paper presents a modified method for tracklet position estimation. We compare several tracklet construction algorithms such as "Flock of Features" and normalized cross correlation. Our experiments reveal that all the proposed modifications improve both robustness and precision of tracks compared to the basic algorithm.

Online Pedestrian Tracking with Kalman Filter and Random Ferns

Object tracking is one of the most important components in numerous applications of computer vision. Much progress has been made in recent years. The Tracking-Learning-Detection (TLD) algorithm achieves excellent performance on a set of challenging video sequences. However, classical TLD algorithm fails to track non-rigid pedestrian as complicated appearance, varying viewpoints, shape changes and occlusions. In this paper, we follow the TLD and propose a robust KMD framework which consists of the Kalman filter tracker, random ferns pedestrian detector and the pedestrian model. During the tracking process the tracker and detector are complementary: the Kalman filter tracker predicts the motion, the pedestrian detector searches the best-match appearance and the pedestrian model combines performance of both to determine final result and generate new samples for learning. Experimental results show our framework comparatively improves performance for pedestrian tracking in surveillance videos.

Object tracking in surveillance videos using compressed domain features from scalable bit-streams

Recent developments in the video coding technology brought new possibilities of utilising inherently embedded features of the encoded bit-stream in applications such as video adaptation and analysis. Due to the proliferation of surveillance videos there is a strong demand for highly efficient and reliable algorithms for object tracking. This paper presents a new approach for the fast compressed domain analysis utilising motion data from the encoded bit-streams in order to achieve low-processing complexity of object tracking in the surveillance videos. The algorithm estimates the trajectory of video objects by using compressed domain motion vectors extracted directly from standard H.264/MPEG-4 Advanced Video Coding (AVC) and Scalable Video Coding (SVC) bit-streams. The experimental results show comparable tracking precision when evaluated against the standard algorithms in uncompressed domain, while maintaining low computational complexity and fast processing time, thus making the algorithm suitable for real time and streaming applications where good estimates of object trajectories have to be computed fast.