Video Vehicle Detection Research Articles

CFDRM: Coarse-to-Fine Dynamic Refinement Model for Weakly Supervised Moving Vehicle Detection in Satellite Videos

CFDRM: Coarse-to-Fine Dynamic Refinement Model for Weakly Supervised Moving Vehicle Detection in Satellite Videos

Real-Time Moving Vehicle Detection in Satellite Video Based on Historical Differential Information and Grouping Features

Real-Time Moving Vehicle Detection in Satellite Video Based on Historical Differential Information and Grouping Features

Scene Prior Constrained Self-Paced Learning for Unsupervised Satellite Video Vehicle Detection

Scene Prior Constrained Self-Paced Learning for Unsupervised Satellite Video Vehicle Detection

VEHICLE DETECTION AND CLASSIFICATION USING FORWARD SCATTER RADAR (FSR) FOR TRAFFIC MANAGEMENT USING CONVOLUTIONAL NEURAL NETWORK

The importance of automatic vehicle detection and classification has grown significantly in recent years, as it has become a crucial component of traffic management and monitoring systems. To overcome the limitations of traditional video vehicle detection, this paper proposes the use of forward scatter radar (FSR) technology. The FSR system is tested for the classification of four different vehicle types, each with distinct sizes. To improve the classification accuracy of the FSR system, the paper utilizes a well-established neural network known as a convolutional neural network (CNN). Two time-frequency analyses, continuous wavelet transform (CWT) and short-time Fourier transform (STFT), are used to evaluate the classification performance of the FSR system. The study demonstrates that the CNN classifier significantly improves the classification accuracy of the FSR system in vehicle detection and classification. This finding is supported by the evaluation of the time-frequency analyses, CWT and STFT. Overall, the proposed approach has the potential to enhance traffic management and monitoring systems, thereby improving road safety and traffic efficiency.

Cascaded Vehicle Matching and Short-Term Spatial-Temporal Network for Smoky Vehicle Detection

Vehicle exhaust is the main source of air pollution with the rapid increase of fuel vehicles. Automatic smoky vehicle detection in videos is a superior solution to traditional expensive remote sensing with ultraviolet-infrared light devices for environmental protection agencies. However, it is challenging to distinguish vehicle smoke from shadow and wet regions in cluttered roads, and could be worse due to limited annotated data. In this paper, we first introduce a real-world large-scale smoky vehicle dataset with 75,000 annotated smoky vehicle images, facilitating the effective training of advanced deep learning models. To enable a fair algorithm comparison, we also built a smoky vehicle video dataset including 163 long videos with segment-level annotations. Second, we present a novel efficient cascaded framework for smoky vehicle detection which largely integrates prior knowledge and advanced deep networks. Specifically, it starts from an improved frame-based smoke detector with a high recall rate, and then applies a vehicle matching strategy to fast eliminate non-vehicle smoke proposals, and finally refines the detection with an elaborately-designed short-term spatial-temporal network in consecutive frames. Extensive experiments in four metrics demonstrated that our framework is significantly superior to hand-crafted feature based methods and recent advanced methods.

Exploration of Vehicle Target Detection Method Based on Lightweight YOLOv5 Fusion Background Modeling

Due to the explosive increase per capita in vehicle ownership in China brought about by the continuous development of the economy and society, many negative impacts have arisen, making it necessary to establish the smart city system that has rapidly developing vehicle detection technology as its data acquisition system. This paper proposes a lightweight detection model based on an improved version of YOLOv5 to address the problem of missed and false detections caused by occlusion during rush hour vehicle detection in surveillance videos. The proposed model replaces the BottleneckCSP structure with the Ghostnet structure and prunes the network model to speed up inference. Additionally, the Coordinate Attention Mechanism is introduced to enhance the network’s feature extraction and improve its detection and recognition ability. Distance-IoU Non-Maximum Suppression replaces Non-Maximum Suppression to address the issue of false detection and omission when detecting congested targets. Lastly, the combination of the five-frame differential method with VIBE and MD-SILBP operators is used to enhance the model’s feature extraction capabilities for vehicle contours. The experimental results show that the proposed model outperforms the original model in terms of the number of parameters, inference ability, and accuracy when applied to both the expanded UA-DETRAC and a self-built dataset. Thus, this method has significant industrial value in intelligent traffic systems and can effectively improve vehicle detection indicators in traffic monitoring scenarios.

Incorporating Deep Background Prior Into Model-Based Method for Unsupervised Moving Vehicle Detection in Satellite Videos

Background reconstruction is a key step of moving object detection in satellite videos. Most existing model-based methods exploit low-rank prior to recover background, which have achieved good performance but suffered degradation under complex and dynamic scenes. In this paper, we introduce a deep background prior into model-based methods for moving vehicle detection in satellite videos. Our deep background prior is obtained by a background reconstruction network, which can learn to reconstruct background from consecutive frames. By applying our deep background prior into model-based methods, a closed-form solution can be obtained via alternating direction method of multipliers (ADMM) and then detection results can be acquired through iterative optimization. More importantly, our background reconstruction network can be trained in an unsupervised way by introducing specifically designed loss, thus relieving the dependence on large-scale labeled dataset. Extensive experimental results demonstrate the efficiency and effectiveness of the proposed method.

Dynamic Vehicle Detection in Satellite Video With Multiframe Brightness Gradient

Dynamic Vehicle Detection in Satellite Video With Multiframe Brightness Gradient

Vehicle detection in surveillance videos based on YOLOv5 lightweight network

Vehicle detection in surveillance videos based on YOLOv5 lightweight network

Automated Vehicle to Vehicle Conflict Analysis at Signalized Intersections by Camera and LiDAR Sensor Fusion

This research presents a robust approach for automated safety diagnosis using sensor fusion techniques. This work fuses the outputs of a roadside low-resolution camera and a solid-state LiDAR. For vehicle classification and detection in videos, the YOLO-v5 object detection model was utilized. The raw 3D point clouds generated by the LiDAR are processed by two manual steps—ground plane transformation and background segmentation, and two real-time steps—foreground clustering and bounding box fitting. Taking the generated 2D bounding boxes of both camera and LiDAR, we associate the common bounding box pairs by thresholding on the Euclidean distance threshold of 6 ft between the centroid pairs. We perform weighted measurement updates based on the root mean square error of each of the sensor’s detection compared with manually labeled ground truths. The fused measurements are tracked by using linear constant velocity Kalman filter. With the generated trajectories, we compute post encroachment time at pixel-level conflicts based on the generated vehicle trajectories. We have proposed a complete bipartite graph-matching strategy of vehicle parts along with the conflict angle to obtain conflict types—rear-end, sideswipe, head-on, and angle conflict. A case study on a signalized intersection is presented. The output of the proposed framework performs with 97.384% precision and 95.316% recall. It is better than both single-sensor-based systems in relation to detection count and localization. It is expected that the proposed method can be employed to diagnose road safety problems and inform the required countermeasures.

A Robust Framework for Object Detection in a Traffic Surveillance System

Object recognition is the technique of specifying the location of various objects in images or videos. There exist numerous algorithms for the recognition of objects such as R-CNN, Fast R-CNN, Faster R-CNN, HOG, R-FCN, SSD, SSP-net, SVM, CNN, YOLO, etc., based on the techniques of machine learning and deep learning. Although these models have been employed for various types of object detection applications, however, tiny object detection faces the challenge of low precision. It is essential to develop a lightweight and robust model for object detection that can detect tiny objects with high precision. In this study, we suggest an enhanced YOLOv2 (You Only Look Once version 2) algorithm for object detection, i.e., vehicle detection and recognition in surveillance videos. We modified the base network of the YOLOv2 by reducing the number of parameters and replacing it with DenseNet. We employed the DenseNet-201 technique for feature extraction in our improved model that extracts the most representative features from the images. Moreover, our proposed model is more compact due to the dense architecture of the base network. We utilized DenseNet-201 as a base network due to the direct connection among all layers, which helps to extract a valuable information from the very first layer and pass it to the final layer. The dataset gathered from the Kaggle and KITTI was used for the training of the proposed model, and we cross-validated the performance using MS COCO and Pascal VOC datasets. To assess the efficacy of the proposed model, we utilized extensive experimentation, which demonstrates that our algorithm beats existing vehicle detection approaches, with an average precision of 97.51%.

Very Low-Resolution Moving Vehicle Detection in Satellite Videos

This paper proposes a practical end-to-end neural network framework to detect tiny moving vehicles in satellite videos with low imaging quality. Some instability factors such as illumination changes, motion blurs, and low contrast to the cluttered background make it difficult to distinguish true objects from noise and other point-shaped distractors. Moving vehicle detection in satellite videos can be carried out based on background subtraction or frame differencing. However, these methods are prone to produce lots of false alarms and miss many positive targets. Appearance-based detection can be an alternative but is not well-suited since classifier models are of weak discriminative power for the vehicles in top view at such low resolution. This article addresses these issues by integrating motion information from adjacent frames to facilitate the extraction of semantic features and incorporating the Transformer to refine the features for key points estimation and scale prediction. Our proposed model can well identify the actual moving targets and suppress interference from stationary targets or background. The experiments and evaluations using satellite videos show that the proposed approach can accurately locate the targets under weak feature attributes and improve the detection performance in complex scenarios.

Cross-frame keypoint-based and spatial motion information-guided networks for moving vehicle detection and tracking in satellite videos

Deep learning methods have achieved the state-of-the-art performance of object detection and tracking in natural images, such as keypoint-based detectors and appearance/motion-based trackers. However, for small and blurry moving vehicles in satellite videos, keypoint-based detectors cause the missed detection of keypoints and incorrect keypoint matching. In terms of multi-object tracking, it is difficult to track the crowded similar vehicles stably only by using the appearance or motion information. To address these problems, a novel deep learning framework is proposed for moving vehicle detection and tracking in the satellite videos. It is comprised of the cross-frame keypoint-based detection network (CKDNet) and spatial motion information-guided tracking network (SMTNet). In CKDNet, a customized cross-frame module is designed to assist the detection of keypoints by exploiting complementary information between frames. Furthermore, CKDNet improves keypoint matching by incorporating size prediction around the keypoints and defining the soft mismatch suppression for out-of-size keypoint pairs. Based on high-quality detection, SMTNet can track the densely-packed vehicles effectively by constructing two-branch long short-term memories. It extracts not only spatial information of the same frame by considering the relative spatial relationship of neighboring vehicles, but also motion information among consecutive frames by calculating the movement velocity. Especially, it regresses virtual positions for missed or occluded vehicles and keeps on tracking these vehicles while they reappear. Experimental results on Jilin-1 and SkySat satellite videos demonstrate the effectiveness of the proposed detection and tracking methods.

A fast and effective video vehicle detection method leveraging feature fusion and proposal temporal link

A fast and effective video vehicle detection method leveraging feature fusion and proposal temporal link

Tiny moving vehicle detection in satellite video with constraints of multiple prior information

ABSTRACT Ｗith the rapid development of remote sensing, satellite video has become an important data source for vehicle detection, which provides a broader field of surveillance. The achieved work generally focuses on aerial video with moderately sized objects based on feature extraction. However, the moving vehicles in satellite video imagery range from just a few pixels to dozens of pixels and exhibit low contrast with respect to the background, which makes it hard to get available appearance or shape information this paper, a tiny vehicle detection method based on spatio-temporal information is proposed to constrain the significance of the image. Firstly, the background modelling method is used to obtain the motion heat map of the image and constrain the motion region. A significance detection method for small targets was used to obtain the significance mapping of these regions. Finally, the detection results were optimized by combining the significance neighbourhood information and the time information between frames to output the binary target detection map. Finally, taking different urban road scenes in ‘Jilin-1’satellite video as examples and compares a variety of existing algorithms. Experiments prove that the proposed algorithm can maintain false alarm rate of less than 10% when the detection accuracy and recall rate reach 85% and has certain anti-interference ability in the image environment with satellite Angle deviation.

A Novel AMS-DAT Algorithm for Moving Vehicle Detection in a Satellite Video

Satellite videos have recently served as a new data source for a wide range of applications in traffic management and military surveillance. Due to its wider coverage, satellite videos show more advantages in large-scale monitoring than ground surveillance videos. However, pseudomotion background and low-resolution targets pose new challenges to moving vehicle detection in satellite videos, resulting in poor performance of conventional target detection methods when applied to satellite videos. To overcome this difficulty, we propose a novel moving vehicle detection approach using adaptive motion separation and difference accumulated trajectory. Specifically, a new indicator is designed to assist adaptive separation of moving targets and background, considering the scale invariance of vehicles in satellite videos. Meanwhile, we offer a vehicle discrimination algorithm based on a differential accumulated trajectory to distinguish the moving vehicles from the pseudomotion background. Experimental results on two satellite video data sets demonstrate that the proposed approach achieves better detection performance over the state-of-the-art moving vehicle detection methods.

Automatic Vehicles Detection, Classification and Counting Techniques / Survey

Vehicle detection (VD) plays a very essential role in Intelligent Transportation Systems (ITS) that have been intensively studied within the past years. The need for intelligent facilities expanded because the total number of vehicles is increasing rapidly in urban zones. Traffic monitoring is an important element in the intelligent transportation system, which involves the detection, classification, tracking, and counting of vehicles. One of the key advantages of traffic video detection is that it provides traffic supervisors with the means to decrease congestion and improve highway planning. Vehicle detection in videos combines image processing in real-time with computerized pattern recognition in flexible stages. The real-time processing is very critical to keep the appropriate functionality of automated or continuously working systems. VD in road traffics has numerous applications in the transportation engineering field. In this review, different automated VD systems have been surveyed, with a focus on systems where the rectilinear stationary camera is positioned above intersections in the road rather than being mounted on the vehicle. Generally, three steps are utilized to acquire traffic condition information, including background subtraction (BS), vehicle detection and vehicle counting. First, we illustrate the concept of vehicle detection and discuss background subtraction for acquiring only moving objects. Then a variety of algorithms and techniques developed to detect vehicles are discussed beside illustrating their advantages and limitations. Finally, some limitations shared between the systems are demonstrated, such as the definition of ROI, focusing on only one aspect of detection, and the variation of accuracy with quality of videos. At the point when one can detect and classify vehicles, then it is probable to more improve the flow of the traffic and even give enormous information that can be valuable for many applications in the future.

Efficient vehicle detection and tracking strategy in aerial videos by employing morphological operations and feature points motion analysis

Real-time automatic detection and tracking of moving vehicles in videos acquired by airborne cameras is a challenging problem due to vehicle occlusion, camera movement, and high computational cost. This paper presents an efficient and robust real-time approach for automatic vehicle detection and tracking in aerial videos that employ both detections and tracking features to enhance the final decision. The use of Top-hat and Bottom-hat transformation aided by the morphological operation in the detection phase has been adopted. After detection, background regions are eliminated by motion feature points’ analysis of the obtained object regions using a combined technique between KLT tracker and K-means clustering. Obtained object features are clustered into separate objects based on their motion characteristic. Finally, an efficient connecting algorithm is introduced to assign the vehicle labels with their corresponding cluster trajectories. The proposed method was tested on videos taken in different scenarios. The experimental results showed that the recall, precision, and tracking accuracy of the proposed method were about 95.1 %, 97.5%, and 95.2%, respectively. The method also achieves a fast processing speed. Thus, the proposed approach has superior overall performance compared to newly published approaches.

A three-stage framework for smoky vehicle detection in traffic surveillance videos

The smoky vehicle exhaust pollutes the air and endangers human health. Existing methods detecting smoky vehicles in traffic surveillance videos are with high false alarm rates due to the diversity of smoke characteristics and continuous interferences of common vehicles. To solve this issue, this paper presents a three-stage framework for smoky vehicle detection. In the first stage, a Robust Pixel Based Adaptive Segmenter (R-PBAS) algorithm, which adapts to cameras shaking, is proposed to extract moving objects. The Cumulative Color Histogram (CCH) is adopted to extract smoke-colored blocks from moving objects. In the second stage, three groups of features, including Non-Redundant Robust Local Binary Pattern (NR-RLBP), Weighted Co-occurrence Histograms of Oriented Gradients (W-CoHOG), and Motion Boundary Histograms (MBH) are proposed to extract texture, gradient, and motion information from smoke-colored blocks, respectively. In the third stage, we fuse smoke blocks to obtain Region of Interest (ROI) and extract frequency domain features based on Discrete Wavelet Transform (DWT). To further improve robustness, the Auto-Regressive and Moving Average (ARMA) Model and Hidden Markov Model (HMM) are adopted to model ROIs in consecutive frames. Extensive experiments show that our method performs better than existing methods.

Spatio-Temporal Processing for Automatic Vehicle Detection in Wide-Area Aerial Video

Vehicle detection in aerial videos often requires post-processing to eliminate false detections. This paper presents a spatio-temporal processing scheme to improve automatic vehicle detection performance by replacing the thresholding step of existing detection algorithms with multi-neighborhood hysteresis thresholding for foreground pixel classification. The proposed scheme also performs spatial post-processing, which includes morphological opening and closing to shape and prune the detected objects, and temporal post-processing to further reduce false detections. We evaluate the performance of the proposed spatial processing on two local aerial video datasets and one parking vehicle dataset, and the performance of the proposed spatio-temporal processing scheme on five local aerial video datasets and one public dataset. Experimental evaluation shows that the proposed schemes improve vehicle detection performance for each of the nine algorithms when evaluated on seven datasets. Overall, the use of the proposed spatio-temporal processing scheme improves average F-score to above 0.8 and achieves an average reduction of 83.8% in false positives.