Real-time Object Tracking Research Articles

Enhancement of Real-Time Object Detection and Tracking in Collaborative Environment using AI and Mixed Reality

The area of mixed reality has had rapid growth in recent years, with a notable rise in funding. This may be attributed to the rising recognition of the potential advantages associated with the integration of virtual information into the physical environment. The majority of contemporary mixed reality apps that rely on markers use algorithms for local feature identification and tracking. This study aims to enhance the accuracy of object recognition in complicated environment and enable real-time classification operations via the introduction of a unique detection approach known as the lightweight and efficient YOLOv4 model. In the present setting, Computational vision emerges as a very valuable and engaging manifestation of artificial intelligence (AI) that finds widespread application in many aspects of daily existence. The field of computer vision is dedicated to the development of advanced artificial intelligence and computer systems that aim to replace complex elements of the human environment. In recent times, deep neural networks have emerged as a crucial component in several sectors owing to their well-established capacity to process visual input. This study presents a methodology for classifying and identifying objects using the YOLOv4 object detection algorithm. Convolutional neural networks (CNNs) have shown exceptional efficacy in the tasks of object tracking and feature extraction from pictures. Therefore, the enhanced network architecture optimizes both the precision of identification and the speed at which it operates. This research will contribute to developing mixed-reality simulations system for object detection and tracking in collaborative environment that are accessible to everyone, including users in the architectural filed. The model was evaluated in comparison to other object detection approaches. Based on the empirical results, it was observed that the YOLOv4 model exhibited a mean average precision (mAP) of 0.988, surpassing the performance of both YOLOv3 and other object identification models.

Real-Time Tracking of Objects in Video Based on Adaptive Histogram Features

Real-Time Tracking of Objects in Video Based on Adaptive Histogram Features

A Lightweight Model for Real-Time Monitoring of Ships

Real-time monitoring of ships is crucial for inland navigation management. Under complex conditions, it is difficult to balance accuracy, real-time performance, and practicality in ship detection and tracking. We propose a lightweight model, YOLOv8-FAS, to address this issue for real-time ship detection and tracking. First, FasterNet and the attention mechanism are integrated and introduced to achieve feature extraction simply and efficiently. Second, the lightweight GSConv convolution method and a one-shot aggregation module are introduced to construct an efficient network neck to enhance feature extraction and fusion. Furthermore, the loss function is improved based on ship characteristics to make the model more suitable for ship datasets. Finally, the advanced Bytetrack tracke is added to achieve the real-time detection and tracking of ship targets. Compared to the YOLOv8 model, YOLOv8-FAS reduces computational complexity by 0.8×109 terms of FLOPs and reduces model parameters by 20%, resulting in only 2.4×106 parameters. The mAP-0.5 is improved by 0.9%, reaching 98.50%, and the real-time object tracking precision of the model surpasses 88%. The YOLOv8-FAS model combines light weight with high precision, and can accurately perform ship detection and tracking tasks in real time. Moreover, it is suitable for deployment on hardware resource-limited devices such as unmanned surface ships.

Deep features fusion for KCF-based moving object tracking

Real-time object tracking and occlusion handling are critical research areas in computer vision and machine learning. Developing an efficient and accurate object-tracking method that can operate in real-time while handling occlusion is essential for various applications, including surveillance, autonomous driving, and robotics. However, relying solely on a single hand-crafted feature results in less robust tracking. As a hand-crafted feature extraction technique, HOG effectively detects edges and contours, which is essential in localizing objects in images. However, it does not capture fine details in object appearance and is sensitive to changes in lighting conditions. On the other hand, the grayscale feature has computational efficiency and robustness to changes in lighting conditions. The deep feature can extract features that express the image in more detail and discriminate between different objects. By fusing different features, the tracking method can overcome the limitations of individual features and capture a complete representation of the object. The deep features can be generated with transfer learning networks. However, selecting the right network is difficult, even in real-time applications. This study integrated the deep feature architecture and hand-crafted features HOG and grayscale in the KCF method to solve this problem. The object images were obtained through at least three convolution blocks of transfer learning architecture, such as Xception, DenseNet, VGG16, and MobileNet. Once the deep feature was extracted, the HOG and grayscale features were computed and combined into a single stack. In the KCF method, the stacked features acquired the actual object location by conveying a maximum response. The result shows that this proposed method, especially in the combination of Xception, grayscale, and HOG features, can be implemented in real-time applications with a small center location error.

Deep Neural Network-Based Dynamical Object Recognition and Robust Multiobject Tracking Technique for Onboard Unmanned Aerial Vehicle’s Computer Vision-Based Systems

Computer vision-based systems seem highly perspective for semantic analysis of the dynamical objects. However, considering dynamical object recognition and tracking from the unmanned aerial vehicle the task to design a robust model for data association is highly challenging due to additional issues, e.g., image degradation, non-fixed object camera distance and shooting focus, and real-time issues. Thus, we propose an accurate deep neural network-based dynamical object recognition and robust multi-object tracking technique based on bidirectional LSTM with the optimized motion and appearance gates as a multi-object tracking backbone, supported by an advanced single-shot detector network improved with residual prediction model and implemented DenseNet network as well as YOLOv4eff network as feature extraction. The technique has been trained on VisDrone 2022 and UAVDT datasets with the side-shoot dynamical objects at a height of up to 50 meters. The performance analysis on the test stage performed on 7 metrics demonstrate that the proposed technique surpasses by accuracy and robustness ability of other state-of-the-art techniques based on 2 cumulative MOTA and MOTP, as well as MT and IDsw. In particular, we have dramatically decreased the number of IDsw which implies a better capability to handle several occlusions, which is a desirable property in real-time multiple object tracking. We have pointed out the sensitivity of the tracking performance of our technique on the number of utilizing different sequence lengths and have defined an optimum. Finally, the applicability and reliability of the proposed technique for onboard UAV computer-based systems have been discussed.

A Deep Learning-Enhanced Multi-Modal Sensing Platform for Robust Human Object Detection and Tracking in Challenging Environments

In modern security situations, tracking multiple human objects in real-time within challenging urban environments is a critical capability for enhancing situational awareness, minimizing response time, and increasing overall operational effectiveness. Tracking multiple entities enables informed decision-making, risk mitigation, and the safeguarding of civil-military operations to ensure safety and mission success. This paper presents a multi-modal electro-optical/infrared (EO/IR) and radio frequency (RF) fused sensing (MEIRFS) platform for real-time human object detection, recognition, classification, and tracking in challenging environments. By utilizing different sensors in a complementary manner, the robustness of the sensing system is enhanced, enabling reliable detection and recognition results across various situations. Specifically designed radar tags and thermal tags can be used to discriminate between friendly and non-friendly objects. The system incorporates deep learning-based image fusion and human object recognition and tracking (HORT) algorithms to ensure accurate situation assessment. After integrating into an all-terrain robot, multiple ground tests were conducted to verify the consistency of the HORT in various environments. The MEIRFS sensor system has been designed to meet the Size, Weight, Power, and Cost (SWaP-C) requirements for installation on autonomous ground and aerial vehicles.

Multi-sensor fusion for real-time object tracking

Multi-sensor fusion for real-time object tracking

Real-time Tracking of Handheld Object from Color or Depth Images.

Object tracking during rehabilitation could help a therapist to evaluate a patient's movement and progress. Hence, we present an image-based method for real-time tracking of handheld objects due to its ease of use and availability of color or depth cameras. We use an efficient projective point correspondence method and generalize the use of precomputed spare viewpoint information to allow real-time tracking of a rigid object. The method runs at more than 30 fps on a CPU while achieving submillimeter accuracy on synthetic datasets and robust tracking on a semi-synthetic dataset.Clinical relevance Real-time, accurate, and robust tracking of an object using an image-based method is a promising tool for rehabilitation applications as it is practical for clinical settings.

An Improved Real-Time Object Tracking Algorithm Based on Deep Learning Features

An Improved Real-Time Object Tracking Algorithm Based on Deep Learning Features

Improved Real Time Target Tracking System Based on Cam-shift and Kalman Filtering Techniques

This paper presents an improved real time target tracking system based on Cam-Shift and advanced Kalman filter algorithms. The paper, proposes a simple low implementation cost scheme while keeping the high tracking performance. Two degrees of freedom target tracking system based on two hybrid stepper motors with their drive systems is fully designed and implemented to improve the tracking accuracy while keeping low-cost. The potential of the proposed algorithm lies in its ability to accurately detect, track and produce firing commands on the designated target while utilizing low cost on the shelf embedded Microcontroller boards. A low cost Universal Serial Port (USB) camera is used and integrated with the proposed algorithm in order to detect and track maneuvering targets. A series of experiments for stationary and moving objects are carried out for testing the proposed system efficiency. The proposed system enables accurate performance for tracking static and moving objects. Hence it provides a simple and low implementation cost scheme for real time object tracking applications.

Correction to: Real-time object tracking in the wild with Siamese network

Correction to: Real-time object tracking in the wild with Siamese network

Improving the Efficiency of 3D Monocular Object Detection and Tracking for Road and Railway Smart Mobility

Three-dimensional (3D) real-time object detection and tracking is an important task in the case of autonomous vehicles and road and railway smart mobility, in order to allow them to analyze their environment for navigation and obstacle avoidance purposes. In this paper, we improve the efficiency of 3D monocular object detection by using dataset combination and knowledge distillation, and by creating a lightweight model. Firstly, we combine real and synthetic datasets to increase the diversity and richness of the training data. Then, we use knowledge distillation to transfer the knowledge from a large, pre-trained model to a smaller, lightweight model. Finally, we create a lightweight model by selecting the combinations of width, depth & resolution in order to reach a target complexity and computation time. Our experiments showed that using each method improves either the accuracy or the efficiency of our model with no significant drawbacks. Using all these approaches is especially useful for resource-constrained environments, such as self-driving cars and railway systems.

A Fast Hyperspectral Tracking Method via Channel Selection

With the rapid development of hyperspectral imaging technology, object tracking in hyperspectral video has become a research hotspot. Real-time object tracking for hyperspectral video is a great challenge. We propose a fast hyperspectral object tracking method via a channel selection strategy to improve the tracking speed significantly. First, we design a strategy of channel selection to select few candidate channels from many hyperspectral video channels, and then send the candidates to the subsequent background-aware correlation filter (BACF) tracking framework. In addition, we consider the importance of local and global spectral information in feature extraction, and further improve the BACF tracker to ensure high tracking accuracy. In the experiments carried out in this study, the proposed method was verified and the best performance was achieved on the publicly available hyperspectral dataset of the WHISPERS Hyperspectral Objecting Tracking Challenge. Our method was superior to state-of-the-art RGB-based and hyperspectral trackers, in terms of both the area under the curve (AUC) and DP@20pixels. The tracking speed of our method reached 21.9 FPS, which is much faster than that of the current most advanced hyperspectral trackers.

Real-Time Objects Detection, Tracking, and Counting Using Image Processing Techniques

As a result of the tremendous development taking place in modern systems and technologies in the field of electronic monitoring. Intelligent monitoring, decision making, and automated response systems have become common subjects at this time, especially after the development of machines responsible for these processes. Traffic surveillance is a trend goal nowadays using different techniques and equipment. In this article, real-time Object detection and tracking techniques were proposed for traffic surveillance using image processing techniques. A state was specifically examined for its ability to detect and count passing motorcycles on a highway in a specific area. The results showed good reliability, with a frame processing time of approximately about (30 ms) and the achievement of real-time performance. The main contribution of this article is reaching the best result implemented by the performance the real-time process using image process technique and tracking the object by depending on the sequencing of frames and can stands with rationally not so powerful machines. Several tools have been used for different types of necessary tasks that will be part of the required application such as Python 3.7; which was used to build the basic algorithms,Visual studio code (VSC) as an Integrated Development Environment (IDE), and Anaconda navigator for downloading many useful libraries. The specifications of the used device were Intel(R) Core (TM) i7- 10750H CPU @ 2.60GHz 2.59 GHz, RAM 16.0 GB, NVIDIA GeForce GTX 1650 GPU, 64-bit operating system, x64-based processor.

Real-time object tracking in the wild with Siamese network

Real-time object tracking in the wild with Siamese network

Object Sub-Categorization and Common Framework<br /> Method using Iterative AdaBoost for Rapid Detection of Multiple Objects

Object detection and tracking in real time has numerous applications and benefits in various fields like survey, crime detection etc. The idea of gaining useful information from real time scenes on the roads is called as Traffic Scene Perception (TSP). TSP actually consists of three subtasks namely, detecting things of interest, recognizing the discovered objects and tracking of the moving objects. Normally the results obtained could be of value in object recognition and tracking, however the detection of a particular object of interest is of higher value in any real time scenario. The prevalent systems focus on developing unique detectors for each of the above-mentioned subtasks and they work upon utilizing different features. This obviously is time consuming and involves multiple redundant operations. Hence in this paper a common framework using the enhanced AdaBoost algorithm is proposed which will examine all dense characteristics only once thereby increasing the detection speed substantially. An object sub-categorization strategy is proposed to capture the intra-class variance of objects in order to boost generalisation performance even more. We use three detection applications to demonstrate the efficiency of the proposed framework: traffic sign detection, car detection, and bike detection. On numerous benchmark data sets, the proposed framework delivers competitive performance using state-of-the-art techniques.

Real-Time 3D Single Object Tracking With Transformer

LiDAR-based 3D single object tracking is a challenging issue in robotics and autonomous driving. Currently, existing approaches usually suffer from the problem that objects at long distance often have very sparse or partially-occluded point clouds, which makes the features extracted by the model ambiguous. Ambiguous features will make it hard to locate the target object and finally lead to bad tracking results. To solve this problem, we utilize the powerful Transformer architecture and propose a Point-Track-Transformer (PTT) module for point cloud-based 3D single object tracking task. Specifically, PTT module generates fine-tuned attention features by computing attention weights, which guides the tracker focusing on the important features of the target and improves the tracking ability in complex scenarios. To evaluate our PTT module, we embed PTT into the dominant method and construct a novel 3D SOT tracker named PTTNet. In PTT-Net, we embed PTT into the voting stage and proposal generation stage, respectively. PTT module in the voting stage could model the interactions among point patches, which learns context-dependent features. Meanwhile, PTT module in the proposal generation stage could capture the contextual information between object and background. We evaluate our PTT-Net on KITTI and NuScenes datasets. Experimental results demonstrate the effectiveness of PTT module and the superiority of PTT-Net, which surpasses the baseline by a noticeable margin, ~10% in the Car category. Meanwhile, our method also has a significant performance improvement in sparse scenarios. In general, the combination of transformer and tracking pipeline enables our PTT-Net to achieve state-of-the-art performance on both two datasets. Additionally, PTT-Net could run in real-time at 40FPS on NVIDIA 1080Ti GPU. Our code is open-sourced for the research community at https://github.com/shanjiayao/PTT.

Revisiting the Spaceborne Illuminators of Opportunity for Airborne Object Tracking

This article reviews existing research for cooperative passive coherent location and tracking employing spaceborne opportunistic illuminators, highlighting the need for novel cooperative real-time object detection and tracking approaches and discussing the lack of multistatic experimental data for future research.

A novel approach of surveillance video indexing and retrieval using object detection and tracking

The problem of searching videos in large databases i.e. multimedia applications is a major challenge. Therefore, video indexing is used to search the location of the particular video in a large database quickly. Quickly locating the video in the large database is the good quality of indexing. Still, there is a scope of improvement in quickly searching a video in a large database in terms of assigning labels to video. In computer vision, real-time object detection and tracking is a gigantic, vibrant yet indecisive and intricate area. You only look once (YOLO) algorithm is used to detect the object and background subtraction is used to track the object. In this paper, video indexing using object detection / tracking can be performed on single object in a video. In future, video indexing can be performed on multiple objects in a video.

Visible and Infrared Object Tracking via Convolution-Transformer Network With Joint Multimodal Feature Learning

The existing Transformer-based RGBT tracker mainly focus on the enhancement of features extracted by Convolutional Neural Network (CNN). The potential of Transformer in representation learning remains under-explored. In this paper, we propose a Convolution-Transformer network with joint multimodal feature learning, in which both representation learning and feature fusion leverage Transformer. Specifically, we use the multi-branch Convolution-Transformer feature extraction network to process the extraction task of local modality-independent features and global modality-shared features respectively. Several simplified Transformer encoder layers form the Transformer backbone network, which is more suitable for the real-time object tracking. Besides, we found that inter-modality correlation is an important factor for modality interactions and mutual exploitation. Therefore, we propose a Joint Multimodal Feature Learning (JMFL) module, which uses cross-attention to capture the dependencies of cross-modal and enhance multimodal fusion by bidirectional guidance of multimodal information. The proposed method is fully experimented on two large benchmark datasets and compared with some current well-performing methods. The experimental results show that the proposed method performs well in terms of tracking accuracy and speed.