Object Detection Method Research Articles

Enhanced object detection in videos using bio vision

Video surveillance systems enhance security and monitor various environments. They act as a deterrent to potential threats and provide vital surveillance to maintain safety. A key component of these systems is object detection, which identifies objects of interest and generates critical data for tracking and analysis. However, detecting objects in low-light conditions is particularly challenging due to reduced visibility, low contrast, and shadows, which can obscure objects or cause them to blend into the background. To address these challenges, this research introduces an enhanced object detection model that combines bio-inspired vision techniques with traditional object detection methods. The YOLO model is augmented with bio-vision principles, and specialized CNN models are developed to improve detection accuracy, particularly in low-light scenarios.

A Review of Deep Learning Based Object Detection Algorithms

With the rapid development of artificial intelligence technology, the traditional manual feature-based object detection method has been gradually replaced by deep learning-based object detection technology. Object detection is the basis and prerequisite for many computer vision tasks aimed at recognizing targets in an image and determining their class and location. The purpose of object detection algorithm research based on deep learning is to improve the detection accuracy and detection speed of the detection algorithm, so that the object detection algorithm can be more safe and convenient applied to People's Daily production and life. This article reviews the evolution of object detection algorithms, focusing on two-stage, one-stage and object detection algorithms based on the transformer architecture. In addition, the performance, advantages and disadvantages of different algorithms are compared, and the development trend of object detection algorithms based on deep learning is summarized in the end.

Research on Impact Prediction Model for Corn Ears by Integrating Motion Features Using Machine Learning Algorithms

The mechanical damage of corn kernels during harvest leads to mildew in the kernel storage process, seriously affecting food safety and quality. Impact force is the primary source of mechanical damage in the corn threshing process, and its accurate detection is of great significance for corn threshing with low damage. A method for the impact force detection of corn ears was proposed in this manuscript. The momentum theorem determined the main factors influencing impact force (weight, falling height, and space attitude). Corn ear weight, falling height, and space attitude were used as experimental factors. The bench test was carried out with the impact force of corn ear as the output variable. During the experiment, piezoelectric sensors were used to collect the impact force of corn ears under different motion states. Then, the impact force detection model was constructed using four machine learning algorithms: multiple linear regression, ridge regression, random forest, and support vector regression. The results showed that the RF algorithm was more suitable for constructing the prediction model of average and maximum impact force when corn ears fall, SD, RMSE, and r were, respectively: 0.9526, 1.2685, 0.9855; 3.8389, 3.6071, and 0.8510. Secondly, the weight characteristics had the most significant influence on the impact force detection of the ear. Therefore, this method can be used as an accurate, objective, and efficient online detection method for impact force.

Bearing defect detection based on the improved YOLOv5 algorithm.

In the field of bearing defect detection, Aiming at the problem of low efficiency in manual inspection and prone to missed detections in scenarios with small target defects, and overlapping targets, an improved YOLOv5-based object detection method is proposed. Firstly, in terms of feature extraction, the C3 modules in the original backbone of YOLOv5 are replaced with the finer-grained Res2Block modules to improve the model's feature extraction ability. Secondly, in terms of feature fusion, a Bidirectional Feature Pyramid Network (BiFPN) is added to the original neck of YOLOv5 to enhance the fusion ability of shallow graphic features and deep semantic features. Finally, the performance of the improved YOLOv5 algorithm is validated through ablation experiments and comparative experiments with other defect detection algorithms, including the Small_obj algorithm the existing method of adding a small target detection head for identifying small target defects. The experimental results demonstrate that the improved YOLOv5 algorithm exhibits high mAP and accuracy in bearing defect detection, enabling more precise identification the types of small target defects on bearings in complex scenarios with multiple coexisting defects and overlapping detection targets, thereby providing valuable reference for practical bearing defect detection.

YOLO-DHGC: Small Object Detection Using Two-Stream Structure with Dense Connections

Small object detection, which is frequently applied in defect detection, medical imaging, and security surveillance, often suffers from low accuracy due to limited feature information and blurred details. This paper proposes a small object detection method named YOLO-DHGC, which employs a two-stream structure with dense connections. Firstly, a novel backbone network, DenseHRNet, is introduced. It innovatively combines a dense connection mechanism with high-resolution feature map branches, effectively enhancing feature reuse and cross-layer fusion, thereby obtaining high-level semantic information from the image. Secondly, a two-stream structure based on an edge-gated branch is designed. It uses higher-level information from the regular detection stream to eliminate irrelevant interference remaining in the early processing stages of the edge-gated stream, allowing it to focus on processing information related to shape boundaries and accurately capture the morphological features of small objects. To assess the effectiveness of the proposed YOLO-DHGC method, we conducted experiments on several public datasets and a self-constructed dataset. Exceptionally, a defect detection accuracy of 96.3% was achieved on the Market-PCB public dataset, demonstrating the effectiveness of our method in detecting small object defects for industrial applications.

MonoCAPE: Monocular 3D object detection with coordinate-aware position embeddings

3D monocular detection remains to be a focal point of research, particularly due to its capacity to deliver available precision under conditions of low cost and simplified configurations, making it especially valuable in fields like autonomous driving. Current 3D object detection methods often overlook the spatial information missing from images, which is critical to spatial perception, and optimize bounding box attributes separately, failing to meet the requirements of autonomous driving. We introduce MonoCAPE, a novel 3D detection framework addressing these issues by encoding spatial information and co-optimizing attributes through a Coordinate-Aware Position Encoding (CAPE) Generator and a Task Co-optimization Strategy (TCS). The CAPE Generator produces sparse positional embeddings, enabling spatial awareness with low computational cost, while the TCS utilizes Gaussian modeling to prevent suboptimal outputs. In this way, our framework comprehensively takes into account what existing approaches ignore. Extensive experiments on the KITTI dataset demonstrate MonoCAPE significantly improves AP3D and APBEV metrics compared to existing advanced methods.

Object Detection Algorithms for Video Surveillance Applications

Abstract—Object Detection algorithms find applications in various fields, such as defense, security, and healthcare. In this paper, various Object Detection Algorithms, such as face detection, skin detection, color detection, shape detection, and target detection, are simulated and implemented using MATLAB 2017b to detect various types of objects with improved accuracy for video surveillance applications. Further, various challenges and applications of object detection methods are elaborated.

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

With the simultaneous acquisition of the infrared and optical remote sensing images of the same target becoming increasingly easy, using multi-modal data for high-performance object detection has become a research focus. In remote sensing multi-modal data, infrared images lack color information, it is hard to detect difficult targets with low contrast, and optical images are easily affected by illuminance. One of the most effective ways to solve this problem is to integrate multi-modal images for high-performance object detection. The challenge of fusion object detection lies in how to fully integrate multi-modal image features with significant modal differences and avoid introducing interference information while taking advantage of complementary advantages. To solve these problems, a new multi-modal fusion object detection method is proposed. In this paper, the method is improved in terms of two aspects: firstly, a new dual-branch asymmetric attention backbone network (DAAB) is designed, which uses a semantic information supplement module (SISM) and a detail information supplement module (DISM) to supplement and enhance infrared and RGB image information, respectively. Secondly, we propose a feature fusion pyramid network (FFPN), which uses a Transformer-like strategy to carry out multi-modal feature fusion and suppress features that are not conducive to fusion during the fusion process. This method is a state-of-the-art process for both FLIR-aligned and DroneVehicle datasets. Experiments show that this method has strong competitiveness and generalization performance.

Modular YOLOv8 optimization for real-time UAV maritime rescue object detection.

The task of UAV-based maritime rescue object detection faces two significant challenges: accuracy and real-time performance. The YOLO series models, known for their streamlined and fast performance, offer promising solutions for this task. However, existing YOLO-based UAV maritime rescue object detection methods tend to prioritize high accuracy, often at the expense of real-time performance and ease of implementation and expansion. This study proposes a modular plug-and-play optimization approach based on the YOLOv8 framework, aiming to enhance real-time performance while maintaining high accuracy for UAV maritime rescue object detection. The proposed optimization modules are flexible, easy to implement, and extendable. In experiments on the large-scale publicly available SeaDronesSee dataset, our method achieved a 13.53% improvement in accuracy over YOLOv8x while reducing computational cost by 85.63%. Additionally, it surpassed the detection speed of the SeaDronesSee official code's two-stage detector by over 20 times, while maintaining comparable accuracy. Furthermore, our analysis of the experimental results highlights differences in detection difficulty among various objects and potential biases within the dataset.

Three-Dimensional Outdoor Object Detection in Quadrupedal Robots for Surveillance Navigations

Quadrupedal robots are confronted with the intricate challenge of navigating dynamic environments fraught with diverse and unpredictable scenarios. Effectively identifying and responding to obstacles is paramount for ensuring safe and reliable navigation. This paper introduces a pioneering method for 3D object detection, termed viewpoint feature histograms, which leverages the established paradigm of 2D detection in projection. By translating 2D bounding boxes into 3D object proposals, this approach not only enables the reuse of existing 2D detectors but also significantly increases the performance with less computation required, allowing for real-time detection. Our method is versatile, targeting both bird’s eye view objects (e.g., cars) and frontal view objects (e.g., pedestrians), accommodating various types of 2D object detectors. We showcase the efficacy of our approach through the integration of YOLO3D, utilizing LiDAR point clouds on the KITTI dataset, to achieve real-time efficiency aligned with the demands of autonomous vehicle navigation. Our model selection process, tailored to the specific needs of quadrupedal robots, emphasizes considerations such as model complexity, inference speed, and customization flexibility, achieving an accuracy of up to 99.93%. This research represents a significant advancement in enabling quadrupedal robots to navigate complex and dynamic environments with heightened precision and safety.

A Crowded Object Counting System with Self-Attention Mechanism

Traditional object counting systems use object detection methods to count objects. However, when objects are small, crowded, and dense, object detection may fail, leading to inaccuracies in counting. To address this issue, we propose a crowded object counting system based on density map estimation. While most density map estimation models employ encoder–decoder or multi-branch approaches to generate feature maps at different scales for obtaining an accurate density map, improving the accuracy of crowded object counting remains a challenge. In this paper, we propose a novel model that can generate more accurate density maps, utilizing the context-aware network as the primary structure and integrating the self-attention mechanism. There are three main contributions in this paper. Firstly, the self-attention mechanism is employed to improve the accuracy of density map estimation. Secondly, the missing vehicle labels in the TRANCOS database are relabeled, ensuring that the ground truth data are more complete than the original TRANCOS database, thus enabling the proposed novel model to have higher crowded object counting accuracy. Thirdly, the parameters of the self-attention mechanism are analyzed to obtain the optimum parameter combination. The experimental results demonstrate that the accuracy of crowded object counting can reach 85.9%, 90.0%, 83.4%, and 92.6% for the TRANCOS, relabeled TRANCOS, ShanghaiTech Part A, and Part B datasets, respectively. Furthermore, the ablation study for the context-aware network with self-attention mechanism analyzes the optimum parameter combination.

Temporal-enhanced Radar and Camera Fusion for Object Detection

Recently, object detection methods based on multimodal fusion have gained widespread adoption in autonomous driving, proving to be valuable for detecting objects in dynamic environments. Among them, millimetre wave (mmWave) radar is commonly utilized as an effective complement to cameras, as it is almost unaffected by harsh weather conditions. However, current approaches that fuse mmWave radar and camera often overlook the correlation between the two modalities, failing to fully exploit their complementary features. To address this, we propose a temporal-enhanced radar and camera fusion network to explore the correlation between these two modalities and learn a comprehensive representation for object detection. In our model, a temporal fusion model is introduced to fuse mmWave radar features from different moments, thus mitigating the problem of mmWave radar point-object mismatch due to object movement. Moreover, a new correlation-based fusion strategy using the dedicated mask cross attention is proposed to fuse mmWave radar and vision features more effectively. Finally, we design a gate feature pyramid network that selects shallow texture information based on deep semantic information to obtain more representative features. The experimental results on the nuScenes benchmark demonstrate the effectiveness of our proposed method.

Road object detection method based on improved YOLOv5 algorithm

Aiming at the existing network's poor recognition of distant targets in road traffic scenes, insufficient expression of target features, and inaccurate target positioning, a road target detection method based on the improved YOLOv5 algorithm is proposed. Firstly, the feature extraction structure of the YOLOv5 algorithm is summarized, and the shortcomings of the original network structure are analyzed; secondly, a small target detection layer is added on the basis of the original network, and the recognition ability of the network for distant targets is improved by supplementing the fusion feature layer and introducing an additional detection head; thirdly, the original detection head is decoupled, and the expression ability of the network for target features is improved by changing the bounding box regression and target classification process into two branches; then, the prior frame is re-clustered, and the height-width ratio of the prior frame is adjusted by the K-means++ algorithm to enhance the network's positioning ability for the target; finally, ablation, comparison and visualization verification experiments are carried out with AP, mAP and FPS as evaluation indicators. The results show that the detection speed of the proposed algorithm on the BDD100K dataset is 95.2 frames/second, and the average accuracy reaches 55.6%, which is higher than that of the YOLOv5 algorithm 6.7%. It can be seen that the improved YOLOv5 algorithm has good target detection accuracy while meeting the real-time requirements of detection. It is suitable for road target detection tasks in complex traffic environments and has guiding significance for improving the visual perception ability of autonomous vehicles.

Enhanced Abandoned Object Detection through Adaptive Dual-Background Modeling and SAO-YOLO Integration

Abandoned object detection is a critical task in the field of public safety. However, existing methods perform poorly when detecting small and occluded objects, leading to high false detection and missed detection rates. To address this issue, this paper proposes an abandoned object detection method that integrates an adaptive dual-background model with SAO-YOLO (Small Abandoned Object YOLO). The goal is to reduce false and missed detection rates for small and occluded objects, thereby improving overall detection accuracy. First, the paper introduces an adaptive dual-background model that adjusts according to scene changes, reducing noise interference in the background model. When combined with an improved PFSM (Pixel-based Finite State Machine) model, this enhances detection accuracy and robustness. Next, a network model called SAO-YOLO is designed. Key improvements within this model include the SAO-FPN (Small Abandoned Object FPN) feature extraction network, which fully extracts features of small objects, and a lightweight decoupled head, SODHead (Small Object Detection Head), which precisely extracts local features and enhances detection accuracy through multi-scale feature fusion. Finally, experimental results show that SAO-YOLO increases mAP@0.5 and mAP@0.5:0.95 by 9.0% and 5.1%, respectively, over the baseline model. It outperforms other advanced detection models. Ultimately, after a series of experiments on the ABODA, PETS2006, and AVSS2007 datasets, the proposed method achieved an average detection precious of 91.1%, surpassing other advanced methods. It significantly outperforms other advanced detection methods. This approach notably reduces false and missed detections, especially for small and occluded objects.

CN-ViT- Visual Object Detection with VisionTransformer

Object detection has always been an important and challenging task in the field of computer vision. In recent years, Vision Transformers (ViT) have achieved remarkable results on image classification tasks, demonstrating its potential in vision tasks. In this paper, we propose CN-ViT, a novel Vision Transformer based visual object detection model.CN-ViT effectively improves the accuracy and robustness of object detection by combining the advantages of self-attention mechanism and convolutional neural network, and introducing the GCCA (Global Context Block and Coordinate Attention) module. In this paper, CN-ViT is evaluated on the Mini COCO standard dataset. The experimental results suggest that CN-ViT may outperform current mainstream object detection methods in terms of detection accuracy and speed. This study sheds light on the potential of Transformer architectures for complex visual tasks and offers valuable insights for future research in this area.

Salient object detection with bayesian inference based on radar and camera fusion used in UAV obstacle avoidance

Most existing salient object detection methods are sensitive to background noise and rely on prior information in UAV obstacle avoidance applications despite detection methods witnessing rapid progress. In this paper, we propose an efficient framework for salient object detection based on radar-camera fusion and iterative Bayesian optimization. A rough salient object (RSO) image is first built through radar and camera calibration. Next, the RSO image is used to calculate the edge response based on the receptive field mechanism of the primary visual cortex to construct the contour image. Finally, the above two images and the 2D Gaussian distribution are jointly integrated into an iterative Bayesian optimization scheme to get the final salient object image. Different from typical detection methods, this method suppresses background noise by filtering out irrelevant pixels using fusion information. The Bayesian inference framework’s detection performance is improved by precise spatial prior, consisting of optimized contour and RSO images. Experimental results indicate that the presented algorithm performs well against state-of-the-art salient object detection methods on several reference datasets in different evaluation metrics.

A Novel Pre-Processing Approach and Benchmarking Analysis for Faster, Robust, and Improved Small Object Detection Methods

A Novel Pre-Processing Approach and Benchmarking Analysis for Faster, Robust, and Improved Small Object Detection Methods

Generation of NIR Spectral Band from RGB Image with Wavelet Domain Spectral Extrapolation Generative Adversarial Network

Near-infrared (NIR) imaging exhibits outstanding penetration capabilities and robust anti-interference characteristics. However, acquiring high-resolution and high-fidelity NIR images is difficult due to the limited mobility, high cost, and low resolution of NIR imaging hardware. In this paper, we proposed a new end-to-end Wavelet Domain Spectral Extrapolation Generative Adversarial Network (WSEGAN) to generate highly realistic NIR images from RGB images. Since RGB and NIR images have different types of noise and artifacts, which affects the quality of NIR images generation. We design a generator with a discrete wavelet transform and an attention mechanism to capture multi-resolution contextual information, and a multi-scale discriminator to capture detailed and global features. Then, the proposed approach is evaluated by three different datasets to achieve optimal results regarding both visual effects and quantitative evaluation. The normalized difference vegetation index (NDVI) is utilized to validate the effectiveness of the generated NIR images. The result demonstrates a strong correlation between the generated images and the actual vegetation distribution. More importantly, the proposed network is testified to generate NIR images to be fused with the RGB image source for agricultural target detection tasks. In dark conditions, results show that using multi-modal data instead of RGB images improves mAP0.5 detection accuracy by 4% on the CAPSICUM dataset and by 8% on the KIWI dataset across five object detection methods. This follows the physical significance of the NIR imaging and demonstrates the potential use of the NIR images generated by the proposed method.

ML Approaches for the Study of Significant Heritage Contexts: An Application on Coastal Landscapes in Sardinia

Remote Sensing (RS) and Geographic Information Science (GIS) techniques are powerful tools for spatial data collection, analysis, management, and digitization within cultural heritage frameworks. Despite their capabilities, challenges remain in automating data semantic classification for conservation purposes. To address this, leveraging airborne Light Detection And Ranging (LiDAR) point clouds, complex spatial analyses, and automated data structuring is crucial for supporting heritage preservation and knowledge processes. In this context, the present contribution investigates the latest Artificial Intelligence (AI) technologies for automating existing LiDAR data structuring, focusing on the case study of Sardinia coastlines. Moreover, the study preliminary addresses automation challenges in the perspective of historical defensive landscapes mapping. Since historical defensive architectures and landscapes are characterized by several challenging complexities—including their association with dark periods in recent history and chronological stratification—their digitization and preservation are highly multidisciplinary issues. This research aims to improve data structuring automation in these large heritage contexts with a multiscale approach by applying Machine Learning (ML) techniques to low-scale 3D Airborne Laser Scanning (ALS) point clouds. The study thus develops a predictive Deep Learning Model (DLM) for the semantic segmentation of sparse point clouds (<10 pts/m2), adaptable to large landscape heritage contexts and heterogeneous data scales. Additionally, a preliminary investigation into object-detection methods has been conducted to map specific fortification artifacts efficiently.

EFMF-pillars: 3D object detection based on enhanced features and multi-scale fusion

As unmanned vehicle technology advances rapidly, obstacle recognition and target detection are crucial links, which directly affect the driving safety and efficiency of unmanned vehicles. In response to the inaccurate localization of small targets such as pedestrians in current object detection tasks and the problem of losing local features in the PointPillars, this paper proposes a three-dimensional object detection method based on improved PointPillars. Firstly, addressing the issue of lost spatial and local information in the PointPillars, the feature encoding part of the PointPillars is improved, and a new pillar feature enhancement extraction module, CSM-Module, is proposed. Channel encoding and spatial encoding are introduced in the new pillar feature enhancement extraction module, fully considering the spatial information and local detailed geometric information of each pillar, thereby enhancing the feature representation capability of each pillar. Secondly, based on the fusion of CSPDarknet and SENet, a new backbone network CSE-Net is designed in this paper, enabling the extraction of rich contextual semantic information and multi-scale global features, thereby enhancing the feature extraction capability. Our method achieves higher detection accuracy when validated on the KITTI dataset. Compared to the original network, the improved algorithm’s average detection accuracy is increased by 3.42%, it shows that the method is reasonable and valuable.