Object Detection Research Articles

Hybrid network with difficult–easy learning for concealed object detection in imbalanced terahertz image dataset

Hybrid network with difficult–easy learning for concealed object detection in imbalanced terahertz image dataset

A Reparameterization Feature Redundancy Extract Network for Unmanned Aerial Vehicles Detection

In unmanned aerial vehicles (UAVs) detection, challenges such as occlusion, complex backgrounds, motion blur, and inference time often lead to false detections and missed detections. General object detection frameworks encounter difficulties in adequately tackling these challenges, leading to substantial information loss during network downsampling, inadequate feature fusion, and being unable to meet real-time requirements. In this paper, we propose a Real-Time Small Object Detection YOLO (RTSOD-YOLO) model to tackle the various challenges faced in UAVs detection. We further enhance the adaptive nature of the Adown module by incorporating an adaptive spatial attention mechanism. This mechanism processes the downsampled feature maps, enabling the model to better focus on key regions. Secondly, to address the issue of insufficient feature fusion, we employ combined serial and parallel triple feature encoding (TFE). This approach fuses scale-sequence features from both shallow features and twice-encoded features, resulting in a new small-scale object detection layer. While enhancing the global context awareness of the existing detection layers, this also enriches the small-scale object detection layer with detailed information. Since rich redundant features often ensure a comprehensive understanding of the input, which is a key characteristic of deep neural networks, we propose a more efficient redundant feature generation module. This module generates more feature maps with fewer parameters. Additionally, we introduce reparameterization techniques to compensate for potential feature loss while further improving the model’s inference speed. Experimental results demonstrate that our proposed RTSOD-YOLO achieves superior detection performance, with mAP50/mAP50:95 reaching 97.3%/51.7%, which represents improvement of 3%/3.5% over YOLOv8, and 2.6%/0.1% higher than YOLOv10. Additionally, it has the lowest parameter count and FLOPs, making it highly efficient in terms of computational resources.

A Systematic Review of Event-Matching Methods for Complex Event Detection in Video Streams

Complex Event Detection (CED) in video streams involves numerous challenges such as object detection, tracking, spatio–temporal relationship identification, and event matching, which are often complicated by environmental variations, occlusions, and tracking losses. This systematic review presents an analysis of CED methods for video streams described in publications from 2012 to 2024, focusing on their effectiveness in addressing key challenges and identifying trends, research gaps, and future directions. A total of 92 studies were categorized into four main groups: training-based methods, object detection and spatio–temporal matching, multi-source solutions, and others. Each method’s strengths, limitations, and applicability are discussed, providing an in-depth evaluation of their capabilities to support real-time video analysis and live camera feed applications. This review highlights the increasing demand for advanced CED techniques in sectors like security, safety, and surveillance and outlines the key opportunities for future research in this evolving field.

Learning to Detect Novel Species with SAM in the Wild

AbstractThis paper tackles the limitation of a closed-world object detection model that was trained on one species. The expectation for this model is that it will not generalize well to recognize the instances of new species if they were present in the incoming data stream. We propose a novel object detection framework for this open-world setting that is suitable for applications that monitor wildlife, ocean life, livestock, plant phenotype and crops that typically feature one species in the image. Our method leverages labeled samples from one species in combination with a novelty detection method and Segment Anything Model, a vision foundation model, to (1) identify the presence of new species in unlabeled images, (2) localize their instances, and (3) retrain the initial model with the localized novel class instances. The resulting integrated system assimilates and learns from unlabeled samples of the new classes while not “forgetting” the original species the model was trained on. We demonstrate our findings on two different domains, (1) wildlife detection and (2) plant detection. Our method achieves an AP of 56.2 (for 4 novel species) to 61.6 (for 1 novel species) for wildlife domain, without relying on any ground truth data in the background.

Application of CNN Classic Model in Modern Image Processing

As a deep learning model, convolutional neural network (CNN) has been widely used in the field of modern image processing and has shown excellent performance. From LeNet to AlexNet, to classic models such as VGGNet and ResNet, CNN has achieved remarkable success in tasks such as image classification, object detection and segmentation through multi-level feature extraction and automatic learning capabilities. This paper first explores the basic structure and working principle of CNN, analyzes the advantages and limitations of classic models, and reviews its specific applications in image processing. By introducing the optimization strategies of various models, it further explores the improvement path of CNN in the field of image processing, including model compression, lightweight design and the introduction of new network structures. In short, the continuous optimization of CNN has enabled it to show powerful performance in multiple complex tasks, promoted the rapid development of image processing technology, and provided strong support for applications in more fields.

Improving Visual Object Detection using General UFIR Filtering

Object detection is a fundamental task in computer vision, which involves the identification and localization of objects within image frames or video sequences. The problem is complicated by large variations in the video camera bounding box, which can be thought of as colored measurement noise (CMN). In this paper, we use the general unbiased finite impulse response (GUFIR) approach to improve detection performance under CMN. The results are compared to the general Kalman filter (GKF) and two detection methods: “Faster-RCNN” and “Tensorflow PASCAL Visual Object Classes (VOC)”. Experimental testing is carried out using the benchmark data ”Car4”. It is shown that GUFIR significantly improves the detection accuracy and demonstrates the properties of the effective tool for visual object tracking.

Lightweight enhanced YOLOv8n underwater object detection network for low light environments.

In response to the challenges of target misidentification, missed detection, and other issues arising from severe light attenuation, low visibility, and complex environments in current underwater target detection, we propose a lightweight low-light underwater target detection network, named PDSC-YOLOv8n. Firstly, we enhance the input images using the improved Pro MSRCR algorithm for data augmentation. Secondly, we replace the traditional convolutions in the backbone and neck networks of YOLOv8n with Ghost and GSConv modules respectively to achieve lightweight network modeling. Additionally, we integrate the improved DCNv3 module into the C2f module of the backbone network to enhance the capability of target feature extraction. Furthermore, we introduce the GAM into the SPPF and incorporate the CBAM attention mechanism into the last layer of the backbone network to enhance the model's perceptual and generalization capabilities. Finally, we optimize the training process of the model using WIoUv3 as the loss function. The model is successfully deployed on an embedded platform, achieving real-time detection of underwater targets on the embedded platform. We first conduct experiments on the RUOD underwater dataset. Meanwhile, we also utilized the Pascal VOC2012 dataset to evaluate our approach. The mAP@0.5 and mAP@0.5:0.95 of the original YOLOv8n algorithm on RUOD dataset were 79.6% and 58.2%, respectively, and the PDSC -YOLOv8n algorithm mAP@0.5 and mAP@0.5:0.95 can reach 86.1% and 60.8%. The number of parameters of the model is reduced by about 15.5%, the detection accuracy is improved by 6.5%. The original YOLOv8n algorithm was 73% and 53.2% mAP@0.5 and mAP@0.5:0.95 on the Pascal VOC dataset, respectively. The PDSC-YOLOv8n algorithm mAP@0.5 and mAP@0.5:0.95 were 78.5% and 57%, respectively. The superior performance of PDSC-YOLOv8n indicates its effectiveness in the field of underwater target detection.

Vision Aid: Developing An Assistive Mobile Application for Visually Impaired Indivuals

Vision Aid is a cutting edge smartphone software that combines several assistive technologies into a unified platform to help visually impaired individuals. Integrating Computer Vision algorithms this project makes use of Bing Maps API for Step by Step navigation, Tesseract OCR for text recognition, YOLO (You Only Look Once) for real time object detection and CLIP (Contrastive Language-Image Pre training) for scene description. It offers voice commands, audio feedback for a more improved day to day life hence improving self-confidence while empowering independence to the users. This journal provides a thorough description of Vision Aid the development process, methodology, evaluation results and shows the potential for future improvements with a goal to advance mobile accessibility for visually impaired individuals

QAGA-Net: enhanced vision transformer-based object detection for remote sensing images

PurposeVision transformers (ViT) detectors excel in processing natural images. However, when processing remote sensing images (RSIs), ViT methods generally exhibit inferior accuracy compared to approaches based on convolutional neural networks (CNNs). Recently, researchers have proposed various structural optimization strategies to enhance the performance of ViT detectors, but the progress has been insignificant. We contend that the frequent scarcity of RSI samples is the primary cause of this problem, and model modifications alone cannot solve it.Design/methodology/approachTo address this, we introduce a faster RCNN-based approach, termed QAGA-Net, which significantly enhances the performance of ViT detectors in RSI recognition. Initially, we propose a novel quantitative augmentation learning (QAL) strategy to address the sparse data distribution in RSIs. This strategy is integrated as the QAL module, a plug-and-play component active exclusively during the model’s training phase. Subsequently, we enhanced the feature pyramid network (FPN) by introducing two efficient modules: a global attention (GA) module to model long-range feature dependencies and enhance multi-scale information fusion, and an efficient pooling (EP) module to optimize the model’s capability to understand both high and low frequency information. Importantly, QAGA-Net has a compact model size and achieves a balance between computational efficiency and accuracy.FindingsWe verified the performance of QAGA-Net by using two different efficient ViT models as the detector’s backbone. Extensive experiments on the NWPU-10 and DIOR20 datasets demonstrate that QAGA-Net achieves superior accuracy compared to 23 other ViT or CNN methods in the literature. Specifically, QAGA-Net shows an increase in mAP by 2.1% or 2.6% on the challenging DIOR20 dataset when compared to the top-ranked CNN or ViT detectors, respectively.Originality/valueThis paper highlights the impact of sparse data distribution on ViT detection performance. To address this, we introduce a fundamentally data-driven approach: the QAL module. Additionally, we introduced two efficient modules to enhance the performance of FPN. More importantly, our strategy has the potential to collaborate with other ViT detectors, as the proposed method does not require any structural modifications to the ViT backbone.

Remote Assistance for Bone-Fractured Patients using Deep Learning Models

ABSTRACT Remote diagnosis enables healthcare professionals to evaluate and diagnose patients from a distance using telecommunication technologies, enhancing healthcare delivery by improving accessibility, especially for those in remote or underserved areas. One of the significant sustainability challenges in remote medical diagnostics is offering timely assistance to vulnerable groups like the elderly, disabled, mentally impaired individuals, and wounded military personnel in combat zones. This becomes particularly difficult in emergencies when rapid analysis of medical records is needed, especially if the data is stored on secure blockchain networks. The proposed work addresses these challenges by deploying a comprehensive framework for large-scale analysis, utilizing both document and image classification for dual validation. It integrates advanced techniques such as Inception V3, VGG-16, VGG-19, RESNET-50, and Densenet-201 for bone fracture detection, with Inception V3 achieving the highest accuracy of 95.1%. In addition, a Document Classification Analysis (DCA) method is proposed, which automatically classifies the severity of fractures. Object detection techniques are also introduced for detecting minor fractures using region-based image segmentation, ensuring precise diagnosis even for subtle injuries. This pioneering integration of technologies provides a holistic solution for remote medical diagnostics.

Foreground separation knowledge distillation for object detection

In recent years, deep learning models have become predominant methods for computer vision tasks, but the large computation and storage requirements of many models make them challenging to deploy on devices with limited resources. Knowledge distillation (KD) is a widely used approach for model compression. However, when applied in the object detection problems, the existing KD methods either directly applies the feature map or simply separate the foreground from the background by using a binary mask, aligning the attention between the teacher and the student models. Unfortunately, these methods either completely overlook or fail to thoroughly eliminate noise, resulting in unsatisfactory model accuracy for student models. To address this issue, we propose a foreground separation distillation (FSD) method in this paper. The FSD method enables student models to distinguish between foreground and background using Gaussian heatmaps, reducing irrelevant information in the learning process. Additionally, FSD also extracts the channel feature by converting the spatial feature maps into probabilistic forms to fully utilize the knowledge in each channel of a well-trained teacher. Experimental results demonstrate that the YOLOX detector enhanced with our distillation method achieved superior performance on both the fall detection and the VOC2007 datasets. For example, YOLOX with FSD achieved 73.1% mean average precision (mAP) on the Fall Detection dataset, which is 1.6% higher than the baseline. The code of FSD is accessible via https://doi.org/10.5281/zenodo.13829676.

Hierarchical Image Quality Improvement Based on Illumination, Resolution, and Noise Factors for Improving Object Detection

Object detection performance is significantly impacted by image quality factors such as illumination, resolution, and noise. This paper proposes a hierarchical image quality improvement process that dynamically prioritizes these factors based on severity, enhancing detection accuracy in diverse conditions. The process evaluates each factor—illumination, resolution, and noise—using discriminators that analyze brightness, edge strength, and noise levels. Improvements are applied iteratively with an adaptive weight update mechanism that adjusts factor importance based on improvement effectiveness. Following each improvement, a quality assessment is conducted, updating weights to fine-tune subsequent adjustments. This allows the process to learn optimal parameters for varying conditions, enhancing adaptability. The image improved through the proposed process shows improved quality through quality index (PSNR, SSIM) evaluation, and the object detection accuracy is significantly improved when the performance is measured using deep learning models called YOLOv8 and RT-DETR. The detection rate is improved by 7% for the ‘Bottle’ object in a high-light environment, and by 4% and 2.5% for the ‘Bicycle’ and ‘Car’ objects in a low-light environment, respectively. Additionally, segmentation accuracy saw a 9.45% gain, supporting the effectiveness of this method in real-world applications.

New Astronomical Observatory Design for the Detection and Tracking of Satellite Objects: The Satellite Robotic Observatory (SRO)

Robotic Astronomical Observatories (RAOs) have provided very good results in different research projects in astrophysics/astronomy. Their applications in the detection, tracking, and identification of near-Earth objects have contributed to the identification of potentially dangerous objects for our security, such as near-Earth Objects (NEOs), near-Earth Asteroids (NEAs), meteors, and comets, whose trajectory changes can cause an impact on our planet. If advances in astrometry techniques (measuring the position and trajectory of Earth-orbiting objects) and photometry (variation in light curves) are considered together with the new sensors that work in the optical and near-infrared spectral ranges, a new observatory system that allows for the detection of nearby satellite objects in different spectral ranges and with better-defined optics can be developed. The present paper describes the design of a new observatory applied to the surveillance and tracking of satellites and other debris objects, the Satellite Robotic Observatory (SRO). Starting from general constraints from astronomy observatories, the design process has been determined, considering the main objectives, the necessary sensors, and several technical improvements that have contributed to a final configuration proposed for the SRO. The result is the design of a portable observatory model that can host at least two sensors to track and monitor satellite objects simultaneously.

Adaptive occlusion object detection algorithm based on OL-IoU.

The continuous advancement of autonomous driving technology imposes higher demands on the accuracy of target detection in complex environments, particularly when traffic targets are occluded. Existing algorithms still face significant challenges in detection accuracy and real-time performance under such conditions. To address this issue, this paper proposes an improved YOLOX algorithm based on adaptive deformable convolution, named OCC-YOLOX. This algorithm enhances the feature extraction network's ability to focus on occluded targets by incorporating a coordinate attention mechanism. Additionally, it introduces the Overlapping IoU (OL-IoU) loss function to optimize the overlap between predicted and ground truth bounding boxes, thereby improving detection accuracy. Furthermore, the adoption of Fast Spatial Pyramid Pooling (Fast SPP) reduces computational complexity while maintaining real-time performance. Experiments on fused public datasets demonstrate that OCC-YOLOX achieves improvements in accuracy, recall, and average precision by 2.76%, 1.25%, and 1.92%, respectively. In addition to testing on the KITTI, CityPersons, and BDD100K datasets, the effectiveness of the OCC-YOLOX algorithm is further validated through comparisons with self-collected occlusion scene data. The experimental results indicate that OCC-YOLOX outperforms existing mainstream detection algorithms, particularly in handling complex occlusion scenarios, significantly enhancing the accuracy and efficiency of object detection. This study provides new insights for addressing the challenges of occluded target detection in intelligent transportation systems.

Cucumber Leaf Segmentation Based on Bilayer Convolutional Network

When monitoring crop growth using top-down images of the plant canopies, leaves in agricultural fields appear very dense and significantly overlap each other. Moreover, the image can be affected by external conditions such as background environment and light intensity, impacting the effectiveness of image segmentation. To address the challenge of segmenting dense and overlapping plant leaves under natural lighting conditions, this study employed a Bilayer Convolutional Network (BCNet) method for accurate leaf segmentation across various lighting environments. The major contributions of this study are as follows: (1) Utilized Fully Convolutional Object Detection (FCOS) for plant leaf detection, incorporating ResNet-50 with the Convolutional Block Attention Module (CBAM) and Feature Pyramid Network (FPN) to enhance Region of Interest (RoI) feature extraction from canopy top-view images. (2) Extracted the sub-region of the RoI based on the position of the detection box, using this region as input for the BCNet, ensuring precise segmentation. (3) Utilized instance segmentation of canopy top-view images using BCNet, improving segmentation accuracy. (4) Applied the Varifocal Loss Function to improve the classification loss function in FCOS, leading to better performance metrics. The experimental results on cucumber canopy top-view images captured in glass greenhouse and plastic greenhouse environments show that our method is highly effective. For cucumber leaves at different growth stages and under various lighting conditions, the Precision, Recall and Average Precision (AP) metrics for object recognition are 97%, 94% and 96.57%, respectively. For instance segmentation, the Precision, Recall and Average Precision (AP) metrics are 87%, 83% and 84.71%, respectively. Our algorithm outperforms commonly used deep learning algorithms such as Faster R-CNN, Mask R-CNN, YOLOv4 and PANet, showcasing its superior capability in complex agricultural settings. The results of this study demonstrate the potential of our method for accurate recognition and segmentation of highly overlapping leaves in diverse agricultural environments, significantly contributing to the application of deep learning algorithms in smart agriculture.

Efficient indoor 3D object detection in point clouds using the Kinect sensor

Abstract Only using the point clouds collected by a Kinect sensor to perform 3D object detection is a very challenging task for indoor sense understanding. In this paper, we propose a novel point clouds based 3D object detection framework named Weighted VoteNet (W-VoteNet), which systematically enhances seed points, voting points, and proposal objects to varying degree, thereby enhancing the detection accuracy of indoor scene point clouds. Firstly, a new neighborhood feature enhancement module was designed to enhance the features of the seed point, which can better utilize the neighborhood feature of the seed point. Secondly, a weighted voting module is implemented to increase the accuracy of voting, allowing more prospect seed points to participate in voting. Finally, a new semantic relation reasoning module is proposed to get the semantic relationship features of the proposal object, which can further decrease false alarm rate. The three modules we proposed all contribute to more accurate voting and more effective proposals. The experimental results on two benchmark indoor 3D object detection datasets, SUN RGB-D and ScanNet V2, demonstrate the effectiveness of our approach. The source code is available at: https://github.com/Guo-JQ/W-VoteNet.

Anomaly triplet-net: progress recognition model using deep metric learning considering occlusion for manual assembly work

In this paper, we propose a method for recognizing progress in product assembly considering occlusion using deep metric learning. Visualizing the assembly process in factories is crucial for enhancing work efficiency and minimizing disposal costs. However, there is a problem in that products are managed by pasting them on paper with progress status written on them. We solve the problem of having to manage progress manually. First, the target assembly product is detected from images acquired from a fixed-point camera installed in the factory using a deep learning-based object detection method. Next, the detection area is cropped from the image. Finally, by using a classification method based on deep metric learning on the cropped image, the progress of the product assembly work is estimated as a rough progress step. As a specific progress estimation model, we propose an Anomaly Triplet-Net which is an improved model of the existing method Triplet Loss. This model considers occlusion by learning anomaly samples. In experiments, an 82.9 [%] success rate is achieved for the progress estimation method using Anomaly Triplet-Net. We also experimented with the practicality of the sequence of detection, cropping, and progression estimation, and confirmed the effectiveness of the overall system.

Predictive Health Monitoring of Palm Trees: Techniques and Applications for Enhanced Processing

This paper presents new framework for predictive health monitoring in palm trees using advanced deep learning methods. The system then selects the YOLOv8 method for the detection of the health of palm trees and further divides them into their real-time classification. Here, the model will, after training on its dataset, classify the palm tree as healthy, diseased, and stressed trees, keeping all the influential factors of the growth of the palm tree in consideration. It makes provision for the profiling of health status by way of early intervention, reducing risks and preventing diseases with a view to optimizing crop yields within palm plantations. The proposed model leverages state-of-the-art methodologies in object detection to process images of the palm tree with identification of key indicators of health issues. This approach has great implications for agricultural productivity in view of the maintenance of plant health through early detection. Further, the paper discusses challenges presented during the training and validation of the model, their strategies for overcoming such obstacles, and goes further into relating details to the technical architecture of the model. Further details on the works related to plant disease detection, image-based classification, and further applications of deep learning in agriculture have inspired the research work. Based on the obtained results, it can be observed that the proposed system provides a scalable and efficient solution for continuous monitoring and assessment of the health conditions of palm trees, hence enabling sustainable agricultural practices.

A Study to Investigate the Role and Challenges Associated with the Use of Deep Learning in Autonomous Vehicles

The application of deep learning in autonomous vehicles has surged over the years with advancements in technology. This research explores the integration of deep learning algorithms into autonomous vehicles (AVs), focusing on their role in perception, decision-making, localization, mapping, and navigation. It shows how deep learning, as a part of machine learning, mimics the human brain’s neural networks, enabling advancements in perception, decision-making, localization, mapping, and overall navigation. Techniques like convolutional neural networks are used for image detection and steering control, while deep learning is crucial for path planning, automated parking, and traffic maneuvering. Localization and mapping are essential for AVs’ navigation, with deep learning-based object detection mechanisms like Faster R-CNN and YOLO proving effective in real-time obstacle detection. Apart from the roles, this study also revealed that the integration of deep learning in AVs faces challenges such as dataset uncertainty, sensor challenges, and model training intricacies. However, these issues can be addressed through the increased standardization of sensors and real-life testing for model training, and advancements in model compression technologies can optimize the performance of deep learning in AVs. This study concludes that deep learning plays a crucial role in enhancing the safety and reliability of AV navigation. This study contributes to the ongoing discourse on the optimal integration of deep learning in AVs, aiming to foster their safety, reliability, and societal acceptance.

Novel Method for Detecting Coughing Pigs with Audio-Visual Multimodality for Smart Agriculture Monitoring

While the pig industry is crucial in global meat consumption, accounting for 34% of total consumption, respiratory diseases in pigs can cause substantial economic losses to pig farms. To alleviate this issue, we propose an advanced audio-visual monitoring system for the early detection of coughing, a key symptom of respiratory diseases in pigs, that will enhance disease management and animal welfare. The proposed system is structured into three key modules: the cough sound detection (CSD) module, which detects coughing sounds using audio data; the pig object detection (POD) module, which identifies individual pigs in video footage; and the coughing pig detection (CPD) module, which pinpoints which pigs are coughing among the detected pigs. These modules, using a multimodal approach, detect coughs from continuous audio streams amidst background noise and accurately pinpoint specific pens or individual pigs as the source. This method enables continuous 24/7 monitoring, leading to efficient action and reduced human labor stress. It achieved a substantial detection accuracy of 0.95 on practical data, validating its feasibility and applicability. The potential to enhance farm management and animal welfare is shown through proposed early disease detection.