Deep Learning-based Object Detection Research Articles

A Miniaturized and Intelligent Lensless Holographic Imaging System With Auto-Focusing and Deep Learning-Based Object Detection for Label-Free Cell Classification

A Miniaturized and Intelligent Lensless Holographic Imaging System With Auto-Focusing and Deep Learning-Based Object Detection for Label-Free Cell Classification

Deep Learning-based Lightweight Models for Bactrocera Oleae Detection

The detection of Bactrocera oleae (BO), an invasive pest that poses a serious threat to olive tree cultivation, is crucial for ensuring the quality and quantity of olive oil production. This study explores the application of deep learning with lightweight models for BO detection in olive trees. The DIRT Dataset, consisting of 841 images obtained from traps, was used for training and evaluation. Different combinations of Faster R-CNN and SSD models with various backbone architectures, including EfficientNet B0, MobileNet v3, ResNet-18, and ResNet-50, were assessed. The combination of Faster R-CNN with ResNet-18 achieves comparable results to Faster R-CNN with ResNet-50 but with lower latency and a reduced parameter count. These findings highlight the potential of deep learning-based object detection models for BO detection in olive trees, offering efficient and accurate identification of infestations.

Small object intelligent Detection method based on Adaptive Cascading Context

With the technology advances, deep learning-based object detection has made unprecedented progress. However, the small spatial ratio of object pixels affects the effective extraction of deep details features, resulting in poor detection results in small object detection. To improve the accuracy of small object detection, an adaptive Cascading Context small (ACC) object detection method is proposed based on YOLOv5. Firstly, a separate shallow layer feature was proposed to obtain more detailed information beneficial to small object detection. Secondly, an adaptive cascade method is proposed to fuse the output features of the three layers of the pyramid to adaptively filter negative semantic information, while fusing with shallow features to solve the problem of low classification accuracy caused by insufficient semantic information of shallow features. Finally, an adaptive context model is proposed to use a deformable convolution to obtain spatial context features of shallow small objects, associating the targets with the background, thereby improving the accuracy of small object detection. The experimental results show that the detection accuracy of the proposed method has been improved by 6.12%, 3.35%, 3.33%, and 5.2%, respectively, compared with the source code on the PASCAL VOC, NWPU VHR-10, KITTI, and RSOD datasets, which fully demonstrate the effectiveness of our method in small object detection.

A Few-Shot Object Detection Method for Endangered Species

Endangered species detection plays an important role in biodiversity conservation and is significant in maintaining ecological balance. Existing deep learning-based object detection methods are overly dependent on a large number of supervised samples, and building such endangered species datasets is usually costly. Aiming at the problems faced by endangered species detection, such as low accuracy and easy loss of location information, an efficient endangered species detection method with fewer samples is proposed to extend the few-shot object detection technique to the field of endangered species detection, which requires only a small number of training samples to obtain excellent detection results. First, SE-Res2Net is proposed to optimize the feature extraction capability. Secondly, an RPN network with multiple attention mechanism is proposed. Finally, for the classification confusion problem, a weighted prototype-based comparison branch is introduced to construct weighted category prototype vectors, which effectively improves the performance of the original classifier. Under the setting of 30 samples in the endangered species dataset, the average detection accuracy value of the method, mAP50, reaches 76.54%, which is 7.98% higher than that of the pre-improved FSCE method. This paper also compares the algorithm on the PASCOL VOC dataset, which is optimal and has good generalization ability compared to the other five algorithms.

MCF-YOLOv5: A Small Target Detection Algorithm Based on Multi-Scale Feature Fusion Improved YOLOv5

In recent years, many deep learning-based object detection methods have performed well in various applications, especially in large-scale object detection. However, when detecting small targets, previous object detection algorithms cannot achieve good results due to the characteristics of the small targets themselves. To address the aforementioned issues, we propose the small object algorithm model MCF-YOLOv5, which has undergone three improvements based on YOLOv5. Firstly, a data augmentation strategy combining Mixup and Mosaic is used to increase the number of small targets in the image and reduce the interference of noise and changes in detection. Secondly, in order to accurately locate the position of small targets and reduce the impact of unimportant information on small targets in the image, the attention mechanism coordinate attention is introduced in YOLOv5’s neck network. Finally, we improve the Feature Pyramid Network (FPN) structure and add a small object detection layer to enhance the feature extraction ability of small objects and improve the detection accuracy of small objects. The experimental results show that, with a small increase in computational complexity, the proposed MCF-YOLOv5 achieves better performance than the baseline on both the VisDrone2021 dataset and the Tsinghua Tencent100K dataset. Compared with YOLOv5, MCF-YOLOv5 has improved detection APsmall by 3.3% and 3.6%, respectively.

Roles of Wettability and Wickability on Enhanced Hydrogen Evolution Reactions.

Bubble dynamics significantly impact mass transfer and energy conversion in electrochemical gas evolution reactions. Micro-/nanostructured surfaces with extreme wettability have been employed as gas-evolving electrodes to promote bubble departure and decrease the bubble-induced overpotential. However, effects of the electrodes' wickability on the electrochemical reaction performances remain elusive. In this work, hydrogen evolution reaction (HER) performances are experimentally investigated using micropillar array electrodes with varying interpillar spacings, and effects of the electrodes' wettability, wickability as well as bubble adhesion are discussed. A deep learning-based object detection model was used to obtain bubble counts and bubble departure size distributions. We show that microstructures on the electrode have little effect on the total bubble counts and bubble size distribution characteristics at low current densities. At high current densities, however, micropillar array electrodes have much higher total bubble counts and smaller bubble departure sizes compared with the flat electrode. We also demonstrate that surface wettability is a critical factor influencing HER performances under low current densities, where bubbles exist in an isolated regime. Under high current densities, where bubbles are in an interacting regime, the wickability of the micropillar array electrodes emerges as a determining factor. This work elucidates the roles of surface wettability and wickability on enhancing electrochemical performances, providing guidelines for the optimal design of micro-/nanostructured electrodes in various gas evolution reactions.

Improved PAA algorithm for breast mass detection in mammograms

Mammography screening is instrumental in the early detection and diagnosis of breast cancer by identifying masses in mammograms. With the rapid development of deep learning, numerous deep learning-based object detection algorithms have been explored for mass detection studies. However, these methods often yield a high false positive rate per image (FPPI) while achieving a high true positive rate (TPR). To maintain a higher TPR while also ensuring lower FPPI, we improved the Probability Anchor Assignment (PAA) algorithm to enhance the detection capability for mammographic characteristics with our previous work. We considered three dimensions: the backbone network, feature fusion module, and dense detection heads. The final experiment showed the effectiveness of the proposed method, and the TPR/FPPI values of the final improved PAA algorithm were 0.96/0.56 on the INbreast datasets. Compared to other methods, our method stands distinguished with its effectiveness in addressing the imbalance between positive and negative classes in cases of single lesion detection.

Enhancing the Safety of Autonomous Vehicles in Adverse Weather by Deep Learning-Based Object Detection

Recognizing and categorizing items in weather-adverse environments poses significant challenges for autonomous vehicles. To improve the robustness of object-detection systems, this paper introduces an innovative approach for detecting objects at different levels by leveraging sensors and deep learning-based solutions within a traffic circle. The suggested approach improves the effectiveness of single-stage object detectors, aiming to advance the performance in perceiving autonomous racing environments and minimizing instances of false detection and low recognition rates. The improved framework is based on the one-stage object-detection model, incorporating multiple lightweight backbones. Additionally, attention mechanisms are integrated to refine the object-detection process further. Our proposed model demonstrates superior performance compared to the state-of-the-art method on the DAWN dataset, achieving a mean average precision (mAP) of 99.1%, surpassing the previous result of 84.7%.

Automatic detection of midfacial fractures in facial bone CT images using deep learning-based object detection models

BackgroundMidfacial fractures are among the most frequent facial fractures. Surgery is recommended within 2 weeks of injury, but this time frame is often extended because the fracture is missed on diagnostic imaging in the busy emergency medicine setting. Using deep learning technology, which has progressed markedly in various fields, we attempted to develop a system for the automatic detection of midfacial fractures. The purpose of this study was to use this system to diagnose fractures accurately and rapidly, with the intention of benefiting both patients and emergency room physicians. MethodsOne hundred computed tomography images that included midfacial fractures (e.g., maxillary, zygomatic, nasal, and orbital fractures) were prepared. In each axial image, the fracture area was surrounded by a rectangular region to create the annotation data. Eighty images were randomly classified as the training dataset (3736 slices) and 20 as the validation dataset (883 slices). Training and validation were performed using Single Shot MultiBox Detector (SSD) and version 8 of You Only Look Once (YOLOv8), which are object detection algorithms. ResultsThe performance indicators for SSD and YOLOv8 were respectively: precision, 0.872 and 0.871; recall, 0.823 and 0.775; F1 score, 0.846 and 0.82; average precision, 0.899 and 0.769. ConclusionsThe use of deep learning techniques allowed the automatic detection of midfacial fractures with good accuracy and high speed. The system developed in this study is promising for automated detection of midfacial fractures and may provide a quick and accurate solution for emergency medical care and other settings.

Object detection on low-resolution images with two-stage enhancement

Although deep learning-based object detection methods have achieved superior performance on conventional benchmark datasets, it is still difficult to detect objects from low-resolution (LR) images under diverse degradation conditions. To this end, a two-stage enhancement method for the LR image object detection (TELOD) framework is proposed. In the first stage, an extremely lightweight task disentanglement enhancement network (TDEN) is developed as a super-resolution (SR) sub-network before the detector. In the TDEN, the SR images can be obtained by applying the recurrent connection manner between an image restoration branch (IRB) and a resolution enhancement branch (REB) to enhance the input LR images. Specifically, the TDEN reduces the difficulty of image reconstruction by dividing the total image enhancement task into two sub-tasks, which are accomplished by the IRB and REB, respectively. Furthermore, a shared feature extractor is applied across two sub-tasks to explore common and accurate feature representations. In the second stage, an auxiliary feature enhancement head (AFEH) driven by high-resolution (HR) image priors is designed to improve the task-specific features produced by the detection Neck without any extra inference costs. In particular, the feature interaction module is built into the AFEH to integrate the features from the enhancement and detection phases to learn comprehensive information for detection. Extensive experiments show that the proposed TELOD significantly outperforms other methods. Specifically, the TELOD achieves mAP improvements of 1.8% and 3.3% over the second best method AERIS on degraded VOC and COCO datasets, respectively.

The evolution of object detection methods

Object detection is one of the most important domains in computer vision tasks, which is an important branch of artificial intelligence. It aims at finding and locating the accurate position of objects in given pictures or videos. With the development of deep learning techniques, more powerful and robust algorithms have emerged to deal with multi-scale, high-level features to overcome the limitations of traditional pipeline of object detectors. The popularity of transformer framework enables larger capacity datasets by processing self-attention mechanism, and the object detection methods have evolved into a new era. This paper first reviews traditional object detection pipeline and brief history of deep learning, afterwards it focuses on the classification of deep learning-based object detection methods covering Convolution Neural Network based and transformer-based methods. Commonly used datasets and metrics are also covered in the next part. The Convolution Neural Network based methods mainly contain two-stage and one-stage detectors, Convolution Neural Network is the underlying structure of these methods convolutional stages are fundamental parts. Transformer-based models convert traditional object detection issues into end-to-end detection, which is widely used in dealing with images. Finally, the promising future of object detection areas are listed to show guidance on future work.

Deep Learning-Based Fish Detection Using Above-Water Infrared Camera for Deep-Sea Aquaculture: A Comparison Study.

Long-term, automated fish detection provides invaluable data for deep-sea aquaculture, which is crucial for safe and efficient seawater aquafarming. In this paper, we used an infrared camera installed on a deep-sea truss-structure net cage to collect fish images, which were subsequently labeled to establish a fish dataset. Comparison experiments with our dataset based on Faster R-CNN as the basic objection detection framework were conducted to explore how different backbone networks and network improvement modules influenced fish detection performances. Furthermore, we also experimented with the effects of different learning rates, feature extraction layers, and data augmentation strategies. Our results showed that Faster R-CNN with the EfficientNetB0 backbone and FPN module was the most competitive fish detection network for our dataset, since it took a significantly shorter detection time while maintaining a high AP50 value of 0.85, compared to the best AP50 value of 0.86 being achieved by the combination of VGG16 with all improvement modules plus data augmentation. Overall, this work has verified the effectiveness of deep learning-based object detection methods and provided insights into subsequent network improvements.

Multi-nanoparticle recognition and tracking based on SPTGAN-YOLOv3 modeling

Nanoparticle tracking techniques based on point spread function (PSF) engineering can monitor the movement of nanoparticles in 3D space in real time. However, increasing the axial tracking depth decreases the signal-to-noise ratio (SNR), which makes the reconstruction of nanoparticle trajectories more difficult. This paper proposes a deep learning-based object detection model SPTGAN-YOLOv3 for nanoparticle tracking technique. The SPTGAN-YOLOv3 model utilizes a noisy image with a low SNR as its input. It learns the mapping from noisy to noise-free images, generating a high SNR image. This rendered image is then used as the input for the object detection network, enabling the recognition and tracking of nanoparticles. Comparative analysis with conventional particle tracking methods demonstrates that the SPTGAN-YOLOv3 model significantly improves the precision and efficiency in recognizing and tracking multiple nanoparticles. Moreover, experimental results indicate that this technique notably enhances the SNR of nanoparticle tracking images and enables precise identification of nanoparticles.

Development of an AI-based image/ultrasonic convergence camera system for accurate gas leak detection in petrochemical plants

Outdoor pipeline leaks are difficult to accurately measure using existing concentration measurement systems installed in petrochemical plants owing to external air currents. Besides, leak detection is only possible for a specific gas. The purpose of this study was to develop an image/ultrasonic convergence camera system that incorporates artificial intelligence (AI) to improve pipe leak detection and establish a real-time monitoring system. Our system includes an advanced ultrasonic camera coupled with a deep learning-based object-detection algorithm trained on pipe image data from petrochemical plants. The collected data improved the accuracy of detected gas leak localization through deep learning. Our detection model achieves an mAP50 (Mean average precision calculated at an intersection over union (IoU) threshold of 0.50)score of 0.45 on our data and is able to detect the majority of leak points within a system. The petrochemical plant environment was simulated by visiting petrochemical plants and reviewing drawings, and an outdoor experimental demonstration site was established. Scenarios such as flange connection failure were set under medium-/low-pressure conditions, and the developed product was experimented under gas leak conditions that simulated leakage accidents. These experiments enabled the removal of potentially confounding surrounding noise sources, which led to the false detection of actual gas leaks using the AI piping detection technique.

Automated License Plate Recognition for Non-Helmeted Motor Riders Using YOLO and OCR

One of the leading causes of serious injuries in motorcycle accidents is the failure to wear a helmet, pressing the need for effective measures to encourage riders to use helmets. To stop these frequent violations of business regulations, regular observation is necessary. The proposed system is for detecting traffic violations in India related to riding motorcycles without helmets. The system utilizes deep learning-based object detection using YOLO and OCR techniques to automatically detect non-helmet riders and extract license plate numbers. The proposed system aims to improve efficiency and accuracy in detecting violations by automating the process and reducing the need for manpower. The system involves three levels of object detection: person and motorcycle/moped, helmet, and license plate. OCR is used to extract the license plate number, and all techniques are subject to predefined conditions and constraints. The system is designed to operate on video input to ensure high-speed execution, and it intends to offer a complete solution for both detection of helmet and extracting the license plate number.

Loose to compact feature alignment for domain adaptive object detection

Recently, great achievements have been made for deep learning based object detection methods. But their performance drops significantly when domain shifts occur. To address this problem, in this work we propose a loose to compact feature alignment method under an unsupervised domain adaptation framework. The entire feature alignment is performed in a divide and conquer manner, so as to distribute the alignment difficulties at two steps. At the first step, we loosen the goal at both image and instance levels. At the image level, a new Mask Guided Foreground Alignment (MGFA) module is proposed to make the alignment focus more on easier foreground regions, leaving the more diverse and more difficult background regions to the second step; at the instance level, we propose a Class-Wise Instance Alignment (CWIA) module with separated domain classifiers for different categories so as to ease the alignment. At the second step, the alignment is performed per pixel and per instance, achieving a more compact and better aligned feature space. We conduct experiments on three different adaptation scenarios, where we achieve comparable results, demonstrating the effectiveness of our proposed method.

Testing a Vision-Based Autonomous Drone Navigation Model in a Forest Environment

Drones play a pivotal role in various industries of Industry 4.0. For achieving the application of drones in a dynamic environment, finding a clear path for their autonomous flight requires more research. This paper addresses the problem of finding a navigation path for an autonomous drone based on visual scene information. A deep learning-based object detection approach can localize obstacles detected in a scene. Considering this approach, we propose a solution framework that includes masking with a color-based segmentation method to identify an empty area where the drone can fly. The scene is described using segmented regions and localization points. The proposed approach can be used to remotely guide drones in dynamic environments that have poor coverage from global positioning systems. The simulation results show that the proposed framework with object detection and the proposed masking technique support drone navigation in a dynamic environment based only on the visual input from the front field of view.

Performance analysis of deep learning-based object detection algorithms on COCO benchmark: a comparative study

This paper thoroughly explores the role of object detection in smart cities, specifically focusing on advancements in deep learning-based methods. Deep learning models gain popularity for their autonomous feature learning, surpassing traditional approaches. Despite progress, challenges remain, such as achieving high accuracy in urban scenes and meeting real-time requirements. The study aims to contribute by analyzing state-of-the-art deep learning algorithms, identifying accurate models for smart cities, and evaluating real-time performance using the Average Precision at Medium Intersection over Union (IoU) metric. The reported results showcase various algorithms’ performance, with Dynamic Head (DyHead) emerging as the top scorer, excelling in accurately localizing and classifying objects. Its high precision and recall at medium IoU thresholds signify robustness. The paper suggests considering the mean Average Precision (mAP) metric for a comprehensive evaluation across IoU thresholds, if available. Despite this, DyHead stands out as the superior algorithm, particularly at medium IoU thresholds, making it suitable for precise object detection in smart city applications. The performance analysis using Average Precision at Medium IoU is reinforced by the Average Precision at Low IoU (APL), consistently depicting DyHead’s superiority. These findings provide valuable insights for researchers and practitioners, guiding them toward employing DyHead for tasks prioritizing accurate object localization and classification in smart cities. Overall, the paper navigates through the complexities of object detection in urban environments, presenting DyHead as a leading solution with robust performance metrics.

A comparison of deep learning-based object detection for unmanned aerial vehicle

Unmanned aerial vehicle (UAV) plays a critical role in the field of object detection, and machine learning techniques have significantly advanced the field in recent years. This paper provides a comprehensive overview of machine learning developments for UAV object detection. The process involves multiple steps. Firstly, deep learning and Convolutional Neural Network (CNN) are widely utilized to extract precise features and train object detection models for accurate classification and efficient recognition of target objects in images and videos. Secondly, classical object detection algorithms such as Faster R-CNN, You Only Look Once (YOLO), and Single Shot MultiBox Detector (SSD), have been enhanced to improve accuracy and real-time performance. In this review, we primarily focus on comparing the principles of CNN and YOLOv5 themselves, as well as their applications in object detection and image recognition. Ultimately, it becomes apparent that CNN is better suited for processing image data, automatically extracting features, and achieving more accurate classification and detection. On the other hand, YOLOv5 directly performs detection on large images, significantly reducing computation time compared to CNN.

Semi-supervised learning approach for construction object detection by integrating super-resolution and mean teacher network

Deep learning-based object detection methods are utilized for safety management at construction sites, which require large-scale, high-quality, and well-labeled datasets for training. The existing construction datasets are relatively small due to the high expense of labor-intensive annotation, and the varying quality of the construction images also affects the detection performance of the model. To address the limitations of datasets, this study proposes a new method for construction object detection by integrating super-resolution and semi-supervised learning. The proposed method improves the quality of construction images and achieves excellent detection performance with limited labeled data. First, the Real-ESRGAN model is introduced to improve the quality of construction images and make the construction objects visible. The proposed super-resolution method can enhance the texture details of low-resolution images, hence improving the performance of object detection models. Second, the mean-teacher network is adopted to expand the training set, thus avoiding the labor-intensive annotation work. To verify the effectiveness of the proposed method, the method is applied to the state-of-the-art Yolov5 object detection model, and construction images from the Site Object Detection Dataset (SODA) with different labeled data proportions (from 10% to 50% in 10% intervals with an extreme case of 5%) are used as the training set. By comparing with the existing supervised learning method, it is shown that the proposed method can achieve better detection performance. In particular, the method is more effective in enhancing detection performance when the proportion of the labeled data is smaller, which is of great practical value in real-world engineering. The experimental results show the potential of the proposed method in improving image quality and reducing the expense of developing construction datasets.