Object Detection Model Research Articles

A foundation model for joint segmentation, detection and recognition of biomedical objects across nine modalities

A foundation model for joint segmentation, detection and recognition of biomedical objects across nine modalities

Research on coal gangue recognition method based on SFD-YOLOv5s

ABSTRACT Aiming at the current coal gangue recognition model’s difficulty in recognizing aggregated coal gangue targets, which leads to the problems of misdetections, omissions, and inaccurate localization, we propose a coal gangue recognition method based on the SFD-YOLOv5s model. The SE attention mechanism is improved in incorporating maximum pooling and introduced into the backbone network of the YOLOv5s model to improve the model’s ability to extract the critical feature information of the coal gangue. Furthermore, to improve the recognition ability of the YOLOv5s model for aggregated targets, we introduce the Focal-EIoU loss function and the Dyhead. The experimental results show that the overall performance of the SFD-YOLOv5s model has surpassed other mainstream object detection models of the YOLO series. The SFD-YOLOv5s model has the highest precision, recall, and mean average precision. The precision reaches 97.9%, the recall is 96.2%, and the mean average precision is 94.5%, which is 8.7%, 8.9%, and 9.0% higher compared with the YOLOv5s model, respectively. The FPS is 96.15, which can fully meet the demand for real-time detection of coal gangue. Meanwhile, the SFD-YOLOv5s model has the best recognition effect of aggregated coal gangue targets.

Crack Detection and Cost Analyzer Using AI

Crack Vision is an innovative AI-powered Android application developed to detect and analyze wall cracks, providing users with real-time, automated repair cost estimates. By leveraging advanced object detection models such as YOLOv7 and Mask R-CNN, Crack Vision enhances both the accuracy and efficiency of crack detection, enabling precise measurement of crack dimensions, severity assessment, and quick identification of structural issues. This application simplifies the inspection and budgeting process for wall repairs, making it an essential tool for homeowners, contractors, and structural engineers who seek to minimize reliance on manual inspection methods. The core functionality of Crack Vision combines high-resolution image processing with state-of-the-art machine learning algorithms, ensuring reliable detection across various wall types and crack textures. Using computer vision and deep learning techniques, the app can differentiate between structural and non-structural cracks, thereby offering a comprehensive solution for repair prioritization. Furthermore, Crack Vision integrates with a robust backend that stores user data, allowing users to track the condition of their walls over time. This feature aids in preventive maintenance by identifying trends in crack expansion and deterioration, potentially mitigating costly repairs. Additionally, the application provides a detailed breakdown of estimated repair costs based on crack size, depth, and type, empowering users to make informed decisions about necessary repairs. Crack Vision is designed with user-friendliness in mind, featuring an intuitive interface that guides users through the inspection process. The app also supports multilingual options and customizable settings to cater to diverse user needs. In sum, Crack Vision redefines wall crack inspection, offering a rapid, accurate, and accessible solution for both casual users and industry professionals, ultimately contributing to improved building safety and maintenance efficiency

Comparative Analysis of Object Detection Models for Sheet Music Recognition: A Focus on YOLO and OMR Technologies

Abstract. As Artificial Intelligence (AI) technologies are developing rapidly and are widely used in various domains, it is efficient and convenient for composers to make music using AI to convert sheet music to audio. This research aims to compare the performance of different models in identifying individual notes within sheet music. Compared to traditional technologies like Optical Music Recognition (OMR), deep learning models have a significant advantage in processing blurry images with high efficiency. In the research process, three different models are used in searching for musical notes: OMR, You Only Look Once (YOLO)v5, and YOLOv8. The evaluation index consists of recognition accuracy, mean Average Precision (mAP), inference speed, and parameter quantity. After the experiment, it is found that the YOLO model performs best with high accuracy and fast speed. Based on the above analyses, the thesis finds that the YOLO model can be an efficient tool in composing music, with further research.

Learning to Detect Novel Species with SAM in the Wild

AbstractThis paper tackles the limitation of a closed-world object detection model that was trained on one species. The expectation for this model is that it will not generalize well to recognize the instances of new species if they were present in the incoming data stream. We propose a novel object detection framework for this open-world setting that is suitable for applications that monitor wildlife, ocean life, livestock, plant phenotype and crops that typically feature one species in the image. Our method leverages labeled samples from one species in combination with a novelty detection method and Segment Anything Model, a vision foundation model, to (1) identify the presence of new species in unlabeled images, (2) localize their instances, and (3) retrain the initial model with the localized novel class instances. The resulting integrated system assimilates and learns from unlabeled samples of the new classes while not “forgetting” the original species the model was trained on. We demonstrate our findings on two different domains, (1) wildlife detection and (2) plant detection. Our method achieves an AP of 56.2 (for 4 novel species) to 61.6 (for 1 novel species) for wildlife domain, without relying on any ground truth data in the background.

I-DINO: High-Quality Object Detection for Indoor Scenes

Object Detection in Complex Indoor Scenes is designed to identify and categorize objects in indoor settings, with applications in areas such as smart homes, security surveillance, and home service robots. It forms the basis for advanced visual tasks including visual question answering, video description generation, and instance segmentation. Nonetheless, the task faces substantial hurdles due to background clutter, overlapping objects, and significant size differences. To tackle these challenges, this study introduces an indoor object detection approach utilizing an enhanced DINO framework. To cater to the needs of indoor object detection, an Indoor-COCO dataset was developed from the COCO object detection dataset. The model incorporates an advanced Res2net as the backbone feature extraction network, complemented by a deformable attention mechanism to better capture detailed object features. An upgraded Bi-FPN module is employed to replace the conventional feature fusion module, and SIoU loss is utilized to expedite convergence. The experimental outcomes indicate that the refined model attains an mAP of 62.3%, marking a 5.2% improvement over the baseline model. These findings illustrate that the DINO-based indoor object detection model exhibits robust generalization abilities and practical utility for multi-scale object detection in complex environments.

CDANet: a small object detection model for unmanned aerial vehicle images based on cross-layer guidance and skip dilated fusion

CDANet: a small object detection model for unmanned aerial vehicle images based on cross-layer guidance and skip dilated fusion

An artificial intelligence-enabled consumables tracking system for medical laboratories

Abstract The medical laboratory plays a crucial role within a hospital setting and is responsible for the examination and analysis of patient specimens to accurately diagnose various ailments. The burden on medical laboratory personnel has significantly increased, particularly in the context of the ongoing global COVID-19 pandemic. Worldwide, the implementation of comprehensive and extended COVID-19 screening programs has placed a significant strain on healthcare professionals. This burden has led to exhaustion among medical employees, limiting their ability to effectively track laboratory resources, such as medical equipment and consumables. Therefore, this study proposed an artificial intelligence (AI)-based solution that contributes to a more efficient and less labor-intensive workflow for medical workers in laboratory settings. With the ultimate goal to reduce the burden on healthcare providers by streamlining the process of monitoring and managing these resources, the objective of this study is to design and develop an AI-based system for consumables tracking in medical laboratories. In this work, the effectiveness of two object detection models, namely, YOLOv5x6 and YOLOv8l, for the administration of consumables in medical laboratories was evaluated and analyzed. A total of 570 photographs were used to create the dataset, capturing the objects in a variety of settings. The findings indicate that both detection models demonstrate a notable capability to achieve a high mean average precision. This underscores the effectiveness of computer vision in the context of consumable goods detection scenarios and provides a reference for the application of real-time detection models in tracking systems within medical laboratories.

RS-DETR: An Improved Remote Sensing Object Detection Model Based on RT-DETR

Object detection is a fundamental task in computer vision. Recently, deep-learning-based object detection has made significant progress. However, due to large variations in target scale, the predominance of small targets, and complex backgrounds in remote sensing imagery, remote sensing object detection still faces challenges, including low detection accuracy, poor real-time performance, high missed detection rates, and high false detection rates in practical applications. To enhance remote sensing target detection performance, this study proposes a new model, the remote sensing detection transformer (RS-DETR). First, we incorporate cascaded group attention (CGA) into the attention-driven feature interaction module. By capturing features at different levels, it enhances the interaction between features through cascading and improves computational efficiency. Additionally, we propose an enhanced bidirectional feature pyramid network (EBiFPN) to facilitate multi-scale feature fusion. By integrating features across multiple scales, it improves object detection accuracy and robustness. Finally, we propose a novel bounding box regression loss function, Focaler-GIoU, which makes the model focus more on difficult samples, improving detection performance for small and overlapping targets. Experimental results on the satellite imagery multi-vehicles dataset (SIMD) and the high-resolution remote sensing object detection (TGRS-HRRSD) dataset show that the improved algorithm achieved mean average precision (mAP) of 78.2% and 91.6% at an intersection over union threshold of 0.5, respectively, which is an improvement of 2.0% and 1.5% over the baseline model. This result demonstrates the effectiveness and robustness of our proposed method for remote sensing image object detection.

Clinical efficacy of DSA-based features in predicting outcomes of acupuncture intervention on upper limb dysfunction following ischemic stroke

Background and objectivesThis study aimed to employ machine learning techniques to predict the clinical efficacy of acupuncture as an intervention for patients with upper limb motor dysfunction following ischemic stroke, as well as to assess its potential utility in clinical practice.MethodsMedical records and digital subtraction angiography (DSA) imaging data were collected from 735 ischemic stroke patients with upper limb motor dysfunction who were treated with standardized acupuncture at two hospitals. Following the initial screening, 314 patient datasets that met the inclusion criteria were selected. We applied three deep-learning algorithms (YOLOX, FasterRCNN, and TOOD) to develop the object detection model. Object detection results pertaining to the cerebral vessels were integrated into a clinical efficacy prediction model (random forest). This model aimed to classify patient responses to acupuncture treatment. Finally, the accuracies and discriminative capabilities of the prediction models were assessed.ResultsThe object detection model achieved an optimal recognition rate, The mean average precisions of YOLOX, TOOD, and FasterRCNN were 0.61, 0.7, and 0.68, respectively. The prediction accuracy of the clinical efficacy model reached 93.6%, with all three-treatment response classification area under the curves (AUCs) exceeding 0.95. Feature extraction using the prediction model highlighted the significant influence of various cerebral vascular stenosis sites within the internal carotid artery (ICA) on prediction outcomes. Specifically, the initial and C1 segments of the ICA had the highest predictive weights among all stenosis sites. Additionally, stenosis of the middle cerebral, anterior cerebral, and posterior cerebral arteries exerted a notable influence on the predictions. In contrast, the stenosis sites within the vertebral artery exhibited minimal impact on the model's predictive abilities.ConclusionsResults underscore the substantial predictive influence of each cerebral vascular stenosis site within the ICA, with the initial and C1 segments being pivotal predictors.

Design and implementation of a smoke alarm system using YOLOv8

Abstract. This paper present a smoke alarm system built using Yolov8, a state-of-the-art object detection model. The system is designed to detect smoke in real-time environments and alert users in the event of a fire or smoke detection. The use of Yolov8 in this system offers several advantages over other object detection models, making it a suitable choice for building an effective smoke alarm system. One of the critical advantages of Yolov8 is its high accuracy in detecting objects with a small size, such as smoke. This is achieved through its efficient and robust architecture, which allows it to process images quickly and accurately. In comparison to other object detection models, Yolov8 demonstrates superior performance in terms of speed and accuracy. Furthermore, Yolov8s ability to detect objects with high precision and low false positives is crucial for a smoke alarm system. This is because smoke detection needs high accuracy to prevent false alarms and promptly detect real threats. The smoke alarm system built using Yolov8 can be implemented in various environments, including homes, offices, and public buildings. It can provide early warnings for fires and smoke, enabling timely evacuation and reducing potential injuries or damages. The implementation of this system can greatly contribute to improving safety in various environments by providing early warnings of fires and smoke.

A Comprehensive Comparative Study of Intuitive Physics Modeling in Machine Learning Trained with Cartoon and Realistic Data

Abstract. This study delves into the influence of training data typesspecifically cartoon versus realistic visual datasetson the development of intuitive physics modeling in machine learning. Intuitive physics, the inherent human ability to understand and predict the physical properties and dynamics of objects, presents a significant challenge for current AI systems to replicate accurately. Leveraging YOLOv5, a cutting-edge object detection model, this research systematically evaluates the cognitive understanding and performance of AI models trained on distinct types of visual data. The findings reveal that the visual complexity inherent in the training datasets plays a crucial role in shaping the model's ability to generalize and accurately perform intuitive physics tasks. Models trained on cartoon datasets exhibited different learning patterns and generalization capabilities compared to those trained on realistic data, providing valuable insights into the role of data representation in AI training. This research offers both theoretical advancements in understanding AI's cognitive limitations and practical guidance for designing AI systems that can interact with the physical world more effectively. Ultimately, the study contributes to bridging the gap between human cognition and machine learning, pushing the boundaries of what AI can achieve in modeling complex, real-world phenomena.

A Black-Box Watermarking Modulation for Object Detection Models

Training a Deep Neural Network (DNN) from scratch comes with a substantial cost in terms of money, energy, data, and hardware. When such models are misused or redistributed without authorisation, the owner faces significant financial and intellectual property (IP) losses. Therefore, there is a pressing need to protect the IP of Machine Learning models to avoid these issues. ML watermarking emerges as a promising solution for model traceability. Watermarking has been well-studied for image classification models, but there is a significant research gap in its application to other tasks like object detection, for which no effective methods have been proposed yet. In this paper, we introduce a novel black-box watermarking method for object detection models. Our contributions include a watermarking technique that maps visual information to text semantics and a comparative study of fine-tuning techniques’ impact on watermark detectability. We present the model’s detection performance and evaluate fine-tuning strategies’ effectiveness in preserving watermark integrity.

Automated acute skin toxicity scoring in a mouse model through deep learning.

This study presents a novel approach to skin toxicity assessment in preclinical radiotherapy trials through an advanced imaging setup and deep learning. Skin reactions, commonly associated with undesirable side effects in radiotherapy, were meticulously evaluated in 160 mice across four studies. A comprehensive dataset containing 7542 images was derived from proton/electron trials with matched manual scoring of the acute toxicity on the right hind leg, which was the target area irradiated in the trials. This dataset was the foundation for the subsequent model training. The two-step deep learning framework incorporated an object detection model for hind leg detection and a classification model for toxicity classification. An observer study involving five experts and the deep learning model, was conducted to analyze the retrospective capabilities and inter-observer variations. The results revealed that the hind leg object detection model exhibited a robust performance, achieving an accuracy of almost 99%. Subsequently, the classification model demonstrated an overall accuracy of about 85%, revealing nuanced challenges in specific toxicity grades. The observer study highlighted high inter-observer agreement and showcased the model's superiority in accuracy and misclassification distance. In conclusion, this study signifies an advancement in objective and reproducible skin toxicity assessment. The imaging and deep learning system not only allows for retrospective toxicity scoring, but also presents a potential for minimizing inter-observer variation and evaluation times, addressing critical gaps in manual scoring methodologies. Future recommendations include refining the system through an expanded training dataset, paving the way for its deployment in preclinical research and radiotherapy trials.

Evoattack: suppressive adversarial attacks against object detection models using evolutionary search

Evoattack: suppressive adversarial attacks against object detection models using evolutionary search

An in-air synthetic aperture sonar dataset of target scattering in environments of varying complexity

This paper describes a synthetic aperture sonar (SAS) dataset collected in-air consisting of four types of targets in four environments of different complexity. The in-air laboratory based experiments produced data with a level of fidelity and ground truth accuracy that is not easily attainable in data collected underwater. The range of complexity, high level of data fidelity, and accurate ground truth provides a rich dataset with acoustic features on multiple scales. It can be used to develop new signal-processing and image reconstruction algorithms, as well as machine learning models for object detection and classification. It may also find application in model verification and validation for acoustic simulators. The dataset consists of raw acoustic time series returns, associated environmental conditions, hardware configuration, array motion, as well as the reconstructed imagery.

YOLOv5DA: An Improved YOLOv5 Model for Posture Detection of Grouped Pigs

Accurate posture detection is the foundation for analyzing animal behavior, which can promote animal welfare. With the development of computer vision, such technology has been widely used in analyzing animal behavior without physical contact. However, computer vision technology for pig posture detection often suffers from problems of missed or false detection due to complex scenarios. To solve the problem, this study proposed a novel object detection model YOLOv5DA, which was based on YOLOv5s and designed for pig posture detection from 2D camera video. Firstly, we established the annotated dataset (7220 images) including the training set (5776 images), validation set (722 images), and test set (722 images). Secondly, an object detection model YOLOv5DA based on YOLOv5s was proposed to recognize pig postures (standing, prone lying, and side lying), which incorporated Mosaic9 data augmentation, deformable convolution, and adaptive spatial feature fusion. The comparative and ablation experiments were conducted to verify the model’s effectiveness and reliability. Finally, we used YOLOv5DA to detect the posture distribution of pigs. The results revealed that the standing posture was more frequent in the morning and afternoon and the side-lying posture was most common at noon. This observation demonstrated that the posture of pigs is influenced by temperature variations. The study demonstrated that YOLOv5DA could accurately identify three postures of standing, prone lying, and side lying with an average precision (AP) of 99.4%, 99.1%, and 99.1%, respectively. Compared with YOLOv5s, YOLOv5DA could effectively handle occlusion while increasing the mean precision (mAP) by 1.7%. Overall, our work provided a highly accurate, effective, low-cost, and non-contact strategy of posture detection in grouped pigs, which can be used to monitor pig behavior and assist in the early prevention of disease.

Deep Learning-Assisted Label-Free Parallel Cell Sorting with Digital Microfluidics.

Sorting specific cells from heterogeneous samples is important for research and clinical applications. In this work, a novel label-free cell sorting method is presented that integrates deep learning image recognition with microfluidic manipulation to differentiate cells based on morphology. Using an Active-Matrix Digital Microfluidics (AM-DMF) platform, the YOLOv8 object detection model ensures precise droplet classification, and the Safe Interval Path Planning algorithm manages multi-target, collision-free droplet path planning. Simulations and experiments revealed that detection model precision, concentration ratios, and sorting cycles significantly affect recovery rates and purity. With HeLa cells and polystyrene beads as samples, the method achieved 98.5% sorting precision, 96.49% purity, and an 80% recovery over three cycles. After a series of experimental validations, this method can also be used to sort HeLa cells from red blood cells, cancer cells from white blood cells (represented by HeLa and Jurkat cells), and differentiate white blood cell subtypes (represented by HL-60 cells and Jurkat cells). Cells sorted using this method can be lysed directly on chip within their hosting droplets, ensuring minimal sample loss and suitability for downstream bioanalysis. This innovative AM-DMF cell sorting technique holds significant potential to advance diagnostics, therapeutics, and fundamental research in cell biology.

AI+AR based Framework for Guided Visual Diagnosis of Equipment

Automated solutions for effective support services, such as failure diagnosis and repair, are crucial to keep customer satisfaction and loyalty. However, providing consistent, high quality, and timely support is a difficult task. In practice, customer support usually requires technicians to perform onsite diagnosis, but service quality is often adversely affected by limited expert technicians, high turnover, and minimal automated tools. To address these challenges, we present a novel solution framework for aiding technicians in performing visual equipment diagnosis. We envision a workflow where the technician reports a failure and prompts the system to automatically generate a diagnostic plan that includes parts, areas of interest, and necessary tasks. The plan is used to guide the technician with augmented reality (AR), while a perception module analyzes and tracks the technician’s actions to recommend next steps. Our framework consists of three components: planning, tracking, and guiding. The planning component automates the creation of a diagnostic plan by querying a knowledge graph (KG). We propose to leverage Large Language Models (LLMs) for the construction of the KG to accelerate the extraction process of parts, tasks, and relations from manuals. The tracking component enhances 3D detections by using perception sensors with a 2D nested object detection model. Finally, the guiding component reduces process complexity for technicians by combining 2D models and AR interactions. To validate the framework, we performed multiple studies to:1) determine an effective prompt method for the LLM to construct the KG; 2) demonstrate benefits of our 2D nested object model combined with AR model.

WCAY object detection of fractures for X-ray images of multiple sites

The WCAY (weighted channel attention YOLO) model, which is meticulously crafted to identify fracture features across diverse X-ray image sites, is presented herein. This model integrates novel core operators and an innovative attention mechanism to enhance its efficacy. Initially, leveraging the benefits of dynamic snake convolution (DSConv), which is adept at capturing elongated tubular structural features, we introduce the DSC-C2f module to augment the model’s fracture detection performance by replacing a portion of C2f. Subsequently, we integrate the newly proposed weighted channel attention (WCA) mechanism into the architecture to bolster feature fusion and improve fracture detection across various sites. Comparative experiments were conducted, to evaluate the performances of several attention mechanisms. These enhancement strategies were validated through experimentation on public X-ray image datasets (FracAtlas and GRAZPEDWRI-DX). Multiple experimental comparisons substantiated the model’s efficacy, demonstrating its superior accuracy and real-time detection capabilities. According to the experimental findings, on the FracAtlas dataset, our WCAY model exhibits a notable 8.8% improvement in mean average precision (mAP) over the original model. On the GRAZPEDWRI-DX dataset, the mAP reaches 64.4%, with a detection accuracy of 93.9% for the “fracture” category alone. The proposed model represents a substantial improvement over the original algorithm compared to other state-of-the-art object detection models. The code is publicly available at https://github.com/cccp421/Fracture-Detection-WCAY .