Learning-based Object Detection Algorithm Research Articles

YOLOv8-E: An Improved YOLOv8 Algorithm for Eggplant Disease Detection

During the developmental stages, eggplants are susceptible to diseases, which can impact crop yields and farmers’ economic returns. Therefore, timely and effective detection of eggplant diseases is crucial. Deep learning-based object detection algorithms can automatically extract features from images of eggplants affected by diseases. However, eggplant disease images captured in complex farmland environments present challenges such as varying disease sizes, occlusion, overlap, and small target detection, making it difficult for existing deep-learning models to achieve satisfactory detection performance. To address this challenge, this study proposed an optimized eggplant disease detection algorithm, YOLOv8-E, based on You Only Look Once version 8 nano (YOLOv8n). Firstly, we integrate switchable atrous convolution (SAConv) into the C2f module to design the C2f_SAConv module, replacing some of the C2f modules in the backbone network of YOLOv8n, enabling our proposed algorithm to better extract eggplant disease features. Secondly, to facilitate the deployment of the detection model on mobile devices, we reconstruct the Neck network of YOLOv8n using the SlimNeck module, making the model lighter. Additionally, to tackle the issue of missing small targets, we embed the large separable kernel attention (LSKA) module within SlimNeck, enhancing the model’s attention to fine-grained information. Lastly, we combined intersection over union with auxiliary bounding box (Inner-IoU) and minimum point distance intersection over union (MPDIoU), introducing the Inner-MPDIoU loss to speed up convergence of the model and raise detection precision of overlapped and occluded targets. Ablation studies demonstrated that, compared to YOLOv8n, the mean average precision (mAP) and F1 score of YOLOv8-E reached 79.4% and 75.7%, respectively, which obtained a 5.5% increment and a 4.5% increase, while also reducing the model size and computational complexity. Furthermore, YOLOv8-E achieved higher detection performance than other mainstream algorithms. YOLOv8-E exhibits significant potential for practical application in eggplant disease detection.

An unmanned aerial system benchmark object detection dataset for deep learning in outfall surveys

ABSTRACT Deep-learning-based object detection in UAS imagery is crucial for outfall surveys and basin environmental protection. Comprehensive UAS image datasets serve as a foundation for creating deep-learning-based outfall-detection models and evaluating outfall-detection algorithms. However, existing remote sensing deep learning datasets lack specific outfall data. This study introduces a benchmark UAS image dataset of outfalls, categorized into three main and seven subcategories. Over 10,000 labeled images were collected from UAS images with a 10 cm resolution for the Yangtze River, Yellow River, and other basins from 2019 to 2022, covering nearly all types of outfalls in China. Each sample was matched with digital surface model (DSM) data generated through photographometry or the DSM transfer method. Evaluation with seven widely used deep learning-based object detection algorithms demonstrated the dataset's viability, achieving an average precision ( A P 50 ) of 64.6, surpassing performance on Microsoft Common Objects in Context. Further experiments indicated that DSMs attached to this dataset could benefit from geo-deep-learning-based object detection algorithms for outfalls, achieving an A P 50 exceeding 70. This study presents a UAS benchmark image dataset for outfall surveys, potentially advancing the application of deep learning in environmental protection.

CubeSats for space debris removal from LEO: Prototype design of a robotic arm-based deorbiter CubeSat

Space debris has become a growing problem, and various studies indicate that the population of space objects has reached a critical density in low Earth orbits (LEO). Therefore, removing debris from the LEO is key to stabilizing the growth of space objects and making some of the orbits reusable for future launches. Deorbiting larger debris objects using miniaturized satellites, CubeSats is both economically viable and requires relatively less time for design & deployment. In this paper, we present a system-level study of orbital debris removal from LEO using CubeSats, detailing various existing debris tracking, rendezvous, capture, and deorbit mechanisms. A deep learning-based object detection algorithm has been utilized to improve the accuracy of detecting and localizing debris. We also present a discussion on the CubeSat-compatible capture & deorbit mechanisms identified from our study and an upper bound on the debris mass that can be deorbited from a given LEO orbit using CubeSats. We aim to demonstrate a case study for the orbital decay analysis of a CubeSat deorbiting the XSat, a microsatellite launched by Singapore. We detail the design of a 27U CubeSat deorbiter prototype equipped with a pair of robotic arms to capture the XSat. This analysis considers active deorbiting using Hall-effect thrusters, for which the required delta-V & propellant mass have also been computed.

Object Detection Algorithms Based on Deep Learning: A Review

With the continuous development of deep learning, object detection algorithms based on deep learning have made significant progress in the field of computer vision, widely applied in areas such as autonomous driving, industrial inspection, agriculture, transportation, and medicine. Traditional object detection algorithms face issues such as low detection efficiency and poor robustness. However, deep learning-based object detection algorithms significantly enhance detection accuracy and generalization by learning low-level and high-level image features. This article first introduces traditional object detection algorithms and their existing problems, then elaborates on the main processes, innovations, advantages, disadvantages, and experimental results on datasets of deep learning-based object detection algorithms. It focuses on the development of Two-Stage and One-Stage object detection algorithms, and provides an outlook on the future development of object detection algorithms, discussing challenges such as the coordination of detection speed and accuracy, difficulties in detecting small objects, real-time detection tasks, and multi-modal fusion applications, and proposes possible future directions.

Enhancing fall risk assessment: instrumenting vision with deep learning during walks

BackgroundFalls are common in a range of clinical cohorts, where routine risk assessment often comprises subjective visual observation only. Typically, observational assessment involves evaluation of an individual’s gait during scripted walking protocols within a lab to identify deficits that potentially increase fall risk, but subtle deficits may not be (readily) observable. Therefore, objective approaches (e.g., inertial measurement units, IMUs) are useful for quantifying high resolution gait characteristics, enabling more informed fall risk assessment by capturing subtle deficits. However, IMU-based gait instrumentation alone is limited, failing to consider participant behaviour and details within the environment (e.g., obstacles). Video-based eye-tracking glasses may provide additional insight to fall risk, clarifying how people traverse environments based on head and eye movements. Recording head and eye movements can provide insights into how the allocation of visual attention to environmental stimuli influences successful navigation around obstacles. Yet, manual review of video data to evaluate head and eye movements is time-consuming and subjective. An automated approach is needed but none currently exists. This paper proposes a deep learning-based object detection algorithm (VARFA) to instrument vision and video data during walks, complementing instrumented gait.MethodThe approach automatically labels video data captured in a gait lab to assess visual attention and details of the environment. The proposed algorithm uses a YoloV8 model trained on with a novel lab-based dataset.ResultsVARFA achieved excellent evaluation metrics (0.93 mAP50), identifying, and localizing static objects (e.g., obstacles in the walking path) with an average accuracy of 93%. Similarly, a U-NET based track/path segmentation model achieved good metrics (IoU 0.82), suggesting that the predicted tracks (i.e., walking paths) align closely with the actual track, with an overlap of 82%. Notably, both models achieved these metrics while processing at real-time speeds, demonstrating efficiency and effectiveness for pragmatic applications.ConclusionThe instrumented approach improves the efficiency and accuracy of fall risk assessment by evaluating the visual allocation of attention (i.e., information about when and where a person is attending) during navigation, improving the breadth of instrumentation in this area. Use of VARFA to instrument vision could be used to better inform fall risk assessment by providing behaviour and context data to complement instrumented e.g., IMU data during gait tasks. That may have notable (e.g., personalized) rehabilitation implications across a wide range of clinical cohorts where poor gait and increased fall risk are common.

HDetect-VS: Tiny Human Object Enhancement and Detection Based on Visual Saliency for Maritime Search and Rescue

Strong sun glint noise is an inevitable obstruction for tiny human object detection in maritime search and rescue (SAR) tasks, which can significantly deteriorate the performance of local contrast method (LCM)-based algorithms and cause high false alarm rates. For SAR tasks in noisy environments, it is more important to find tiny objects than localize them. Hence, considering background clutter and strong glint noise, in this study, a noise suppression methodology for maritime scenarios (HDetect-VS) is established to achieve tiny human object enhancement and detection based on visual saliency. To this end, the pixel intensity value distributions, color characteristics, and spatial distributions are thoroughly analyzed to separate objects from background and glint noise. Using unmanned aerial vehicles (UAVs), visible images with rich details, rather than infrared images, are applied to detect tiny objects in noisy environments. In this study, a grayscale model mapped from the HSV model (HSV-gray) is used to suppress glint noise based on color characteristic analysis, and large-scale Gaussian Convolution is utilized to obtain the pixel intensity surface and suppress background noise based on pixel intensity value distributions. Moreover, based on a thorough analysis of the spatial distribution of objects and noise, two-step clustering is employed to separate objects from noise in a salient point map. Experiments are conducted on the SeaDronesSee dataset; the results illustrate that HDetect-VS has more robust and effective performance in tiny object detection in noisy environments than other pixel-level algorithms. In particular, the performance of existing deep learning-based object detection algorithms can be significantly improved by taking the results of HDetect-VS as input.

IDP-YOLOV9: Improvement of Object Detection Model in Severe Weather Scenarios from Drone Perspective

Despite their proficiency with typical environmental datasets, deep learning-based object detection algorithms struggle when faced with diverse adverse weather conditions. Moreover, existing methods often address single adverse weather scenarios, neglecting situations involving multiple concurrent adverse conditions. To tackle these challenges, we propose an enhanced approach to object detection in power construction sites under various adverse weather conditions, dubbed IDP-YOLOV9. This model leverages a parallel architecture comprising the Image Dehazing and Enhancement Processing (IDP) module and an improved YOLOV9 object detection module. Specifically, for images captured in adverse weather, our approach employs a parallel architecture that includes the Three-Weather Removal Algorithm (TRA) module and the Deep Learning-based Image Enhancement (DLIE) module, which, together, filter multiple weather factors to enhance image quality. Subsequently, we introduce an improved YOLOV9 detection network module that incorporates a three-layer routing attention mechanism for object detection. Experiments demonstrate that the IDP module significantly improves image quality by mitigating the impact of various adverse weather conditions. Compared to traditional single-processing models, our method improves recognition accuracy on complex weather datasets by 6.8% in terms of mean average precision (mAP50).

Estimation of the amount of pear pollen based on flowering stage detection using deep learning

Pear pollination is performed by artificial pollination because the pollination rate through insect pollination is not stable. Pollen must be collected to secure sufficient pollen for artificial pollination. However, recently, collecting sufficient amounts of pollen in Japan has become difficult, resulting in increased imports from overseas. To solve this problem, improving the efficiency of pollen collection and strengthening the domestic supply and demand system is necessary. In this study, we proposed an Artificial Intelligence (AI)-based method to estimate the amount of pear pollen. The proposed method used a deep learning-based object detection algorithm, You Only Look Once (YOLO), to classify and detect flower shapes in five stages, from bud to flowering, and to estimate the pollen amount. In this study, the performance of the proposed method was discussed by analyzing the accuracy and error of classification for multiple flower varieties. Although this study only discussed the performance of estimating the amount of pollen collected, in the future, we aim to establish a technique for estimating the time of maximum pollen collection using the method proposed in this study.

An Advanced Approach to Object Detection and Tracking in Robotics and Autonomous Vehicles Using YOLOv8 and LiDAR Data Fusion

Accurately and reliably perceiving the environment is a major challenge in autonomous driving and robotics research. Traditional vision-based methods often suffer from varying lighting conditions, occlusions, and complex environments. This paper addresses these challenges by combining a deep learning-based object detection algorithm, YOLOv8, with LiDAR data fusion technology. The principle of this combination is to merge the advantages of these technologies: YOLOv8 excels in real-time object detection and classification through RGB images, while LiDAR provides accurate distance measurement and 3D spatial information, regardless of lighting conditions. The integration aims to apply the high accuracy and robustness of YOLOv8 in identifying and classifying objects, as well as the depth data provided by LiDAR. This combination enhances the overall environmental perception, which is critical for the reliability and safety of autonomous systems. However, this fusion brings some research challenges, including data calibration between different sensors, filtering ground points from LiDAR point clouds, and managing the computational complexity of processing large datasets. This paper presents a comprehensive approach to address these challenges. Firstly, a simple algorithm is introduced to filter out ground points from LiDAR point clouds, which are essential for accurate object detection, by setting different threshold heights based on the terrain. Secondly, YOLOv8, trained on a customized dataset, is utilized for object detection in images, generating 2D bounding boxes around detected objects. Thirdly, a calibration algorithm is developed to transform 3D LiDAR coordinates to image pixel coordinates, which are vital for correlating LiDAR data with image-based object detection results. Fourthly, a method for clustering different objects based on the fused data is proposed, followed by an object tracking algorithm to compute the 3D poses of objects and their relative distances from a robot. The Agilex Scout Mini robot, equipped with Velodyne 16-channel LiDAR and an Intel D435 camera, is employed for data collection and experimentation. Finally, the experimental results validate the effectiveness of the proposed algorithms and methods.

Enhanced object detection in pediatric bronchoscopy images using YOLO-based algorithms with CBAM attention mechanism

Background and ObjectiveBronchoscopy is a widely used diagnostic and therapeutic procedure for respiratory disorders such as infections and tumors. However, visualizing the bronchial tubes and lungs can be challenging due to the presence of various objects, such as mucus, blood, and foreign bodies. Accurately identifying the anatomical location of the bronchi can be quite challenging, especially for medical professionals who are new to the field. Deep learning-based object detection algorithms can assist doctors in analyzing images or videos of the bronchial tubes to identify key features such as the epiglottis, vocal cord, and right basal bronchus. This study aims to improve the accuracy of object detection in bronchoscopy images by integrating a YOLO-based algorithm with a CBAM attention mechanism. MethodsThe CBAM attention module is implemented in the YOLO-V7 and YOLO-V8 object detection models to improve their object identification and classification capabilities in bronchoscopy images. Various YOLO-based object detection algorithms, such as YOLO-V5, YOLO-V7, and YOLO-V8 are compared on this dataset. Experiments are conducted to evaluate the performance of the proposed method and different algorithms. ResultsThe proposed method significantly improves the accuracy and reliability of object detection for bronchoscopy images. This approach demonstrates the potential benefits of incorporating an attention mechanism in medical imaging and the benefits of utilizing object detection algorithms in bronchoscopy. In the experiments, the YOLO-V8-based model achieved a mean Average Precision (mAP) of 87.09% on the given dataset with an Intersection over Union (IoU) threshold of 0.5. After incorporating the Convolutional Block Attention Module (CBAM) into the YOLO-V8 architecture, the proposed method achieved a significantly enhanced mAP0.5 and mAP0.5:0.95 of 88.27% and 55.39%, respectively. ConclusionsOur findings indicate that by incorporating a CBAM attention mechanism with a YOLO-based algorithm, there is a noticeable improvement in object detection performance in bronchoscopy images. This study provides valuable insights into enhancing the performance of attention mechanisms for object detection in medical imaging.

Improved PAA algorithm for breast mass detection in mammograms

Mammography screening is instrumental in the early detection and diagnosis of breast cancer by identifying masses in mammograms. With the rapid development of deep learning, numerous deep learning-based object detection algorithms have been explored for mass detection studies. However, these methods often yield a high false positive rate per image (FPPI) while achieving a high true positive rate (TPR). To maintain a higher TPR while also ensuring lower FPPI, we improved the Probability Anchor Assignment (PAA) algorithm to enhance the detection capability for mammographic characteristics with our previous work. We considered three dimensions: the backbone network, feature fusion module, and dense detection heads. The final experiment showed the effectiveness of the proposed method, and the TPR/FPPI values of the final improved PAA algorithm were 0.96/0.56 on the INbreast datasets. Compared to other methods, our method stands distinguished with its effectiveness in addressing the imbalance between positive and negative classes in cases of single lesion detection.

Development of an AI-based image/ultrasonic convergence camera system for accurate gas leak detection in petrochemical plants

Outdoor pipeline leaks are difficult to accurately measure using existing concentration measurement systems installed in petrochemical plants owing to external air currents. Besides, leak detection is only possible for a specific gas. The purpose of this study was to develop an image/ultrasonic convergence camera system that incorporates artificial intelligence (AI) to improve pipe leak detection and establish a real-time monitoring system. Our system includes an advanced ultrasonic camera coupled with a deep learning-based object-detection algorithm trained on pipe image data from petrochemical plants. The collected data improved the accuracy of detected gas leak localization through deep learning. Our detection model achieves an mAP50 (Mean average precision calculated at an intersection over union (IoU) threshold of 0.50)score of 0.45 on our data and is able to detect the majority of leak points within a system. The petrochemical plant environment was simulated by visiting petrochemical plants and reviewing drawings, and an outdoor experimental demonstration site was established. Scenarios such as flange connection failure were set under medium-/low-pressure conditions, and the developed product was experimented under gas leak conditions that simulated leakage accidents. These experiments enabled the removal of potentially confounding surrounding noise sources, which led to the false detection of actual gas leaks using the AI piping detection technique.

Performance analysis of deep learning-based object detection algorithms on COCO benchmark: a comparative study

This paper thoroughly explores the role of object detection in smart cities, specifically focusing on advancements in deep learning-based methods. Deep learning models gain popularity for their autonomous feature learning, surpassing traditional approaches. Despite progress, challenges remain, such as achieving high accuracy in urban scenes and meeting real-time requirements. The study aims to contribute by analyzing state-of-the-art deep learning algorithms, identifying accurate models for smart cities, and evaluating real-time performance using the Average Precision at Medium Intersection over Union (IoU) metric. The reported results showcase various algorithms’ performance, with Dynamic Head (DyHead) emerging as the top scorer, excelling in accurately localizing and classifying objects. Its high precision and recall at medium IoU thresholds signify robustness. The paper suggests considering the mean Average Precision (mAP) metric for a comprehensive evaluation across IoU thresholds, if available. Despite this, DyHead stands out as the superior algorithm, particularly at medium IoU thresholds, making it suitable for precise object detection in smart city applications. The performance analysis using Average Precision at Medium IoU is reinforced by the Average Precision at Low IoU (APL), consistently depicting DyHead’s superiority. These findings provide valuable insights for researchers and practitioners, guiding them toward employing DyHead for tasks prioritizing accurate object localization and classification in smart cities. Overall, the paper navigates through the complexities of object detection in urban environments, presenting DyHead as a leading solution with robust performance metrics.

Deep Learning for Midfacial Fracture Detection in CT Images.

This study deploys the deep learning-based object detection algorithms to detect midfacial fractures in computed tomography (CT) images. The object detection models were created using faster R-CNN and RetinaNet from 2,000 CT images. The best detection model, faster R-CNN, yielded an average precision of 0.79 and an area under the curve (AUC) of 0.80. In conclusion, faster R-CNN model has good potential for detecting midfacial fractures in CT images.

Performance Analysis of YOLO Architectures for Surgical Waste Detection in Post-COVID-19 Medical Waste Management

In the wake of the COVID-19 outbreak, there has been a dramatic uptick in the need for efficient medical waste management, making it imperative that more surgical waste management systems are developed. Used surgical masks and gloves are examples of potentially infectious materials that are the subject of this research. By utilizing its real-time object detection capabilities, the You Only Look Once (YOLO) deep learning-based object detection algorithm is used to identify surgical waste. Using the MSG dataset, a deep dive into the performance of three different YOLO architectures (YOLOv5, YOLOv7, and YOLOv8) was undertaken. According to the findings, YOLOv5-s, YOLOv7-x, and YOLOv8-m all perform exceptionally well when it comes to identifying surgical waste. YOLOv8-m was the best model, with a mAP of 82.4%, among these three. To mitigate post-COVID-19 infection risks and improve waste management efficiency, these results can be used to the creation of automated systems for medical waste sorting.

A deep learning approach for object detection of rockfish in challenging underwater environments

IntroductionPreserving the marine ecological environment and safeguarding marine species is a global priority. However, human overfishing has led to a drastic decline in fish species with longer growth cycles, disrupting the equilibrium of the marine ecosystem. To address this issue, researchers are turning to deep learning techniques and state-of-the-art underwater devices, such as underwater robots, to explore the aquatic environment and monitor the activities of endangered populations. This approach has emerged as a focal point of recent research in protecting the marine ecological environment. This study employs a deep learning-based object detection algorithm to identify fish species in complex underwater environments.MethodsThe algorithm is built upon the You Only Look Once version 7(YOLOv7) algorithm, with the addition of the attention mechanism Convolutional Block Attention Module (CBAM) in the network’s backbone. CBAM enhances the feature maps through the fusion of spatial attention and channel attention, ultimately improving the robustness and accuracy of the model’s inference by replacing the original loss function CIoU with SCYLLAIntersection over Union(SIoU). In this paper, the rockfish pictures in the dataset Label Fishes in the Wild published by the National Marine Fisheries Service are selected, and the underwater image enhancement model (UWCNN) is introduced to process the pictures.ResultThe experimental results show that the mean average precision (mAP) value of the improved model on the test set is 94.4%, which is 3.5% higher than the original YOLOv7 model, and the precision and recall rate are 99.1% and 99%, respectively. The detection performance of the algorithm in the field of complex underwater environment is improved.DiscussionThe underwater fish detection scheme proposed in this study holds significant practical value and significance in promoting the conservation of marine ecosystems and the protection of fish species.

Deep-Learning-Based Anti-Collision System for Construction Equipment Operators

Due to the dynamic environment of construction sites, worker collisions and stray accidents caused by heavy equipment are constantly occurring. In this study, a deep learning-based anti-collision system was developed to improve the existing proximity warning systems and to monitor the surroundings in real time. The technology proposed in this paper consists of an AI monitor, an image collection camera, and an alarm device. The AI monitor has a built-in object detection algorithm, automatically detects the operator from the image input from the camera, and notifies the operator of a danger warning. The deep learning-based object detection algorithm was trained with an image data set composed of a total of 42,620 newly constructed in this study. The proposed technology was installed on an excavator, which is the main equipment operated at the construction site, and performance tests were performed, and it showed the potential to effectively prevent collision accidents.

Microorganism Detection in Activated Sludge Microscopic Images Using Improved YOLO

Wastewater has detrimental effects on the natural environment. The activated sludge method, a widely adopted approach for wastewater treatment, has proven highly effective. Within this process, microorganisms play a pivotal role, necessitating continuous monitoring of their quantity and diversity. Conventional methods, such as microscopic observation, are time-consuming. With the widespread integration of computer vision technologies into object detection, deep learning-based object detection algorithms, notably the You Only Look Once (YOLO) model, have garnered substantial interest for their speed and precision in detection tasks. In this research, we applied the YOLO model to detect microorganisms in microscopic images of activated sludge. Furthermore, addressing the irregular shapes of microorganisms, we developed an improved YOLO model by incorporating deformable convolutional networks and an attention mechanism to enhance its detection capabilities. We conducted training and testing using a custom dataset comprising five distinct objects. The performance evaluations used in this study utilized metrics such as the mean average precision at intersections over a union threshold of 0.5 (mAP@0.5), with the improved YOLO model achieving a mAP@0.5 value of 93.7%, signifying a 4.3% improvement over the YOLOv5 model. Comparative analysis of the improved YOLO model and other object detection algorithms on the same dataset revealed a higher accuracy for the improved YOLO model. These results demonstrate the superior performance of the improved YOLO model in the task of detecting microorganisms in activated sludge, providing an effective auxiliary method for wastewater treatment monitoring.

Shine: A deep learning-based accessible parking management system

The ongoing expansion of urban areas facilitated by advancements in science and technology has resulted in a considerable increase in the number of privately owned vehicles worldwide, including in South Korea. However, this gradual increment in the number of vehicles has inevitably led to parking-related issues, including the abuse of disabled parking spaces (hereafter referred to as accessible parking spaces) designated for individuals with disabilities. Traditional license plate recognition (LPR) systems have proven inefficient in addressing such a problem in real-time due to the high frame rate of surveillance cameras, the presence of natural and artificial noise, and variations in lighting and weather conditions that impede detection and recognition by these systems. With the growing concept of parking 4.0, many sensors, IoT and deep learning-based approaches have been applied to automatic LPR and parking management systems. Nonetheless, the studies show a need for a robust and efficient model for managing accessible parking spaces in South Korea. To address this, we have proposed a novel system called, ‘Shine’, which uses the deep learning-based object detection algorithm for detecting the vehicle, license plate, and disability badges (referred to as cards, badges, or access badges hereafter) and verifies the rights of the driver to use accessible parking spaces by coordinating with the central server. Our model, which achieves a mean average precision of 92.16%, is expected to address the issue of accessible parking space abuse and contributes significantly towards efficient and effective parking management in urban environments.

Autonomous dental treatment planning on panoramic x-ray using deep learning based object detection algorithm

Autonomous dental treatment planning on panoramic x-ray using deep learning based object detection algorithm