You Only Look Once Research Articles

Evaluasi Trade-off Akurasi dan Kecepatan YOLOv5 dalam Deteksi Kebakaran pada Edge Devices

Real-time object detection using the YOLO (You Only Look Once) algorithm has shown promising performance in various computer vision applications. However, its application on devices with limited resources is still a challenge due to its high computational requirements. This study aims to optimize the YOLOv5 model for fire and smoke detection on Orange Pi Zero 3 devices using quantization techniques. Using a dataset of 2247 fire and smoke images, this study applies static quantization techniques to improve model efficiency. The methodology includes training of standard YOLOv5 models, conversion to ONNX format, and application of static quantization. Results show a significant improvement in computational efficiency, with a 42.2% reduction in model size and a 65.21% increase in inference speed. Despite a decrease in the mAP value by 25.6%, the optimized model was still able to perform object detection at a significantly higher speed. In conclusion, the quantization technique is effective in optimizing the YOLOv5 model for deployment on edge computing devices, despite the trade-off between speed and accuracy.

Traffic Sign Detection under Foggy Conditions using Machine Learning

Traffic sign detection is crucial for enhancing road safety, especially under adverse weather conditions like fog. This paper explores the challenges of detecting traffic signs in fog and presents an approach that incorporates dehazing techniques to improve detection accuracy. We implement a combination of YOLO (You Only Look Once) and HOG (Histogram of Oriented Gradients) algorithms, evaluating their performance on various datasets. Our findings indicate a significant improvement in detection rates under foggy conditions, suggesting that integrating dehazing techniques can enhance visibility and road safety.

Comparative Analysis of Object Detection Models for Sheet Music Recognition: A Focus on YOLO and OMR Technologies

Abstract. As Artificial Intelligence (AI) technologies are developing rapidly and are widely used in various domains, it is efficient and convenient for composers to make music using AI to convert sheet music to audio. This research aims to compare the performance of different models in identifying individual notes within sheet music. Compared to traditional technologies like Optical Music Recognition (OMR), deep learning models have a significant advantage in processing blurry images with high efficiency. In the research process, three different models are used in searching for musical notes: OMR, You Only Look Once (YOLO)v5, and YOLOv8. The evaluation index consists of recognition accuracy, mean Average Precision (mAP), inference speed, and parameter quantity. After the experiment, it is found that the YOLO model performs best with high accuracy and fast speed. Based on the above analyses, the thesis finds that the YOLO model can be an efficient tool in composing music, with further research.

Application of machine learning for detecting and tracking turbulent structures in plasma fusion devices using ultra fast imaging.

This study explores the application of machine learning techniques for detecting and tracking plasma filaments around the boundary of magnetically confined tokamak plasmas. Plasma filaments, also called blobs, are responsible for enhanced turbulent transport across magnetic field lines, and their accurate characterization is crucial for optimizing the performance of magnetic fusion devices. We present a novel approach that combines machine learning methods applied to data obtained from ultra-fast cameras, including YOLO (You Only Look Once) for object detection, semantic segmentation, and specific tracking methods. This approach enables fast and accurate detection and tracking of filaments while overcoming the limitations of conventional methods, which are time-consuming and prone to human subjectivity. A significant advance in our study lies in the development of a method for automatically labeling a large batch of data, which greatly facilitates the training of supervised machine learning algorithms. Using these techniques, we obtained promising results demonstrating a significant improvement over conventional tracking methods, achieving a detection accuracy of up to 98.8%, while reducing the inference time per frame by 15% to 31% compared to conventional Kalman filter tracking. These results open up new perspectives for investigating turbulent phenomena in tokamaks, and could have important implications for the development of controlled nuclear fusion.

Vision Aid: Developing An Assistive Mobile Application for Visually Impaired Indivuals

Vision Aid is a cutting edge smartphone software that combines several assistive technologies into a unified platform to help visually impaired individuals. Integrating Computer Vision algorithms this project makes use of Bing Maps API for Step by Step navigation, Tesseract OCR for text recognition, YOLO (You Only Look Once) for real time object detection and CLIP (Contrastive Language-Image Pre training) for scene description. It offers voice commands, audio feedback for a more improved day to day life hence improving self-confidence while empowering independence to the users. This journal provides a thorough description of Vision Aid the development process, methodology, evaluation results and shows the potential for future improvements with a goal to advance mobile accessibility for visually impaired individuals

Mixed Reality-Based Concrete Crack Detection and Skeleton Extraction Using Deep Learning and Image Processing

Advancements in image processing and deep learning offer considerable opportunities for automated defect assessment in civil structures. However, these systems cannot work interactively with human inspectors. Mixed reality (MR) can be adopted to address this by involving inspectors in various stages of the assessment process. This paper integrates You Only Look Once (YOLO) v5n and YOLO v5m with the Canny algorithm for real-time concrete crack detection and skeleton extraction with a Microsoft HoloLens 2 MR device. The YOLO v5n demonstrates a superior mean average precision (mAP) 0.5 and speed, while YOLO v5m achieves the highest mAP 0.5 0.95 among the other YOLO v5 structures. The Canny algorithm also outperforms the Sobel and Prewitt edge detectors with the highest F1 score. The developed MR-based system could not only be employed for real-time defect assessment but also be utilized for the automatic recording of the location and other specifications of the cracks for further analysis and future re-inspections.

Comparison of CNN-Based Architectures for Detection of Different Object Classes

(1) Background: Detecting people and technical objects in various situations, such as natural disasters and warfare, is critical to search and rescue operations and the safety of civilians. A fast and accurate detection of people and equipment can significantly increase the effectiveness of search and rescue missions and provide timely assistance to people. Computer vision and deep learning technologies play a key role in detecting the required objects due to their ability to analyze big volumes of visual data in real-time. (2) Methods: The performance of the neural networks such as You Only Look Once (YOLO) v4-v8, Faster R-CNN, Single Shot MultiBox Detector (SSD), and EfficientDet has been analyzed using COCO2017, SARD, SeaDronesSee, and VisDrone2019 datasets. The main metrics for comparison were mAP, Precision, Recall, F1-Score, and the ability of the neural network to work in real-time. (3) Results: The most important metrics for evaluating the efficiency and performance of models for a given task are accuracy (mAP), F1-Score, and processing speed (FPS). These metrics allow us to evaluate both the accuracy of object recognition and the ability to use the models in real-world environments where high processing speed is important. (4) Conclusion: Although different neural networks perform better on certain types of metrics, YOLO outperforms them on all metrics, showing the best results of mAP-0.88, F1-0.88, and FPS-48, so the focus was on these models.

Analyzing spatiotemporal features of Suzhou's old canal city: an optimized composite space syntax model based on multifaceted historical-modern data

AbstractRivers and road systems play crucial roles in urban development and in shaping the vitality of cities. The present study focuses on the spatiotemporal development patterns of canal cities. Taking Suzhou as an example, employing various spatial measurement methods combined with multidimensional spatiotemporal data, it clearly demonstrates the urban morphological patterns and societal characteristics related to the road and river network systems at different stages of urban development. Utilizing data extracted from historical and modern maps of Suzhou and employing the YOLO (You Only Look Once) algorithm, this study establishes a spatiotemporal dataset for Suzhou's ancient city, a representative Chinese canal city. An optimized space syntax algorithm for public service facilities, utilizing Python library like Geopandas, Numpy, is proposed to analyze the river and road system's impact on historical development and urban morphology. With multiple spatial econometric models applied to maps from various periods, this research explores the following findings: (1) By controlling rivers as a variable, it quantitatively confirms that rivers were crucial components of urban systems in ancient cities, playing a significant role in urban development and activities, though gradually overlooked in modern times. (2) Public service facilities of different types demonstrate patterns of Accessibility and Integration within the river-road system across various periods. (3) Changes in the distribution of public service facilities correspond to phased shifts in the center of Suzhou’s ancient city, mutually validating the authenticity of realistic paintings, historical maps, and the methodologies used in this study. This study emphasizes a broader historical and spatiotemporal perspective, augmented by quantitative research methods. It investigates the distribution and developmental characteristics of various types of public service facilities across different periods. The research aim is to understand the impact of river and road systems on urban development, as well as the morphological and social changes in historical cities that arise from urban activities.

AI-Based Object Detection, Distance Measurement and Speaking System for Blind Stick

The sense of sight is fundamental to how humans perceive and navigate their surroundings. For visually impaired individuals, this lack of vision creates significant challenges in detecting obstacles and measuring distances, making daily navigation difficult and potentially dangerous. In response to this problem, we propose an AI-based object detection, distance measurement, and speaking system integrated with a blind stick to enhance mobility and independence for the visually impaired. This system leverages cutting-edge artificial intelligence and image processing techniques to provide real-time object detection and distance measurement. By combining ultrasonic sensors with an AI-powered object recognition module, the system accurately identifies obstacles and calculates their distance, offering directional audio feedback to the user. Designed to be compact and user-friendly, the blind stick system provides seamless assistance in both indoor and outdoor environments. The object detection process utilizes advanced algorithms like YOLO (You Only Look Once) to identify obstacles. Distance measurement is performed using ultrasonic sensors to ensure accurate proximity readings. When an obstacle is detected, the system provides immediate auditory feedback, alerting users to the direction and distance of the object. The Google Maps API enhances usability by offering location awareness and route planning, empowering users to navigate with confidence. This AI-based blind stick system aims to improve the mobility and safety of visually impaired individuals, offering a more autonomous experience in their daily lives.

Experimental identification of ion cyclotron emission on HL-2A using YOLO neural network algorithm

Abstract Identification of magnetohydrodynamics (MHD) instabilities with neural networks has been extensively applied in the research of magnetically controlled fusion plasmas. Ion Cyclotron Emission (ICE) is a potential fast ion diagnostic method in burning plasmas. To assess ICE as a fast ion diagnostic for International Thermonuclear Experimental Reactor, real-time identification of ICE is required in the fast ion diagnostic flow. In the present work, we employed YOLO (You Only Look Once) to identify core and edge ICE in a large labeled database of HL-2A discharges, achieving a precision of 85.4% and a recall rate of 77.3%. Subsequent improvements to the YOLO model resulted in a noteworthy 8.3% increment in the recall rate. The developed identification method demonstrates significant potential for real-time application in identifying MHD instabilities.

On the use of synthetic data for body detection in maritime search and rescue operations

Time is a critical factor in maritime Search And Rescue (SAR) missions, during which promptly locating survivors is paramount. Unmanned Aerial Vehicles (UAVs) are a useful tool with which to increase the success rate by rapidly identifying targets. While this task can be performed using other means, such as helicopters, the cost-effectiveness of UAVs makes them an effective choice. Moreover, these vehicles allow the easy integration of automatic systems that can be used to assist in the search process. Despite the impact of artificial intelligence on autonomous technology, there are still two major drawbacks to overcome: the need for sufficient training data to cover the wide variability of scenes that a UAV may encounter and the strong dependence of the generated models on the specific characteristics of the training samples. In this work, we address these challenges by proposing a novel approach that leverages computer-generated synthetic data alongside novel modifications to the You Only Look Once (YOLO) architecture that enhance its robustness, adaptability to new environments, and accuracy in detecting small targets. Our method introduces a new patch-sample extraction technique and task-specific data augmentation, ensuring robust performance across diverse weather conditions. The results demonstrate our proposal’s superiority, showing an average 28% relative improvement in mean Average Precision (mAP) over the best-performing state-of-the-art baseline under training conditions with sufficient real data, and a remarkable 218% improvement when real data is limited. The proposal also presents a favorable balance between efficiency, effectiveness, and resource requirements.

Research on the Forward Simulation and Intelligent Detection of Defects in Highways Using Ground-Penetrating Radar

The increasing variety and frequency of subgrade defects in operational highways have led to a rise in road safety incidents. This study employed ground-penetrating radar (GPR) detection and forward simulation to analyze the characteristic patterns of common subgrade defects, such as looseness, voids, and cavities. Through the integration of instantaneous feature information from different defect patterns with complex signal techniques, the boundary judgment of structural layers and anomalies in GPR images of various subgrade defects was improved. An intelligent recognition platform was established, and a radar image dataset was created and trained to evaluate the recognition performance of the You Only Look Once (YOLO) v3 and Single-Shot Multi-Box Detector (SSD) algorithms. Evaluation metrics such as precision, recall, F1-score, average precision (AP), and mean average precision (mAP) were used to assess the detection efficiency and accuracy for subgrade defect images. The results showed that YOLO v3 achieved an average detection accuracy of 76.69%, while the SSD achieved 75.07%. This study demonstrates that the reliability of the intelligent recognition and classification of highway subgrade defects can be enhanced by using GPR for non-destructive testing.

Evaluation of YOLO Efficiency in Automatic Orange Detection in Multi-Exposure Images

Abstract. Brazil is the largest producer of oranges in the world and the automatic detection of fruits has been a challenging task in the context of remote sensing, due to variations in fruit appearance, changes in lighting and occlusions of foliage and neighboring fruits. In this sense, this paper focus on the detection of oranges in multispectral images, with different spectral bands and exposures, using a convolutional neural network (CNN) known as YOU ONLY LOOK ONCE (YOLO). The results indicate that, after 300 epochs, the model demonstrated an accuracy of 81.5% and an approximate recovery rate of 85%. Shutter speeds 1/640s and 1/250s are not suitable for detection due to low light and overexposure, respectively. Intermediate values may be more suitable for identifying a larger number of fruits.

Acoustic Imaging Learning-Based Approaches for Marine Litter Detection and Classification

This paper introduces an advanced acoustic imaging system leveraging multibeam water column data at various frequencies to detect and classify marine litter. This study encompasses (i) the acquisition of test tank data for diverse types of marine litter at multiple acoustic frequencies; (ii) the creation of a comprehensive acoustic image dataset with meticulous labelling and formatting; (iii) the implementation of sophisticated classification algorithms, namely support vector machine (SVM) and convolutional neural network (CNN), alongside cutting-edge detection algorithms based on transfer learning, including single-shot multibox detector (SSD) and You Only Look once (YOLO), specifically YOLOv8. The findings reveal discrimination between different classes of marine litter across the implemented algorithms for both detection and classification. Furthermore, cross-frequency studies were conducted to assess model generalisation, evaluating the performance of models trained on one acoustic frequency when tested with acoustic images based on different frequencies. This approach underscores the potential of multibeam data in the detection and classification of marine litter in the water column, paving the way for developing novel research methods in real-life environments.

The docking control system of an autonomous underwater vehicle combining intelligent object recognition and deep reinforcement learning

This study develops a visual-based docking system (VDS) for an autonomous underwater vehicle (AUV), significantly enhancing docking performance by integrating intelligent object recognition and deep reinforcement learning (DRL). The system overcomes traditional navigation limitations in complex and unpredictable environments by using a variable information dock (VID) for precise multi-sensor docking recognition in the AUV. Employing image-based visual servoing (IBVS) technology, the VDS efficiently converts 2D visual data into accurate 3D motion control commands. It integrates the YOLO (short for You Only Look Once) algorithm for object recognition and the deep deterministic policy gradient (DDPG) algorithm, improving continuous motion control, docking accuracy, and adaptability. Experimental validation at the National Cheng Kung University towing tank demonstrates that the VDS enhances control stability and operational reliability, reducing the mean absolute error (MAE) in depth control by 42.03% and pitch control by 98.02% compared to the previous method. These results confirm the VDS's reliability and its potential for transforming AUV docking.

Autonomous Drone Navigation Using Computer Vision

Abstract: Autonomous drone navigation with computer vision is an innovative technology that allows drones to move through intricate surroundings without needing human control. This system uses live visual information to identify objects, steer clear of obstacles, and determine routes, improving operational safety and precision. The project's main objective is to create a visionbased navigation system that combines object detection and obstacle avoidance algorithms through deep learning methods like YOLO (You Only Look Once), alongside real-time sensor fusion. The drone uses computer vision algorithms to process aerial images and automatically changes its flight path to prevent crashes. A personalized dataset of aerial images is generated and utilized for improving object detection skills in various environments. In order to guarantee practicality in real- world situations, the system undergoes validation through simulations and field tests on different terrains, focusing on its resilience in changing environments. Improvements in navigation accuracy and obstacle detection are accomplished by implementing adaptive pathplanning and integrating multiple sensors, guaranteeing the drone's efficient operation in real-life situations. The goal of this method is to enhance the drone's ability to make decisions, minimize human mistakes, and expand its range of potential uses in areas like surveillance, agriculture, and disaster response

LCGSC-YOLO: a lightweight apple leaf diseases detection method based on LCNet and GSConv module under YOLO framework.

In response to the current mainstream deep learning detection methods with a large number of learned parameters and the complexity of apple leaf disease scenarios, the paper proposes a lightweight method and names it LCGSC-YOLO. This method is based on the LCNet(A Lightweight CPU Convolutional Neural Network) and GSConv(Group Shuffle Convolution) module modified YOLO(You Only Look Once) framework. Firstly, the lightweight LCNet is utilized to reconstruct the backbone network, with the purpose of reducing the number of parameters and computations of the model. Secondly, the GSConv module and the VOVGSCSP (Slim-neck by GSConv) module are introduced in the neck network, which makes it possible to minimize the number of model parameters and computations while guaranteeing the fusion capability among the different feature layers. Finally, coordinate attention is embedded in the tail of the backbone and after each VOVGSCSP module to improve the problem of detection accuracy degradation issue caused by model lightweighting. The experimental results show the LCGSC-YOLO can achieve an excellent detection performance with mean average precision of 95.5% and detection speed of 53 frames per second (FPS) on the mixed datasets of Plant Pathology 2021 (FGVC8) and AppleLeaf9. The number of parameters and Floating Point Operations (FLOPs) of the LCGSC-YOLO are much less thanother related comparative experimental algorithms.

Comparison of deep learning-based models for detection of diseased trees using an image compression algorithm

The object of the research is the application of deep learning algorithms using an improved mathematical lossless image compression method for recognizing and identifying dead trees in aerospace images. The main problem that has been solved is the archiving of images due to their large volume on disk and the possibility of their further processing by deep learning methods such as convolutional and capsule neural networks, which have shown high efficiency and accuracy in image recognition and classification tasks using the proposed new image compression method. The article presents a comparative analysis of the performance of three YOLO (You Only Look Once) models with different types of architectures, such as YOLOv5, YOLOv7 and YOLOv8, to assess the effectiveness of their work for the task of recognizing aerospace tree images obtained from satellites, drones, and aircrafts. Comprehensive analysis of YOLO models presents that model YOLO v8 turned out to be most effective with a positive accuracy of 88.2 %, a recall of 77.4 %, and a mAP50 score of 87.2 %. Moreover, the average detection time was only 0.052 seconds for each image, even though the model size remains very small – 21.5 MB. These results suggest a much better usage of time and precise identification of dead trees, and classified targets with high efficiency. From the research, there is significant prospects of global forest management especially on forest reduction and protection of ecosystems through accurate assessment on the health of forestry. The proposed approach is universal and can be used in real life conditions, providing a good compromise of the speed, accuracy and resources required for forest monitoring and management

Comparative analysis of hybrid cognitive radar techniques for enhanced target detection and tracking: A performance evaluation perspective

This paper introduces an innovative hybrid algorithmic approach for cognitive radar systems, by integrating unique machine learning optimization techniques such as, YOLO (You Only Look Once), Mask R-CNN, and Recurrent Neural Networks (RNNs). Through extensive simulations, the integrated approach demonstrates notable enhancements in target detection, instance segmentation, and target tracking within radar systems. Leveraging deep learning models, the framework facilitates adaptive and intelligent processing of radar data, augmenting system performance in dynamic environments. By seamlessly integrating state-of-the-art techniques, the proposed framework showcases a comprehensive solution to the challenges faced by traditional radar systems. This research represents a significant stride forward in radar technology, promising transformative impacts across various domains, including surveillance, remote sensing, and autonomous navigation. As radar systems continue to evolve, the adoption of advanced deep learning techniques offers unprecedented opportunities for enhancing situational awareness and decision-making capabilities in complex operational scenarios.

Automated Surface Crack Identification of Reinforced Concrete Members Using an Improved YOLOv4-Tiny-Based Crack Detection Model

In recent times, the deployment of advanced structural health monitoring techniques has increased due to the aging infrastructural elements. This paper employed an enhanced You Only Look Once (YOLO) v4-tiny algorithm, based on the Crack Detection Model (CDM), to accurately identify and classify crack types in reinforced concrete (RC) members. YOLOv4-tiny is faster and more efficient than its predecessors, offering real-time detection with reduced computational complexity. Despite its smaller size, it maintains competitive accuracy, making it ideal for applications requiring high-speed processing on resource-limited devices. First, an extensive experimental program was conducted by testing full-scale RC members under different shear span (a) to depth ratios to achieve flexural and shear dominant failure modes. The digital images captured from the failure of RC beams were analyzed using the CDM of the YOLOv4-tiny algorithm. Results reveal the accurate identification of cracks formed along the depth of the beam at different stages of loading. Moreover, the confidence score attained for all the test samples was more than 95%, which indicates the accuracy of the developed model in capturing the types of cracks in the RC beam. The outcomes of the proposed work encourage the use of a developed CDM algorithm in real-time crack detection analysis of critical infrastructural elements.