Object Detection Algorithm Research Articles

Deep Learning Approaches for Water-body Detection from Satellite Imagery

Agriculture department of Government of India provides funds for digging wells and making farm ponds for improving farmers livelihood. The proper execution of the policies not been worked out due to the manual process. For the automation of the process, we are using the object detection algorithm Faster Region-based Convolutional Neural Network (F-RCNN) to detect the location of the wells and Farm ponds. The faster RCNN method introduced region of interest to improve the model speed. We have tried to address water body detection on satellite imagery with an AI approach to cross verify the utilization of funds is the challenge. The traditional object detection algorithms are low in accuracy, also uses coco image data set. Detecting water body has not been addressed by anybody. We have extended the algorithms for water bodies detection for the complete geographic region of agricultural land. Improved Faster R-CNN algorithm used in the detection of wells and farm ponds. More than 1000 Satellite imagery are used to train the model to detect the water body. The experimental results demonstrated promising accuracy on well and farm ponds detection. The accuracy of the faster RCNN algorithm is 90%, we have tested the accuracy of the results by GIS locations, and ground-truthing is achieved by our designed Android App.This app gives the latitude and longitude of well or farm ponds entered by the person in Jalgaon. Keywords : About four key words or phrases in alphabetical order, separated by commas.

3D Camera and Single-Point Laser Sensor Integration for Apple Localization in Spindle-Type Orchard Systems.

Accurate localization of apples is the key factor that determines a successful harvesting cycle in the automation of apple harvesting for unmanned operations. In this regard, accurate depth sensing or positional information of apples is required for harvesting apples based on robotic systems, which is challenging in outdoor environments because of uneven light variations when using 3D cameras for the localization of apples. Therefore, this research attempted to overcome the effect of light variations for the 3D cameras during outdoor apple harvesting operations. Thus, integrated single-point laser sensors for the localization of apples using a state-of-the-art model, the EfficientDet object detection algorithm with an mAP@0.5 of 0.775 were used in this study. In the experiments, a RealSense D455f RGB-D camera was integrated with a single-point laser ranging sensor utilized to obtain precise apple localization coordinates for implementation in a harvesting robot. The single-point laser range sensor was attached to two servo motors capable of moving the center position of the detected apples based on the detection ID generated by the DeepSORT (online real-time tracking) algorithm. The experiments were conducted under indoor and outdoor conditions in a spindle-type apple orchard artificial architecture by mounting the combined sensor system behind a four-wheel tractor. The localization coordinates were compared between the RGB-D camera depth values and the combined sensor system under different light conditions. The results show that the root-mean-square error (RMSE) values of the RGB-D camera depth and integrated sensor mechanism varied from 3.91 to 8.36 cm and from 1.62 to 2.13 cm under 476~600 lx to 1023~1100 × 100 lx light conditions, respectively. The integrated sensor system can be used for an apple harvesting robotic manipulator with a positional accuracy of ±2 cm, except for some apples that were occluded due to leaves and branches. Further research will be carried out using changes in the position of the integrated system for recognition of the affected apples for harvesting operations.

Enhanced Deep Learning Algorithm for Object Detection in the Agriculture Field

Enhanced Deep Learning Algorithm for Object Detection in the Agriculture Field

Real-time underwater object detection technology for complex underwater environments based on deep learning

Underwater object detection technology is crucial in many marine-related fields, including marine environmental monitoring, marine resource development, and marine ecological protection. However, this technology faces great challenges due to the poor quality of underwater optical images and the varying sizes of underwater objects. Therefore, we proposed an underwater optical detection network (UODN) based on the you only look once version 8 (YOLOv8) framework, which addresses these issues through the cross stage multi-branch (CSMB) module and large kernel spatial pyramid (LKSP) module. The aim of the CSMB module is to extract more features from underwater optical images to address the issue of poor image quality, while the LKSP module is designed to enhance the ability of the network to detect underwater objects of various scales. Furthermore, CSMBDarknet built by CSMB and LKSP can be used as the backbone of other underwater object detection algorithms for underwater feature extraction. Extensive experimental results on the underwater robot professional contest 2020 dataset revealed that the average precision (AP) of UODN increased by 1.0%, the AP50 of UODN increased by 1.1%, and the AP75 of UODN increased by 2.1% compared with those of the original YOLOv8s. Furthermore, UODN outperforms 12 state-of-the-art models on multiple underwater optical datasets, paving the way for future real-time and high-precision underwater object detection.

The 3-billion fossil question: How to automate classification of microfossils

Microfossil classification is an important discipline in subsurface exploration, for both oil & gas and Carbon Capture and Storage (CCS). The abundance and distribution of species found in sedimentary rocks provide valuable information about the age and depositional environment. However, the analysis is difficult and time-consuming, as it is based on manual work by human experts. Attempts to automate this process face two key challenges: (1) the input data are very large - our dataset is projected to grow to 3 billion microfossils, and (2) there are not enough labeled data to use the standard procedure of training a deep learning classifier. We propose an efficient pipeline for processing and grouping fossils by genus, or even species, from microscope slides using self-supervised learning. First we show how to efficiently extract crops from whole slide images by adapting previously trained object detection algorithms. Second, we provide a comparison of a range of self-supervised learning methods to classify and identify microfossils from very few labels. We obtain excellent results with both convolutional neural networks and vision transformers fine-tuned by self-supervision. Our approach is fast and computationally light, providing a handy tool for geologists working with microfossils.

Estimation of the amount of pear pollen based on flowering stage detection using deep learning

Pear pollination is performed by artificial pollination because the pollination rate through insect pollination is not stable. Pollen must be collected to secure sufficient pollen for artificial pollination. However, recently, collecting sufficient amounts of pollen in Japan has become difficult, resulting in increased imports from overseas. To solve this problem, improving the efficiency of pollen collection and strengthening the domestic supply and demand system is necessary. In this study, we proposed an Artificial Intelligence (AI)-based method to estimate the amount of pear pollen. The proposed method used a deep learning-based object detection algorithm, You Only Look Once (YOLO), to classify and detect flower shapes in five stages, from bud to flowering, and to estimate the pollen amount. In this study, the performance of the proposed method was discussed by analyzing the accuracy and error of classification for multiple flower varieties. Although this study only discussed the performance of estimating the amount of pollen collected, in the future, we aim to establish a technique for estimating the time of maximum pollen collection using the method proposed in this study.

An Advanced Approach to Object Detection and Tracking in Robotics and Autonomous Vehicles Using YOLOv8 and LiDAR Data Fusion

Accurately and reliably perceiving the environment is a major challenge in autonomous driving and robotics research. Traditional vision-based methods often suffer from varying lighting conditions, occlusions, and complex environments. This paper addresses these challenges by combining a deep learning-based object detection algorithm, YOLOv8, with LiDAR data fusion technology. The principle of this combination is to merge the advantages of these technologies: YOLOv8 excels in real-time object detection and classification through RGB images, while LiDAR provides accurate distance measurement and 3D spatial information, regardless of lighting conditions. The integration aims to apply the high accuracy and robustness of YOLOv8 in identifying and classifying objects, as well as the depth data provided by LiDAR. This combination enhances the overall environmental perception, which is critical for the reliability and safety of autonomous systems. However, this fusion brings some research challenges, including data calibration between different sensors, filtering ground points from LiDAR point clouds, and managing the computational complexity of processing large datasets. This paper presents a comprehensive approach to address these challenges. Firstly, a simple algorithm is introduced to filter out ground points from LiDAR point clouds, which are essential for accurate object detection, by setting different threshold heights based on the terrain. Secondly, YOLOv8, trained on a customized dataset, is utilized for object detection in images, generating 2D bounding boxes around detected objects. Thirdly, a calibration algorithm is developed to transform 3D LiDAR coordinates to image pixel coordinates, which are vital for correlating LiDAR data with image-based object detection results. Fourthly, a method for clustering different objects based on the fused data is proposed, followed by an object tracking algorithm to compute the 3D poses of objects and their relative distances from a robot. The Agilex Scout Mini robot, equipped with Velodyne 16-channel LiDAR and an Intel D435 camera, is employed for data collection and experimentation. Finally, the experimental results validate the effectiveness of the proposed algorithms and methods.

Automated Counting of Steel Construction Materials: Model, Methodology, and Online Deployment

Construction material management is crucial for promoting intelligent construction methods. At present, the manual inventory of materials is inefficient and expensive. Therefore, an intelligent counting method for steel materials was developed in this study using the object detection algorithm. First, a large-scale image dataset consisting of rebars, circular steel pipes, square steel tubes, and I-beams on construction sites was collected and constructed to promote the development of intelligent counting methods. A vision-based and accurate counting model for steel materials was subsequently established by improving the YOLOv4 detector in terms of its network structure, loss function, and training strategy. The proposed model provides a maximum average precision of 91.41% and a mean absolute error of 4.07 in counting square steel tubes. Finally, a mobile application and a WeChat mini-program were developed using the proposed model to allow users to accurately count materials in real time by taking photos and uploading them. Since being released, this application has attracted more than 28,000 registered users.

Automatized self-supervised learning for skin lesion screening

Melanoma, the deadliest form of skin cancer, has seen a steady increase in incidence rates worldwide, posing a significant challenge to dermatologists. Early detection is crucial for improving patient survival rates. However, performing total body screening (TBS), i.e., identifying suspicious lesions or ugly ducklings (UDs) by visual inspection, can be challenging and often requires sound expertise in pigmented lesions. To assist users of varying expertise levels, an artificial intelligence (AI) decision support tool was developed. Our solution identifies and characterizes UDs from real-world wide-field patient images. It employs a state-of-the-art object detection algorithm to locate and isolate all skin lesions present in a patient’s total body images. These lesions are then sorted based on their level of suspiciousness using a self-supervised AI approach, tailored to the specific context of the patient under examination. A clinical validation study was conducted to evaluate the tool’s performance. The results demonstrated an average sensitivity of 95% for the top-10 AI-identified UDs on skin lesions selected by the majority of experts in pigmented skin lesions. The study also found that the tool increased dermatologists’ confidence when formulating a diagnosis, and the average majority agreement with the top-10 AI-identified UDs reached 100% when assisted by our tool. With the development of this AI-based decision support tool, we aim to address the shortage of specialists, enable faster consultation times for patients, and demonstrate the impact and usability of AI-assisted screening. Future developments will include expanding the dataset to include histologically confirmed melanoma and validating the tool for additional body regions.

Human behaviour detection dataset (HBDset) using computer vision for evacuation safety and emergency management

During emergency evacuation, it is crucial to accurately detect and classify different groups of evacuees based on their behaviours using computer vision. Traditional object detection models trained on standard image databases often fail to recognise individuals in specific groups such as the elderly, disabled individuals and pregnant women, who require additional assistance during emergencies. To address this limitation, this study proposes a novel image dataset called the Human Behaviour Detection Dataset (HBDset), specifically collected and annotated for public safety and emergency response purposes. This dataset contains eight types of human behaviour categories, i.e. the normal adult, child, holding a crutch, holding a baby, using a wheelchair, pregnant woman, lugging luggage and using a mobile phone. The dataset comprises more than 1,500 images collected from various public scenarios, with more than 2,900 bounding box annotations. The images were carefully selected, cleaned and subsequently manually annotated using the LabelImg tool. To demonstrate the effectiveness of the dataset, classical object detection algorithms were trained and tested based on the HBDset, and the average detection accuracy exceeds 90 %, highlighting the robustness and universality of the dataset. The developed open HBDset has the potential to enhance public safety, provide early disaster warnings and prioritise the needs of vulnerable individuals during emergency evacuation.

Enhanced object detection in pediatric bronchoscopy images using YOLO-based algorithms with CBAM attention mechanism

Background and ObjectiveBronchoscopy is a widely used diagnostic and therapeutic procedure for respiratory disorders such as infections and tumors. However, visualizing the bronchial tubes and lungs can be challenging due to the presence of various objects, such as mucus, blood, and foreign bodies. Accurately identifying the anatomical location of the bronchi can be quite challenging, especially for medical professionals who are new to the field. Deep learning-based object detection algorithms can assist doctors in analyzing images or videos of the bronchial tubes to identify key features such as the epiglottis, vocal cord, and right basal bronchus. This study aims to improve the accuracy of object detection in bronchoscopy images by integrating a YOLO-based algorithm with a CBAM attention mechanism. MethodsThe CBAM attention module is implemented in the YOLO-V7 and YOLO-V8 object detection models to improve their object identification and classification capabilities in bronchoscopy images. Various YOLO-based object detection algorithms, such as YOLO-V5, YOLO-V7, and YOLO-V8 are compared on this dataset. Experiments are conducted to evaluate the performance of the proposed method and different algorithms. ResultsThe proposed method significantly improves the accuracy and reliability of object detection for bronchoscopy images. This approach demonstrates the potential benefits of incorporating an attention mechanism in medical imaging and the benefits of utilizing object detection algorithms in bronchoscopy. In the experiments, the YOLO-V8-based model achieved a mean Average Precision (mAP) of 87.09% on the given dataset with an Intersection over Union (IoU) threshold of 0.5. After incorporating the Convolutional Block Attention Module (CBAM) into the YOLO-V8 architecture, the proposed method achieved a significantly enhanced mAP0.5 and mAP0.5:0.95 of 88.27% and 55.39%, respectively. ConclusionsOur findings indicate that by incorporating a CBAM attention mechanism with a YOLO-based algorithm, there is a noticeable improvement in object detection performance in bronchoscopy images. This study provides valuable insights into enhancing the performance of attention mechanisms for object detection in medical imaging.

Improved and Efficient Object Detection Algorithm based on YOLOv5

Improved and Efficient Object Detection Algorithm based on YOLOv5

A universal method for solar filament detection from Hαobservations using semi-supervised deep learning

Filaments are omnipresent features in the solar atmosphere. Their location, properties, and time evolution can provide important information about changes in solar activity and assist in the operational space weather forecast. Therefore, filaments have to be identified in full-disk images and their properties extracted from these images, but manual extraction is tedious and too time-consuming, and extraction with morphological image processing tools produces a large number of false positive detections. Automatic object detection, segmentation, and extraction in a reliable manner would allow for the processing of more data in a shorter time frame. The Chromospheric Telescope (ChroTel; Tenerife, Spain), the Global Oscillation Network Group (GONG), and the Kanzelhöhe Observatory for Solar and Environmental Research (KSO; Austria) provide regular full-disk observations of the Sun in the core of the chromospheric Hαabsorption line. In this paper, we present a deep learning method that provides reliable extractions of solar filaments from Hαfiltergrams. First, we trained the object detection algorithm YOLOv5 with labeled filament data of ChroTel Hαfiltergrams. We used the trained model to obtain bounding boxes from the full GONG archive. In a second step, we applied a semi-supervised training approach where we used the bounding boxes of filaments to train the algorithm on a pixel-wise classification of solar filaments with u-net. We made use of the increased data set size, which avoids overfitting of spurious artifacts from the generated training masks. Filaments were predicted with an accuracy of 92%. With the resulting filament segmentations, physical parameters such as the area or tilt angle could be easily determined and studied. We demonstrated this in an example where we determined the rush-to-the pole for Solar Cycle 24 from the segmented GONG images. In a last step, we applied the filament detection to Hαobservations from KSO and demonstrated the general applicability of our method to Hαfiltergrams.

Object detection and crowd analysis using deep learning techniques: Comprehensive review and future directions

Object detection using deep learning has attracted considerable interest from researchers because of its competency in performing state-of-the-art tasks, including detection, observation, and action recognition. Deep Learning (DL)-based object detection models extract features directly from data, which is more efficient and effective than traditional methods requiring handcrafted features. Further, DL also effectively tackles spatiotemporal challenges by leveraging techniques; hence, researchers can develop better object detection models and implement more efficient strategies for object recognition. Moreover, optimizing these models improves performance and recognizes objects within videos or images. This survey comprises of an overview of related review papers and DL-based Object Detection (OD) algorithms. Object detection algorithms are presented as two classifications, namely Two-stage and One-stage methods, with Convolutional Neural Network (CNN) as the backbone. OD’s applications are examined here, and crowd analysis has been extensively studied and researched for potential applications. Most of the papers in object detection rely on Convolutional Neural Networks (CNNs) (28%), whereas crowd analysis papers are distributed as follows: 24% in counting, 25% in categorizing, and 25% in analyzing individual behaviors, and 27% in others. In recent years, deep learning has significantly advanced object detection capabilities to provide effective solutions for various applications, including crowd analysis.

Automated Identification of Dental Implants: A New, Fast and Accurate Artificial Intelligence System.

Prosthetic complications that occur to some implant prosthetics may require removal of the prosthesis for replacement or repair. Therefore, the presence of a technique to identify the type of dental implant is mandatory to provide the suitable components. Hence, the aim of the current study was to evaluate the accuracy of YOLOv8 object detection algorithm in automatic identification of the type of dental implant from digital periapical radiographs. YOLOv8m-seg object detection algorithm was used to build a model to automatically identify the type of dental implant. A set of 2573 digital periapical radiographs for six distinct dental implants manufacturers were used to train the model. The outcomes were evaluated using precision, recall, F1 score and mAP. The overall accuracy of the YOLOv8m-seg model in terms of precision, recall, F1 score and mAP revealed values of 0.919, 0.98, 0.95 and 0.972 respectively. The average detection speed of the images was 1.3 seconds. The model was able to detect and identify multiple implants simultaneously on the same image. YOLOv8m-seg object detection algorithm is promising in identification of dental implants from periapical radiographs with high detection accuracy (97.2%), fast detection results and multi-implant detection from the same image. This AI system can accurately identify the type of osseointegrated dental implants enabling dentists to provide the appropriate prosthetic components even if different implant systems are used within the same patient. This can save tremendous amounts of time, effort and cost for both the dentist and the patient.

Multi-Scale Object Detection in Remote Sensing Images Based on Feature Interaction and Gaussian Distribution

Remote sensing images are usually obtained from high-altitude observation. The spatial resolution of the images varies greatly and there are scale differences both between and within object classes, resulting in a diversified distribution of object scales. In order to solve these problems, we propose a novel object detection algorithm that maintains adaptability to multi-scale object detection based on feature interaction and Gaussian distribution in remote sensing images. The proposed multi-scale feature interaction model constructs feature interaction modules in the feature layer and spatial domain and combines them to fully utilize the spatial and semantic information of multi-level features. The proposed regression loss algorithm based on Gaussian distribution takes the normalized generalized Jensen–Shannon divergence with Gaussian angle loss as the regression loss function to ensure the scale invariance of the model. The experimental results demonstrate that our method achieves 77.29% mAP on the DOTA-v1.0 dataset and 97.95% mAP on the HRSC2016 dataset, which are, respectively, 1.12% and 1.41% higher than that of the baseline. These experimental results indicate the effectiveness of our method for object detection in remote sensing images.

Moving Vehicle Number Plate Detection

Abstract: The ability to detect and recognize vehicle license plates is a crucial task in various applications such as traffic management, law enforcement, and parking systems. In this project, we propose a system for moving vehicle license plate detection using image and video processing techniques. The system employs a combination of computer vision algorithms and machine learning models to accurately locate and recognize license plates from moving vehicles in real-time. The input images or video frames are preprocesses to enhance the regions containing license plates and reduce noise. This preprocessing step may include operations such as resizing, grayscale conversion, noise reduction, and contrast enhancement. Next, object detection algorithms such as Haar cascades or deep learning-based techniques like YOLO (You Only Look Once) are utilized to detect candidate regions in the image/frame that potentially contain license plates. After candidate regions are identified, a series of image processing techniques such as morphological operations, contour detection, and character segmentation are employed to isolate and extract the license plate characters. Machine learning models like Support Vector Machines (SVM), Convolutional Neural Networks (CNNs) are then applied to recognize the characters on the license plate.

A YOLO-based deep learning model for Real-Time face mask detection via drone surveillance in public spaces

Automating face mask detection in public areas is paramount to maintaining public health, especially in the context of the COVID-19 pandemic. Utilization of technologies such as deep learning and computer vision systems enables effective monitoring of mask compliance, thereby minimizing the risk of virus spread. Real-time detection helps in prompt intervention for and enforcement of the use of masks, thereby preventing potential outbreaks and ensuring compliance with public health guidelines. This method helps save human resources and makes the reinforcement of wearing masks in public areas consistent and objective. Automatic detection of face masks serves as a key tool for preventing the spread of contagious diseases, protecting public health, and creating a safer environment for every person. This study addresses the challenges of real-time face mask detection via drone surveillance in public spaces, with reference to three categories: wearing of mask, incorrect wearing of mask, and no mask. Addressing these challenges entails an efficient and robust object detection and recognition algorithm. This algorithm can deal with a crowd of multiple faces via a mobile camera carried by a mini drone, and performs real-time video processing. Accordingly, this study proposes a You Only Look Once (YOLO) based deep learning C-Mask model for real-time face mask detection and recognition via drone surveillance in public spaces. The C-Mask model aims to operate within a mini drone surveillance system and provide efficient and robust face mask detection. The C-Mask model performs preprocessing, feature extraction, feature generation, feature enhancement, feature selection, and multivariate classification tasks for each face mask detection cycle. The preprocessing task prepares the training and testing data in the form of images for further processing. The feature extraction task is performed using a Convolutional Neural Network (CNN). Moreover, Cross-Stage Partial (CSP) DarkNet53 is used to improve the feature extraction and to facilitate the model’s object detection ability. A data augmentation algorithm is used for feature generation to enhance the model’s training robustness. The feature enhancement task is performed by applying the Path Aggregation Network (PANet) and Spatial Pyramid Pooling Network (SPPNet) algorithms, which are deployed to enhance the extracted and generated features. The classification task is performed through multi-label classification, wherein each object in an image can belong to multiple classes simultaneously, and the network generates a grid of bounding boxes and corresponding confidence scores for each class. The YOLO-based C-Mask model testing is performed by experimenting with various face mask detection scenarios and with varying mask colors and types, to ensure the efficiency and robustness of the proposed model. The C-Mask model test results show that this model can correctly and effectively detect face masks in real-time video streams under various conditions with an overall accuracy of 92.20%, precision of 92.04, recall of 90.83%, and F1-score of 89.95%, for all the three classes. These high scores have been obtained despite mini drone mobility and camera orientation adjustment substantially affecting face mask detection performance.

Development of Automatic Object Detection and IoT for Garbage Pickup Assignment Problem

Waste management remains a challenge in certain cities, particularly in allocating fleets responsible for collecting garbage from temporary disposal sites. Inadequate planning can lead to the accumulation of substantial waste piles. This study aims to enhance truck assignment by considering truck capacity and the collection route. The assignment process incorporates the fundamental concept of the transportation problem, precisely the northwest corner method. The volume of waste transported aligns with the resident or industrial population within the designated service area. The waste generation capacity determines the future fleet and quantity, forming a crucial element of the ensuing distribution channel. A monitoring system integrating object detection and the Internet of Things (IoT) has been devised to ensure effective garbage collection. Cameras strategically positioned at temporary disposal sites transmit real-time images. The system evaluates garbage collection capacity through object detection facilitated by neural network training. The research outcomes demonstrate the system's capability to identify waste pile levels and validate the garbage pickup process by the designated fleet. Future research should focus on assignment and scheduling in waste transportation, enabling fleet allocation within specific timeframes. Additionally, an object detection algorithm refinement is necessary for more precise identification of waste pile locations.

Automating Helmet Usage Detection: A YOLOv8 Based Framework

Abstract: The biggest threat to Powered two-wheeler(PTW) riders is a head injury. With the humongous amount of daily commuters on such PTWs, the risk only increases substantially. In such cases, helmets reduce the risk of head injuries in accidents but not every citizen is keen on their use. In India, where the use of motorcycles is widespread, ensuring helmetuse remains a challenge. This study explores the effectiveness of YOLOv8(You Only Look Once) a state-of-the-art single-stage object detection algorithm for helmet detection on Indian roads [14]. The CNN(Convolutional Neural Networks) based technologyimplements many other efficient, reliable and quick algorithmsto train, validate and predict the object’s detection, segmentationand classification task. We leverage the use of a publicly available Indian helmet dataset from Kaggle, containing 942 images with annotations. This an image dataset of real-life powered two-wheeler riders. The dataset has images and video frames for training on 5 different objects/classes along with annotations that specify thoseobjects. This multi-class approach offers valuable insight intohelmet usage patterns paves shows us the way for real-world applications for automated traffic monitoring. Real-time helmet and number plate detection can become a game changer in trafficmonitoring and can strengthen basic safety laws