Fast Object Detection Research Articles

Traffic Congestion Detection Using YOLOv8 Algorithm With CCTV Data

Community development and growth according to data from the Central Java Statistics Agency regarding the number of vehicles in Central Java Province in 2021 is 20 320 743. The increasing growth of society has caused vehicle density which is a serious problem in urban areas. This study developed a congestion detection system using the YOLOv8 algorithm to analyze traffic density from CCTV footage. Automated detection of traffic congestion is a critical challenge in urban transport management. YOLOv8, a fast and accurate object detection algorithm, is used to identify vehicles and count their number in various areas of the highway. This information is then processed to assess road congestion conditions, with the aim of detecting congestion. The data obtained were tested on two road scenarios and traffic conditions to evaluate the performance of the system. The results showed that the proposed system was able to detect congestion with an accuracy level of 59.2% from several experiments. The use of YOLOv8 enables real-time detection with efficient computing resources, making it a potential solution for large-scale deployment. This research shows that the incorporation of advanced object detection algorithms such as YOLOv8 with CCTV data can provide an effective solution for traffic management in large cities. This system is expected to improve response to congestion, help control traffic, and reduce the negative impact of congestion in urban areas

A Fast and High-Accuracy Foreign Object Detection Method for Belt Conveyor Coal Flow Images with Target Occlusion.

Foreign objects in coal flow easily cause damage to conveyor belts, and most foreign objects are often occluded, making them difficult to detect. Aiming at solving the problems of low accuracy and efficiency in the detection of occluded targets in a low-illumination and dust fog environment, an image detection method for foreign objects is proposed. Firstly, YOLOv5s back-end processing is optimized by soft non-maximum suppression to reduce the influence of dense objects. Secondly, SimOTA label allocation is used to reduce the influence of ambiguous samples under dense occlusion. Then, Slide Loss is used to excavate difficult samples, and Inner-SIoU is used to optimize the bounding box regression loss. Finally, Group-Taylor pruning is used to compress the model. The experimental results show that the proposed method has only 4.20 × 105 parameters, a computational amount of 1.00 × 109, a model size of 1.20 MB, and an mAP0.5 of up to 91.30% on the self-built dataset. The detection speed on the different computing devices is as high as 66.31, 41.90, and 33.03 FPS. This proves that the proposed method achieves fast and high-accuracy detection of multi-layer occluded coal flow foreign objects.

Real-Time SLAM and Faster Object Detection on a Wheeled Lifting Robot with Mobile-ROS Interaction

Wheeled lifting robots have found widespread applications in various industrial and logistical environments. However, traditional robots are far from adequate in terms of visual perception capabilities. Additionally, their remote control methods suffer from inefficiencies, which tend to bring safety concerns. To address these issues, this work proposes an autonomous multi-sensor-enabled wheeled lifting robot system, i.e., AMSeWL-R, to facilitate remote autonomous operations. Specifically, AMSeWL-R integrates real-time simultaneous localization and mapping with object detection on a wheeled lifting robot. Additionally, a novel mobile-ROS interaction method is proposed to achieve real-time communication and control between a mobile device and a ROS host. Furthermore, a lightweight object detection algorithm based on YOLOv8, i.e., YOLOv8-R, is proposed to achieve faster detection. Experimental results validate the effectiveness of the AMSeWL-R system for accurately detecting objects and mapping its surroundings. Furthermore, TensorRT acceleration is employed during practical testing on a Jetson Nano to achieve real-time detection using the proposed YOLOv8-R, demonstrating its efficacy in real-world scenarios.

Dehazing & Reasoning YOLO: Prior knowledge-guided network for object detection in foggy weather

Fast and accurate object detection in foggy weather is crucial for visual tasks such as autonomous driving and video surveillance. Existing methods typically preprocess images with enhancement techniques before the object detector, so that the real-time performance of object detection decreases to some extent. Meanwhile, many popular object detection models rely solely on visual features for localization and classification. When fog is present, visual features would be so adversely impacted that the detection accuracy sharply decreases. Therefore, we propose an end-to-end prior knowledge-guided network called DR-YOLO for object detection in foggy weather. DR-YOLO integrates the atmospheric scattering model and the co-occurrence relation graph as prior knowledge into the entire training process of the detector. Firstly, Restoration Subnet Module (RSM) is designed to employ the atmospheric scattering model to guide the learning direction of the detector for dehazing features. Specifically, it is only adopted during the training process and does not increase the time cost of detection process. Secondly, for guiding the detector to pay more attention to potential co-occurring objects in the same scene, we introduce Relation Reasoning Attention Module (RRAM) that utilizes the co-occurrence relation graph to supplement deficient visual features in foggy weather. In addition, DR-YOLO employs Adaptive Feature Fusion Module (AFFM) to effectively merge the key features from the backbone and neck for the needs of RRAM and RSM. Finally, we conduct experiments on clear, synthetic and real-world foggy datasets to demonstrate the effectiveness of DR-YOLO. The source code is available at https://github.com/wenxinss/DR-YOLO.

Environmentally adaptive fast object detection in UAV images

Detecting objects in aerial images poses a challenging task due to the presence of numerous small objects and complex environmental information. To address these problems, we propose an efficient detector specifically designed for aerial images, named EAF-YOLOv8, based on YOLOv8-S. In this paper, we introduce a novel backbone network called EAFNet, specifically designed for small object detection. EAFNet consists of the Rapidly Merging Receptive Fields Aggregation Module (RMRFAM) and Multi-Scale Channel Attention (MSCA). The RMRFAM utilizes dilated convolution (DConv) and partial convolution (PConv) to acquire richer receptive fields, capturing more extensive contextual information at higher levels while reducing redundancy in channel information, thereby accelerating inference speed. Furthermore, inspired by denoising tasks, we focus on the feature information surrounding the target background and propose MSCA. MSCA integrates channel attention with an embedded self-attention feature pyramid, extending the feature learning scope to the surrounding environment of the target, beyond the target itself. This approach utilizes enhanced background features to elicit a higher response for small targets, reducing false positives. Experimental results demonstrate that in UAVDT and VisDrone2019, the proposed EAF-YOLOv8 achieves mAP50 scores of 34.3% and 49.7%, respectively. Additionally, EAF-YOLOv8 exhibits high real-time inference speeds of 77.60 FPS and 55.56 FPS, showcasing competitive detection performance.

Robust Forest Fire Detection Method for Surveillance Systems Based on You Only Look Once Version 8 and Transfer Learning Approaches

Forest fires have emerged as a significant global concern, exacerbated by both global warming and the expanding human population. Several adverse outcomes can result from this, including climatic shifts and greenhouse effects. The ramifications of fire incidents extend widely, impacting human communities, financial resources, the natural environment, and global warming. Therefore, timely fire detection is essential for quick and effective response and not to endanger forest resources, animal life, and the human economy. This study introduces a forest fire detection approach utilizing transfer learning with the YOLOv8 (You Only Look Once version 8) pretraining model and the TranSDet model, which integrates an improved deep learning algorithm. Transfer Learning based on pre-trained YoloV8 enhances a fast and accurate object detection aggregate with the TranSDet structure to detect small fires. Furthermore, to train the model, we collected 5200 images and performed augmentation techniques for data, such as rotation, scaling, and changing due and saturation. Small fires can be detected from a distance by our suggested model both during the day and at night. Objects with similarities can lead to false predictions. However, the dataset augmentation technique reduces the feasibility. The experimental results prove that our proposed model can successfully achieve 98% accuracy to minimize catastrophic incidents. In recent years, the advancement of deep learning techniques has enhanced safety and secure environments. Lastly, we conducted a comparative analysis of our method’s performance based on widely used evaluation metrics to validate the achieved results.

Research on application of multimodal data fusion in intelligent building environment perception

With the rapid development of the building industry, intelligent buildings benefit from its safety, energy saving, environmental protection and integration and other advantages have been widely loved by people, most operators also realize the importance of intelligent buildings to bring people humanized and customized services, and in order to realize the personalized service of the building, multi-modal data fusion is an effective method. On the other hand, in today’s Internet of Things society, many practical applications need to deploy a large number of sensing equipment for data collection and processing, so as to carry out high-quality monitoring of the physical world, but due to the inherent limitations of these hardware equipment and the influence of factors such as the environment, single mode data often cannot be completely and comprehensively monitored to the physical world’s changing characteristics. In this development context, multi-modal data fusion has become a research hotspot in the field of machine learning. Based on this, this paper proposes a one-stage fast object detection model with multi-level fusion of multi-modal features and end-to-end characteristics for building indoor environment perception, and conducts experimental analysis on the performance of the model. The verification results show that the accuracy of the proposed method is 50.7% and the running speed is 0.107 s, which has better performance than the existing detection methods.

ESGN: Efficient Stereo Geometry Network for Fast 3D Object Detection

Fast stereo based 3D object detectors have made great progress recently. However, they suffer from the inferior accuracy. We argue that the main reason is due to the poor geometry-aware feature representation in 3D space. To solve this problem, we propose an efficient stereo geometry network (ESGN). The key in our ESGN is an efficient geometry-aware feature generation (EGFG) module. Our EGFG module first uses a stereo correlation and reprojection module to construct multi-scale stereo volumes in camera frustum space, second employs a multi-scale bird&#x2019;s eye view (BEV) projection and fusion module to generate multiple geometry-aware features. In these two steps, we adopt deep multi-scale information fusion for discriminative geometry-aware feature generation, without any complex aggregation networks. In addition, we introduce a deep geometry-aware feature distillation scheme to guide stereo feature learning with a LiDAR-based detector. The experiments are performed on the classical KITTI dataset. On KITTI test set, our ESGN outperforms the fast state-of-art-art detector YOLOStereo3D by 5.14% on mAP_3<i>d</i> at 62<i>ms</i>. To the best of our knowledge, our ESGN achieves a best trade-off between accuracy and speed. We hope that our efficient stereo geometry network can provide more possible directions for fast 3D object detection.

Target encirclement for multiple quadrotors with visual detection and localization

Target encirclement is widely used in the field of unmanned aerial vehicles(UAVs), which can effectively monitor and intercept external threats. However, the integration from target detection, localization to final tracking is difficult or costly. This article proposes a complete and inexpensive framework of the target encirclement for multiple quadrotors. The framework consists of three modules: object detection, target localization and formation tracking. Firstly, a one-stage object detector based on a convolutional neural network is used to achieve fast and accurate object detection. Then, combined with the position and attitude states of the quadrotor, a 3D target localization scheme to locate the target position is proposed. Based on consensus theory, a time-varying formation tracking control protocol is proposed. Finally, a multiple quadrotor platform composed of one reconnaissance quadrotor and four hunter quadrotors is built with self-organizing network communication, which avoids the expensive cost of deploying object detection modules on each quadrotor platform. We deployed the framework on the multiple quadrotor platform and conducted static and dynamic localization and encirclement experiments with a minibus as the target. The result shows that the reconnaissance quadrotors can detect and accurately locate targets over 30 fps, and the average deviation of locating the target minibus could reach a minimum of 0.0712 m. The hunter quadrotors could track and encircle the dynamic moving target minibus in a time-varying formation. Experiments demonstrate the effectiveness and practicality of the proposed framework of the target encirclement for multiple quadrotors.

Deteksi Helm Keselamatan Menggunakan Jetson Nano dan YOLOv7

Increasing awareness of the importance of head personal protective equipment in industrial and construction environments has become a major concern in efforts to improve occupational safety. This research developed an early detection system for the use of computer vision-based head protective equipment using the YOLOv7 model and the Jetson Nano controller. The YOLOv7 algorithm was chosen for its ability for fast and accurate object detection. The YOLOv7 model was trained with a total dataset of 2799 images and iterations of 100 epochs to detect head personal protective equipment with a high degree of accuracy. The system captures imagery, activates a warning alarm, and sends a notification to Telegram when a violation occurs on an object that is not wearing a safety helmet. The test results using the confusion matrix method showed that the developed system was able to detect head personal protective equipment with an accuracy rate of 97.23%, which shows the system's ability to recognize personal protective equipment with very high accuracy. In addition, the system also showed a precision value of 98.71% indicating that all detections performed were correct, and a recall of 95.63% which describes the system's ability to recognize most of the head personal protective equipment available. The average FPS result using GPU with CUDA on Jetson Nano reached 5,723 FPS.

Fire-PPYOLOE: An Efficient Forest Fire Detector for Real-Time Wild Forest Fire Monitoring

Forest fire has the characteristics of sudden and destructive, which threatens safety of people’s life and property. Automatic detection and early warning of forest fire in the early stage is very important for protecting forest resources and reducing disaster losses. Unmanned forest fire monitoring is one popular way of forest fire automatic detection. However, the actual forest environment is complex and diverse, and the vision image is affected by various factors easily such as geographical location, seasons, cloudy weather, day and night, etc. In this paper, we propose a novel fire detection method called Fire-PPYOLOE. We design a new backbone and neck structure leveraging large kernel convolution to capture a large arrange area of reception field based on the existing fast and accurate object detection model PP-YOLOE. In addition, our model maintains the high-speed performance of the single-stage detection model and reduces model parameters by using CSPNet significantly. Extensive experiments are conducted to show the effectiveness of Fire-PPYOLOE from the views of detection accuracy and speed. The results show that our Fire-PPYOLOE is able to detect the smoke- and flame-like objects because it can learn features around the object to be detected. It can provide real-time forest fire prevention and early detection.

Automated Paper-based Multiple Choice Scoring Framework using Fast Object Detection Algorithm

Automated Paper-based Multiple Choice Scoring Framework using Fast Object Detection Algorithm

WBC YOLO-ViT: 2 Way - 2 stage white blood cell detection and classification with a combination of YOLOv5 and vision transformer

Accurate detection and classification of white blood cells, otherwise known as leukocytes, play a critical role in diagnosing and monitoring various illnesses. However, conventional methods, such as manual classification by trained professionals, must be revised in terms of accuracy, efficiency, and potential bias. Moreover, applying deep learning techniques to detect and classify white blood cells using microscopic images is challenging owing to limited data, resolution noise, irregular shapes, and varying colors from different sources. This study presents a novel approach integrating object detection and classification for numerous type-white blood cell. We designed a 2-way approach to use two types of images: WBC and nucleus. YOLO (fast object detection) and ViT (powerful image representation capabilities) are effectively integrated into 16 classes. The proposed model demonstrates an exceptional 96.449% accuracy rate in classification.

AN APPLICATION OF A MATERIAL DEFECT DETECTION SYSTEM USING ARTIFICIAL INTELLIGENCE

In recent years, detecting defects in materials has become an important element in many industries, such as automotive, construction, textile manufacturing, and many others. Material defects, such as stains, cracks, dents, and others, can affect the quality and durability of the product, which can have serious consequences for safety, performance, and product quality. Therefore, it is important to detect and remove material defects as quickly and accurately as possible. Traditional methods of detecting material defects, such as manual inspections or simple visual algorithms, can be unreliable and, above all, time-consuming. In recent years, however, new tools based on intelligent algorithms (Liu et al., 2023) or structures (Neethu et al., 2015), such as neural networks, have emerged that enable automation and significantly increase the precision of defect detection. One of the most popular tools for object detection is the YOLOv5 (Redmon et al., 2016) (You Only Look Once version 5) model, which is based on neural networks and designed for fast and accurate object detection in images. The YOLOv5 model can be trained to detect specific types of material defects, such as stains, cracks, dents, etc. To use the YOLOv5 model for defect detection in materials, images of the material with specified objects of interest are needed, which will be used as input data for the model training. The YOLOv5 model analyses the images and determines rectangular frames around each defect indicating its location, and then assigns a selected label (in this case, the name of the defect). As a result, the YOLOv5 model is able to detect defects in new material images, regardless of their location, colour, and size. As the work progresses, it is also possible to prepare new images and retrain the model for new defects or to improve the performance of existing ones. As a result of the research, the obtained results at a 95% level of recognized defects certainly qualify the applied technology for professional use after appropriate workstation preparation and a sufficiently large amount of data (preferably 1000 or more).

Real-Time Object Detection and Tracking for Unmanned Aerial Vehicles Based on Convolutional Neural Networks

This paper presents a system applied to unmanned aerial vehicles based on Robot Operating Systems (ROSs). The study addresses the challenges of efficient object detection and real-time target tracking for unmanned aerial vehicles. The system utilizes a pruned YOLOv4 architecture for fast object detection and the SiamMask model for continuous target tracking. A Proportional Integral Derivative (PID) module adjusts the flight attitude, enabling stable target tracking automatically in indoor and outdoor environments. The contributions of this work include exploring the feasibility of pruning existing models systematically to construct a real-time detection and tracking system for drone control with very limited computational resources. Experiments validate the system’s feasibility, demonstrating efficient object detection, accurate target tracking, and effective attitude control. This ROS-based system contributes to advancing UAV technology in real-world environments.

A LiDAR Multi-Object Detection Algorithm for Autonomous Driving

Three-dimensional object detection is the core of an autonomous driving perception system, which detects and analyzes targets around the vehicle to obtain their sizes, shapes, and categories to provide reliable operational decisions for achieving autonomous driving. To improve the detection and localization accuracy of multi-object targets such as surrounding vehicles and pedestrians in autonomous driving scenarios, based on PointPillars fast object detection network, a three-dimensional object detection algorithm based on the channel attention mechanism, ECA Modules-PointPillars, is proposed. Firstly, the improved algorithm uses point cloud columnarization features to convert a three-dimensional point cloud into a two-dimensional pseudo-image. Then, combining the 2D backbone network for feature extraction with the Efficient Channel Attention (ECA) modules to achieve the enhancement of the positional feature information in the pseudo-image and the weakening of the irrelevant feature information such as background noise. Finally, the single-shot multibox detector (SSD) algorithm was used to complete the 3D object detection task. The experimental results show that the improved algorithm improves the mAP by 3.84% and 4.04% in BEV mode and 3D mode, respectively, compared to PointPillars, which improves the mAP by 4.64% and 5.89% in BEV mode and 3D mode, respectively, compared to F-PointNet, improves the mAP by 11.78% and 14.19% in BEV mode and 3D mode, respectively, compared to VoxelNet, and improves the mAP by 9.47% and 6.55% in BEV mode and 3D mode, respectively, compared to SECOND, demonstrating the effectiveness and reliability of the improved algorithms in autonomous driving scenarios.

MT-Det: A novel fast object detector of maize tassel from high-resolution imagery using single level feature

Accurately and quickly detecting maize tassels is crucial for successful maize breeding and seed production. However, the complex planting environment in the field, including unsynchronized growth stages, cluttered backgrounds, severe occlusions, and varying tassel sizes and shapes, presents a challenge for detection methods. Current methods either use mainstream object detectors off-the-shelf or employ shallow adaptations on the modular level, lacking a systematic design that balances both speed and accuracy. Furthermore, most studies only report evaluation results on sliced image patches instead of original high-resolution images, which can offer limited guidance for large-scale crop management. In this study, we propose a novel one-stage anchor-free maize tassel detector (MT-Det), which is based on a single level feature and designed to be simple yet effective. Extensive comparisons with both one-level counterparts and feature pyramid detectors demonstrate that MT-Det outperforms them in both detection accuracy and inference speed. To address the issue of significant accuracy drop when directly inferring on high-resolution images, we introduce a bundle of slicing-aided hyper inference technologies to our proposed MT-Det, which results in a 13% and 38% improvement of mean average precision (mAP) on proximal and unmanned aerial vehicle (UAV) high-resolution images, respectively. We believe that MT-Det provides a promising high-throughput solution for accurate and efficient detection and counting of maize tassels in real-world field conditions.

Detection of Foreign Objects Around the Railway Line with YOLOv8

This study proposes a deep learning-based method to detect foreign objects around the railway line. It is important to make this determination with high accuracy for rail transport safety, but traditional methods are disadvantageous in terms of time and cost. In the proposed method, the RailSem19 dataset was used, and a YOLOv8-based model was designed. YOLOv8 is a prominent algorithm in the literature with its fast and accurate object detection capability. In the study, the dataset was diversified using image enhancement techniques. The training, validation, and testing stages used manually labeled data for human and car classes. The training process was carried out through Google Colab and different YOLOv8 sub-architectures were evaluated. The results showed that the YOLOv8m sub-architecture had higher mAP50 values than the other sub-architectures and showed a successful performance in the validation phase. The YOLOv8m model was able to clearly distinguish people and cars around the railway line. The YOLOv8m sub-architecture achieved a mAP50 value of 88.8%. This study presents an automated and efficient method to improve rail transport safety. The high success of the YOLOv8-based model with the RailSem19 dataset can be considered an effective solution to detect potential risks around the railway line.

INTELLIGENT VIDEO SURVEILLANCE SYSTEMS: A SURVEY

Over the years, the need for intelligent video surveillance has increased in other to enhance security and safety in the society. Government, private organization and individual need to make sure its properties are kept safe from intruders and as such intelligent video surveillance plays a key role in ensuring that this is achieved. Intelligent video surveillance is embedded with the capability of providing real time intelligent surveillance and also automatically provide analysis of video and image data without human operation. In the development of such systems, computer vision, machine learning and deep learning plays a vital role in achieving this. Therefore, this paper provides a general survey on intelligent video surveillance system, overview of background concept and discussion on object detections and classification, tracking and deep networks. Also, this paper presents an efficient and faster object detection and classification techniques for intelligent video surveillance.

SFTN: Fast object detection for aerial images

AbstractThe task of remote sensing image object detection in low latency scenes is of great research significance. To address the problem that the current high‐precision object detection algorithm based on a feature pyramid network is slow due to a large number of parameters and complicated computation, a fast remote sensing image object detection method based on a Single‐scale Feature Transformation Network (SFTN) is proposed. Firstly, based on the single‐scale remote sensing image features, the new channel features are quickly generated by a linear transformation of the original features and convolution kernel clustering optimization using cosine similarity; secondly, in order to obtain multi‐scale receptive fields, a parallel residual hole convolution module is designed to cover multi‐category remote sensing object scales on the feature map; finally, angle variables are introduced and optimized using angle similarity to effectively improve the object orientation accuracy. The experimental results on different datasets show that the method in this paper improves the detection speed rapidly while ensuring the accuracy of remote sensing image object detection, which is better than many remote sensing image object detection methods. The results demonstrate the reliability and robustness of the method.