Surface Defect Detection Algorithm Research Articles

An Improved YOLOv8n Algorithm for Steel Surface Defect Detection

Due to the manufacturing process and other aspects, steel surface defects vary in shape and size, which is a difficult point for defect detection. For this reason, this paper proposes a steel surface defect detection algorithm based on YOLOv8n. The algorithm improves the C2f module of Backbone in this network by adding Context Guided Block (CG block), which can effectively extract the local features, surrounding context and global context, and integrate this information to improve the precision and accuracy of detection. Meanwhile, we also change the detection header of YOLOv8 to Detect_ASFF by introducing the Adaptive Spatial Feature Fusion (ASFF) technique. This improvement effectively filters out the conflicting information, which can allow the model to have a better adaptability at different scales. In this paper, Shape-IoU is adopted as the bounding box loss function to make up for the traditional IoU loss that ignores the intrinsic properties of the bounding box in the calculation process. After optimisation, mAP@0.5 are improved to 67.9% and mAP@0.5~0.95 are improved to 35.1%, which is 2.8% and 1.1% respectively. The improved algorithm in this paper has improved in detection accuracy, which proves the practicality and effectiveness of the algorithm in this paper.

Lightweight rail surface defect detection algorithm based on an improved YOLOv8

Existing deep learning methods for rail surface defect detection face issues such as poor compatibility with embedded detection systems, high computational resource consumption, and slow detection speeds. To address these challenges, we propose a lightweight rail surface defect detection algorithm11Code: https://github.com/haichao67/GD-YOLOv8. based on an improved YOLOv8.Inspired by Huawei’s Gold-YOLO, our algorithm redesigns the neck architecture, integrates feature extraction, fusion, and injection modules, and replaces Complete Intersection over Union with Scylla Intersection over Union. Comparative experiments confirm its efficacy, achieving 94.9% precision and 81.9% recall on the Rail Surface Defect Dataset, a 26.3% increase in frames per second, and a model size reduction to 63%. Our algorithm not only ensures satisfactory detection results but also reduces the number of model parameters and increases the detection speed.

YOLO-HLT: improved lightweight printed circuit board surface defect detection algorithm based on YOLOv5

YOLO-HLT: improved lightweight printed circuit board surface defect detection algorithm based on YOLOv5

ECM-YOLO: a real-time detection method of steel surface defects based on multiscale convolution

Steel surface defects, characterized by multiple types, varied scales, and overlapping occurrences, directly impact the quality, performance, and reliability of industrial products. Proposing a high-precision and high-speed steel surface defect detection algorithm is crucial for ensuring product quality. In this regard, this paper introduces ECM-YOLO, a detection network based on YOLOv8n. First, addressing the insufficient information capture of the C2f module, the C2f enhanced multiscale convolution processing (C2f_EMSCP) module is proposed, enhancing global and local feature capture capabilities through multiscale convolutions. Second, to further enhance the network’s robustness and focus on critical information, the channel prior convolutional attention (CPCA) mechanism is integrated between the backbone and neck networks to facilitate more efficient information transmission. Last, a novel, to the best of our knowledge, detection head, i.e., multiscale simple and efficient anchor matching head (MultiSEAMHead), is proposed to mitigate accuracy issues arising from overlaps between different types of defects. Experimental results demonstrate that ECM-YOLO achieves mAPs of 78.9% and 68.2% on the NEU-DET and GC 10-DET data sets, respectively, outperforming YOLOv8n by 2.5% and 4.4%. Moreover, ECM-YOLO excels in model parameters, computational efficiency, and inference speed compared with other models. These findings highlight the applicability of ECM-YOLO for real-time defect detection in industrial settings.

Research on Steel Surface Defect Detection Algorithm Based on Improved YOLOv8n

Research on Steel Surface Defect Detection Algorithm Based on Improved YOLOv8n

Improvement of defect detection for steel based on YOLOv7 algorithm

Abstract Working on the conundrum of low efficiency of strip surface defect detection, a surface defect detection algorithm for boards and strips leveraging YOLOV7 is introduced. First, the global attention mechanism is set up to enhance global information interaction and expression capabilities, and improve detection performance; in second place, the C2f component is integrated into the feature pyramid network to the lightweight pattern; ultimately, Focal-EIoU is exerted to replace loss function of the YOLOv7 pattern to solve the divination box and the problem of wrong amplification of length and width, improving the accuracy of defect classification and positioning. The outcomes reveal that the precision of the elevated algorithm has been boosted by about 4.3%, the recall rate has reached 78.3%, and mAP increased by 3.4%. This technique exhibits high accuracy and efficiency in detecting surface defects on the tape.

Attention mechanism based on deep learning for defect detection of wind turbine blade via multi-scale features

Abstract An enhanced wind turbine blade surface defect detection algorithm, CGIW-YOLOv8, has been introduced to tackle the problems of uneven distribution of defect samples, confusion between defects and background, and variations in target scales that arise during drone maintenance of wind turbine blades. This algorithm is given based on the YOLOv8 model. Initially, a data augmentation method based on geometric changes and Poisson mixing was used to enrich the dataset and address the problem of uneven sample distribution. Subsequently, the incorporation of the Coordinate Attention (CA) mechanism into the Backbone network improved the feature extraction capability in complex backgrounds. In the Neck, the Reparameterized Generalized Feature Pyramid Network (Rep-GFPN) was introduced as a path fusion strategy and multiple cross-scale connections are fused, which effectively enhances the multi-scale expression ability of the network. Finally, the original CIOU loss function was replaced with Inner-WIoU, which was created by applying the Inner-IoU loss function to the Wise-IoU loss function. It improved detection accuracy while simultaneously speeding up the model's rate of convergence. Experimental results show that the mAP of the method for defect detection reaches 92%, which is 5.5% higher than the baseline network. The detection speed is 120.5 FPS, which meets the needs of real-time detection.

A deep transfer learning-based algorithm for concrete surface defect detection

The integrity and safety of concrete structures are crucial in modern civil engineering. Traditional image-defect detection methods are significantly affected by light and noise. Methods based on deep learning, particularly convolutional neural networks (CNNs), offer new solutions for automated defect detection. This paper introduces a concrete surface defect detection algorithm based on deep transfer learning. Our model utilizes the ResNet50 architecture as its backbone and incorporates Atrous Spatial Pyramid Pooling (ASPP) to adapt to the diversity of defects and enhance recognition accuracy. In addition, the use of a self-attention mechanism effectively enhances the model’s focus on and analysis of key defect areas, improving its ability to perceive and select features for defects of various sizes, aiding precise localization and classification under complex conditions. Image preprocessing techniques such as resizing, conversion to grayscale, histogram equalization, and noise addition further enhance the robustness of the model in diverse real-world scenarios. On the publicly available COncrete DEfect BRidge IMage Dataset, our model achieved a mean average precision (mAP@0.5) of 0.90, showing a 3.4% improvement over the current best baseline method. Through transfer learning, it reached 0.92 on our custom dataset, significantly outperforming existing methods. These results demonstrate the effectiveness and superiority of the proposed model for detecting concrete defects. Additionally, we evaluated the impact of different architectures on model performance. Compared to traditional models using the VGG16 as the backbone, the ResNet50 architecture used in this study reduces parameter count by 5.41 times while improving performance by 6.1%.

Steel surface defect detection algorithm in complex background scenarios

Detecting surface defects on steel poses a significant challenge attributed to factors such as poor contrast, diverse defect types, complex background clutter, and noise interference present in images of steel surface defects. Current detection techniques face challenges in quickly and accurately identifying defects within complex backgrounds. To address the deployment of high-precision detection models on edge devices with limited resources, particularly for identifying steel surface defects, this study introduces a Multi-Scale Adaptive Fusion (MSAF) YOLOv8n defect detection algorithm designed for complex backgrounds. This algorithm effectively balances detection speed and accuracy. Firstly, a Multi-Scale Adaptive Fusion Block (MS-AFB) is proposed for the extraction of multi-scale features. Secondly, a Dynamic Coordinate Attention Ghostconv Space Pooling Pyramid-fast Cross-stage Partial Convolutional (DCA-GSPPFCSPC) is devised to significantly improve detection accuracy. Furthermore, the detection head has been redesigned utilizing Lightweight Multi-scale Convolutional (LMSC) approach, and an Adaptive Pyramid Receptive Field Block (AP-RFB) has been introduced to improve the receptive field efficiently. Meanwhile, Normalized Weighted Distance (NWD) and Weighted Intersection over Union (WIoU) are employed as the boundary box loss functions, serving as substitutes for Complete Intersection over Union (CIoU) loss function with a ratio of 2:8. The experimental results obtained from the improved Northeastern University Defect Dataset (NEU-DET) dataset demonstrate that MSAF-YOLOv8n model, despite having 40.4 % of the parameters and 28.8 % of Floating Point Operations (FLOPs) of YOLOv8s, achieves a mAP@.5 that is 0.9 % higher than that of YOLOv8s. Additionally, MSAF-YOLOv8n demonstrates robust generalization capabilities in Pascal VOC2007, self-constructed datasets, and various other datasets. Subsequently, the model is implemented on embedded systems, namely Jeston TX2 NX and Orange Pi 5+, both of which demonstrate real-time detection capabilities.

Road Surface Defect Detection Algorithm Based on YOLOv8

Road Surface Defect Detection Algorithm Based on YOLOv8

Steel Surface Defect Detection Algorithm Based on Improved YOLOv8n

The traditional detection methods of steel surface defects have some problems, such as a lack of feature extraction ability, sluggish detection speed, and subpar detection performance. In this paper, a YOLOv8-based DDI-YOLO model is suggested for effective steel surface defect detection. First, on the Backbone network, the extended residual module (DWR) is fused with the C2f module to obtain C2f_DWR, and the two-step approach is used to carry out the effective extraction of multiscale contextual information, and then fusing feature maps formed from the multiscale receptive fields to enhance the capacity for feature extraction. Also based on the above, an extended heavy parameter module (DRB) is added to the structure of C2f_DWR to make up for the lack of C2f’s ability to capture small-scale pattern defects between training to enhance the training fluency of the model. Finally, the Inner-IoU loss function is employed to enhance the regression accuracy and training speed of the model. The experimental results show that the detection of DDI-YOLO on the NEU-DET dataset improves the mAP by 2.4%, the accuracy by 3.3%, and the FPS by 59 frames/s compared with the original YOLOv8n.Therefore, this paper’s proposed model has a superior mAP, accuracy, and FPS in identifying surface defects in steel.

DEW-YOLO: An Efficient Algorithm for Steel Surface Defect Detection

To address the current steel surface defect detection algorithms in practical applications involving low detection accuracy, an efficient and highly accurate strip steel surface defect detection algorithm, DEW-YOLO, is proposed in this paper. Firstly, by combining the advantages of deformable convolutional networks (DCNs), this paper innovates the C2F module in YOLOv8 and proposes a C2f_DCN module that can flexibly sample features to enhance the abilities of learning and expressing defect features of different sizes and shapes. Secondly, the explicit visual center (EVC) is introduced into the backbone network, which enhances feature extraction capabilities and adaptability and enables the model to better adjust features at different levels and scales. Finally, the original loss function is replaced with the Wise-IoU (WIoU) loss function to accurately measure the similarity between the target frames and improve the defect detection performance of the model. The experimental results on the NEU-DET dataset demonstrate that the algorithms proposed in this paper achieved a mean average precision (mAP) of 80.3% in steel surface defect detection tasks, which was a 3.9% improvement over the original YOLOv8 model. The model’s inference speed reached 91 frames per second (FPS). DEW-YOLO effectively enhances the accuracy of steel defect detection and better satisfies industrial inspection requirements.

CAC-YOLOv8: real-time bearing defect detection based on channel attenuation and expanded receptive field strategy

Bearing defect detection plays a crucial role in the intelligent production of chemical transmission equipment, where timely identification and handling of defective bearings are essential. However, in practical large-scale industrial production, product surface defects are often complex, diverse, and exhibit significant variations in appearance, posing severe challenges to the discriminative ability and detection efficiency of bearing defect detection algorithms. This paper proposes a real-time bearing surface defect detection algorithm, CAC-YOLOv8, which designs the Channel Attenuation Network (CAN) and Compound Pooling Pyramid Spatial Pyramid Pooling Fast (CPPSPPF) structure. Specifically, the model introduces the Channel Attenuation Network to achieve parallel feature extraction, deep feature processing, and feature fusion under different channel numbers, capturing critical features related to bearing defects and thereby improving the inference speed. Subsequently, based on the concept of overlapped receptive fields, a CPPSPPF structure is constructed, utilizing multiple iterations of max-pooling operations with smaller pooling kernel sizes to prevent information loss while expanding the receptive field, thereby strengthening the capturing ability of features at different scales. The experimental results indicate that the proposed CAC-YOLOv8 bearing surface defect detection algorithm, compared to the YOLOv8 model, achieved a 0.3% improvement in mAP@0.5, reduced model size by 14.4%, and enhanced model inference speed by 33.3%. This enables the CAC-YOLOv8 model to significantly improve the real-time performance of bearing defect detection while maintaining high-precision detection. The performance in practical industrial detection demonstrates that the proposed approach has achieved outstanding results in both speed and accuracy.

HLG-YOLOv7: small object detection in conveyor belt damage based on leveraging hybrid local and global features

In the industrial production process, the detection of conveyor belt damage plays a crucial role in ensuring the stable operation of the transportation system. To tackle the issues of significant changes in damage size, missed detections, and poor detection ability of small-size objects in conveyor belt surface damage detection, an improved HLG-YOLOv7 (Hybrid Local and Global Features Network) conveyor belt surface defect detection algorithm is proposed. Firstly, Next-VIT is employed as the backbone network to fully extract local and global features of the damage, enhancing the model’s ability to extract features of different-sized damages. Additionally, to deeply utilize the extracted local and global features, the Explicit Visual Center (EVC) feature fusion module is introduced to obtain comprehensive and discriminative feature representations, further enhancing the detection capability of small objects. Lastly, a lightweight neck structure is designed using GSConv to reduce the complexity of the model. Experimental results demonstrate that the proposed method has better small object detection performance compared to existing methods. The improved algorithm achieves mAP and F1 scores of 96.24% and 97.15%, respectively, with an FPS of 28.2.

RSDNet: A New Multiscale Rail Surface Defect Detection Model.

The rapid and accurate identification of rail surface defects is critical to the maintenance and operational safety of the rail. For the problems of large-scale differences in rail surface defects and many small-scale defects, this paper proposes a rail surface defect detection algorithm, RSDNet (Rail Surface Defect Detection Net), with YOLOv8n as the baseline model. Firstly, the CDConv (Cascade Dilated Convolution) module is designed to realize multi-scale convolution by cascading the cavity convolution with different cavity rates. The CDConv is embedded into the backbone network to gather earlier defect local characteristics and contextual data. Secondly, the feature fusion method of Head is optimized based on BiFPN (Bi-directional Feature Pyramids Network) to fuse more layers of feature information and improve the utilization of original information. Finally, the EMA (Efficient Multi-Scale Attention) attention module is introduced to enhance the network's attention to defect information. The experiments are conducted on the RSDDs dataset, and the experimental results show that the RSDNet algorithm achieves a mAP of 95.4% for rail surface defect detection, which is 4.6% higher than the original YOLOv8n. This study provides an effective technical means for rail surface defect detection that has certain engineering applications.

Research on Surface Defect Detection of Strip Steel Based on Improved YOLOv7.

Surface defect detection of strip steel is an important guarantee for improving the production quality of strip steel. However, due to the diverse types, scales, and texture structures of surface defects on strip steel, as well as the irregular distribution of defects, it is difficult to achieve rapid and accurate detection of strip steel surface defects with existing methods. This article proposes a real-time and high-precision surface defect detection algorithm for strip steel based on YOLOv7. Firstly, Partial Conv is used to replace the conventional convolution blocks of the backbone network to reduce the size of the network model and improve the speed of detection; Secondly, The CA attention mechanism module is added to the ELAN module to enhance the ability of the network to extract detect features and improve the effectiveness of detect detection in complex environments; Finally, The SPD convolution module is introduced at the output end to improve the detection performance of small targets with surface defects on steel. The experimental results on the NEU-DET dataset indicate that the mean average accuracy (mAP@IoU = 0.5) is 80.4%, which is 4.0% higher than the baseline network. The number of parameters is reduced by 8.9%, and the computational load is reduced by 21.9% (GFLOPs). The detection speed reaches 90.9 FPS, which can well meet the requirements of real-time detection.

Improved YOLOv5 Based on Multi-Strategy Integration for Multi-Category Wind Turbine Surface Defect Detection

Wind energy is a renewable resource with abundant reserves, and its sustainable development and utilization are crucial. The components of wind turbines, particularly the blades and various surfaces, require meticulous defect detection and maintenance due to their significance. The operational status of wind turbine generators directly impacts the efficiency and safe operation of wind farms. Traditional surface defect detection methods for wind turbines often involve manual operations, which suffer from issues such as high subjectivity, elevated risks, low accuracy, and inefficiency. The emergence of computer vision technologies based on deep learning has provided a novel approach to surface defect detection in wind turbines. However, existing datasets designed for wind turbine surface defects exhibit overall category scarcity and an imbalance in samples between categories. The algorithms designed face challenges, with low detection rates for small samples. Hence, this study first constructs a benchmark dataset for wind turbine surface defects comprising seven categories that encompass all common surface defects. Simultaneously, a wind turbine surface defect detection algorithm based on improved YOLOv5 is designed. Initially, a multi-scale copy-paste data augmentation method is proposed, introducing scale factors to randomly resize the bounding boxes before copy-pasting. This alleviates sample imbalances and significantly enhances the algorithm’s detection capabilities for targets of different sizes. Subsequently, a dynamic label assignment strategy based on the Hungarian algorithm is introduced that calculates the matching costs by weighing different losses, enhancing the network’s ability to learn positive and negative samples. To address overfitting and misrecognition resulting from strong data augmentation, a two-stage progressive training method is proposed, aiding the model’s natural convergence and improving generalization performance. Furthermore, a multi-scenario negative-sample-guided learning method is introduced that involves incorporating unlabeled background images from various scenarios into training, guiding the model to learn negative samples and reducing misrecognition. Finally, slicing-aided hyper inference is introduced, facilitating large-scale inference for wind turbine surface defects in actual industrial scenarios. The improved algorithm demonstrates a 3.1% increase in the mean average precision (mAP) on the custom dataset, achieving 95.7% accuracy in mAP_50 (the IoU threshold is half of the mAP). Notably, the mAPs for small, medium, and large targets increase by 18.6%, 16.4%, and 6.8%, respectively. The experimental results indicate that the enhanced algorithm exhibits high detection accuracy, providing a new and more efficient solution for the field of wind turbine surface defect detection.

Advancements in Steel Surface Defect Detection: An Enhanced YOLOv5 Algorithm with EfficientNet Integration

Steel surface defect detection is of utmost importance for ensuring product quality, cost reduction, enhanced safety, and heightened customer satisfaction. To address the limitations of traditional steel surface defect detection algorithms, which often yielded singular detection results and suffered from high miss detection rates, we proposed an enhanced Yolov5 steel surface defect detection algorithm. In this approach, this paper employed the EfficientNet network as a replacement for the Yolov5 backbone network. Subsequently, we trained and tested this modified network on a steel surface defect dataset to mitigate the challenges associated with high miss detection rates and underperforming evaluation metrics. Our experimental findings underscored the superiority of the improved algorithm, particularly when compared to Yolov5. This enhanced algorithm exhibited substantial improvements across several key performance metrics, including Precision, Recall, mAP@0.5, parameter count, and pt file size. Noteworthy achievements included a 6.39% increase in Precision for Yolov5-EfficientNetB4, a remarkable 7.75% improvement in Recall for Yolov5-EfficientNetB0, and a 5.57% boost in mAP@0.5 for Yolov5-EfficientNetB6. Additionally, the pt file size for Yolov5-EfficientNetB0 saw a substantial 39.65% reduction, although it was important to note that the inference time for the improved algorithm increased. Among the models, Yolov5-EfficientNetB6 struck the best balance in terms of performance.

Research on fabric surface defect detection algorithm based on improved Yolo_v4

In industry, the task of defect classification and defect localization is an important part of defect detection system. However, existing studies only focus on one task and it is difficult to ensure the accuracy of both tasks. This paper proposes a defect detection system based on improved Yolo_v4, which greatly improves the detection ability of minor defects. For K_Means algorithm clustering prianchors question with strong subjectivity, the paper proposes the Density Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm to determine the number of Anchors. To solve the problem of low detection rate of small targets caused by insufficient reuse rate of low-level features in CSPDarknet53 feature extraction network, this paper proposes an ECA-DenseNet-BC-121 feature extraction network to improve it. And the Dual Channel Feature Enhancement (DCFE) module is proposed to improve the local information loss and gradient propagation obstruction caused by quad chain convolution in PANet networks to improve the robustness of the model. The experimental results on the fabric surface defect detection datasets show that the mAP of the improved Yolo_v4 is 98.97%, which is 7.67% higher than SSD, 3.75% higher than Faster_RCNN, 10.82% higher than Yolo_v4 tiny, and 5.35% higher than Yolo_v4, and the detection speed reaches 39.4 fps. It can meet the real-time monitoring needs of industrial sites.

Steel Surface Defect Detection Algorithm Based on YOLOv8

To improve the accuracy of steel surface defect detection, an improved model of multi-directional optimization based on the YOLOv8 algorithm was proposed in this study. First, we innovate the CSP Bottleneck with the two convolutions (C2F) module in YOLOv8 by introducing deformable convolution (DCN) technology to enhance the learning and expression ability of complex texture and irregular shape defect features. Secondly, the advanced Bidirectional Feature Pyramid Network (BiFPN) structure is adopted to realize the weight distribution learning of input features of different scales in the feature fusion stage, allowing for more effective integration of multi-level feature information. Next, the BiFormer attention mechanism is embedded in the backbone network, allowing the model to adaptively allocate attention based on target features, such as flexibly and efficiently skipping non-critical areas, and focusing on identifying potentially defective parts. Finally, we adjusted the loss function from Complete-Intersection over Union (CIoU) to Wise-IoUv3 (WIoUv3) and used its dynamic non-monotony focusing property to effectively solve the problem of overfitting the low quality target bounding box. The experimental results show that the mean Average Precision (mAP) of the improved model in the task of steel surface defect detection reaches 84.8%, which depicts a significant improvement of 6.9% compared with the original YOLO8 model. The improved model can quickly and accurately locate and classify all kinds of steel surface defects in practical applications and meet the needs of steel defect detection in industrial production.