Surface Defect Detection Method Research Articles

Rail Surface Defect Detection Based on An Improved YOLOv5s

As the operational time of the railway increases, rail surfaces undergo irreversible defects. Once the defects occur, it is easy for them to develop rapidly, which seriously threatens the safe operation of trains. Therefore, the accurate and rapid detection of rail surface defects is very important. However, in the detection of rail surface defects, there are problems, such as low contrast between defects and the background, large scale differences, and insufficient training samples. Therefore, we propose a rail surface defect detection method based on an improved YOLOv5s in this paper. Firstly, the sample dataset of rail surface defect images was augmented with flip transformations, random cropping, and brightness transformations. Next, a Conv2D and Dilated Convolution(CDConv) module was designed to reduce the amount of network computation. In addition, the Swin Transformer was combined with the Backbone and Neck ends to improve the C3 module of the original network. Then, the global attention mechanism (GAM) was introduced into PANet to form a new prediction head, namely Swin transformer and GAM Prediction Head (SGPH). Finally, we used the Soft-SIoUNMS loss to replace the original CIoU loss, which accelerates the convergence speed of the algorithm and reduces regression errors. The experimental results show that the improved YOLOv5s detection algorithm reaches 96.9% in the average precision of rail surface defect detection, offering the accurate and rapid detection of rail surface defects, which has certain engineering application value.

A novel approach for surface defect detection of lithium battery based on improved K-nearest neighbor and Euclidean clustering segmentation

Surface defects of lithium batteries seriously affect the product quality and may lead to safety risks. In order to accurately identify the surface defects of lithium battery, a novel defect detection approach is proposed based on improved K-nearest neighbor (KNN) and Euclidean clustering segmentation. Firstly, an improved voxel density strategy for KNN is proposed to speed up the effect for point filtering. Then, the improved clustering segmentation strategy is applied to distinguish point clouds with defect features. The outline fitting algorithm based on the least square method is applied to determine geometric features of each surface defect which are used to classify defect types. Furthermore, experimental results show that the proposed surface defect detection method reaches 99.2% accuracy and 35.3-ms average time consumption for data processing. Finally, an industrial application example of lithium battery production is demonstrated, which meets the requirements of industrial application. All these reports exhibited that the industrial visual inspection system with rapid measurement is an effective method and guarantees for accelerating industrial production and manufacturing in the future.

Adaptive convolution confidence sieve learning for surface defect detection under process uncertainty

Surface defect detection plays an important role in the quality management of industrial manufacturing processes. Existing detection methods are developed based on clean and uncontaminated training data, less considering the process uncertainty. This paper proposes an adaptive convolution confidence sieve learning method for surface defect detection under process uncertainty. First, an edge-separated wavelet transform method combines the spatial and transform domain methods to estimate image noise. After that, an adaptive convolution model integrates parallel multiple convolution kernels, which can cover the defect feature variation. Then, a confidence sieve learning scheme is developed to filter the label noise, and the adaptive convolution is fine-tuned on the high-confidence data to achieve better detection accuracy. Finally, experimental studies on three industrial datasets have verified that the edge-separated wavelet transform method can accurately predict image noise. The adaptive convolution has better representation capability, and the confidence sieve learning improves model robustness.

Apple Surface Defect Detection Method Based on Weight Comparison Transfer Learning with MobileNetV3

Apples are ranked third, after bananas and oranges, in global fruit production. Fresh apples are more likely to be appreciated by consumers during the marketing process. However, apples inevitably suffer mechanical damage during transport, which can affect their economic performance. Therefore, the timely detection of apples with surface defects can effectively reduce economic losses. In this paper, we propose an apple surface defect detection method based on weight contrast transfer and the MobileNetV3 model. By means of an acquisition device, a thermal, infrared, and visible apple surface defect dataset is constructed. In addition, a model training strategy for weight contrast transfer is proposed in this paper. The MobileNetV3 model with weight comparison transfer (Weight Compare-MobileNetV3, WC-MobileNetV3) showed a 16% improvement in accuracy, 14.68% improvement in precision, 14.4% improvement in recall, and 15.39% improvement in F1-score. WC-MobileNetV3 compared to MobileNetV3 with fine-tuning improved accuracy by 2.4%, precision by 2.67%, recall by 2.42% and F1-score by 2.56% compared to the classical neural networks AlexNet, ResNet50, DenseNet169, and EfficientNetV2. The experimental results show that the WC-MobileNetV3 model adequately balances accuracy and detection time and achieves better performance. In summary, the proposed method achieves high accuracy for apple surface defect detection and can meet the demand of online apple grading.

Deep learning based online metallic surface defect detection method for wire and arc additive manufacturing

Wire and arc additive manufacturing (WAAM) is an emerging manufacturing technology that is widely used in different manufacturing industries. To achieve fully automated production, WAAM requires a dependable, efficient, and automatic defect detection system. Although machine learning is dominant in the object detection domain, classic algorithms have defect detection difficulty in WAAM due to complex defect types and noisy detection environments. This paper presents a deep learning-based novel automatic defect detection solution, you only look once (YOLO)-attention, based on YOLOv4, which achieves both fast and accurate defect detection for WAAM. YOLO-attention makes improvements on three existing object detection models: the channel-wise attention mechanism, multiple spatial pyramid pooling, and exponential moving average. The evaluation on the WAAM defect dataset shows that our model obtains a 94.5 mean average precision (mAP) with at least 42 frames per second. This method has been applied to additive manufacturing of single-pass, multi-pass deposition and parts. It demonstrates its feasibility in practical industrial applications and has potential as a vision-based methodology that can be implemented in real-time defect detection systems.

TSDNet: A New Multiscale Texture Surface Defect Detection Model

Industrial defect detection methods based on deep learning can reduce the cost of traditional manual quality inspection, improve the accuracy and efficiency of detection, and are widely used in industrial fields. Traditional computer defect detection methods focus on manual features and require a large amount of defect data, which has some limitations. This paper proposes a texture surface defect detection method based on convolutional neural network and wavelet analysis: TSDNet. The approach combines wavelet analysis with patch extraction, which can detect and locate many defects in a complex texture background; a patch extraction method based on random windows is proposed, which can quickly and effectively extract defective patches; and a judgment strategy based on a sliding window is proposed to improve the robustness of CNN. Our method can achieve excellent detection accuracy on DAGM 2007, a micro-surface defect database and KolektorSDD dataset, and can find the defect location accurately. The results show that in the complex texture background, the method can obtain high defect detection accuracy with only a small amount of training data and can accurately locate the defect position.

Surface defect detection method for electronic panels based on double branching and decoupling head structure.

During the production of electronic panels, surface defects will inevitably appear. How to quickly and accurately detect these defects is very important to improve product quality. However, some problems such as high cost and low accuracy are still prominent when existing manual detection and traditional techniques are used to solve such problems. Therefore, more and more computer vision techniques are proposed to solve such problems, but the current application of deep learning-based object detection networks for surface defect detection of electronic panels is in a gap. The analysis found that there are two main reasons for this phenomenon. On the one hand, the surface defects of electronic panels have their unique characteristics such as multi-scale and irregular shape, and the current object detection networks cannot effectively solve these problems. On the other hand, the regression and classification tasks coupled in the current computational mechanism of each network are commonly found to cause the problem of conflict between them, which makes it more difficult to adapt these network models to the detection tasks in this scenario. Based on this, we design a supervised object detection network for electronic panel surface defect detection scenario for the first time. The computational mechanism of this network includes a prediction box generation strategy based on the double branch structure and a detection head design strategy that decouples the regression task from the classification task. In addition, we validated the designed network and the proposed method on our own collected dataset of surface defects in electronic panels. The final results of the comparative and ablation experiments show that our proposed method achieves an average accuracy of 78.897% for 64 surface defect categories, proving that its application to electronic panel surface defect detection scenarios can achieve better results.

Lightweight Network-Based Surface Defect Detection Method for Steel Plates

This article proposes a lightweight YOLO-ACG detection algorithm that balances accuracy and speed, which improves on the classification errors and missed detections present in existing steel plate defect detection algorithms. To highlight the key elements of the desired area of surface flaws in steel plates, a void space convolutional pyramid pooling model is applied to the backbone network. This model improves the fusion of high- and low-level semantic information by designing feature pyramid networks with embedded spatial attention. According to the experimental findings, the suggested detection algorithm enhances the mapped value by about 4% once compared to the YOLOv4-Ghost detection algorithm on the homemade data set. Additionally, the real-time detection speed reaches about 103FPS, which is about 7FPS faster than the YOLOv4-Ghost detection algorithm, and the detection capability of steel surface defects is significantly enhanced to meet the needs of real-time detection of realistic scenes in the mobile terminal.

Semantic segmentation of surface defects of smooth parts based on deep convolutional neural networks

Machine vision plays an increasingly important role in industrial product quality detection. During processing, scratches, dents and other defects are inevitable on the surface of a smooth part. Although surface defects do not affect the overall performance of the product, their existence is unacceptable when a perfect product is required. The surface defect detection method based on machine vision and deep convolutional neural networks overcomes, to a certain extent, the problem of low detection efficiency, high false detection and missing detection rates in the traditional detection method. In this paper, a multistream semantic segmentation neural network is proposed to identify defects on smooth parts. Taking a seatbelt buckle as an example, the scratch and crush defects on the surface are classified. The network takes DeepLabV3+ as the framework and three types of image stream as the input of the network. In the backbone feature extraction network, the Xception structure is improved to MobilenetV2 and the convolutional block attention module (CBAM) is introduced into the decoding network, which improves the operational efficiency and accuracy. Compared with other classical networks, this network demonstrates good performance in the image dataset of the seatbelt buckle and realises fast and accurate semantic segmentation and classification of surface defects. The evaluation results of the network model have been significantly improved.

MemSeg: A semi-supervised method for image surface defect detection using differences and commonalities

High-accuracy and real-time semi-supervised image surface defect detection is extensively needed in industrial scenarios. However, existing methods do not provide a good balance between accuracy and speed of defect detection, so this paper proposes an end-to-end memory-based segmentation network (MemSeg) to better accomplish this task. Considering the small intra-class variance of products in the same production line, from the perspective of differences and commonalities, MemSeg introduces artificially simulated abnormal samples and memory samples to assist the model learning. In the training phase, MemSeg explicitly learns the potential differences between normal and simulated abnormal images to obtain a robust classification hyperplane. At the same time, inspired by the mechanism of human memory, MemSeg uses a memory pool to store the general patterns of normal samples. By comparing the similarities and differences between input samples and memory samples in the memory pool to give effective guesses about abnormal regions; In the inference phase, MemSeg directly determines the abnormal regions of the input image in an end-to-end approach. Simple but high-performance, MemSeg achieves state-of-the-art (SOTA) performance on MVTec AD datasets with AUC scores of 99.56% and 98.84% at the image level and pixel level, respectively, while also meeting the real-time requirements in industrial scenarios.

Surface defect detection method for electronic panels based on attention mechanism and dual detection heads.

Automatic detection of surface defects in electronic panels is receiving increasing attention in the quality control of products. The surface defect detection of electronic panels is different from other target detection scenarios and is a meaningful and challenging problem. Its main manifestation is that surface defects of electronic panels usually exhibit extreme irregularity and small target characteristics, which bring great difficulties to the task of surface defect target detection including feature extraction and so on. The traditional methods can only detect a very small number of defect classes under specific detection conditions. And due to the weak robustness of these methods, they cannot be applied in real production scenarios on a large scale. Based on this, this paper applies the target detection technique under deep learning to the surface defect detection scenario of electronic panels for the first time. At the same time, in order to make the designed target detection network applicable to the electronic panel surface defect detection scenario and to enhance the interpretability of the designed target detection network in terms of computer mechanism. We design a deformable convolution module with a convolutional self-attentive module to learn the offset and a dual detection head incorporating the SE (Squeeze-and-Excitation) mechanism for the irregular characteristics of electronic panel surface defects and the small target characteristics, respectively. Finally, we carried out a series of experiments on our own electronic panel defect data set, including comparison with the most advanced target detection algorithms and a series of ablation experiments against our proposed method. The final experimental results prove that our method not only has better interpretability, but also has better metric performance, in which the map_0.5 metric reaches 78.257%, which is an increase of 13.506 percentage points over YOLOV5 and 33.457 percentage points higher than Retinanet. The results prove the proposed method is effective.

A Tiny Defect Detection System for Tire Mold Surfaces Based on Consecutive Frames

The purpose of the study is to achieve the precise location of each defect on the surfaces of the customized tire mold. Traditional image processing systems typically face significant challenges when processing images, including noise, distortions, and tiny objects, resulting in low computing efficiency and detection accuracy. To address these concerns, a comprehensive defect detection system is developed. The system consists of an inspection platform and a surface defect detection method. In order to achieve highly sensitive detection, an inspection platform and a novel filtering mechanism are proposed. The inspection platform is suitable for various customized tire molds and can be adjusted according to different situations. The effect of noise is effectively reduced by the novel filtering mechanism using a continuous image. Defect features are also prevented from being filtered out. In addition, to remove unnecessary parts of the image, U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> -Net is adopted to avoid detecting defective features outside the mold. Finally, a tire mold dataset—STM is set up for training and evaluating U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> -Net. The proposed method achieves 83.6% precision and 87.9% recall, which is the best performance among all comparisons. Furthermore, this system can provide defect details for subsequent analysis and automatic defect repair.

A Semi-Supervised Method for Steel Surface Defect Detection Based on Soft-teacher

A Semi-Supervised Method for Steel Surface Defect Detection Based on Soft-teacher

Retracted: Surface Defect Detection Method Based on Improved Attention Mechanism and Feature Fusion Model.

[This retracts the article DOI: 10.1155/2022/3188645.].

Gear Surface Defect Detection Method Based on Improved YOLOx Network

Gear Surface Defect Detection Method Based on Improved YOLOx Network

Deep Learning and Laser-Based 3-D Pixel-Level Rail Surface Defect Detection Method

Rail surface defect inspection is of particular importance in modern railways. Accurate and efficient surface defect detection approaches support optimized maintenance. This enables safe operation of the railway network. However, the scale and harsh working environments of the railway still pose challenges to existing manual and vision-based inspection methods. Inspired by recent advances in laser measurement and deep learning in computer vision, this paper proposes a laser-based 3D pixel-level rail surface defect detection method that combines high-precision laser measurement data with the concept of deep semantic segmentation. In the proposed method, the rail surface is first measured in 3D using a low-cost 2D laser triangulation sensor. Then, a new deep semantic segmentation network is introduced. The network is composed of a fully convolutional segmentation module and two symmetric mapping modules, which can take 3D laser measurement data as input and output 3D pixel-level defect detection results in an end-to-end manner. The modular design of the network allows the use of various segmentation modules for different applications or scenarios. Experiments on a 3D rail dataset demonstrate the feasibility of the proposed method with a pixel-level detection accuracy measured by mean Intersection over Union (mIoU) of up to 87.9%. The 3D output provides not only location and boundary information but also the 3D characterization of defects, giving an essential reference for further defect management and repair tasks.

Research on Surface Defect Detection Method of Aluminum Tube Based on Ensemble Adaptive Undersampling

Research on Surface Defect Detection Method of Aluminum Tube Based on Ensemble Adaptive Undersampling

A New Gradient Based Surface Defect Detection Method for the Ceramic Tile

Ceramic tiles are controlled to detect surface defects after production because many defects may occur on their surface during production. The detection of ceramic tile surface defects is usually performed by human observations in most factories. In this paper, an image processing method was proposed to detect the defects. In the proposed method, first, the user selects the homogenous region in the image. Then the gradient-based image processing algorithm is applied. We conducted our study using simulated and real images to which we applied the conventional image processing methods and our proposed method. Performance of the proposed method was evaluated with quality metric and subjective evaluation. The obtained results demonstrate that the proposed method has very good performance and is very promising for ceramic tile application.

An end‐to‐end steel surface defect detection approach via Swin transformer

AbstractDifferent from most current studies using convolutional neural network (CNN), a deep learning detection method for steel plate surface defects based on Transformer is researched. This paper presents a process, network structure and detection method for steel strip surface defect detection. A Swin Transformer was used to extract hierarchical features in the detection system. Then feature pyramid networks (FPN) was used to fuse the above features to form multi‐scale feature maps, and region proposal network (RPN) was adopted to generate the generate region of interest (ROI) of defects. Finally, the ROI head was used to generate defect category information and its precise location. Here, ablation experiments were conducted to explore the impact of different backbone networks and the number of stages of Swin Transformer and FPN on target detection performance to prove the rationality and efficiency of the network. On the NEU‐DET dataset, the proposed algorithm achieved 81.1% mAP, which is higher than that of classic CNN detection methods such as Faster R‐CNN, SSD, Yolo v3 and RepPoints.

An in situ surface defect detection method based on improved you only look once algorithm for wire and arc additive manufacturing

Purpose Wire and arc additive manufacturing (WAAM) is a widely used advanced manufacturing technology. If the surface defects occurred during welding process cannot be detected and repaired in time, it will form the internal defects. To address this problem, this study aims to develop an in situ monitoring system for the welding process with a high-dynamic range imaging (HDR) melt pool camera. Design/methodology/approach An improved you only look once version 3 (YOLOv3) model was proposed for online surface defects detection and classification. In this paper, improvements were mainly made in the bounding box clustering algorithm, bounding box loss function, classification loss function and network structure. Findings The results showed that the improved model outperforms the Faster regions with convolutional neural network features, single shot multibox detector, RetinaNet and YOLOv3 models with mAP value of 98.0% and a recognition rate of 59 frames per second. And it was indicated that the improved YOLOv3 model satisfied the requirements of real-time monitoring well in both efficiency and accuracy. Originality/value Experimental results show that the improved YOLOv3 model can solve the problem of poor performance of traditional defect detection models and other deep learning models. And the proposed model can meet the requirements of WAAM quality monitoring.