Defect Datasets Research Articles

Improving the Classification of Defect Levels in Main Electrical Equipment Through Advanced Prompting on a Large Language Model

The stable operation of the power system is closely related to the national economy and people’s livelihoods. Therefore, the timely detection, qualitative assessment, and handling of major equipment defects are crucial. The classification of defect levels in main electrical equipment is a fundamental task in this process, which is often manually completed, supplemented by knowledge bases or expert systems. However, this approach is time-consuming, labor-intensive, involves challenging human–machine interaction, and relies on expert experience. Conversational large language models, such as ChatGPT, ERNIE Bot, ChatGLM, have garnered widespread recognition in various domains. However, these models may have errors in the reasoning process, resulting in biased or even erroneous outputs, which is referred to as the “hallucinations”. The hallucinations’ problem of large language models poses challenges in specific fields. To mitigate the hallucinations in large language models, researchers often seek to incorporate domain-specific knowledge into these models through methods like fine-tuning or prompt learning. In order to enhance model performance while minimizing computational costs, this study adopts the prompt learning approach. Specifically, we propose a large language model prompt learning framework based on knowledge graphs, aiming to provide the large language model with reasoning support by leveraging specific information stored within the knowledge graph and receive explainable reasoning result. Experimental results demonstrate that our module achieved superior results on the power defect dataset compared to the non-prompt method.

Research on the generation and evaluation of bridge defect datasets for underwater environments utilizing CycleGAN networks

The surface cracks on the underwater structures critically damages the overall reliability of the structures and reduces their strength. It is significant to monitor these cracks in timely manner. Recently, deep learning algorithms have been used for large scale data study and predictions. However, deep supervised learning algorithms need to get training on large scale data set which is time consuming and difficult to apply on the underwater structures. Therefore, it is highly needed to address these issues. Current research proposes an improved cycle-constraint generative adversarial algorithm for the timely detection of surface cracks in underwater structures. It utilizes an enhanced cycle-consistent generative adversarial network (CycleGAN). The proposed algorithm uses image processing techniques including DeblurGAN and Dark channel prior methods to get quality of dataset from underwater structures. The proposed Algorithm introduces a novel cross-domain VGG-cosine similarity assessment to precisely evaluate the performance of proposed algorithm to retain crack information etc. Moreover, performance of proposed algorithm is evaluated through both qualitative and quantitative methods. The quantitative results are directly obtained from the visual results are presented which are generated by the proposed Algorithm. Whereas, the performance of proposed algorithm based on quantitative results is obtained from metrics including PSNR, SSIM, and FID. Experimental results indicates that the proposed algorithm outperforms the original CycleGAN. End results indicate that the proposed algorithm decreased the value of FID by 20 % and increased the values of PSNR and SSIM by 2.37 % and 3.33 % respectively. Quantitative and qualitative results of the proposed algorithm give significant advantages during creating of surface crack images.

Drainage Pipeline Defect Detection System Based on Semantic Segmentation

Since drainage pipes are widely used in daily life and are necessary for cities to function normally, intelligent fault detection in these pipes has emerged as both an urgent necessity and a major area of development. Compared to traditional target detection methods, the semantic segmentation-based pipeline defect detection method has some special qualities. It can effectively detect a variety of pipeline defect types and segment the defects using precise geometrical attributes to support subsequent defect assessment. This study replaces the backbone network and fuses bar pooling and cascade feature fusion modules in the encoding and decoding phases, respectively, to obtain richer semantic information. This approach strikes a balance between segmentation accuracy and model complexity, aiming to address the problems of the large computational volume of semantic segmentation and the loss of detailed semantic information of pipeline defects. In the pipe defect dataset, the proposed approach is compared with the baseline algorithm and the experimental findings indicate that it has a greater segmentation accuracy than the conventional algorithm. Additionally, the lightweight design of the algorithm lowers the model’s complexity.

Surface defect detection model of laser cutting polycrystalline cubic boron nitride tool based on asymptotic fusion strategy

Due to the polycrystalline cubic boron nitride tool has the characteristics of high hardness, brittleness, etc., it is easy to break the tool or produce defects in the laser cutting process, which affects the cutting performance of the tool. Traditional defect detection methods can no longer meet the needs of modern manufacturing. Aiming at the problems of low accuracy and poor real-time detection of surface defects on laser-cutting polycrystalline cubic boron nitride tools, this study proposes the surface defect detection model of laser cutting polycrystalline cubic boron nitride tool based on asymptotic fusion strategy, which fills the gap in the field. In the backbone network, the C3SE module is constructed by modeling the correlation between feature channels to improve the model’s focus on key features in order to enhance the feature extraction and processing capability of the backbone network; In the neck network, adaptive spatial fusion operation and direct interaction of non-adjacent layers are utilized for multi-scale information fusion, and the asymptotic feature pyramid network for object detection (AFPN) is used instead of the FPN structure to improve the detection performance; In the head network, a soft suppression mechanism is introduced to reduce the overlapping frame score using a decay function, thus improving the detection accuracy. The experimental results based on the self-constructed laser-cutting polycrystalline cubic boron nitride tool surface defects dataset show that the average accuracy of the AFFS-YOLO model is improved by 5.6% compared with that of the YOLOv5 model, reaching 86.1%, and the detection effect is better than that of the original network and other classical target detection networks.

Machine vision-based detection of surface defects in cylindrical battery cases

Automotive 21700 series lithium batteries are prone to surface defects during production and transportation, thus affecting their performance, so we propose a full-surface defect detection method for battery cases based on the synthesis of traditional image processing and deep learning to address this problem. First, the mechanism of surface defects on a battery case is analysed, and the types of surface defects are summarized. A suitable platform for image acquisition is designed for the severely reflective surface. Since there is no publicly available defect dataset for cylindrical battery cases, a defect dataset is established, and the dataset is augmented and expanded via the traditional method and the ACGAN model. For the defects on the top of the battery case, a traditional image processing algorithm is used to combine the roundness and the area of the area pixels to make a comprehensive judgement. For the defects on the bottom and side of the battery case, after comparing and analysing a variety of deep learning networks, the YOLOv7 model is selected to address the data characteristics of the large experimental inputs and the small targeted defects. To improve the accuracy of the model to meet the needs of real-time detection in industry, the CA attention mechanism, the DYHEAD dynamic detector head, and the slicing-assisted super inference (SAHI) method are used, with a final map accuracy reaching 98.1 %, which is 2.7 % higher than that of the initial model. Compared with mainstream target detection algorithms, the algorithm in this paper has good detection performance for cylindrical battery case defect detection and can be better applied to real-time detection in industry.

Sparse cross-transformer network for surface defect detection.

Quality control processes with automation ensure that customers receive defect-free products that meet their needs. However, the performance of real-world surface defect detection is often severely hindered by the scarcity of data. Recently, few-shot learning has been widely proposed as a solution to the data sufficiency problem by leveraging a limited number of base class samples. However, achieving discriminative and generalization capabilities with few samples remains a challenging task in various surface defect detection scenarios. In this paper, we propose a sparse cross-transformer network (SCTN) for surface defect detection. Specifically, we introduce a residual layer module to enhance the network's ability to retain crucial information. Next, we propose a sparse layer module within the cross-transformer to increase computational efficiency. Finally, we incorporate a squeeze-and-excitation network into the cross-transformer to enhance the attention mechanism between local patches outputted by the transformer encoder. To verify the effectiveness of our proposed method, we conducted extensive experiments on the cylinder liner defect dataset, the NEU steel surface defect dataset, and the PKU-Market-PCB dataset, achieving the best mean average precision of 62.73%, 85.29%, and 88.7%, respectively. The experimental results demonstrate that our proposed method achieves significant improvements compared to state-of-the-art algorithms. Additionally, the results indicate that SCTN enhances the network's discriminative ability and effectively improves generalization across various surface defect detection tasks.

Deep Neural Network-Based Cigarette Filter Defect Detection System with FPGA Acceleration for Online Recognition

In the cigarette manufacturing industry, machine vision and artificial intelligence algorithms have been employed to improve production efficiency by detecting product defects. However, achieving both high accuracy and real-time defect detection for cigarettes with complex patterns remains a challenge. To address these issues, this study proposes a model based on RESNET18, combined with a feature enhancement algorithm, to improve detection accuracy. Additionally, a method is designed to deploy the model on a field-programmable gate array (FPGA) with high parallel processing capabilities to achieve high-speed detection. Experimental results demonstrate that the proposed detection model achieves a detection accuracy of 95.88% on a cigarette filter defect dataset with an end-to-end detection speed of only 9.38 ms.

Aero-engine defect detection by integrating attention and multi-scale features

The structural integrity of aircraft engines is related to flight safety. At present, aircraft engine defect detection based on borescope technology is mainly manual operation. In order to improve the detection accuracy and efficiency, an intelligent aircraft engine defect detection algorithm that integrates attention and multi-scale features is proposed to assist borescope work. First, to address the class imbalance problem of defect samples in the original borescope image, a multi- sample fusion data enhancement method based on geometric transformation and Poisson image editing is used to enrich small sample images and construct a defect dataset. Then, the coordinated attention module (CA) is integrated into the baseline network YOLOv5 to emphasize the extraction of defect features and enhance the network's distinction between defect targets and complex backgrounds. A weighted bidirectional feature pyramid structure (BiFPN) is constructed in the neck network to complete higher-level feature fusion and improve the expression ability of multi-scale targets. Finally, the bounding box regression loss function is defined as the EIOU loss to achieve fast and accurate positioning and identification of defect targets. Experimental results show that the average accuracy of defect detection of the proposed algorithm reaches 89.7%, which is improved compared with the baseline network 6.3%, and the size of the trained model is only 14.0 M. Therefore, the proposed method can effectively detect the main defects of aircraft engines.

An efficient multiscale enhancement network with attention mechanism for aluminium defect detection

ABSTRACT Real-time defect detection is required to efficiently control the quality of aluminium. However, aluminium defects have the characteristics of small-size, low contrast, and multiscale variations, which pose great challenges to defect detection. This article aims to improve the defect detection accuracy and propose an effective multiscale enhancement network with attention mechanism for aluminium defect detection (AMMENet). First, to capture key features and mitigate interference from the background, a pluggable parallel residual attention module (PRAM) is proposed for the feature extraction network. To compensate for the loss of deep features, a multilevel semantic enhancement module (C2f-MFF) is proposed to fuse multiscale feature maps. Finally, the model was applied to the Tianchi Aluminium Surface Defect Dataset (TC-ASDD) for ablation experiments and comparisons. The experimental results show that the mean average precision (mAP@0.5) of the proposed AMMENet is 73.6% with a real-time detection speed of 66.2 frames per second (FPS). Compared with YOLOv8 baseline network, AMMENet improves mAP@0.5 by 2.8% with only a slight loss in speed. Moreover, AMMENet is superior to the state-of-the-art detection methods in terms of detection accuracy.

Unsupervised bearing raceway surface defect detection based on improved f-AnoGAN

Abstract For addressing bearing raceway surface defects, supervised deep learning methods face challenges such as insufficient defect samples and imbalance between defect and non-defect samples. To overcome these issues, we propose an enhanced fast anomaly detection with generative adversarial networks (f-AnoGAN) unsupervised detection algorithm. Firstly, SE-Block modules based on SE attention mechanism and residual structure are integrated into the encoder, aiding the network in focusing on channel information while alleviating gradient vanishing problems. Secondly, transfer learning is introduced to effectively enhance the algorithm’s detection performance and generalization ability. Finally, utilizing bearing images collected from industrial sites, a self-built bearing raceway surface defect dataset is constructed, and extensive experiments are conducted. Experimental results demonstrate that the improved algorithm achieves an area under curve score of 99.96% on the self-built bearing raceway surface defect dataset, representing a 7.07% improvement over the f-AnoGAN algorithm, meeting the requirements for online detection in bearing industry applications.

Aircraft skin defect detection algorithm based on improved YOLOv8

To solve the problem that the traditional aircraft skin defect detection relies on human eye observation, which leads to reduced efficiency due to human eye fatigue and limited individual cognition, an aircraft skin defect detection algorithm based on improved YOLOv8 is proposed. The data enhancement method is improved, and a slice reasoning + mosaic data enhancement method is proposed; the residual block is integrated into the feature extraction network to enhance the network expression ability and improve the accuracy of the model in the aircraft skin defect detection task; the three-branch (Triplet) attention module is applied to improve the feature fusion network to reduce the false detection rate and missed detection rate of small target samples; the structure of the detection head is optimized so that the network can better combine shallow information with deep information. Experimental results show that compared with the latest YOLOv8 algorithm, the improved algorithm improves the mean average precision (mAP) and recall rate (Recall) on the aircraft skin defect dataset by 3.6%and respectively 3.7%; and improves the mean average precision and recall rate on the public dataset VOC2007 by 2.9%and 2.2%.

Ultrasonic Weld Quality Inspection Involving Strength Prediction and Defect Detection in Data-Constrained Training Environments.

Welding is an extensively used technique in manufacturing, and as for every other process, there is the potential for defects in the weld joint that could be catastrophic to the manufactured products. Different welding processes use different parameter settings, which greatly impact the quality of the final welded products. The focus of research in weld defect detection is to develop a non-destructive testing method for weld quality assessment based on observing the weld with an RGB camera. Deep learning techniques have been widely used in the domain of weld defect detection in recent times, but the majority of them use, for example, X-ray images. An RGB image-based solution is attractive, as RGB cameras are comparatively inexpensive compared to X-ray image solutions. However, the number of publicly available RGB image datasets for weld defect detection is comparatively lower than that of X-ray image datasets. This work achieves a complete weld quality assessment involving lap shear strength prediction and visual weld defect detection from an extremely limited dataset. First, a multimodal dataset is generated by the fusion of image data features extracted using a convolutional autoencoder (CAE) designed in this experiment and input parameter settings data. The fusion of the dataset reduced lap shear strength (LSS) prediction errors by 34% compared to prediction errors using only input parameter settings data. This is a promising result, considering the extremely small dataset size. This work also achieves visual weld defect detection on the same limited dataset with the help of an ultrasonic weld defect dataset generated using offline and online data augmentation. The weld defect detection achieves an accuracy of 74%, again a promising result that meets standard requirements. The combination of lap shear strength prediction and visual defect detection leads to a complete inspection to avoid premature failure of the ultrasonic weld joints. The weld defect detection was compared against the publicly available image dataset for surface defect detection.

Lightweight rail surface defect detection algorithm based on an improved YOLOv8

Existing deep learning methods for rail surface defect detection face issues such as poor compatibility with embedded detection systems, high computational resource consumption, and slow detection speeds. To address these challenges, we propose a lightweight rail surface defect detection algorithm11Code: https://github.com/haichao67/GD-YOLOv8. based on an improved YOLOv8.Inspired by Huawei’s Gold-YOLO, our algorithm redesigns the neck architecture, integrates feature extraction, fusion, and injection modules, and replaces Complete Intersection over Union with Scylla Intersection over Union. Comparative experiments confirm its efficacy, achieving 94.9% precision and 81.9% recall on the Rail Surface Defect Dataset, a 26.3% increase in frames per second, and a model size reduction to 63%. Our algorithm not only ensures satisfactory detection results but also reduces the number of model parameters and increases the detection speed.

Surface defect detection method of aluminium alloy castings based on data enhancement and CRT‐DETR

AbstractThe surface quality of aluminium alloy castings is crucial to quality control. Aiming to address the challenges of limited samples and extensive computation in deep learning‐based surface defect detection for aluminium alloy castings, this paper proposes a surface defect detection method based on data enhancement and the Casting Real‐Time DEtection TRansformer. First, to tackle the issue of small sample sizes and uneven distribution in surface defect data sets of aluminium alloy castings, ECA‐MetaAconC Deep Convolution Generative Adversarial Networks is proposed for generating defects with fewer samples and employ the image augmentation (IMGAUG) library for sample enhancement. Second, building upon the Real‐Time DEtection TRansformer (RT‐DETR), a lightweight partial‐rep convolution is designed to decrease the network's parameter count. Simultaneously, the Deformable attention module and the DRBC3 module are introduced to enhance the neck network, thereby improving the model's capability to capture information and enhancing its detection performance. Compared to RT‐DETR, this method reduces the number of model parameters by 38.7%, increases mAP by 1.5%, and achieves a frame rate that is 1.58 times higher than the original model. The experimental results demonstrate that this method can effectively and accurately detect surface defects in aluminium alloy castings, satisfying industrial requirements.

A prior knowledge-embedded deformable convolutional network for vision-based fabric defect detection

The vision-based defect detection of textile surface is an essential problem in evaluating the appearance quality. In previous studies on vision-based defect detection, the following two points were neglected: (1) The proportion of defects on fabric is small, resulting in a low signal-to-noise ratio of defect images and a lack of sampling features; (2) the irregular shape of defects can overlap in position, leading to localization difficulty. In this paper, we propose a prior knowledge-embedded deformable convolutional network (PKE-DCNet) based on deep learning to address these two issues. First, a feature extraction method with prior information is designed with a shape-matching deep clustering module and a region-biased sampling module for detecting defects with complex shape. Then, a defect boundary boxes adaptive generation method is proposed with an anchor-free search mechanism and irregular edge contour computation to detect the key points in the region. Extensive experiments with mixed fabric defect datasets demonstrated that PKE-DCNet reached an overall mAP of 95.36% for six types of defects within a detection speed of 322 FPS, which was better than state-of-the-art methods.

Lightweight algorithm based on you only look once version 5 for multiple class defect detection on wind turbine blade surfaces

A lightweight wind turbine blade surface multiple class defect detection algorithm based on You Only Look Once version 5 (YOLOv5) is proposed to address the issues of low accuracy, poor efficiency, and high power consumption associated with manual and traditional automation algorithms used for detecting surface defects on wind turbine blades. Firstly, by replacing the Concentrated-Comprehensive Convolution Block module in YOLOv5 with the GhostBottleneckv2 module, the overall parameter count of the model is significantly reduced. Additionally, advocating the inclusion of the Convolutional Block Attention Module (CBAM) into the YOLOv5 backbone network to address the issue of small targets and significant scale variations in surface defects found on wind turbine blades. The YOLOv5 feature fusion module replaces the Feature Pyramid Network (FPN) structure with the Bidirectional Feature Pyramid Network (BiFPN) structure to enhance the fusion capability of multi-scale weighted features. Finally, the optimized model files underwent structured pruning through the application of pruning strategies, retraining fine-tuning, and knowledge distillation techniques. The experimental results on the self-made dataset of surface defects on wind turbine blades indicate that the optimized model has a parameter count that is only 48.79% of the small version of the YOLOv5 model. However, its mean Average Precision (mAP) and frame rate have increased by 5.05% and 8.1 frames/s, respectively, reaching 94.56% and 43.7 frames/s. The lightweight algorithm proposed in this study meets the accuracy and real-time requirements for surface defect detection on wind turbine blades.

Identification method for micro–nano defects in Si3N4 ceramic bearing rollers

In response to the surface micro–nano defects of small Si3N4 ceramic bearing rollers during use, as well as the poor generalization ability and low accuracy of the object detection model trained on the micro and nano defect dataset, an enhanced recognition algorithm based on deep convolutional generative adversarial networks is proposed. Due to the limited size of the dataset, the DCGAN model is reconstructed to effectively expand the micro–nano defect dataset. In addition, noise generalization is applied to stabilize DCGAN model training, creating a low-dimensional manifold distribution to ensure significant overlap between the data and the original dataset, and activating Jensen–Shannon (JS) divergence for stable training. To verify the effectiveness of the enhanced dataset, synthetic micro–nano defects are used to improve the YOLO-v4-tiny object detection model. By comparing t-distributed stochastic neighbor embedding (t-SNE) and feature vectors, it can be found that the images generated by the optimized DCGAN have higher grayscale feature diversity and better visual consistency. After generations of enhancements, the micro–nano defect detection speed has reached 226FPS, and the accuracy has reached 97.41%.

Improvement of deformable DETR model for insulator defect classification detection method

Abstract In response to challenges faced by traditional detection methods such as image blurring, scarcity of insulator defect datasets, and insulators as small targets, we propose an improved Deformable DETR network based on the DETR defect detection algorithm. This network model accurately identifies the position information of insulators and segments the insulators on the insulator string. To address the classification problem after defect detection, we introduce a fused insulator defect classifier with a self-attention mechanism built behind the Deformable DETR model. The detected insulators are classified into three categories. Due to the limited dataset of damaged insulators, corresponding loss functions are set to address the issue of sample imbalance, thereby increasing the model’s focus on damaged insulators. Experimental results demonstrate an accuracy of 97.5% on the test set, highlighting the network’s strong generalization ability.

FDADNet: Detection of Surface Defects in Wood-Based Panels Based on Frequency Domain Transformation and Adaptive Dynamic Downsampling

The detection of surface defects on wood-based panels plays a crucial role in product quality control. However, due to the complex background and low contrast of defects in wood-based panel images, features extracted by traditional deep learning methods based on spatial domain processing often contain noise and blurred boundaries, which severely affects detection performance. To address these issues, we have proposed a wood-based panel surface defect detection method based on frequency domain transformation and adaptive dynamic downsampling (FDADNet). Specifically, we designed a Multi-axis Frequency Domain Weighted Information Representation Module (MFDW), which effectively decoupled the indistinguishable low-contrast defects from the background in the transform domain. Gaussian filtering was then employed to eliminate noise and blur between the defects and the background. Additionally, to tackle the issue of scale differences in defects that led to difficulties in accurate capture, we designed an Adaptive Dynamic Convolution (ADConv) module for downsampling. This method flexibly compressed and enhanced features, effectively improving the differentiation of the features of objects of varying scales in the transform space, and ultimately achieved effective defect detection. To compensate for the lack of data, we constructed a dataset of wood-based panel surface defects, WBP-DET. The experimental results showed that the proposed FDADNet effectively improved the detection performance of wood-based panel surface defects in complex scenarios, achieving a solid balance between efficiency and accuracy.

Entropy Stacked Autoencoder based Diffusion Model (ESADM) and Fuzzy Clustering with Semi Supervised Fuzzy Graph Convolutional Network (FC-SSFGCN) for Rail Surface Defect Detection

Rails, fasteners, and other parts of railway track lines eventually develop flaws due to continuous strain from train operations and direct exposure to the environment; these faults directly affect the safety of train operations. Detecting defects on rail surfaces presents a formidable challenge due to the wide array of possible flaws and their unpredictable nature. However, Defect identification errors, massive variances, inadequate training sample availability, and weak contrast between faults and the surrounding background all contribute to the complexity of this procedure. In this work, rail surface and fastener flaws may be detected non-destructively using a multi-crack detection approach based on the Entropy Stacked Autoencoder Diffusion Model (ESADM). A novel approach, ESAFM, has been developed, combining a rail surface image encoder with a multi-layer, Stacked Autoencoder to extract latent materials from images showcasing different types of cracks. This integration reduces the need for significant processing resources by integrating easily into the conventional physically-based image workflow. Additionally, the Zero Shot-Semi Supervised Fuzzy Class Knowledge Graph (ZS-SSFCKG) method proposes Class Knowledge Graph Construction (CKGC), which constructs a CKG to elucidate the connection between defects and non-defects. Class features are learned by using a Fuzzy Clustering with Semi Supervised Fuzzy Graph Convolutional Network (FC-SSFGCN). The method employs a transformer encoder to capture distant relationships, allowing for the extraction of features from defect samples. This facilitates the acquisition of distinct defect image characteristics, as industrial defects vary in shape and size. The experimental results on the public Railway Track Fault Detection (RTFD)and Rail Surface Defect Datasets (RSDDs) with rail surface defects are collected from rail tracks surface defect detection.