Detection Of Rail Surface Defects Research Articles

Lightweight rail surface defect detection algorithm based on an improved YOLOv8

Existing deep learning methods for rail surface defect detection face issues such as poor compatibility with embedded detection systems, high computational resource consumption, and slow detection speeds. To address these challenges, we propose a lightweight rail surface defect detection algorithm11Code: https://github.com/haichao67/GD-YOLOv8. based on an improved YOLOv8.Inspired by Huawei’s Gold-YOLO, our algorithm redesigns the neck architecture, integrates feature extraction, fusion, and injection modules, and replaces Complete Intersection over Union with Scylla Intersection over Union. Comparative experiments confirm its efficacy, achieving 94.9% precision and 81.9% recall on the Rail Surface Defect Dataset, a 26.3% increase in frames per second, and a model size reduction to 63%. Our algorithm not only ensures satisfactory detection results but also reduces the number of model parameters and increases the detection speed.

Entropy Stacked Autoencoder based Diffusion Model (ESADM) and Fuzzy Clustering with Semi Supervised Fuzzy Graph Convolutional Network (FC-SSFGCN) for Rail Surface Defect Detection

Rails, fasteners, and other parts of railway track lines eventually develop flaws due to continuous strain from train operations and direct exposure to the environment; these faults directly affect the safety of train operations. Detecting defects on rail surfaces presents a formidable challenge due to the wide array of possible flaws and their unpredictable nature. However, Defect identification errors, massive variances, inadequate training sample availability, and weak contrast between faults and the surrounding background all contribute to the complexity of this procedure. In this work, rail surface and fastener flaws may be detected non-destructively using a multi-crack detection approach based on the Entropy Stacked Autoencoder Diffusion Model (ESADM). A novel approach, ESAFM, has been developed, combining a rail surface image encoder with a multi-layer, Stacked Autoencoder to extract latent materials from images showcasing different types of cracks. This integration reduces the need for significant processing resources by integrating easily into the conventional physically-based image workflow. Additionally, the Zero Shot-Semi Supervised Fuzzy Class Knowledge Graph (ZS-SSFCKG) method proposes Class Knowledge Graph Construction (CKGC), which constructs a CKG to elucidate the connection between defects and non-defects. Class features are learned by using a Fuzzy Clustering with Semi Supervised Fuzzy Graph Convolutional Network (FC-SSFGCN). The method employs a transformer encoder to capture distant relationships, allowing for the extraction of features from defect samples. This facilitates the acquisition of distinct defect image characteristics, as industrial defects vary in shape and size. The experimental results on the public Railway Track Fault Detection (RTFD)and Rail Surface Defect Datasets (RSDDs) with rail surface defects are collected from rail tracks surface defect detection.

Research on Rail Surface Defect Detection Based on Improved CenterNet

Rail surface defect detection is vital for railway safety. Traditional methods falter with varying defect sizes and complex backgrounds, while two-stage deep learning models, though accurate, lack real-time capabilities. To overcome these challenges, we propose an enhanced one-stage detection model based on CenterNet. We replace ResNet with ResNeXt and implement a multi-branch structure for better low-level feature extraction. Additionally, we integrate SKNet attention mechanism with the C2f structure from YOLOv8, improving the model’s focus on critical image regions and enhancing the detection of minor defects. We also introduce an elliptical Gaussian kernel for size regression loss, better representing the aspect ratio of rail defects. This approach enhances detection accuracy and speeds up training. Our model achieves a mean accuracy (mAP) of 0.952 on the rail defects dataset, outperforming other models with a 6.6% improvement over the original and a 35.5% increase in training speed. These results demonstrate the efficiency and reliability of our method for rail defect detection.

An Improved Target Network Model for Rail Surface Defect Detection

Rail surface defects typically serve as early indicators of railway malfunctions, which may compromise the quality and corrosion resistance of rails, thereby endangering the safe operation of trains. The timely detection of defects is essential to ensure the safe operation of railways. To improve the classification accuracy of rail surface defect detection, this paper proposes a rail surface defects detection algorithm based on MobileNet-YOLOv7. By integrating lightweight deep learning algorithms into the engineering application of rail surface defect detection, a MobileNetV3 lightweight network is used as the backbone network for YOLOv7 to enhance both speed and accuracy in complex defect extraction. Subsequently, the efficient intersection over union (EIOU) loss function is utilized as the positional loss function to bolster system resilience. Finally, the k-means++ clustering algorithm is applied to obtain new anchor boxes. The experimental results demonstrate the effectiveness of the proposed method, achieving superior detection accuracy compared with traditional algorithms.

Rail Surface Defect Detection Based on Dual-Path Feature Fusion

With the rapid development of rail transit, the workload of track maintenance has increased, making the intelligent identification of rail surface defects crucial for improving detection efficiency. To address issues such as low defect detection accuracy, the loss of feature information due to single-path architecture backbones, and insufficient information interaction in existing rail defect detection methods, we propose a rail surface defect detection method based on dual-path feature fusion (DPF). This method initially employs a dual-path structure to separately extract low-level and high-level features. It then utilizes a combination of attention mechanisms and feature fusion techniques to integrate these features. By doing so, it preserves richer information and enhances detection accuracy and robustness. The experimental results demonstrate that the comprehensive performance of the proposed model is superior to mainstream algorithms.

Uncertainty inspired domain adaptation network for rail surface defect segmentation

Rail surface defect detection is an essential part of railroad maintenance to prevent safety accidents. Recently, deep learning-based defect detection algorithms have shown impressive detection performance. However, the performance improvement from deep neural networks is based on a strong assumption that the training images have the same data distribution as the test images. This requirement is unrealistic in practical railroad surface defect detection. The appearance of rails varies significantly in different railroad sections due to changes in working conditions and maintenance status. In this paper, we propose a novel uncertainty-inspired unsupervised domain adaptation framework (UIUDA) to improve the generalization of deep learning models on data with distribution differences. Specifically, domain adversarial learning is used to align the feature distributions of training and test data. To mitigate the negative transfer caused by global alignment, we design a locally aligned domain adaptation strategy. In addition, self-training is introduced to refine the decision boundaries of the model in the test data. In this process, we propose an uncertainty-inspired evaluation method to remove noisy pseudo labels. We conducted domain adaptation experiments with RSDD and NEU-RSDD as the source domain and FRSD dataset as the target domain. The results show that UIUDA can effectively improve the generalization ability of the model, and the mIoU metric of defect segmentation is 80.17%.

RSDNet: A New Multiscale Rail Surface Defect Detection Model.

The rapid and accurate identification of rail surface defects is critical to the maintenance and operational safety of the rail. For the problems of large-scale differences in rail surface defects and many small-scale defects, this paper proposes a rail surface defect detection algorithm, RSDNet (Rail Surface Defect Detection Net), with YOLOv8n as the baseline model. Firstly, the CDConv (Cascade Dilated Convolution) module is designed to realize multi-scale convolution by cascading the cavity convolution with different cavity rates. The CDConv is embedded into the backbone network to gather earlier defect local characteristics and contextual data. Secondly, the feature fusion method of Head is optimized based on BiFPN (Bi-directional Feature Pyramids Network) to fuse more layers of feature information and improve the utilization of original information. Finally, the EMA (Efficient Multi-Scale Attention) attention module is introduced to enhance the network's attention to defect information. The experiments are conducted on the RSDDs dataset, and the experimental results show that the RSDNet algorithm achieves a mAP of 95.4% for rail surface defect detection, which is 4.6% higher than the original YOLOv8n. This study provides an effective technical means for rail surface defect detection that has certain engineering applications.

Deep Learning (Fast R-CNN)-Based Evaluation of Rail Surface Defects

In current railway rails, trains are propelled by the rolling contact between iron wheels and iron rails, and the high frequency of train repetition on rails results in a significant load exertion on a very small area where the wheel and rail come into contact. Furthermore, a contact stress beyond the allowable stress of the rail may lead to cracks due to plastic deformation. The railway rail, which is the primary contact surface between the wheel and the rail, is prone to rolling contact fatigue cracks. Therefore, a thorough inspection and diagnosis of the condition of the cracks is necessary to prevent fracture. The Detailed Guideline on the Performance Evaluation of Track Facilities in South Korea specifies the detailed requirements for the methods and procedures for conducting track performance evaluations. However, diagnosing rail surface damage and determining the severity solely rely on visual inspection, which depends on the qualitative evaluation and subjective judgment of the inspector. Against this backdrop, rail surface defect detection was investigated using Fast R-CNN in this study. To test the feasibility of the model, we constructed a dataset of rail surface defect images. Through field investigation, 1300 images of rail surface defects were obtained. Aged rails collected from the field were processed, and 1300 images of internal defects were generated through SEM testing; therefore, a total of 1300 pieces of learning data were constructed. The detection results indicated that the mean average precision was 94.9%. The Fast R-CNN exhibited high efficiency in detecting rail surface defects, and it demonstrated a superior recognition performance compared with other algorithms.

ISRM: introspective self-supervised reconstruction model for rail surface defect detection and segmentation

The problems of intrinsic imbalance of the sample and interference from complex backgrounds limit the performance of existing deep learning methods when applied to the detection and segmentation of rail surface defects. To address these issues, an introspective self-supervised reconstruction model (ISRM) is proposed, which only requires normal samples in the training phase and incorporates the concept of self-supervised learning into an introspective autoencoder. The training framework of ISRM first extracts general features using a pretrained Feature Extractor. Subsequently, a Feature Transformer transfers the features to the target domain. Next, a synthetic defect embedder embeds Bessel-Gaussian random defects into the feature space. Finally, the asymmetric autoencoder reconstructs the rail surface features back into image space. The transformation of pretrained features into target-oriented features helps mitigate domain bias. Since defects exhibit higher commonality in the feature space relative to the image space, embedding synthetic defects into the feature space effectively improves training efficiency. Moreover, the adversarial training architecture enhances the clarity of reconstructed images. The impact of core parameters on the model performance is analyzed through ablation experiments. The results from comparative experiments demonstrate that ISRM achieves 98.5% and 97.2% accuracy on defect detection and segmentation tasks, respectively, reducing the error rate by 11.8% and 3.4% compared to the current state-of-the-art model.

Rail surface defect detection using a transformer-based network

The detection of Rail Surface Defects (RSDs) plays a critical role in railway track maintenance. Traditional image processing methods exhibit limitations due to their intricate design and insufficient robustness, thereby restricting their broader applications. Recently, deep learning-based RSD detection methods have drawn great attention. However, these methods predominantly rely on Convolutional Neural Networks (CNN), neglecting the hierarchical linkages amongst disparate features, which impedes the refined portrayal of RSDs. To address these issues, we propose RailFormer, a novel system leveraging the capabilities of Transformer-based networks for the precise and efficient detection of RSDs. The encoder in RailFormer incorporates overlapped patch merging, efficient self-attention, and a Mix-feed Forward Network (FFN), all meticulously designed to bolster feature fusion from both global and local perspectives. Additionally, we have implemented a Criss-Cross attention module within the decoder to facilitate RSD detection and manage computational complexity. In this study, the proposed RailFormer and four other models including SegFormer, Swin Transformer, ViT, and UNet are trained and compared. We employ the widely used public RSD datasets RSDD, encompassing both Type-I and Type-II RSDD images and a customized RSD dataset, as a basis for performance comparison. The training outcomes and visualization results show that RailFormer achieves the highest mean Intersection over Union (mIoU) and superior visualization performance on the RSDD and the customized RSD datasets. These results demonstrate the superiority of RailFormer and underline its potential for future deployment in railway track inspection applications.

An Improved YOLOv8 Algorithm for Rail Surface Defect Detection

An Improved YOLOv8 Algorithm for Rail Surface Defect Detection

Normalized Cyclic Loop Network for Rail Surface Defect Detection Using Knowledge Distillation

Normalized Cyclic Loop Network for Rail Surface Defect Detection Using Knowledge Distillation

Resolving mode mixing in wheel–rail surface defect detection using EMD based on binary time scale

Due to the mode mixing, empirical mode decomposition (EMD) cannot effectively decompose the vibration signal when the signal is intermittent and pulse interference caused by discontinuous vibration. The methods to solve mode mixing often use noise assistance, such as ensemble EMD (EEMD), complete EEMD (CEEMD), etc. These methods can effectively solve mode mixing, but they also have shortcomings. In EEMD, the added noises not only have residual effects and time-consuming. The drawback of CEEMD is that it is difficult to align during set averaging. In this paper, an improved EMD based on binary time scale (EMD-BTS) is proposed for the fault feature extraction of wheel–rail defect detection. Firstly, the generalized intrinsic mode function (GIMF) is defined based on the time-domain characteristics of non-stationary vibration signals. Then, to tackle the drawbacks of EMD which cannot effectively solve mode mixing caused by signal intermittence and pulse interference, the inherent mode is extracted in the EMD-BTS to decompose the raw signals into GIMFs. Finally, the false components generated by over decomposition are combined based on time-domain cross covariance. A simulation case and a actual case of vehicle bogie are utilized to verify the feasibility of the proposed EMD-BTS. The results indicate that the proposed approach exceeds other typical techniques in extracting intermittent fault features of wheel–rail defect detection.

Self-Supervised Defect Representation Learning for Label-Limited Rail Surface Defect Detection

Self-Supervised Defect Representation Learning for Label-Limited Rail Surface Defect Detection

A Signal Filtering Method for Magnetic Flux Leakage Detection of Rail Surface Defects Based on Minimum Entropy Deconvolution

Magnetic flux leakage (MFL) detection of rail surface defects is an important research field for railway traffic safety. Due to factors such as magnetization and material, it can generate background noise and reduce detection accuracy. To improve the detection signal strength and enhance the detection rate of more minor defects, a signal filtering method based on minimum entropy deconvolution is proposed to denoise. By using the objective function method, the optimal inverse filter parameters are calculated, which are applied to the filtering detection of MFL signals of the rail surface. The detection results show that the peak-to-peak ratio of the defect signal and noise signal detected by this algorithm is 2.01, which is about 1.5 times that of the wavelet transform method and median filtering method. The defect signal is significantly enhanced, and the detection rate of minor defects on the rail surface can be effectively improved.

FS-RSDD: Few-Shot Rail Surface Defect Detection with Prototype Learning.

As an important component of the railway system, the surface damage that occurs on the rails due to daily operations can pose significant safety hazards. This paper proposes a simple yet effective rail surface defect detection model, FS-RSDD, for rail surface condition monitoring, which also aims to address the issue of insufficient defect samples faced by previous detection models. The model utilizes a pre-trained model to extract deep features of both normal rail samples and defect samples. Subsequently, an unsupervised learning method is employed to learn feature distributions and obtain a feature prototype memory bank. Using prototype learning techniques, FS-RSDD estimates the probability of a test sample belonging to a defect at each pixel based on the prototype memory bank. This approach overcomes the limitations of deep learning algorithms based on supervised learning techniques, which often suffer from insufficient training samples and low credibility in validation. FS-RSDD achieves high accuracy in defect detection and localization with only a small number of defect samples used for training. Surpassing benchmarked few-shot industrial defect detection algorithms, FS-RSDD achieves an ROC of 95.2% and 99.1% on RSDDS Type-I and Type-II rail defect data, respectively, and is on par with state-of-the-art unsupervised anomaly detection algorithms.

Unsupervised Pixel-Level Detection of Rail Surface Defects Using Multistep Domain Adaptation

Detection of rail surface defects using deep learning largely relies on supervision with pixel-level ground truths, where the detection accuracy suffers due to unseen image domains. In order to streamline the laborious labeling process and accurately identify defects on rail surfaces a U-Net-based network that integrates spatial and channel attention (SA) modules, multistep domain adaptation (MSDA), and progressive histogram matching (PHM) is developed in the context of pixel-level defects detection in this research. MSDA with an unlabeled intermediate dataset is used to reduce the domain gap underlying different domains. To further improve the adaptation of the transferred model, the PHM method and the self-training method are employed to enhance detection accuracy. Trained in the source domain with ground truths, the deep learning model is then tested in the target domain with no annotations. Experimental results on the RSDD dataset and the Rail-Joint dataset demonstrate the applicability and effectiveness of the proposed approach. By alleviating the domain discrepancy, the developed model drastically enhances the average precision (AP) score of unsupervised detection from 0.103 to 0.861, which shows competitive performance compared with the AP score of 0.895 by the state-of-the-art supervised models. The novelty of this research lies in the development of a hybrid deep learning approach that is able to achieve competitive detection accuracy with a low overlap ratio between domains and few data labeling.

Automatic Rail Surface Defect Inspection Using the Pixelwise Semantic Segmentation Model

Rail surface defect (RSD) is an important railroad track quality indicator and impacts the overall track safety and ride quality. Railroads need to inspect and evaluate RSD conditions regularly to make proper maintenance plan for both freight and passenger services. Unfortunately, current field practices for rail surface defect defection have not been fully automated yet and significant amount of manual inspections are still involved, which could be labor-intensive but low-efficient. Earlier efforts have proposed multiple automatic rail surface defect detection systems, but the accuracy and equipment cost issues have limited their applications in the field. To address the needs in track inspections, this study proposes an improved Deeplabv3-plus model using a lightweight backbone, attention module, and the Lovász-Softmax loss to automatically detect RSD. The improved model not only improves the detection performance but also keeps the computational cost manageable. The ResNet-18 backbone is adopted for the encoder design to reduce the computational cost and maximize the inference speed. The CBAM attention module is unified with the decoder structure for critical features’ representation. The optimum crop size is determined in the training process. The Lovász-Softmax loss is implemented to address the severe class imbalance issue. The improved DeepLabv3-plus model is compared with five other models to validate the performance. Experimental results on both original data and noisy data confirm the proposed model achieves the best performance on evaluation metrics and visualization. This work provides a feasible solution for the future implementation of automatic railroad track inspection.

Rail Surface Defect Detection Based on An Improved YOLOv5s

As the operational time of the railway increases, rail surfaces undergo irreversible defects. Once the defects occur, it is easy for them to develop rapidly, which seriously threatens the safe operation of trains. Therefore, the accurate and rapid detection of rail surface defects is very important. However, in the detection of rail surface defects, there are problems, such as low contrast between defects and the background, large scale differences, and insufficient training samples. Therefore, we propose a rail surface defect detection method based on an improved YOLOv5s in this paper. Firstly, the sample dataset of rail surface defect images was augmented with flip transformations, random cropping, and brightness transformations. Next, a Conv2D and Dilated Convolution(CDConv) module was designed to reduce the amount of network computation. In addition, the Swin Transformer was combined with the Backbone and Neck ends to improve the C3 module of the original network. Then, the global attention mechanism (GAM) was introduced into PANet to form a new prediction head, namely Swin transformer and GAM Prediction Head (SGPH). Finally, we used the Soft-SIoUNMS loss to replace the original CIoU loss, which accelerates the convergence speed of the algorithm and reduces regression errors. The experimental results show that the improved YOLOv5s detection algorithm reaches 96.9% in the average precision of rail surface defect detection, offering the accurate and rapid detection of rail surface defects, which has certain engineering application value.

Rail Surface Defect Detection Based on Image Enhancement and Improved YOLOX

During the long and high-intensity railway use, all kinds of defects emerge, which often produce light to moderate damage on the surface, which adversely affects the stable operation of trains and even endangers the safety of travel. Currently, models for detecting rail surface defects are ineffective, and self-collected rail surface images have poor illumination and insufficient defect data. In light of the aforementioned problems, this article suggests an improved YOLOX and image enhancement method for detecting rail surface defects. First, a fusion image enhancement algorithm is used in the HSV space to process the surface image of the steel rail, highlighting defects and enhancing background contrast. Then, this paper uses a more efficient and faster BiFPN for feature fusion in the neck structure of YOLOX. In addition, it introduces the NAM attention mechanism to increase image feature expression capability. The experimental results show that the detection of rail surface defects using the algorithm improves the mAP of the YOLOX network by 2.42%. The computational volume of the improved network increases, but the detection speed can still reach 71.33 fps. In conclusion, the upgraded YOLOX model can detect rail surface flaws with accuracy and speed, fulfilling the demands of real-time detection. The lightweight deployment of rail surface defect detection terminals also has some benefits.