Multi-surface defect detection for universal joint bearings via multimodal feature and deep transfer learning

Abstract

ABSTRACT Surface defect detection by machine vision has received increased attention concerning the quality control of universal joint bearings (UJB). The defect distribution and counting information are important for product quality optimisation. However, vision defect detection for UJB remains a challenging task due to the diversity of background textures and defect characters on multiple surfaces. In this study, a multi-surface defect detection (MSDD) method consisting of region segmentation, feature extraction and detection is proposed. First, defect regions are accurately localised by the proposed adaptive defect region segmentation algorithm, which suppresses the inference of background variety. Then, a novel defect feature named multimodal fusion shape descriptor that integrates the global information and local information of defects is constructed to generate the discriminative defect representation. Finally, a defect feature extraction ability transfer strategy based on the transfer learning mechanism is proposed to address the problem of insufficient defect samples. The experimental results show that our method achieves the best accuracy of 94.8% macro-F1 and processes 28 defect images per second. Besides, the application effect in the practical production line indicates that our method meets the accuracy and real-time requirements of MSDD for UJB.