Superpixel-based principal feature clustering annotation method for dual-phase microstructure segmentation

Abstract

Metallographic analysis is one of the most commonly used techniques by materials scientists for studying metal materials. The deep learning methods, which have been widely applied in metallographic images analysis, demonstrate excellent performance in this task. However, the optimization of deep learning models often relies on a substantial amount of accurately labeled samples for effective supervision. To address this issue, this paper proposes a novel automatic annotation method based on brightness and spatial distribution which is suitable for deep learning-based segmentation of optical dual-phase metallographic microstructure. The proposed automatic annotated method includes the superpixel segmentation, principal feature extraction, and clustering algorithm therefore it is referred as the superpixel-based principal feature clustering annotation (SPFCA) method. SPFCA employs discriminative criteria similar to those used by metallurgists to differentiate between metallographic structures. Furthermore, it can mitigate the occasional errors inherent in manual annotation, leading to improved performance compared to models trained with expert annotations. Experimental validation was conducted using four self-built datasets with different image qualities to test the performance of models from different perspective. Initially, hyperparameter optimization for the SPFCA method tailored to our dataset was performed. Subsequently, SPFCA was utilized to guide the optimization of the convolutional neural network employed for segmentation. The results demonstrate that the segmentation model optimized with SPFCA guidance achieved an F1 score of 0.9226 in the single dataset without the need for manual labeling, surpassing the segmentation models optimized with expert annotations.