Precise and fast pipe instance segmentation is a critical component in industrial automatic assembly, facilitating accurate object detection and pose estimation, optimizing and supervising the assembly process. However, this problem is challenging due to topological errors on fine-scale structures caused by the pipes being complex and slender. To address these challenges, we propose a topology-constrained pipe instance segmentation network (TopoPIS) for complex stacking scene to achieve accurate segmentation with topological correctness. To better extract the features of complex and variable morphological pipes, adaptive curvature convolution is introduced to dynamically adapt to the slender pipe structure and capture critical features. To handle topological errors like broken connections, we propose a novel topological constraint loss function based on persistent homology, which greatly improves the topological continuity of the segmentation. Experimental results on real-world and unseen datasets demonstrate that our TopoPIS outperforms other methods regrading segmentation accuracy and topological continuity.
Read full abstract