Point cloud completion network for 3D shapes with morphologically diverse structures

Abstract

Point cloud completion is a challenging task that involves predicting missing parts in incomplete 3D shapes. While existing strategies have shown effectiveness on point cloud datasets with regular shapes and continuous surfaces, they struggled to manage the morphologically diverse structures commonly encountered in real-world scenarios. This research proposed a new point cloud completion method, called SegCompletion, to derive complete 3D geometries from a partial shape with different structures and discontinuous surfaces. To achieve this, morphological segmentation was introduced before point cloud completion by deep hierarchical feature learning on point sets, and thus, the complex morphological structure was segmented into regular shapes and continuous surfaces. Additionally, each instance of a point cloud that belonged to the same type of feature could also be effectively identified using HDBSCAN (Hierarchical Density-Based Spatial Clustering of Applications with Noise). Furthermore, the multiscale generative network achieved sophisticated patching of missing point clouds under the same geometric feature based on feature points. To compensate for the variance in the mean distances between the centers of the patches and their closest neighbors, a simple yet effective uniform loss was utilized. A number of experiments on ShapeNet and Pheno4D datasets have shown the performance of SegCompletion on public datasets. Moreover, the contribution of SegCompletion to our dataset (Cotton3D) was discussed. The experimental results demonstrated that SegCompletion performed better than existing methods reported in the literature.