Abstract
In spite of the good performance of convolutional neural network (CNN) and graph neural network (GNN) in 3D point cloud classification and segmentation at present, to aggregate local information of point clouds and improve the robustness of geometric transformation are still challenging problems. In order to tackle the problems, we propose Geometry Feature Aggregation Network (GFA-Net), which can effectively learn the context information of each point to aggregate local information, so as to enhance the robustness of rotation and translation. Compared with the current popular method GNN that convolves on nearby points in Euclidean space, GFA-Net can better aggregate the geometric features around the points. GFA-Net uses the Laplacian feature mapping to reduce dimensions, and aggregates the nearest neighbor features in the space after dimensionality reduction, and fuses them with the nearest neighbor features of Euclidean space, so as to better obtain the geometric features of each point. Then, points are grouped with geometric features, so that nearby points are insensitive to geometric transformations such as rotation and translation. This method allows GFA-Net to better obtain holistic geometry features, such as symmetry. In addition, we use attention mechanism instead of pooling, so that important neighborhood information can be learned automatically and information loss can be reduced. We conduct extensive experiments on public datasets ModelNet40 and ShapeNet Part. The experimental results show that GFA-Net achieves very good performance, which is very close to the current state-of-the-art methods, and GFA-Net has better robustness.
Highlights
At present, with the development of computer vision and artificial intelligence, point cloud classification and segmentation has become a very challenging and important problem in 3D vision
We propose a novel geometric feature aggregation Geometry Feature Aggregation (GFA) module, which effectively extracts the geometric features between points, and integrates with the features obtained from Euclidean space, so as to better extract the local and global geometric features
OTHER METHODS Most studies focus on the calculation of adjacent regional points from Euclidean space, while GS-Net [32] finds that features of distant points with similar geometric features could not be obtained only in Euclidean space, so the Geometry Similarity Connection (GSC) module is designed
Summary
With the development of computer vision and artificial intelligence, point cloud classification and segmentation has become a very challenging and important problem in 3D vision. B. POINT-BASED NETWORKS In addition to PointNet [15] and PointNet++ [16], much of the new work involves extracting local features of each point by designing complex network modules. C. OTHER METHODS Most studies focus on the calculation of adjacent regional points from Euclidean space, while GS-Net [32] finds that features of distant points with similar geometric features could not be obtained only in Euclidean space, so the Geometry Similarity Connection (GSC) module is designed. Geometric feature aggregation module is used to enrich local geometric information, and attention mechanism is used to learn and select the extracted geometric features of surrounding points.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.