3D Point Cloud Upsampling and Colorization Using GAN

Abstract

AbstractProgress in LiDAR sensors have opened up the potential for novel applications using point clouds. However, LiDAR sensors are inherently sensitive, and also lack the ability to colorize point clouds, thus impeding further development of the applications mentioned above. Our paper presents a new end-to-end network that upsamples and colorizes a given input point cloud. Thus the network is able to manage the sparseness and noisiness resulting from the sensitivity of the sensor, and also enrich point cloud data by giving them the original color in the real world. To the best of our knowledge, this is the first work that uses a voxelized generative model to colorize point clouds, and also the first to perform both upsampling and colorization tasks in a single network. Experimental results show that our model is able to correctly colorize and upsample a given input point cloud. From this, we conclude that our model understands the shape and color of various objects. KeywordsGANPoint cloudColorizationUpsampling