Underwater point cloud transmission framework: hybrid encoder implementation based on CNN and transformer

Abstract

Abstract In underwater multi-robot systems, 3D point cloud data generated by sonar and depth sensors facilitates the execution of more complex collaborative tasks among robots, which partly rely on efficient data transmission. In this work, we propose a hybrid encoder framework based on convolutional neural network and Transformer for underwater point cloud transmission, aimed at dealing with large-scale point cloud data. Our encoder allows setting lower compression rate on regions or objects of interest for semantic point clouds, preserving crucial information in the point cloud. For underwater acoustic communication, we employ orthogonal frequency division multiplexing combined with deep joint source-channel coding for transmission to enhance the system’s error-resilience. Compared to state-of-the-art methods in the simulation experiments, our end-to-end framework achieves considerable compression performance while eliminating certain cliff and leveling effects, also demonstrating robustness even with changing channels.