WS-SSD: Achieving faster 3D object detection for autonomous driving via weighted point cloud sampling

Abstract

Due to the limited computational resources of the onboard computing devices of autonomous vehicles, the development of lightweight 3D object detectors is essential. Point-based detectors that progressively sample raw point clouds reduce numerous redundant computations and facilitate the implementation of high-speed 3D object detectors. The farthest point sampling based on Euclidean distance (D-FPS) is frequently utilized in point-based 3D detectors for point cloud sampling to reduce computation overhead. D-FPS can ensure uniform point sampling, covering the entire point cloud space as much as possible. The ratio of foreground and background points does not change significantly in the sampling results; hence, foreground objects do not receive sufficient attention. In addition, the number of road reflection points is large, and these points are close to foreground objects, reducing the sampling accuracy for faint objects. We propose weighted farthest point sampling based on Euclidean distance (W-DFPS), which selectively discards some road reflection points in the point sampling process, thus increasing the weight of foreground points in sampling results. It reduces the likelihood of faint objects being lost in the sampling results, such that a small number of sampling points can also cover most foreground objects. W-DFPS replaces D-FPS in the single-stage detector based on instance-aware (IA-SSD), and the network structure is slightly modified, namely the single-stage detector based on weighted sampling (WS-SSD). We evaluate WS-SSD in the KITTI dataset with a single A100 GPU. When the number of sampling points for the first module of WS-SSD is consistent with IA-SSD, the pedestrian detection accuracy is improved by an average of 4.06 compared to IA-SSD. Although the number of sampling points for the first module of WS-SSD is reduced to 25% of IA-SSD, the object detection accuracy remains competitive; it also achieves a state-of-the-art inference speed of 150.76 frames per second (FPS), which is a 46% improvement over IA-SSD.