VD-LAB: A view-decoupled network with local-global aggregation bridge for airborne laser scanning point cloud classification

Abstract

Airborne Laser Scanning (ALS) point cloud classification is a valuable and practical task in the fields of photogrammetry and remote sensing. It takes an extremely important role in many applications of surveying, monitoring, planning, production and living. Recently, driven by the wave of deep learning, the classification of ALS point clouds has also been gradually shifting from traditional feature design to careful deep network architecture construction. Although significant progress has been achieved by leveraging deep learning technology, there are still some matters demanding prompt solution: (1) the coupling phenomenon of high-level semantic features from multiple field-of-views; (2) information propagation without aggregated local–global features in different levels of symmetrical structure; (3) quite serious class-imbalanced distribution problems in large-scale ALS point clouds. In this paper, to tackle these matters, we propose a novel View-Decoupled Network with Local–global Aggregation Bridge (VD-LAB) model. More concretely, a View-Decoupled (VD) grouping method is set at the deepest layer of the network. Then, we establish a Local–global Aggregation Bridge (LAB) between down-sampling path and up-sampling path of the same level. After that, a Self-Amelioration (SA) loss is taken as the optimization objective to train the whole model in an end-to-end manner. Extensive experiments on four challenging ALS point cloud datasets (LASDU, US3D, ISPRS 3D and GML) demonstrate that our VD-LAB is able to achieve state-of-the-art performance in terms of Overall Accuracy (OA) and mean F1-score (e.g., reaching 88.01% and 78.42% for LASDU dataset, respectively) with very few model parameters and it possesses a strong generalization capability. In addition, the visualization of achieved results also reveals more satisfactory classification for some categories, such as Water in the US3D dataset and Powerline in the ISPRS 3D dataset. Ultimately, the effect of each module in VD-LAB is assessed in detailed ablation analyses as well.