Classification Of LiDAR Data Research Articles

Multi-Feature Cross Attention-Induced Transformer Network for Hyperspectral and LiDAR Data Classification

Transformers have shown remarkable success in modeling sequential data and capturing intricate patterns over long distances. Their self-attention mechanism allows for efficient parallel processing and scalability, making them well-suited for the high-dimensional data in hyperspectral and LiDAR imagery. However, further research is needed on how to more deeply integrate the features of two modalities in attention mechanisms. In this paper, we propose a novel Multi-Feature Cross Attention-Induced Transformer Network (MCAITN) designed to enhance the classification accuracy of hyperspectral and LiDAR data. The MCAITN integrates the strengths of both data modalities by leveraging a cross-attention mechanism that effectively captures the complementary information between hyperspectral and LiDAR features. By utilizing a transformer-based architecture, the network is capable of learning complex spatial-spectral relationships and long-range dependencies. The cross-attention module facilitates the fusion of multi-source data, improving the network’s ability to discriminate between different land cover types. Extensive experiments conducted on benchmark datasets demonstrate that the MCAITN outperforms state-of-the-art methods in terms of classification accuracy and robustness.

Classification of compressed full-waveform airborne lidar data

ABSTRACT Airborne laser scanners produce 3D data that can be used for a range of applications, such as urban planning, facility monitoring, flood mapping, and forest management. Additional information on the surveyed area can be obtained from the backscattered waveforms recorded by modern light detection and ranging (lidar) sensors. However, the high-dimensional representation of full-waveform data has hindered progress in its use due to difficulties in processing and storage. This paper develops a quantized convolutional autoencoder network to compress lidar waveform data into a condensed feature representation, resulting in a compression rate of up to 20:1. This, together with height information, is fed into a U-net convolutional neural network that achieves an accuracy of 93.7% on six classes.

Joint Classification of Hyperspectral and LiDAR Data Based on Adaptive Gating Mechanism and Learnable Transformer

Utilizing multi-modal data, as opposed to only hyperspectral image (HSI), enhances target identification accuracy in remote sensing. Transformers are applied to multi-modal data classification for their long-range dependency but often overlook intrinsic image structure by directly flattening image blocks into vectors. Moreover, as the encoder deepens, unprofitable information negatively impacts classification performance. Therefore, this paper proposes a learnable transformer with an adaptive gating mechanism (AGMLT). Firstly, a spectral–spatial adaptive gating mechanism (SSAGM) is designed to comprehensively extract the local information from images. It mainly contains point depthwise attention (PDWA) and asymmetric depthwise attention (ADWA). The former is for extracting spectral information of HSI, and the latter is for extracting spatial information of HSI and elevation information of LiDAR-derived rasterized digital surface models (LiDAR-DSM). By omitting linear layers, local continuity is maintained. Then, the layer Scale and learnable transition matrix are introduced to the original transformer encoder and self-attention to form the learnable transformer (L-Former). It improves data dynamics and prevents performance degradation as the encoder deepens. Subsequently, learnable cross-attention (LC-Attention) with the learnable transfer matrix is designed to augment the fusion of multi-modal data by enriching feature information. Finally, poly loss, known for its adaptability with multi-modal data, is employed in training the model. Experiments in the paper are conducted on four famous multi-modal datasets: Trento (TR), MUUFL (MU), Augsburg (AU), and Houston2013 (HU). The results show that AGMLT achieves optimal performance over some existing models.

Joint Classification of Hyperspectral Images and LiDAR Data Based on Dual-Branch Transformer

In the face of complex scenarios, the information insufficiency of classification tasks dominated by a single modality has led to a bottleneck in classification performance. The joint application of multimodal remote sensing data for surface observation tasks has garnered widespread attention. However, issues such as sample differences between modalities and the lack of correlation in physical features have limited the performance of classification tasks. Establishing effective interaction between multimodal data has become another significant challenge. To fully integrate heterogeneous information from multiple modalities and enhance classification performance, this paper proposes a dual-branch cross-Transformer feature fusion network aimed at joint land cover classification of hyperspectral imagery (HSI) and Light Detection and Ranging (LiDAR) data. The core idea is to leverage the potential of convolutional operators to represent spatial features, combined with the advantages of the Transformer architecture in learning remote dependencies. The framework employs an improved self-attention mechanism to aggregate features within each modality, highlighting the spectral information of HSI and the spatial (elevation) information of LiDAR. The feature fusion module based on cross-attention integrates deep features from two modalities, achieving complementary information through cross-modal attention. The classification task is performed using jointly obtained spectral and spatial features. Experiments were conducted on three multi-source remote sensing classification datasets, demonstrating the effectiveness of the proposed model compared to existing methods.

Ternary Modality Contrastive Learning for Hyperspectral and LiDAR Data Classification

Ternary Modality Contrastive Learning for Hyperspectral and LiDAR Data Classification

Pseudo-Labelling Contrastive Learning for Semi-supervised Hyperspectral and LiDAR Data Classification

Pseudo-Labelling Contrastive Learning for Semi-supervised Hyperspectral and LiDAR Data Classification

Interactive Enhanced Network Based on Multihead Self-Attention and Graph Convolution for Classification of Hyperspectral and LiDAR Data

Interactive Enhanced Network Based on Multihead Self-Attention and Graph Convolution for Classification of Hyperspectral and LiDAR Data

CMSE: Cross-Modal Semantic Enhancement Network for Classification of Hyperspectral and LiDAR Data

CMSE: Cross-Modal Semantic Enhancement Network for Classification of Hyperspectral and LiDAR Data

Collaborative classification of hyperspectral and LiDAR data based on CNN-transformer

Collaborative classification of hyperspectral and LiDAR data based on CNN-transformer

Multimodal Deep Learning for Semisupervised Classification of Hyperspectral and LiDAR Data

Multimodal Deep Learning for Semisupervised Classification of Hyperspectral and LiDAR Data

Multiple Information Collaborative Fusion Network for Joint Classification of Hyperspectral and LiDAR Data

Multiple Information Collaborative Fusion Network for Joint Classification of Hyperspectral and LiDAR Data

Joint Classification of Hyperspectral Image and LiDAR Data Based on Spectral Prompt Tuning

Joint Classification of Hyperspectral Image and LiDAR Data Based on Spectral Prompt Tuning

Multispectral LiDAR Data Classification Method Based on an Improved PointNet++ Model

Multispectral LiDAR Data Classification Method Based on an Improved PointNet++ Model

3DMASC: Accessible, explainable 3D point clouds classification. Application to bi-spectral topo-bathymetric lidar data

Three-dimensional data have become increasingly present in earth observation over the last decades. However, many 3D surveys are still underexploited due to the lack of accessible and explainable automatic classification methods, for example, new topo-bathymetric lidar data. In this work, we introduce explainable machine learning for 3D data classification using Multiple Attributes, Scales, and Clouds under 3DMASC, a new workflow. This workflow introduces multi-cloud classification through dual-cloud features, encrypting local spectral and geometrical ratios and differences. 3DMASC uses classical multi-scale descriptors adapted to all types of 3D point clouds and new ones based on their spatial variations. In this paper, we present the performances of 3DMASC for multi-class classification of topo-bathymetric lidar data in coastal and fluvial environments. We show how multivariate and embedded feature selection allows the building of optimized predictor sets of reduced complexity, and we identify features particularly relevant for coastal and riverine scene descriptions. Our results show the importance of dual-cloud features, lidar return-based attributes averaged over specific scales, and of statistics of dimensionality-based and spectral features. Additionally, they indicate that small to medium spherical neighbourhood diameters (<7 m) are sufficient to build effective classifiers, namely when combined with distance-to-ground or distance-to-water-surface features. Without using optional RGB information, and with a maximum of 37 descriptors, we obtain classification accuracies between 91 % for complex multi-class tasks and 98 % for lower-level processing using models trained on less than 2000 samples per class. Comparisons with classical point cloud classification methods show that 3DMASC features have a significantly improved descriptive power. Our contributions are made available through a plugin in the CloudCompare software, allowing non-specialist users to create classifiers for any type of 3D data characterized by 1 or 2 point clouds (airborne or terrestrial lidar, structure from motion), and two labelled topo-bathymetric lidar datasets, available on https://opentopography.org/.

POINT-WISE CLASSIFICATION OF HIGH-DENSITY UAV-LIDAR DATA USING GRADIENT BOOSTING MACHINES

Abstract. Point-wise classification of 3D point clouds is a challenging task in point cloud processing, whereas, in particular, its application to high-density point clouds needs special attention because a large number of point clouds affect computational efficiency negatively. Although deep learning based models have been gaining popularity in recent years and have reached state-of-the-art results in accuracy for point-wise classification, their requirements of the high number of training samples and computational resources make those models inefficient for high-density 3D point clouds. However, traditional machine learning classifiers require less training samples, so they are capable of reducing computational requirements, even considering the latest machine learning classifiers, particularly in ensemble learning of gradient boosting machines, the results can compete with deep learning models. In this study, we are studying the point-wise classification of high-density UAV LiDAR data and focusing on efficient feature extraction and a recent state-of-the-art gradient boosting machine learning classifier, LightGBM. Our proposed framework includes the following steps: at first, we are using point cloud sampling for creating sub-sampled point clouds, then we are calculating the features based on those scales implemented on GPU. Finally, we are using the LightGBM classifier for training and testing. For the evaluation of our framework, we used a publicly available benchmark dataset, Hessigheim 3D. According to the results, we achieved an overall accuracy of 87.59% and an average F1 score of 75.92%. Our framework has promising results and scores closer to deep learning models. However, more distinctive features are required to obtain more accurate results.

Variational Auto-Encoder Reconstruction Networks for Classification of Hyperspectral and LiDAR Data

The classification of remote sensing scene objects has been the subject of extensive studies in recent years due to the quick advancement of earth observation and remote sensing technology. More concentration, Hyperspectral images, and LiDAR data are complementary, and their combined use for data fusion can better mine the multi-dimensional features of ground objects in remote sensing scenes, which can effectively improve the classification accuracy and reliability of ground objects in remote sensing scenes. Single-modal remote sensing data frequently cannot fully meet the needs of ground feature classification due to the increasingly complex types of ground features. In order to solve this problem, we have developed two distinct multi-source fusion classification approaches using LiDAR and hyperspectral data and deep learning techniques. They are the reconstructed multi-layer perceptron network based on the variational auto-Encoder (encoding-decoding form) and the two-stream input convolutional neural network based on the cross-channel reconstruction mechanism. These two approaches can help us find more effective and deeper feature extraction methods and feature fusion methods in this research direction and design training. We adopted the network architecture model used in this area of research and used experimental data to demonstrate the effectiveness and superiority of the suggested network model.

3D target detection and spectral classification for single-photon LiDAR data.

3D single-photon LiDAR imaging has an important role in many applications. However, full deployment of this modality will require the analysis of low signal to noise ratio target returns and very high volume of data. This is particularly evident when imaging through obscurants or in high ambient background light conditions. This paper proposes a multiscale approach for 3D surface detection from the photon timing histogram to permit a significant reduction in data volume. The resulting surfaces are background-free and can be used to infer depth and reflectivity information about the target. We demonstrate this by proposing a hierarchical Bayesian model for 3D reconstruction and spectral classification of multispectral single-photon LiDAR data. The reconstruction method promotes spatial correlation between point-cloud estimates and uses a coordinate gradient descent algorithm for parameter estimation. Results on simulated and real data show the benefits of the proposed target detection and reconstruction approaches when compared to state-of-the-art processing algorithms.

Treeline remote sensing: from tracking treeline shifts to multi‐dimensional monitoring of ecotonal change

AbstractRemote sensing applications have a long history in treeline research. Recent reviews have examined the topic mainly from a methodological point of view. Here, we propose a question‐oriented review of remote sensing in treeline ecology to relate remote sensing methodologies to key ecological metrics and identify knowledge gaps and promising areas for future research. We performed a meta‐analysis to assess the role of remote sensing as a tool for measuring spatial patterns and dynamics of alpine and Arctic treeline ecotone globally. We assessed the geographic distribution, scale of analysis, and relationships between remote sensing techniques and treeline ecological metrics through co‐occurrence mapping and multivariate statistics. Our analysis revealed that only 10% of treeline ecology studies applied remote sensing tools, often associated with the keyword ‘climate change’. Monitoring studies adopted coarser spatial resolutions over longer temporal extents in comparison with other treeline studies. A multiscale and multi‐sensor spatial approach was implemented in just 19% of papers. Long‐term research commonly relied on aerial and oblique photography to measure treeline shifts through photointerpretation within a multidisciplinary framework. More recent treeline dynamics were often quantified using greenness trends derived from the pixel‐based classification of satellite images. Many recent short‐term studies focused on delineating tree scale metrics derived from the object‐based classification of uncrewed aerial vehicle (UAV) images or LiDAR data. Over the past decade, high‐resolution and low‐cost UAV remote sensing has emerged as an interesting opportunity to fill the gap between local‐scale ecological patterns and coarse‐resolution satellite sensors. Additionally, treeline remote sensing applications would strongly benefit from multidisciplinary frameworks that integrate field studies in ecology and environmental science. The multi‐dimensional structural complexity of treelines typically responds to environmental drivers over multiple scales and thus is best described with multiscale and multi‐sensor approaches.

A Novel Dual-Encoder Model for Hyperspectral and LiDAR Joint Classification via Contrastive Learning

Deep-learning-based multi-sensor hyperspectral image classification algorithms can automatically acquire the advanced features of multiple sensor images, enabling the classification model to better characterize the data and improve the classification accuracy. However, the currently available classification methods for feature representation in multi-sensor remote sensing data in their respective domains do not focus on the existence of bottlenecks in heterogeneous feature fusion due to different sensors. This problem directly limits the final collaborative classification performance. In this paper, to address the bottleneck problem of joint classification due to the difference in heterogeneous features, we innovatively combine self-supervised comparative learning while designing a robust and discriminative feature extraction network for multi-sensor data, using spectral–spatial information from hyperspectral images (HSIs) and elevation information from LiDAR. The advantages of multi-sensor data are realized. The dual encoders of the hyperspectral encoder by the ConvNeXt network (ConvNeXt-HSI) and the LiDAR encoder by Octave Convolution (OctaveConv-LiDAR) are also used. The adequate feature representation of spectral–spatial features and depth information obtained from different sensors is performed for the joint classification of hyperspectral images and LiDAR data. The multi-sensor joint classification performance of both HSI and LiDAR sensors is greatly improved. Finally, on the Houston2013 dataset and the Trento dataset, we demonstrate through a series of experiments that the dual-encoder model for hyperspectral and LiDAR joint classification via contrastive learning achieves state-of-the-art classification performance.

Feature Selection for Airbone LiDAR Point Cloud Classification

The classification of airborne LiDAR data is a prerequisite for many spatial data elaborations and analysis. In the domain of power supply networks, it is of utmost importance to be able to discern at least five classes for further processing—ground, buildings, vegetation, poles, and catenaries. This process is mainly performed manually by domain experts with the use of advanced point cloud manipulation software. The goal of this paper is to find a set of features which would divide space well enough to achieve accurate automatic classification on all relevant classes within the domain, thus reducing manual labor. To tackle this problem, we propose a single multi-class approach to classify all four basic classes (excluding ground) in a power supply domain with single pass-through, using one network. The proposed solution implements random forests and gradient boosting to create a feature-based per-point classifier which achieved an accuracy and F1 score of over 99% on all tested cases, with the maximum of 99.7% for accuracy and 99.5% for F1 score. Moreover, we achieved a maximum of 81.7% F1 score for the most sparse class. The results show that the proposed set of features for the LiDAR data cloud is effective in power supply line classification.