Lidar Odometry Research Articles

Multi-Robot SLAM Using Fast LiDAR Odometry and Mapping

This paper presents an approach to implem enting centralized multirobot simultaneous localization and mapping (MR-SLAM) in an unknown environment based on LiDAR sensors. The suggested implementation addresses two main challenges faced in MR-SLAM, particularly in real-time applications: computing complexity (solving the problem with minimum time and resources) and map merging (finding the alignment between the maps and merging maps by integrating information from the aligned maps into one map). The proposed approach integrates Fast LiDAR and Odometry Mapping (FLOAM), which reduces the computational complexity of localization and mapping for individual robots by adopting a non-iterative two-stage distortion compensation method. This, in turn, accelerates inputs for the map merging algorithm and expedites the creation of a comprehensive map. The map merging algorithm utilizes feature matching techniques, Singular Value Decomposition (SVD), and the Iterative Closest Point (ICP) algorithm to estimate the transformation between the maps. Subsequently, the algorithm employs a map-merging graph to estimate the global transformation. Our system has been designed to utilize two robots and has been evaluated on datasets and in a simulated environment using ROS and Gazebo. The system required less computing time to build the global map and achieved good estimation accuracy.

Camera and LiDAR Fusion for Urban Scene Reconstruction and Novel View Synthesis via Voxel-Based Neural Radiance Fields

3D reconstruction of urban scenes is an important research topic in remote sensing. Neural Radiance Fields (NeRFs) offer an efficient solution for both structure recovery and novel view synthesis. The realistic 3D urban models generated by NeRFs have potential future applications in simulation for autonomous driving, as well as in Augmented and Virtual Reality (AR/VR) experiences. Previous NeRF methods struggle with large-scale, urban environments. Due to the limited model capability of NeRF, directly applying them to urban environments may result in noticeable artifacts in synthesized images and inferior visual fidelity. To address this challenge, we propose a sparse voxel-based NeRF. First, our approach leverages LiDAR odometry to refine frame-by-frame LiDAR point cloud alignment and derive accurate initial camera pose through joint LiDAR-camera calibration. Second, we partition the space into sparse voxels and perform voxel interpolation based on 3D LiDAR point clouds, and then construct a voxel octree structure to disregard empty voxels during subsequent ray sampling in the NeRF, which can increase the rendering speed. Finally, the depth information provided by the 3D point cloud on each viewpoint image supervises our NeRF model, which is further optimized using a depth consistency loss function and a plane constraint loss function. In the real-world urban scenes, our method significantly reduces the training time to around an hour and enhances reconstruction quality with a PSNR improvement of 1–2 dB, outperforming other state-of-the-art NeRF models.

GNSS-Assisted LiDAR Odometry and Mapping for Urban Environment

GNSS-Assisted LiDAR Odometry and Mapping for Urban Environment

A 3D Lidar SLAM System Based on Semantic Segmentation for Rubber-Tapping Robot

Simultaneous localization and mapping (SLAM) in rubber plantations is a challenging task for rubber-tapping robots. Due to the long-term stability of tree trunks in rubber plantations, a SLAM system based on semantic segmentation, called Se-LOAM, is proposed in this work. The 3D lidar point cloud datasets of trunks collected in rubber plantations of Hainan University are used to train the semantic model, and the model is used to extract features of trunk point clouds. After clustering the trunk point clouds, each single rubber tree instance is segmented based on the Viterbi algorithm. The point clouds of tree instances are fitted to the cylindrical trunk models for semantic cluster association and positional estimation, which are used for lidar odometry and mapping. The experimental results show that the present SLAM system is accurate in establishing online mapping, and the location of the trunk in the map is clearer. Specifically, the average relative pose error is 0.02 m, which is better than the positioning performance of LOAM and LeGO-LOAM. The average error of estimating the diameter at breast height (DBH) is 0.57 cm, and it only takes 401.4 kB to store a map of the area of approximately 500 m2, which is about 10% less than other classic methods. Therefore, Se-LOAM can meet the requirements of online mapping, providing a robust SLAM method for rubber-tapping robots.

LFVB-BioSLAM: A Bionic SLAM System with a Light-Weight LiDAR Front End and a Bio-Inspired Visual Back End.

Simultaneous localization and mapping (SLAM) is one of the crucial techniques applied in autonomous robot navigation. The majority of present popular SLAM algorithms are built within probabilistic optimization frameworks, achieving high accuracy performance at the expense of high power consumption and latency. In contrast to robots, animals are born with the capability to efficiently and robustly navigate in nature, and bionic SLAM algorithms have received increasing attention recently. Current bionic SLAM algorithms, including RatSLAM, with relatively low accuracy and robustness, tend to fail in certain challenging environments. In order to design a bionic SLAM system with a novel framework and relatively high practicality, and to facilitate the development of bionic SLAM research, in this paper we present LFVB-BioSLAM, a bionic SLAM system with a light-weight LiDAR-based front end and a bio-inspired vision-based back end. We adopt a range flow-based LiDAR odometry as the front end of the SLAM system, providing the odometry estimation for the back end, and we propose a biologically-inspired back end processing algorithm based on the monocular RGB camera, performing loop closure detection and path integration. Our method is verified through real-world experiments, and the results show that LFVB-BioSLAM outperforms RatSLAM, a vision-based bionic SLAM algorithm, and RF2O, a laser-based horizontal planar odometry algorithm, in terms of accuracy and robustness.

SDV-LOAM: Semi-Direct Visual-LiDAR Odometry and Mapping.

Visual-LiDAR odometry and mapping (V-LOAM), which fuses complementary information of a camera and a LiDAR, is an attractive solution for accurate and robust pose estimation and mapping. However, existing systems could suffer nontrivial tracking errors arising from 1) association between 3D LiDAR points and sparse 2D features (i.e., 3D-2D depth association) and 2) obvious drifts in the vertical direction in the 6-degree of freedom (DOF) sweep-to-map optimization. In this paper, we present SDV-LOAM which incorporates a semi-direct visual odometry and an adaptive sweep-to-map LiDAR odometry to effectively avoid the above-mentioned errors and in turn achieve high tracking accuracy. The visual module of our SDV-LOAM directly extracts high-gradient pixels where 3D LiDAR points project on for tracking. To avoid the problem of large scale difference between matching frames in the VO, we design a novel point matching with propagation method to propagate points of a host frame to an intermediate keyframe which is closer to the current frame to reduce scale differences. To reduce the pose estimation drifts in the vertical direction, our LiDAR module employs an adaptive sweep-to-map optimization method which automatically choose to optimize 3 horizontal DOF or 6 full DOF pose according to the richness of geometric constraints in the vertical direction. In addition, we propose a novel sweep reconstruction method which can increase the input frequency of LiDAR point clouds to the same frequency as the camera images, and in turn yield a high frequency output of the LiDAR odometry in theory. Experimental results demonstrate that our SDV-LOAM ranks 8th on the KITTI odometry benchmark which outperforms most LiDAR/visual-LiDAR odometry systems. In addition, our visual module outperforms state-of-the-art visual odometry and our adaptive sweep-to-map optimization can improve the performance of several existing open-sourced LiDAR odometry systems. Moreover, we demonstrate our SDV-LOAM on a custom-built hardware platform in large-scale environments which achieves both a high accuracy and output frequency. We have released the source code of our SDV-LOAM for the development of the community.

WiCRF2: Multi-Weighted LiDAR Odometry and Mapping With Motion Observability Features

WiCRF2: Multi-Weighted LiDAR Odometry and Mapping With Motion Observability Features

LiDAR–Inertial Integration for Rail Vehicle Localization and Mapping in Tunnels

Modern light detection and ranging (LiDAR) simultaneously localization and mapping (SLAM) systems have delivered excellent results in real-world scenarios. However, the potential of LiDAR SLAM still lacks well investigation for rail vehicle applications. This paper proposes a SLAM method for rail vehicles in tunnel environments, which fully exploits the typical geometric feature structure in the tunnels. The system receives measurements from a LiDAR and an IMU. As frontend, the estimated motion variation from IMU measurement de-skews the denoised point clouds and produces initial guess for frame-to-frame LiDAR odometry. A degeneracy-aware feature selection is employed to select the most informative features. As backend, a factor graph is formulated to jointly optimize the multi-modal information. Besides, we leverage the plane constraints from extracted rail tracks and the pole-like features to further constrain the 6D state estimation. In addition, the real-time performance can be achieved with an onboard computer. Through extensive evaluation of datasets gathered over an extended time range in a railway scenario, it has been demonstrated that our proposed system delivers reliable localization accuracy even in long tunnel environments.

Quadric Representations for LiDAR Odometry, Mapping and Localization

Quadric Representations for LiDAR Odometry, Mapping and Localization

Tightly Coupled LiDAR-Inertial Odometry and Mapping for Underground Environments.

The demand for autonomous exploration and mapping of underground environments has significantly increased in recent years. However, accurately localizing and mapping robots in subterranean settings presents notable challenges. This paper presents a tightly coupled LiDAR-Inertial odometry system that combines the NanoGICP point cloud registration method with IMU pre-integration using incremental smoothing and mapping. Specifically, a point cloud affected by dust particles is first filtered out and separated into ground and non-ground point clouds (for ground vehicles). To maintain accuracy in environments with spatial variations, an adaptive voxel filter is employed, which reduces computation time while preserving accuracy. The estimated motion derived from IMU pre-integration is utilized to correct point cloud distortion and provide an initial estimation for LiDAR odometry. Subsequently, a scan-to-map point cloud registration is executed using NanoGICP to obtain a more refined pose estimation. The resulting LiDAR odometry is then employed to estimate the bias of the IMU. We comprehensively evaluated our system on established subterranean datasets. These datasets were collected by two separate teams using different platforms during the DARPA Subterranean (SubT) Challenge. The experimental results demonstrate that our system achieved performance enhancements as high as 50-60% in terms of root mean square error (RMSE).

Efficient and Accurate Vehicle Localization Based on LiDAR Place Recognition

An efficient and accurate LiDAR place recognition methodology is proposed for vehicle localization. First, the Iris-LOAM is proposed to overcome the disadvantages of low accuracy of loop-closure detection and low efficiency of map construction in the existing LOAM-series methods. The method integrates the LiDAR-Iris global descriptor and Normal Distribution Transform (NDT) registration method into the loop-closure detection module of LiDAR Odometry and Mapping (LOAM), thereby improving the accuracy and efficiency of map construction. For the shortcomings of low map loading and matching efficiency, the Random Sample Consensus method is used to remove the ground point cloud information. The Voxel Grid method is used to down sample the loaded map. Finally, the NDT method is adopted for point cloud map matching to obtain the position information. Show that the Iris-LOAM has higher efficiency than the SC-LeGO-LOAM. The average time of point cloud map matching is reduced by 39.5%. The place recognition can be executed to achieve accuracy vehicle localization.

Longitudinal Velocity Estimation of Driverless Vehicle by Fusing LiDAR and Inertial Measurement Unit

Aiming at the problem that, under certain extreme conditions, relying on tire force or tire angular velocity to represent the longitudinal velocity of the unmanned vehicle will fail, this paper proposes a longitudinal velocity estimation method that fuses LiDAR and inertial measurement unit (IMU). First, in order to improve the accuracy of LiDAR odometry, IMU information is introduced in the process of eliminating point cloud motion distortion. Then, the statistical characteristic of the system noise is tracked by an adaptive noise estimator, which reduces the model error and suppresses the filtering divergence, thereby improving the robustness and filtering accuracy of the algorithm. Next, in order to further improve the estimation accuracy of longitudinal velocity, time-series analysis is used to predict longitudinal acceleration, which improves the accuracy of the prediction step in the unscented Kalman filter (UKF). Finally, the feasibility of the estimation method is verified by simulation experiments and real-vehicle experiments. In the simulation experiments, medium- and high-velocity conditions are tested. In high-velocity conditions (0–30 m/s), the average error is 1.573 m/s; in the experiment, the average error is 0.113 m/s.

TransLO: A Window-Based Masked Point Transformer Framework for Large-Scale LiDAR Odometry

Recently, transformer architecture has gained great success in the computer vision community, such as image classification, object detection, etc. Nonetheless, its application for 3D vision remains to be explored, given that point cloud is inherently sparse, irregular, and unordered. Furthermore, existing point transformer frameworks usually feed raw point cloud of N×3 dimension into transformers, which limits the point processing scale because of their quadratic computational costs to the input size N. In this paper, we rethink the structure of point transformer. Instead of directly applying transformer to points, our network (TransLO) can process tens of thousands of points simultaneously by projecting points onto a 2D surface and then feeding them into a local transformer with linear complexity. Specifically, it is mainly composed of two components: Window-based Masked transformer with Self Attention (WMSA) to capture long-range dependencies; Masked Cross-Frame Attention (MCFA) to associate two frames and predict pose estimation. To deal with the sparsity issue of point cloud, we propose a binary mask to remove invalid and dynamic points. To our knowledge, this is the first transformer-based LiDAR odometry network. The experiment results on the KITTI odometry dataset show that our average rotation and translation RMSE achieves 0.500°/100m and 0.993% respectively. The performance of our network surpasses all recent learning-based methods and even outperforms LOAM on most evaluation sequences.Codes will be released on https://github.com/IRMVLab/TransLO.

Layered SOTIF Analysis and 3σ-Criterion-Based Adaptive EKF for Lidar-Based Multi-Sensor Fusion Localization System on Foggy Days

The detection range and accuracy of light detection and ranging (LiDAR) systems are sensitive to variations in fog concentration, leading to the safety of the intended functionality-related (SOTIF-related) problems in the LiDAR-based fusion localization system (LMSFLS). However, due to the uncontrollable weather, it is almost impossible to quantitatively analyze the effects of fog on LMSFLS in a realistic environment. Therefore, in this study, we conduct a layered quantitative SOTIF analysis of the LMSFLS on foggy days using fog simulation. Based on the analysis results, we identify the component-level, system-level, and vehicle-level functional insufficiencies of the LMSFLS, the corresponding quantitative triggering conditions, and the potential SOTIF-related risks. To address the SOTIF-related risks, we propose a functional modification strategy that incorporates visibility recognition and a 3σ-criterion-based variance mismatch degree grading adaptive extended Kalman filter. The visibility of a scenario is recognized to judge whether the measurement information of the LiDAR odometry is disturbed by fog. Moreover, the proposed filter is adopted to fuse the abnormal measurement information of the LiDAR odometry with IMU and GNSS. Simulation results demonstrate that the proposed strategy can inhibit the divergence of the LMSFLS, improve the SOTIF of self-driving cars on foggy days, and accurately recognize the visibility of the scenarios.

Research on positioning and mapping algorithm of sliding window optimization for substation monitoring robot

This paper proposed a positioning and mapping algorithm of sliding window optimization for substation monitoring robots to solve the problems of low precision location and poor robustness of the existing laser odometer in power inspection outdoor scene mapping. A tightly coupled simultaneous localization and mapping (SLAM) algorithm was proposed based on 16-wire LiDAR and inertial measurement unit (IMU). Firstly, the paper estimated the IMU and corrected the motion distortion of the laser point cloud by linear interpolation. Secondly, scene features were extracted by curvature and classified according to different feature properties. The local map was constructed in the sliding window using the inter-frame matching module. Finally, the joint optimization function was built using the distance and IMU data obtained by matching the frame with the local map. The paper used the KITTI and self-recorded datasets to conduct the experiments. The results show that the improved method’s accuracy outperforms the lightweight and ground-optimized LiDAR odometry and Mapping (Lego-LOAM) and LiDAR inertial odometry and mapping (LIO-Mapping) and draws a broad application prospect in power inspection field.

Versatile LiDAR-Inertial Odometry With SE(2) Constraints for Ground Vehicles

LiDAR SLAM has become one of the major localization systems for ground vehicles since LiDAR Odometry And Mapping (LOAM). Many extension works on LOAM mainly leverage one specific constraint to improve the performance, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">e.g.</i> , information from on-board sensors such as loop closure and inertial state; prior conditions such as ground level and motion dynamics. In many robotic applications, these conditions are often known partially, hence a SLAM system can be a comprehensive problem due to the existence of numerous constraints. Therefore, we can achieve a better SLAM result by fusing them properly. In this paper, we propose a hybrid LiDAR-inertial SLAM framework that leverages both the on-board perception system and prior information such as motion dynamics to improve localization performance. In particular, we consider the case for ground vehicles, which are commonly used for autonomous driving and warehouse logistics. We present a computationally efficient LiDAR-inertial odometry method that directly parameterizes ground vehicle poses on SE(2). The out-of-SE(2) motion perturbations are not neglected but incorporated into an integrated noise term of a novel SE(2)-constraints model. For odometric measurement processing, we propose a versatile, tightly coupled LiDAR-inertial odometry to achieve better pose estimation than traditional LiDAR odometry. Thorough experiments are performed to evaluate our proposed method's performance in different scenarios, including localization for both indoor and outdoor environments. The proposed method achieves superior performance in accuracy and robustness.

LiDAR Inertial Odometry Based on Indexed Point and Delayed Removal Strategy in Highly Dynamic Environments.

Simultaneous localization and mapping (SLAM) is considered a challenge in environments with many moving objects. This paper proposes a novel LiDAR inertial odometry framework, LiDAR inertial odometry-based on indexed point and delayed removal strategy (ID-LIO) for dynamic scenes, which builds on LiDAR inertial odometry via smoothing and mapping (LIO-SAM). To detect the point clouds on the moving objects, a dynamic point detection method is integrated, which is based on pseudo occupancy along a spatial dimension. Then, we present a dynamic point propagation and removal algorithm based on indexed points to remove more dynamic points on the local map along the temporal dimension and update the status of the point features in keyframes. In the LiDAR odometry module, a delay removal strategy is proposed for historical keyframes, and the sliding window-based optimization includes the LiDAR measurement with dynamic weights to reduce error from dynamic points in keyframes. We perform the experiments both on the public low-dynamic and high-dynamic datasets. The results show that the proposed method greatly increases localization accuracy in high-dynamic environments. Additionally, the absolute trajectory error (ATE) and average RMSE root mean square error (RMSE) of our ID-LIO can be improved by 67% and 85% in the UrbanLoco-CAMarketStreet dataset and UrbanNav-HK-Medium-Urban-1 dataset, respectively, when compared with LIO-SAM.

VILO SLAM: Tightly Coupled Binocular Vision–Inertia SLAM Combined with LiDAR

For the existing visual–inertial SLAM algorithm, when the robot is moving at a constant speed or purely rotating and encounters scenes with insufficient visual features, problems of low accuracy and poor robustness arise. Aiming to solve the problems of low accuracy and robustness of the visual inertial SLAM algorithm, a tightly coupled vision-IMU-2D lidar odometry (VILO) algorithm is proposed. Firstly, low-cost 2D lidar observations and visual–inertial observations are fused in a tightly coupled manner. Secondly, the low-cost 2D lidar odometry model is used to derive the Jacobian matrix of the lidar residual with respect to the state variable to be estimated, and the residual constraint equation of the vision-IMU-2D lidar is constructed. Thirdly, the nonlinear solution method is used to obtain the optimal robot pose, which solves the problem of how to fuse 2D lidar observations with visual–inertial information in a tightly coupled manner. The results show that the algorithm still has reliable pose-estimation accuracy and robustness in many special environments, and the position error and yaw angle error are greatly reduced. Our research improves the accuracy and robustness of the multi-sensor fusion SLAM algorithm.

BoW3D: Bag of Words for Real-Time Loop Closing in 3D LiDAR SLAM

Loop closing is a fundamental part of simultaneous localization and mapping (SLAM) for autonomous mobile systems. In the field of visual SLAM, bag of words (BoW) has achieved great success in loop closure. The BoW features for loop searching can also be used in the subsequent 6-DoF loop correction. However, for 3D LiDAR SLAM, the state-of-the-art methods may fail to effectively recognize the loop in real time, and usually cannot correct the full 6-DoF loop pose. To address this limitation, we present a novel Bag of Words for real-time loop closing in 3D LiDAR SLAM, called BoW3D. Our method not only efficiently recognizes the revisited loop places, but also corrects the full 6-DoF loop pose in real time. BoW3D builds the bag of words based on the 3D LiDAR feature LinK3D, which is efficient, pose-invariant and can be used for accurate point-to-point matching. We furthermore embed our proposed method into 3D LiDAR odometry system to evaluate loop closing performance. We test our method on public dataset, and compare it against other state-of-the-art algorithms. BoW3D shows better performance in terms of F1 max and extended precision scores on most scenarios. It is noticeable that BoW3D takes an average of 48 ms to recognize and correct the loops on KITTI 00 (includes 4K+ 64-ray LiDAR scans), when executed on a notebook with an Intel Core i7 @2.2 GHz processor. We release the implementation of our method here: https://github.com/YungeCui/BoW3D.

AFLI-Calib: Robust LiDAR-IMU extrinsic self-calibration based on adaptive frame length LiDAR odometry

As an effective complement to common laser scanning systems, the portable laser scanning system can acquire point clouds flexibly and quickly. Calibration between Light detection and ranging (LiDAR) sensors and inertial measurement units (IMU) is the prerequisite for laser scanning systems to obtain high-quality point clouds. Related methods have been proposed in the last two decades, where the global navigation satellite system (GNSS) or high-precision calibration fields are commonly used. However, the extrinsic self-calibration of LiDAR-IMU is challenging, due to the large distortion in single-frame point cloud caused by rapid motion and the position errors of IMU integration which drift quickly. At the same time, the highly dynamic motion patterns of portable devices and the changes in the scanned scene structure are not well considered in existing LiDAR odometry methods. To take better advantage of the characteristics of non-repetitive scanning LiDAR sensor, this paper proposes AFLI-Calib, which utilizes adaptive frame length LiDAR odometry to perform the extrinsic self-calibration of LiDAR-IMU. Unlike LiDAR odometry methods with a fixed frame length, the LiDAR frame length is dynamically adjusted according to the motion state of sensors and the matching stability of scenes. The single-frame point cloud is registered to the map through a linear-based continuous-time model, eliminating the motion distortion correction in advance. For further optimization of trajectory and extrinsic parameters, IMU raw measurements and LiDAR observations are involved in the multi-constraint optimization, through tightly-coupled IMU pre-integration constraints, LiDAR point-to-plane constraints, and prior constraints. The method is fully validated using self-collected calibration data of indoor and outdoor scenes and different motion modes. Experiments show that on the test data, the translation parameter accuracy of the method is 0.041 m, which is 56.3% higher than the state-of-the-art method. The standard deviation is significantly reduced, with translation deviation (0.017 m, 0.024 m, 0.022 m) and rotation deviation (0.17°, 0.25°, 0.15°), which verifies the robustness of our method. The average RMSE of distances to the reference point cloud acquired by the terrestrial laser scanning system (TLS) is 0.042 m, showing a high accuracy calibration result. Comparative experiments with the fixed frame length LiDAR odometry method and classical “correction-then-registration” motion distortion model further verify the superiority and effectiveness of the proposed adaptive frame length LiDAR odometry.