Iterative Point Research Articles

Automated Weld Path Generation in Cluttered Environments Using Segmentation and Iterative Closest Point Workpiece Localization

Abstract A significant amount of manufacturing is performed by small to medium enterprises (SMEs), but these manufacturers often have lower adoption rates of automation. The cost and complexity associated with traditional robot systems slow the adoption of robotic welding operations for SMEs. The recent increase in collaborative robotic welding systems is bridging the gap, however, by reducing the complexity of installing, maintaining, and training operators to perform weld operations with collaborative robotics. These systems add flexibility in the range of operator use and ease of deployment. These systems however still rely on kinematic registration between the robot-mounted torch and workpiece on any open-loop weld. This requires precise placement of the workpiece prior to performing a weld. This work will discuss a method for part identification and registration in a welding task as a step toward automated weld path generation. The method is based on lower-resolution 3D cameras (RGBD cameras) using a combination of color and depth information. This information is used to both identify the workpiece within a workspace that may have other, non-workpiece items, and then provide registration or localization information of the workpiece within a resolution that could allow follow-on near-position strategies to achieve final weld path identification.

Displacement field monitoring of tunnel faces using terrestrial laser scanning data

The instability of tunnel faces is a serious geological hazard, thus requiring monitoring and prediction of the stability of tunnel faces. This paper presents a high-accuracy method for estimating the displacement fields of tunnel faces from terrestrial laser scanning data. The proposed method consists of four parts: i) the development of a stable rigid-body reference under planar strain assumption, ii) the fine alignment of the rigid-body references using the developed local deformation constrained rigid-body assumption (LDC-RBA) and local cross-validation iterative closest point (LCV-ICP) algorithm, iii) the segmentation of tunnel faces using a machine learning classifier, and iv) tracking of tunnel face displacement vectors under the LDC-RBA. Qualitative experimental results demonstrate that the estimated displacement fields of the tunnel face using the proposed method conform to the deformation law. Furthermore, quantitative experimental results indicate that the estimation accuracy of tunnel face displacement fields achieves millimeter-level.

An Improved Non-Monotonic Adaptive Trust Region Algorithm for Unconstrained Optimization

The trust region method is an effective method for solving unconstrained optimization problems. Incorrectly updating the rules of the trust region radius will increase the number of iterations and affect the calculation efficiency. In order to obtain an effective radius for the trust region, an adaptive radius updating criterion is proposed based on the gradient of the current iteration point and the eigenvalue of the Hessian matrix which avoids calculating the inverse of the Hessian matrix during radius updating. This approach reduces the computation time and enhances the algorithm’s performance. On this basis, we apply adaptive radius and non-monotonic techniques to the trust region algorithm and propose an improved non-monotonic adaptive trust region algorithm. Under proper assumptions, the convergence of the algorithm is analyzed. Numerical experiments confirm that the suggested algorithm is effective.

Position Normalization of Propellant Grain Point Clouds

Point cloud data obtained from scanning propellant grains with 3D scanning equipment exhibit positional uncertainty in space, posing significant challenges for calculating the relevant parameters of the propellant grains. Therefore, it is essential to normalize the position of each propellant grain’s point cloud. This paper proposes a normalization algorithm for propellant grain point clouds, consisting of two stages, coarse normalization and fine normalization, to achieve high-precision transformations of the point clouds. In the coarse normalization stage, a layer-by-layer feature points detection scheme based on k-dimensional trees (KD-tree) and k-means clustering (k-means) is designed to extract feature points from the propellant grain point cloud. In the fine normalization stage, a rotation angle compensation scheme is proposed to align the fitted symmetry axis of the propellant grain point cloud with the coordinate axes. Finally, comparative experiments with iterative closest point (ICP) and random sample consensus (RANSAC) validate the efficiency of the proposed normalization algorithm.

Performance evaluation of image co-registration methods in photoacoustic mesoscopy of the vasculature

Objective:The formation of functional vasculature in solid tumours enables delivery of oxygen and nutrients, and is vital for effective treatment with chemotherapeutic agents. Longitudinal characterisation of vascular networks can be enabled using mesoscopic photoacoustic imaging, but requires accurate image co-registration to precisely assess local changes across disease development or in response to therapy. Co-registration in photoacoustic imaging is challenging due to the complex nature of the generated signal, including the sparsity of data, artefacts related to the illumination/detection geometry, scan-to-scan technical variability, and biological variability, such as transient changes in perfusion. To better inform the choice of co-registration algorithms, we compared five open-source methods, in physiological and pathological tissues, with the aim of aligning evolving vascular networks in tumours imaged over growth at different time-points.Approach:Co-registration techniques were applied to 3D vascular images acquired with photoacoustic mesoscopy from murine ears and breast cancer patient-derived xenografts, at a fixed time-point and longitudinally. Images were pre-processed and segmented using an unsupervised generative adversarial network. To compare co-registration quality in different settings, pairs of fixed and moving intensity images and/or segmentations were fed into five methods split into the following categories: affine intensity-based using 1)mutual information (MI) or 2)normalised cross-correlation (NCC) as optimisation metrics, affine shape-based using 3)NCC applied to distance-transformed segmentations or 4)iterative closest point algorithm, and deformable weakly supervised deep learning-based using 5)LocalNet co-registration. Percent-changes in Dice coefficients, surface distances, MI, structural similarity index measure and target registration errors were evaluated.Main results:Co-registration using MI or NCC provided similar alignment performance, better than shape-based methods. LocalNet provided accurate co-registration of substructures by optimising subfield deformation throughout the volumes, outperforming other methods, especially in the longitudinal breast cancer xenograft dataset by minimising target registration errors.Significance:We showed the feasibility of co-registering repeatedly or longitudinally imaged vascular networks in photoacoustic mesoscopy, taking a step towards longitudinal quantitative characterisation of these complex structures. These tools open new outlooks for monitoring tumour angiogenesis at the meso-scale and for quantifying treatment-induced co-localised alterations in the vasculature.

Accurate reconstruction of turbine blade point cloud and multiple point cloud registration based on structured light

In recent years, the industry has increasingly adopted vision-guided laser processing techniques to machine cooling holes in turbine blades, placing higher demands on the accuracy of visual measurement. Therefore, to meet the need for high-precision measurement of the three-dimensional shape of turbine blades in the context of laser processing of film cooling holes, this paper proposes a structured light-based method for precise reconstruction of turbine blade point clouds and multi-point cloud registration. Specifically, to improve the accuracy of point cloud reconstruction, an improved phase matching and reconstruction method based on epipolar constraints is proposed. To enhance the accuracy and stability of multi-point cloud registration, a weighted iterative closest point (ICP) method combined with a mark point registration strategy is proposed, optimizing the stability of the ICP algorithm and achieving high-quality multiple point cloud stitching. Experimental results validate the effectiveness and accuracy of the proposed method.

Particle tracking-aided digital volume correlation for clay–sand soil mixtures

In this study, a novel, interdisciplinary method is introduced that merges fundamental geomechanics with computer vision to develop an advanced hybrid feature-aided digital volume correlation (DVC) technique. This technique is specifically engineered to measure and compute the full-field strain distribution in fine-grained soil mixtures. A clay–sand mixture specimen composed of quartz sand particles and kaolinite was created. Its mechanical properties and deformation behaviour were then tested using a mini-triaxial apparatus, combined with micro-focus X-ray computed tomography (μCT). The CT slices underwent image processing for denoising, segmentation of distinct phases, reconstruction of sand particles and feature extraction within the soil specimen. The proposed approach incorporated a two-step particle tracking method, which initially uses particle volume and surface area features to establish a preliminary matching list for a reference particle and then use the iterative closest point method for precise target particle matching. The soil specimen's initial displacement field was then mapped onto the DVC method's grid, and further refined through sub-voxel registration by way of a three-dimensional inverse compositional Gauss–Newton algorithm. The proposed method's effectiveness and efficiency were validated by accurately calculating the displacement and strain fields of the soil mixture sample, and comparing the results with those from a traditional DVC method. Given the soil's compositional and microstructural characteristics, these image-matching techniques can be integrated to create a versatile, efficient, and robust DVC system, suitable for a variety of soil mixture types.

An automatic method of siltation depth detection and 3D modeling in water-filled sewer pipelines based on sonar point clouds

Underground sewer pipeline inspection is essential for ensuring the safety and sustainability of urban infrastructure and improving residents’ quality of life. Traditional sewer pipeline inspection methods incur high manual costs. Therefore, this paper proposes an automated siltation depth identification and three-dimensional pipeline model reconstruction using an iterative farthest point removal fitting process based on a sonar point cloud. This method includes interpreting raw sonar data into point cloud data, point cloud preprocessing, iterative farthest point removal fitting process to fit pipeline profile and reverse interpolation of pipeline slices for three-dimensional model reconstruction. This method is validated in real-world applications, successfully calculating and annotating silt depth for pipeline slice profiles. The quantitative analysis shows an error in the estimated siltation proportion fluctuating within approximately 1%. This method also reconstructs the three-dimensional spatial model of siltation in the sewer pipeline, thereby providing effective technical support for engineering applications and reducing manual effort.

An improved SLAM algorithm for substation inspection robot based on the fusion of IMU and visual information

In the past, manual inspection was often used for equipment inspection in indoor environments such as substation rooms and chemical plant rooms. This way often accompanies high labor intensity, low inspection efficiency, and low safety, which is difficult to meet the increasingly stringent requirements of indoor equipment operation and maintenance management. For dealing with these issues, a VIORB-SLAM2 algorithm based on the integration of IMU and visual information, was proposed by this paper. Firstly, the IMU data and image data were integrated to restore scale information of cameras, and then an error function was established to enhance the algorithm’s robustness. Secondly, in order to improve the accuracy of the algorithm, the random sampling consensus method was used to eliminate the wrong matching points in feature point matching, and the normalized cross-correlation matching was employed to constrain key frame matching conditions. Finally, through the iterative closest point method to stitch the point clouds, a dense map for navigation was constructed. The experimental results show that the algorithm designed by this paper has solved the shortcomings of applying the ORB-SLAM2 algorithm to indoor inspection robots while achieving high positioning accuracy, which can be combined with other algorithms in the field of artificial intelligence for object detection and semantic map construction in the future.

An efficient iterative pseudo point elimination technique to represent the shape of the digital image boundary

An efficient iterative pseudo point elimination technique to represent the shape of the digital image boundary

ICP registration with SHOT descriptor for arresters point clouds

Abstract Arresters are one of the critical components of the power system.
However, due to the arrester’s regular and uniform umbrella skirt, both traditional
manual detection methods and existing computer vision approaches exhibit limitations
in accuracy and efficiency. This paper proposes an automatic, robust, efficient arrester
point cloud registration method to address this problem. First, a robotic arm
maneuvers a depth camera to capture point cloud data from various perspectives.
Then, the fast global registration (FGR) point cloud coarse registration method
based on the signature of histograms of orientations (SHOT) descriptor to produce
preliminary registration results. This result is ultimately used as the initial value of
the improved iterative closest point (ICP) algorithm to refine the registration further.
Experimental results on various data sets collected from arrester and public data sets
show that the algorithm’s root mean square error(RMSE) is less than 0.1mm, meeting
the requirements of the engineering application of arrester detection.

RD-SLAM: Real-Time Dense SLAM Using Gaussian Splatting

Simultaneous localization and mapping (SLAM) is fundamental for intelligent mobile units to perform diverse tasks. Recent work has shown that integrating neural rendering and SLAM showed promising results in photorealistic environment reconstruction. However, existing methods estimate pose by minimizing the error between rendered and input images, which is time-consuming and cannot be run in real-time, deviating from the original intention of SLAM. In this paper, we propose a dense RGB-D SLAM based on 3D Gaussian splatting (3DGS) while employing generalized iterative closest point (G-ICP) for pose estimation. We actively utilize 3D point cloud information to improve the tracking accuracy and operating speed of the system. At the same time, we propose a dual keyframe selection strategy and its corresponding densification method, which can effectively reconstruct new observation scenes and improve the quality of previously constructed maps. In addition, we introduce regularization loss to address the scale explosion of the 3D Gaussians and over-elongate in the camera viewing direction. Experiments on the Replica, TUM-RGBD, and ScanNet datasets show that our method achieves state-of-the-art tracking accuracy and runtime while being competitive in rendering quality.

Approach angle estimation method for ships based on deep learning

Accurately estimating the ship's approach angle is crucial during berthing, or passing through navigational structures. It forms the foundation for ship navigation decisions. This study introduces the LiDAR point cloud-based ship pose perception network (PP-Net), a novel deep learning-based method for acquiring ship approach angles. Addressing the challenge of manually annotating approach angles, the ship pose perception method based on point cloud feature distribution (FD) was proposed to obtain initial angle estimates. The max-pooling function was utilized to address the disorder of point clouds, and a multi-resolution feature extractor was employed to enhance the network's robustness in extracting features from inconsistently dense point clouds. By using iterative farthest point sampling (IFPS), datasets with varying numbers of point clouds were standardized to a fixed number of points, thereby normalizing input dimensions and improving computational efficiency. Additionally, a novel loss function was proposed to improve the model's predictive accuracy. Experimental validation conducted in the scenario of ships entering ship lifts demonstrates the effectiveness of the proposed method. The outcomes can support safe navigation for ships in restricted waterways.

A Novel Algorithm for Enhancing Terrain-Aided Navigation in Autonomous Underwater Vehicles

The position error in an inertial navigation system (INS) for autonomous underwater vehicles (AUVs) increases over time. Terrain-aided navigation can assist in correcting these INS position errors. To enhance the matching accuracy under large initial position errors, an improved terrain matching algorithm comprising terrain contour matching (TERCOM), particle swarm optimization (PSO), and iterative closest contour point (ICCP), named TERCOM-PSO-ICCP, is proposed. Initially, an enhanced TERCOM with an increased rotation angle is utilized to minimize heading errors and reduce the initial position error. The similarity extremum approach evaluates the initial matching outcomes, leading to an enhanced accuracy in the initial results. Next, artificial bee colony (ABC)-optimized PSO is employed for secondary matching to further reduce the initial position error and narrow the matching area. Finally, the ICCP, using the Mahalanobis distance as the objective function, is applied for the third matching, leveraging the ICCP’s fine search capabilities. The effective combination of these three algorithms significantly improves the terrain-aided navigation matching effect. Two tests show that the improved TERCOM-PSO-ICCP effectively reduces the matching error and corrects the position of the INS.

基于扫描上下文和 NDT-ICP 融合方案的果园同步定位与绘图方法研究

Simultaneous localization and mapping (SLAM) is one of the key technologies for agricultural robots to build maps and localize in complex orchard environments and realize unmanned autonomous operations. Due to the complexity of the orchard environment, the single canopy feature and the diffuse reflection of light caused by the leaves, etc., the map construction process of the orchard environment leads to mismatch and increases the cumulative error of the map construction. Aiming at the above problems, this paper propose a navigation map construction method for orchard environment based on the fusion of Scan Context and NDT-ICP. The method firstly searches the Ring key quickly to get the candidate frames, and scores the similarity between the candidate frames and the current frame, and effectively detects the loopbacks by two-stage searching algorithm to reduce the false matches in the map of orchard environment. Meanwhile, a point cloud alignment method based on the fusion of normal distribution transform coarse alignment and iterative nearest point exact alignment is used to reduce the cumulative error of the orchard environment map. The results show that the improved algorithm compensates the drift of the point cloud map with higher mapping accuracy, better real-time performance, lower resource utilization, higher overlap between the trajectory estimation and the real trajectory, smoother loops, and a 4% reduction in CPU occupancy. In the complex orchard environment, the root mean square error and standard deviation of the trajectories of this paper's algorithm are 0.57 m and 0.19 m, which are 68% and 83% higher than those of the loop detection algorithms in the Lightweight Ground Optimized Lidar Trajectory Measurement and Multivariate Terrain Mapping (LeGO-LOAM), respectively. Accurate map construction and low drift pose estimation can be performed.The research algorithm effectively reduces the influence of mis-matching and large cumulative error in the process of map construction in the orchard environment, meets the demand for high-precision environmental mapping in the orchard environment, and provides technical support for promoting unmanned operation in the orchard environment.

3D modelling method and application to a digital campus by fusing point cloud data and image data

ObjectiveThe use of single-source data for real-world 3D modelling currently faces problems such as deformation, pulling and fuzzy texture at the bottom of buildings in some feature models because of the lack of images. Moreover, LIDAR generates a huge amount of data, and the massive raw data processing and point cloud parsing puts high demands on the hardware arithmetic and algorithms. Aiming at the deficiencies and defects of the two data sources of inclined photogrammetry and airborne laser point cloud in the construction of high-quality and high-precision city-level 3D models. Methodsthis study uses a university library building as an example and proposes the main technical process and method of modelling after fusing the point cloud data acquired by inclined photogrammetry and 3D laser scanning technology. This is accomplished in the reconstruction stage of multi-source data fusion through data spatial alignment, coordinate system unification and data spatial integration. At the stage of multi-source data fusion and reconstruction, through data spatial alignment, coordinate system unification, point cloud coarse alignment and the iterative closest point (ICP) algorithm, a realistic 3D model of a building is constructed to verify the effectiveness of the modelling method. ResultsThe method can effectively improve the accuracy of the real-life 3D model, repair the deficiencies in the model and optimise the details of the model. It can also significantly improve the fineness of the tilt photography model and perfectly present the geometric and texture information of the building, making it a superior method for fine 3D reconstruction. ConclusionThis 3D reconstruction method of buildings, which integrates low-altitude inclined photogrammetry and airborne light detection and ranging (LiDAR), has high positional accuracy and can provide new methods and new ideas for the construction of digital campuses as well as for other engineering applications.

Digital modelling method of coal-mine roadway based on millimeter-wave radar array

The roadway space of coal mine is narrow, and the illumination is low and uneven. Dynamic mining is accompanied by dust and water mist. The accuracy and reliability of roadway data collected by vision and laser sensors are poor. Based on this, a digital modeling method of coal mine roadway based on millimeter-wave radar array is proposed. Firstly, aiming at the problem of complex environmental interference, combined with the characteristics of small amount of single frame data of millimeter-wave point cloud, a multi-layer filtering noise reduction processing and dynamic subgraph registration method of millimeter-wave point cloud is proposed to filter out interference points and realize single radar point cloud registration. Secondly, aiming at the problem that a single millimeter-wave radar cannot scan the complete roadway information at one time, combined with the characteristics of small elevation field of view of millimeter-wave radar, a millimeter-wave radar array acquisition system is built, and an improved iterative closest point (ICP) registration algorithm based on point cloud features is established to construct the roadway point cloud fusion model. Finally, aiming at the problem of uneven and sparse point cloud after array fusion, a Poisson surface reconstruction method based on point cloud density weighted interpolation is proposed to refine the roadway structure and realize the accurate reconstruction of digital roadway model. The experimental results show that the digital modeling method of millimeter-wave radar array can accurately obtain the information of roadway surrounding rock, the density of roadway point cloud is increased by 22.4%, and the average absolute error percentage of the width and height of the reconstructed roadway model is only 0.82% and 0.72%, which provides a new research method for the reconstruction of underground roadway and an important basis for the digital modeling method of coal mine roadway.

Analysis of healthy glenohumeral arthrokinematics using four-dimensional computed tomography throughout internal rotation and forward elevation

BackgroundThe glenohumeral joint is the most mobile joint in the human body and can translate in addition to rotating in its socket. Currently, it is not well established in literature how much the healthy humeral head translates, and how that changes overtime as people age. The objective of this study is to quantify glenohumeral joint proximity and translation in healthy patients and determine if there are any age, position, or direction related differences. MethodsThirty-one participants were recruited for this study and split into two cohorts: young (≤ 37 years old) and old (≥45 years old). Four-dimensional computed tomography scans were taken as these participants completed internal rotation to the back (IR) and forward elevation (FE). 3D bone models of the humerus and scapula were created using 3D Slicer. An inter-bone distance algorithm, and an Iterative Closest Point algorithm were used to determine glenohumeral joint proximity and translation, respectively. ResultsThis study found that older participants displayed significantly closer joint proximity (63% of glenoid surface was within 4mm of humeral head) during the middle of IR, compared to younger participants (52% of glenoid surface within 4mm of humeral head). Additionally, younger participants had significantly more translation in the Superior/Inferior direction (16% of glenoid height) compared to the Anterior/Posterior direction (10% of glenoid width) throughout IR. ConclusionThis study demonstrates the significance of translational movements within the glenohumeral joint throughout IR and FE, which will aid implant manufacturers in designing implants that will allow for more normalized glenohumeral translations.

VE-LIOM: A Versatile and Efficient LiDAR-Inertial Odometry and Mapping System

LiDAR has emerged as one of the most pivotal sensors in the field of navigation, owing to its expansive measurement range, high resolution, and adeptness in capturing intricate scene details. This significance is particularly pronounced in challenging navigation scenarios where GNSS signals encounter interference, such as within urban canyons and indoor environments. However, the copious volume of point cloud data poses a challenge, rendering traditional iterative closest point (ICP) methods inadequate in meeting real-time odometry requirements. Consequently, many algorithms have turned to feature extraction approaches. Nonetheless, with the advent of diverse scanning mode LiDARs, there arises a necessity to devise unique methods tailored to these sensors to facilitate algorithm migration. To address this challenge, we propose a weighted point-to-plane matching strategy that focuses on local details without relying on feature extraction. This improved approach mitigates the impact of imperfect plane fitting on localization accuracy. Moreover, we present a classification optimization method based on the normal vectors of planes to further refine algorithmic efficiency. Finally, we devise a tightly coupled LiDAR-inertial odometry system founded upon optimization schemes. Notably, we pioneer the derivation of an online gravity estimation method from the perspective of S2 manifold optimization, effectively minimizing the influence of gravity estimation errors introduced during the initialization phase on localization accuracy. The efficacy of the proposed method was validated through experimentation employing various LiDAR sensors. The outcomes of indoor and outdoor experiments substantiate its capability to furnish real-time and precise localization and mapping results.

Enhancing Legal Protection of Children's Rights in the “Internet Plus”

In the contemporary era of the internet, safeguarding children's rights emerges as a critical concern necessitating immediate attention. Given children's heightened vulnerability within society, the legal framework must prioritize their protection, reinforcing their agency and safeguarding their rights through legislative measures. This study proposes an innovative differential clustering algorithm specifically designed to uphold children's rights. Through rigorous experimentation, the algorithm achieves an Adjusted Rand Index (ARI) approaching 2, showcasing its effectiveness in offering targeted differential protection for children's rights while maintaining high clustering precision. The paper emphasizes the importance of noise reduction through iterative central point optimization to stabilize cluster configurations, with the fusion of multiple clusters serving to mitigate noise impacts on data points and yield robust clustering outcomes. Consequently, this research delivers reliable clustering results while preserving the confidentiality of children's rights information.