Point cloud registration for agriculture and forestry crops based on calibration balls using Kinect V2

Abstract

For the process of point cloud registration, and the problem of inaccurate registration due to errors in correspondence between keypoints. In this paper, a registration method based on calibration balls was proposed, the trunk, branch, and crown were selected as experimental objects, and three calibration balls were randomly placed around the experimental objects to ensure different distances between two ball centers. Using the Kinect V2 depth camera to collect the point cloud of the experimental scene from four different viewpoints, the PassThrough filter algorithm was used for point cloud filtering in each view of the experimental scenes. The Euclidean cluster extraction algorithm was employed for point cloud clustering and segmentation to extract the experimental object and the calibration ball. The random sample consensus (RANSAC) algorithm was applied to fit the point cloud of a ball and calculate the coordinates of the ball center so that the distance between two ball centers under different viewpoints can be obtained by using the coordinates of the ball center. Comparing the distance between the ball centers from different viewpoints to determine the corresponding relationship between the ball centers from different viewpoints, and then using the singular value decomposition (SVD) method, the initial registration matrix was obtained. Finally, Iterative Closest Point (ICP) and its improved algorithm were used for accurate registration. The experimental results showed that the method of point cloud registration based on calibration balls can solve the problem of corresponding error of keypoints, and can register point clouds from different viewpoints of the same object. The registration method was evaluated by using the registration running time and the fitness score. The final registration running time of different experimental objects was not more than 6.5 s. The minimum fitness score of the trunk was approximately 0.0001, the minimum fitness score of the branch was approximately 0.0001, and the minimum fitness score of the crown was approximately 0.0006. Keywords: point cloud registration, calibration balls, Kinect V2, ICP DOI: 10.25165/j.ijabe.20201301.5077 Citation: Zhou S Z, Kang F, Li W B, Kan J M, Zheng Y J. Point cloud registration for agriculture and forestry crops based on calibration balls using Kinect V2. Int J Agric & Biol Eng, 2020; 13(1): 198–205.