Morphological estimation of primary branch length of individual apple trees during the deciduous period in modern orchard based on PointNet++

Abstract

Primary branch length is an important morphological trait of individual apple tree phenotypes. This study presents a novel method for estimating the primary branch lengths of individual apple trees during the deciduous period by distinguishing their instances, i.e., merging those belonging to the same primary branch based on part segmentation outputs of PointNet++. Firstly, colored and colorless 3D-datasets were prepared for training PointNet++ models. The model with higher overall accuracy (OA), class average accuracy (CAA), and mean intersection-over-union (mIoU) was employed to segment the point cloud of a tree into primary branches (PB), trunk (TK), and end-points of primary branches (EPB) of individual apple trees. Skeletonization was applied to the outputs of the three parts of individual apple trees. Subsequently, each primary branch instance was distinguished by determining its corresponding path and retaining the longest path of the same primary branch only. Finally, the primary branch length was estimated by calculating the sum of Euclidean distances between adjacent points on the corresponding path. Results indicated that adding color to point clouds did not improve segmentation accuracy of PointNet++ on segmenting PB, TK, and EPB with similar color features. The PointNet++ model that was trained without color achieved an OA, CAA, and mIoU of 0.84, 0.83, and 0.70, respectively. The proportion of estimated and ground-truth values of the number of primary branches was 93.64 %. The mean absolute percentage error of estimating primary branch lengths was 12.00 %. These findings demonstrate that the proposed method is promising for high-throughput phenotyping of apple trees.