The rise of mechanical automation in orchards has sparked research interest in developing robots capable of autonomous tree pruning operations. To achieve accurate pruning outcomes, these robots require robust perception systems that can reconstruct three-dimensional tree characteristics and execute appropriate pruning strategies. Three-dimensional modeling plays a crucial role in enabling accurate pruning outcomes. This paper introduces a specialized tree modeling approach using the space colonization algorithm (SCA) tailored for pruning. The proposed method extends SCA to operate in three-dimensional space, generating comprehensive cherry tree models. The resulting models are exported as normalized point cloud data, serving as the input dataset. Multiple criteria decision analysis is utilized to guide pruning decisions, incorporating various factors such as tree species, tree life cycle stages, and pruning strategies during real-world implementation. The pruning task is transformed into a point cloud neural network segmentation task, identifying the trunks and branches to be pruned. This approach reduces the data acquisition time and labor costs during development. Meanwhile, pruning training in a virtual environment is an application of digital twin technology, which makes it possible to combine the meta-universe with the automated pruning of fruit trees. Experimental results demonstrate superior performance compared to other pruning systems. The overall accuracy is 85%, with mean accuracy and mean Intersection over Union (IoU) values of 0.83 and 0.75. Trunks and branches are successfully segmented with class accuracies of 0.89 and 0.81, respectively, and Intersection over Union (IoU) metrics of 0.79 and 0.72. Compared to using the open-source synthetic tree dataset, this dataset yields 80% of the overall accuracy under the same conditions, which is an improvement of 6%.
Read full abstract