Abstract
Litchi is often harvested by clamping and cutting the branches, which are small and can easily be damaged by the picking robot. Therefore, the detection of litchi branches is particularly significant. In this article, an fully convolutional neural network-based semantic segmentation algorithm is proposed to semantically segment the litchi branches. First, the DeepLabV3+ semantic segmentation model is combined with the Xception depth separable convolution feature. Second, transfer learning and data enhancement are used to accelerate the convergence and improve the robustness of the model. Third, a coding and a decoding structure are adopted to reduce the number of network parameters. The decoding structure uses upsampling and the shallow features to fuse, and the same weight is assigned to ensure that the shallow feature semantics and the deep feature semantics are evenly distributed. Fourth, using atrous spatial pyramid pooling, we can better extract the semantic pixel position information without increasing the number of weight parameters. Finally, different sizes of hole convolution are used to ensure the prediction accuracy of small targets. Experiment results demonstrated that the DeepLabV3+ model using the Xception_65 feature extraction network obtained the best results, achieving a mean intersection over union (MIoU) of 0.765, which is 0.144 higher than the MIoU of 0.621 of the original DeepLabV3+ model. Meanwhile, the DeepLabV3+ model using the Xception_65 network has greater robustness, far exceeding the PSPNet_101 and ICNet in detection accuracy. The aforementioned results indicated that the proposed model produced better detection results. It can provide powerful technical support for the gripper picking robot to find fruit branches and provide a new solution for the problem of aim detection and recognition in agricultural automation.
Highlights
With the increasing industrialization of social industrial structures, the number of people engaged in agricultural production has been decreasing and the automation and mechanization of agriculture will become its main production methods in the future
A litchi-picking robot can effectively solve the problems of labor shortage and large-scale planting, which can significantly reduce the production cost of litchi and alleviate the decrease in productivity caused by the loss of agricultural population
The DeepLabV3+ semantic segmentation framework was selected, and its segmentation principle and segmentation advantages are systematically explained in this article
Summary
With the increasing industrialization of social industrial structures, the number of people engaged in agricultural production has been decreasing and the automation and mechanization of agriculture will become its main production methods in the future. Litchi has a very short maturity period, and the weather is hot and rainy in southern China. If this fruit cannot be harvested on. A litchi-picking robot can effectively solve the problems of labor shortage and large-scale planting, which can significantly reduce the production cost of litchi and alleviate the decrease in productivity caused by the loss of agricultural population. Because litchi grows in clusters with a large number of fruits, the branch is not obvious. H. Peng et al.: Semantic Segmentation of Litchi Branches Using DeepLabV3+ Model and make the robot hold and cut them to pick the fruits. This study used a deep learning algorithm to semantically segment the litchi branches for nondestructive picking
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.