Key technologies of machine vision for weeding robots: A review and benchmark

Abstract

• This paper reviews the research status of typical machine-vision-based weeding robots. • This paper has evaluated the performance of eight baseline methods that are based on deep learning on a public dataset. • This paper presents the application of object detection algorithms based on deep learning to weed identification. Due to its obvious advantages in saving labor and pesticides, weeding robots are one of the key technologies for modern and sustainable agriculture and have attracted increasing attention from researchers and developers. Some papers on machine-vision-based weeding robots have been published in recent years, yet there is no clear attempt to systematically study these papers to discuss the components of a robotic weed control system, such as visual navigation, weed detection and directional weeding. In this paper, typical machine-vision-based weeding robots proposed or constructed in the last 30 years, together with a few open datasets for weed detection, are reviewed. Key technologies such as image preprocessing, image segmentation, navigation line extraction, and weed recognition based on machine learning (ML) or deep learning (DL) for weeding robots are discussed. To illustrate the application of DL algorithms to weed detection, this paper provides weed object detection results and a comparative analysis of eight baseline methods based on DL using a public dataset. The study found that there are still many issues that need to be addressed in each part of the robotic weeding control system. Because of environmental variation and system complexity, machine-vision-based weeding robots are still in their early stages. The results of the systematic review provide an understanding of innovative trends in the use of machine vision in weeding systems and references for future research on weeding robots.