Vision based crop row navigation under varying field conditions in arable fields

Abstract

Accurate crop row detection is often challenged by the varying field conditions present in real-world arable fields. Traditional colour based segmentation is unable to cater for all such variations. The lack of comprehensive datasets in agricultural environments limits the researchers from developing robust segmentation models to detect crop rows. We present a dataset for crop row detection with 11 field variations from sugar beet and maize crops. We also present a novel crop row detection algorithm for visual servoing in crop row fields. The proposed method uses deep learning based crop row skeleton segmentation method followed by a crop row scanning algorithm that identifies the central crop row which the robot then follows. The unique dataset we used with skeleton representations for crop row detection enables robust crop row detection in challenging real world field conditions. Our algorithm can detect crop rows against varying field conditions such as curved crop rows, weed presence, discontinuities, growth stages, tramlines, shadows and light levels. Dense weed presence within inter-row space and discontinuities in crop rows were the most challenging field conditions for our crop row detection algorithm. An End-of Row detector algorithm was developed to detect the end of the crop row and navigate the robot towards the headland area when it reaches the end of the crop row.