Road Garbage Segmentation and Cleanliness Assessment Based on Semantic Segmentation Network for Cleaning Vehicles

Abstract

Road garbage recognition and cleanliness assessment are very important for intelligent cleaning of vehicles. However, widely used garbage detection methods cannot provide accurate information to assess cleanliness. Also, only a few contributions are available in the road cleanliness assessment, and they too mainly depend on the category and quantity of garbage. In this paper, deep supervision UNet++ (DUNet++) is proposed to solve the problem of road garbage classification and segmentation, which can directly impact the output of the category of garbage and the occupied ground area. A new, simple and accurate method is established to assess road cleanliness by combining the results of garbage segmentation. Compared with the cleanliness index (CI), the road cleanliness index based on semantic segmentation (CISS) not only considers the road area occupied by different types or categories of the garbage but also considers the difficulty of cleaning them. A road garbage segmentation dataset, which consists of four categories (stones, leaves, sand, and bottles), is collected to train the designed garbage segmentation model, and it has achieved considerable garbage segmentation improvement with an MIoU (Mean Intersection over Union) of <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$76.73\pm 0.11$</tex-math></inline-formula> . Especially when compared with the state-of-the-art methods, the model we designed has greatly improved the accuracy of garbage segmentation. Experimental results have shown that our road garbage segmentation and cleanliness assessment methods are relatively simple, and can provide accurate road cleanliness information for cleaning vehicles.