Grasping Objects Mixed With Towels

Xiaoman Wang,Shengfan Wang,Yun-Hui Liu,Xin Jiang,Jie Zhao

doi:10.1109/access.2020.3008763

Xiaoman Wang, Shengfan Wang + Show 3 more

Open Access

https://doi.org/10.1109/access.2020.3008763

Copy DOI

Abstract

In logistics warehouse sorting, rubbish classification, and household services, scenarios exist in which rigid and soft objects are randomly piled together. In such situations, two major challenges arise in robotic picking tasks: the first is to distinguish rigid objects from soft objects, and the second is to grasp one object of each type at a time. In this study, we propose a novel robotic picking methodology for the grasping of objects mixed with towels. The proposed approach is based on a novel object detection method that can identify a rigid object placed in different directions using a rotational bounding box. Rigid objects can be separated from the mixed scene without object segmentation. Moreover, the grasping pose of a rigid object can be generated directly along its principal axis, without using a CAD model or specific pose detection method. The gripper opening width is determined according to the object size. Therefore, our method can detect whether other objects, particularly soft ones, exist around a rigid object. If no suitable grasping pose is available for the rigid objects, the grasping pose on a wrinkle of the towel is selected. The experiments demonstrate that our method can accomplish the picking task in scenes with mixed rigid and soft objects, thereby indicating its significance in robotic object detection and sorting.

Highlights

In terms of logistics warehouse sorting, rubbish classification, and household services, humans constantly need to deal with object sorting in mixed and disordered scenes
Based on the object detection results, we introduce an algorithm to accomplish the efficient grasping of objects mixed with towels
We propose the use of RIoU instead of the traditional IoU to measure the accuracy of the prediction bounding box, which can display the angle change between two rotational bounding boxes in an improved manner

Summary

Introduction

In terms of logistics warehouse sorting, rubbish classification, and household services, humans constantly need to deal with object sorting in mixed and disordered scenes. People, including children, can pick up a rigid object without pulling up its surrounding objects. They can successfully grasp a soft object without catching the objects covered thereby, and can place the objects in the correct locations according to their categories. It is rather difficult for a robot to accomplish such tasks. We focus on object grasping when rigid objects are mixed with towels

Methods

Results

Conclusion