Abstract
To achieve high-accuracy grasping of unknown objects, we present novel multilevel convolutional neural networks (CNNs) for robotic grasping with a parallel gripper or multifingered dexterous hand. The multilevel CNNs include four levels with different structures and functions. The first level is constructed to get the approximate position of the grasped object. The second level aims to obtain the preselected grasping rectangles. The third level is constructed to re-evaluate the preselected grasping rectangles and obtain substantially detailed features with quite a large network, so as to assess each preselected grasping rectangle exactly. By using a selection algorithm, the optimal grasping rectangle can be determined and unknown object grasping can be achieved with a parallel gripper. The purpose of the fourth level is to obtain the finger position distribution to complete the accurate grasping of unknown objects with a multifingered dexterous hand. The test results indicate that, compared to state-of-the-art methods, the proposed multilevel CNNs can greatly increase the precision of the grasping rectangle. Grasping experiments were implemented on a Youbot arm with five degrees of freedom and a Shadow four-fingered dexterous hand. The results show that the multilevel CNNs can determine the optimal grasping rectangle and finger position distribution, thereby achieving high-accuracy grasping of various unknown objects, even under several complex environmental conditions. <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners—Robot grasping of objects lags far behind human experiences and poses a significant challenge in the robotics area. To solve it, we present new multilevel convolutional neural networks (CNNs) to process red green blue-depth (RGB-D) images and realize optimal grasping detection of unknown objects. Moreover, we provide details of the network structure, network training, and network testing. The testing results obtained from the open grasping data set show that the multilevel CNNs can significantly increase the accuracy of the grasping rectangle compared to state-of-the-art methods. Experiments were implemented on different robotic platforms, including a five-degrees-of-freedom Youbot arm with a parallel gripper and a UR5 robot arm with a Shadow multifingered dexterous hand. The results validate that the multilevel CNNs offer excellent generalization and robustness for handling different sizes and shapes of unknown objects, as well as background disturbances, which are key problems in robotic manipulation.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
More From: IEEE Transactions on Automation Science and Engineering
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.