Abstract

This paper focuses on 6Dof object pose estimation from a single RGB image. We tackle this challenging problem with a two-stage optimization framework. More specifically, we first introduce a translation estimation module to provide an initial translation based on an estimated depth map. Then, a pose regression module combines the ROI (Region of Interest) and the original image to predict the rotation and refine the translation. Compared with previous end-to-end methods that directly predict rotations and translations, our method can utilize depth information as weak guidance and significantly reduce the searching space for the subsequent module. Furthermore, we design a new loss function function for symmetric objects, an approach that has handled such exceptionally difficult cases in prior works. Experiments show that our model achieves state-of-the-art object pose estimation for the YCB- video dataset (Yale-CMU-Berkeley).

Highlights

  • Detecting objects and estimating their poses [1] are critical steps for many 3D applications, such as autonomous driving [2,3,4], augmented reality [5,6,7], and robotic grasping [8,9]

  • Object poses consist of rotations and translations

  • For RGB methods, it is harder to figure out translations than rotations

Read more

Summary

Introduction

Detecting objects and estimating their poses [1] are critical steps for many 3D applications, such as autonomous driving [2,3,4], augmented reality [5,6,7], and robotic grasping [8,9]. Object poses consist of rotations and translations. The challenges of estimating object poses lie in changing lighting conditions, heavy occlusion, sensor noise, etc. Methods based on RGB-D images have made great progress [4,10,11]. For many scenes, depth sensors are not available. Pose estimation based on RGB only remains a challenging problem. We focus on 6D pose estimation using only a single RGB image

Objectives
Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call