Abstract

Motion estimation is crucial to predict where other traffic participants will be at a certain period of time, and accordingly plan the route of the ego-vehicle. This paper presents a novel approach to estimate the motion state by using region-level instance segmentation and extended Kalman filter (EKF). Motion estimation involves three stages of object detection, tracking and parameter estimate. We first use a region-level segmentation to accurately locate the object region for the latter two stages. The region-level segmentation combines color, temporal (optical flow), and spatial (depth) information as the basis for segmentation by using super-pixels and Conditional Random Field. The optical flow is then employed to track the feature points within the object area. In the stage of parameter estimate, we develop a relative motion model of the ego-vehicle and the object, and accordingly establish an EKF model for point tracking and parameter estimate. The EKF model integrates the ego-motion, optical flow, and disparity to generate optimized motion parameters. During tracking and parameter estimate, we apply edge point constraint and consistency constraint to eliminate outliers of tracking points so that the feature points used for tracking are ensured within the object body and the parameter estimates are refined by inner points. Experiments have been conducted on the KITTI dataset, and the results demonstrate that our method presents excellent performance and outperforms the other state-of-the-art methods either in object segmentation and parameter estimate.

Highlights

  • (2) We compose an edge-point constraint on the feature points and apply the random sample consensus (RANSAC) [17] algorithm to eliminate outliers of tracking points so that the points used for tracking are ensured within the object body and the parameter estimate are refined by inner points

  • The extended Kalman filter (EKF) model takes the ego-motion into considerations and integrates optical flow, and disparity to generate optimized object position and velocity

  • (2) We compose an edge-point constraint on the feature points and apply the random sample consensus algorithm to eliminate outliers of tracking points so that the points used for tracking are ensured within the object body and the parameter estimate are refined as inner points

Read more

Summary

Introduction

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. We propose a novel approach to estimate the motion state for autonomous vehicles by using region-level segmentation and Extended Kalman. These points are noise points and will result in unreliable object tracking and incorrect parameter estimate. To generate object bounding boxes and apply a region-level segmentation on them to accurately locate object contour and determine points within the objects (Figure 1 shows the results). We propose a relative motion model of the ego-vehicle and moving objects, and establish an EKF model for point tracking and parameter estimate. We propose a relative motion model of the ego-vehicle and the object, and establish an EKF model for point tracking and parameter estimate.

Related Work
Method
Object Detection and Region-Level Segmentation
Tracking and Parameter Estimate
The Relative Motion Model of the Ego-Vehicle and the Object
Feature-Point Filtering
Experiments
Segmentation Results
Results of Feature-Point Filtering
Motion Estimate Results
Evaluation and Comparison
Conclusions
Methods
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call