Image-based UAV position and velocity estimation using a monocular camera

Abstract

Autonomous landing of aerial vehicles is challenging, especially in emergency flight scenarios in which precise information about the vehicle and the environment is required for near-to-ground maneuvers. In this paper, the optic-flow concept based on feature detection is applied to estimate the vertical distance and the velocity vector of a multirotor UAV (MUAV) for landing. The UAV kinematics, the optical flow equations, and the detected feature states, provided by a low-cost monocular camera, are combined to develop a novel appropriate model for estimation. The proposed algorithm applies the variation of detected features, the angular velocities, as well as the Euler angles, measured by the Inertial Measurement Unit (IMU), to estimate the vertical distance of the UAV to the ground, the MUAV velocity vector, and also to predict the future features position. Extended Kalman filter (EKF) is applied as the estimation method on the coupled optic-flow and kinematic equations. The accuracy of state estimation is enhanced by the idea of multiple-feature tracking. The 6-DOF simulations, laboratory experiments, and comparison of results demonstrate the capability of height and velocity estimation of a MUAV in the landing phase of flight by just applying the low-cost camera information. Monte Carlo simulations have been performed to study the effect of IMU acceleration, and angular velocity measurement noises as well as the number of the detected features on the success probability of the estimation process. The results reveal that increasing the number of detected features, i.e tracking multiple features, increases the estimation accuracy, however, it mainly improves the success probability, which is a more important factor in practical scenarios.