DVIO: An Optimization-Based Tightly Coupled Direct Visual-Inertial Odometry

Abstract

In this article, we propose a novel optimization-based tightly coupled Direct Visual-Inertial Odometry (DVIO), which fuses the visual and inertial measurements to provide real-time full state estimation. Different from existing frameworks, the key novelty of the proposed method is to integrate the data association, state estimation, and outlier detection into a nonlinear optimization framework in a tightly coupled way. Specifically, by jointly minimizing the preintegration error of the inertial measurement unit and the photometric error of the camera, the data association is tightly coupled with the process of state estimation. Then, an iterative selection strategy is design to reject outliers during the data association and establish more visual constraints in the optimization. In addition, a hybrid weighting method is proposed to tightly integrate the iterative selection into the optimization by dynamically weighting residual terms. As a consequence, the proposed method aligns the image patches, estimates the motion and removes the outliers synchronously. Comparative experiments on the public dataset and extensive real-world experiments show that DVIO outperforms state-of-the-art visual-inertial odometries in terms of both the accuracy and the robustness. Thus, DVIO is highly applicable to the navigation or the simultaneous localization and mapping of mobile devices or agile robots like micro air vehicles.