Integration of vision and inertial sensors for industrial tools tracking

Abstract

PurposeThis paper represents a hybrid Vision/INS system for tool tracking applications. The proposed system incorporates low cost MEMS sensors and low cost vision type sensors for tracking industrial tools. Vision systems alone have to deal with the problem of “line of sight” and the INS sensor alone will encounter an exponential drift, which render both systems useless for the proposed application.Design/methodology/approachThe Vision/INS system with the integration of the extended Kalman filter calculates 6D position‐orientation of a tool during its operation within the required accuracy tolerance specific to the application at hand. In this paper, a tool motion modeling approach is proposed to limit the error in an acceptable range for a short period of missing data. The motion of the tool is modeled and updated at any time that the instrument is in the camera view field. This model is applied to the estimation algorithm whenever the camera is not in line of site and the optical data is missing.FindingsThe result of applying motion modeling is shown that the resulted error due to absence of the vision measurement system was bounded and decreased (see the experimental results).Originality/valueIn this paper, the tool motion modeling is proposed to bind the error in the acceptable range for a short period of missing data. The motion of the tool is modeled and updated at any time that the instrument is in the camera view field. This model is applied to the estimation algorithm whenever the camera is not in line of site and the optical data is missing.