The estimate process of a moving target trajectory is a well-known problem, where the main objective is to improve the estimation of object position. During the tracking are presented errors or variations between the true position and the estimated. In this paper, we treat such variations as a Gauss-Markov colored measurement noise (CMN). The estimation process is performed in predict and update, where the prediction indicates the next position of the bounding box, and the update is a correction step, which includes the new measurement of the tracking model and helps to improve the estimation. Looking for this improvement we use Kalman and Unbiased Finite Impulse Response filters in the standard version and modified for CMN to demonstrate the filter with the best performance. To test the most robust filter we use a high coloredness factor. The tests were carried out with simulated data (ideal and no ideal conditions) and with benchmark data (no ideal conditions). The UFIR modified for the CMN algorithm showed favorable results with high precision and low RMSE in the object tracking process with benchmark data and under no ideal conditions. While KF CMN showed better results under ideal conditions.