Image feature matching is an important part of visual odometry. In order to improve the accuracy of feature point matching for visual odometry, an accurate algorithm combining the pyramid feature optical flow and corner features based on image feature matching is proposed. Firstly, the Oriented Features from Accelerated Segment Test and Rotated BRIEF (ORB) algorithm is used to extract the image feature points quickly. Secondly, the local feature window is utilised to calculate the displacement vector of the image feature points and the pyramid Lucas–Kanade feature optical flow is used to track feature points. Then, to solve the problem of matching alignment and feature loss, the K nearest neighbour radius search is used as feature filter to remove the confused matching. Finally, the Random Sample Consensus algorithm is introduced to eliminate redundant mismatch points and improved the matching rate. The comparison of experimental data shows that the proposed algorithm can get high matching rate. Compared with the traditional ORB feature matching algorithm, the algorithm had a significant improvement in real time and image feature matching accuracy.