In this study, we propose a novel visual-based autonomous trajectory-tracking control method for steering a wheeled robot following the lines of crop row in paddy field. A rice crop rows detection method, based on the region growth sequential clustering − random sample consensus (RANSAC) algorithm, is developed to generate trajectory. Concurrently, a dynamics predictive controller is employed to compute the command for the desired steering angle. The controller leverages a model that incorporates slip dynamics and operates on a low power consumption industrial computer. Experimental results show that the developed algorithm can successfully obtain the correct trajectory in more than 96.25 % of the cases, with the angle error consistently below 3°. Furthermore, the single-image processing time is notably swift at 13.98 ms, underscoring the commendable adaptability and real-time performance of the proposed methodology. During movement in the paddy field, the robot exhibits maximum lateral deviations of 4.55 cm, 5.65 cm, and 6.41 cm at speeds of 0.3 m/s, 0.6 m/s, and 0.9 m/s, respectively, accompanied by corresponding heading angle errors of 4.59°, 5.63°, and 7.39°. Notably, while adeptly tracking rice crop rows at all three speeds, the robot consistently maintains a maximum lateral error below one-fourth of the inter-row spacing of rice planting. This study assumes significance in enhancing the stability of ground-traversing agricultural robots, serving as a valuable reference for advancing the research and development of intelligent and efficient agricultural robotic systems.