For the problem of backlash in the semi-closed-loop linear feed servo system of CNC machine tools, which seriously affects the accuracy of machine tools, an acceleration segmentation backlash compensation strategy is proposed. In the reverse motion of the servo motor, the servo motor is controlled to compensate for the backlash error during a period of accelerated motion and a period of decelerated motion. Based on the established backlash transmission model, the parameters of the compensated motion process are calculated. In order to ensure accurate and quick compensation of the gap compensation value for the transmission gap, the backpropagation method is used to backpropagate the acceleration calculation based on whether the acceleration process time is an integer multiple of the servo interpolation period. Finally, the feasibility of the method is verified through experiments, and the results show that the method improves the positioning accuracy of machine tools.