High-speed rail grinding is a unique passive grinding maintenance strategy that differs from conventional grinding techniques. Its grinding behavior is dependent on the relative motion between the grinding wheel and rail; hence, it possesses great speed and efficiency. In this study, the effects of the duration of grinding time and the increase in the number of grinding passes on the grinding of high-speed rails were investigated using passive grinding tests with a single grinding time of 10 s and 30 s and grinding passes of once, twice, and three times, respectively. The results show that when the total grinding time was the same, the rail removal, grinding ratio of grinding wheels, rail grinding effect, grinding force, and grinding temperature were better in three passes of 10 s grinding than in one pass of 30 s grinding, indicating that the short-time and multi-pass grinding scheme is not only conducive to improving the grinding efficiency and grinding quality in the high-speed rail grinding but can also extend the service life of the grinding wheels. Moreover, when the single grinding times were 10 s and 30 s, respectively, the grinding removal, grinding efficiency, grinding marks depth, and surface roughness of rail increased with the number of grinding passes, implying that the desired rail grinding objective can be achieved by extending the grinding time via the multi-pass grinding strategy. The results and theoretical analysis of this study will contribute to re-conceptualizing the practical operation of high-speed rail grinding and provide references for the development of the grinding process and grinding technology.