With the advance of contemporary technology, high precision surface finishing techniques for optical glasses are of great concern and developing to meet the requirements of the effective industrialized processes. Not only the used tools but also process parameters have great influence on the surface roughness improvements. In this paper, surface roughness improvement of Zerodur optical glass using an innovative rotary abrasive fluid multi-jet polishing process has been presented. For the same purpose, a tool for executing ultra precision polishing was designed and manufactured. Taguchi's experimental approach, an L18 orthogonal array was employed to obtain the optimal process parameters. ANOVA analysis has also been carried out to determine the significant factors. It was observed that about a 98.33% improvement on surface roughness from (Ra) 0.360μm to (Ra) 0.006μm has been achieved. The experimental results show that a surface finished achieved can satisfy the requirements for optical-quality surface (Ra<12nm). In addition, the influence of significant factors on surface roughness improvement has been discussed in this study.