The work focuses on the optimization of surface texturing and their geometrical characteristics to improve the sealing performance of mechanical seal. The hydrodynamic model is developed to predict the sealing performance of four textures, including dimple, triangle, chevron and squamous textures. Result indicates that the squamous texture exhibits better sealing performance with high ratio of load-carrying capacity to leakage and ratio of oil film stiffness to leakage at various angular speeds and pressures. Furthermore, the functions of squamous texture characteristics with the load-carrying capacity and leakage ratio are revealed by the response surface methodology. And the squamous texture is optimized with high load-carrying capacity and low leakage ratio through the multi-objective optimization algorithm NSGA-II to achieve the Pareto-optimal set.