Nowadays, high aerodynamic load has made blade separation an issue for compact axial compressors under high-altitude low-Reynolds-number conditions. In this study, herringbone grooves inspired by bird feathers were applied to suppress the suction side separation and reduce loss. To study the effect of bio-inspired herringbone grooves on the aerodynamic performance of compressor cascades, a high subsonic compressor cascade was taken as the research object. Under the conditions of different Reynolds numbers, the effects of herringbone grooves of different depths on the flow separation were numerically studied. The research results show that at a high-Reynolds-number condition (Re = 5.6 × 105), the sawtooth-shaped wake induced by herringbone grooves increases the turbulent mixing loss near the suction surface, and the blade performance deteriorates. At a low-Reynolds-number condition (Re = 1.3 × 105), the span-wise secondary flow and micro-vortex structure induced by the herringbone grooves effectively suppress the laminar separation on the suction surface of the blade, and there is an optimal depth for the herringbone grooves that reduces the profile loss by 8.33% and increases the static pressure ratio by 0.55%. The selection principle of the optimal groove depth with the Re is discussed based on the research results under six low-Reynolds-number conditions.