Abstract High-power permanent magnet synchronous motors (HPMSM) face extremely harsh cooling conditions due to their high power and complex structure. An efficient cooling system is pivotal to ensuring the safety and operational reliability of HPMSM. To improve the uneven axial temperature distribution in HPMSM and enhance the cooling effect, this paper presents an optimization of the water channels within the motor's cooling system. Initially, targeting the maximum temperature of the motor, the number and width of the traditional water channel (TWC) ribs are parameterized, and the optimal parameters are determined. Subsequently, based on the optimal parameters, three different waveform water channels are designed: circular channel (CC), triangular channel, and square channel. By employing the computational fluid dynamics numerical simulation, the influence of three kinds of water channels on the temperature of an HPMSM is analyzed under rated conditions. When the depth is 36 mm and the span is 40 mm for the CC, the average temperature rise of the motor winding is 9.88% lower than that of the TWC, reaching 48.77 °C. Results indicate that the cooling effect of the CC is better than others, which improves the cooling effect and operation performance of the motor.