As oil production increasingly transitions from shallow to deep formation, the need for efficient PDC cutters to drill through deep hard rock becomes paramount. Currently, there is a lack of effective methods for optimizing cutter shapes and their cutting parameters. This study addresses this gap by developing a rock-breaking mechanism model for PDC cutters and proposing a Stability Index (SI) based on cutting force variations during the cutting process. Using the FDEM method, we simulated the rock-breaking processes of planar, stinger, and machete cutters under various cutting depths and angles. SI and Mechanical Specific Energy (MSE) were employed as evaluation metrics to analyze the rock-breaking characteristics and determine the optimal cutting parameters for each cutter type. The results indicate that at shallow cutting depths, cutting force changes are minimal, predominantly causing plastic damage to the rock, resulting in lower stress and reduced wear on the PDC cutters. Conversely, at greater cutting depths, significant fluctuations in cutting force occur, leading to brittle failure and the generation of large cuttings. This sudden increase in cutting force can accelerate rock breaking but also increases the risk of cutter wear. Our findings suggest that the planar cutter offers stable performance with high cutting force requirements, optimal at a cutting depth of 1.5 mm and an angle of less than 20°. The stinger cutter, requiring lower cutting forces, performs best at a cutting depth of 2 mm and an angle of 20°. The machete cutter exhibits characteristics similar to the stinger cutter at shallow depths and the planar cutter at deeper depths, making it suitable for drilling at a depth of 2 mm and an angle of less than 10°. By balancing SI and MSE, this study provides a comprehensive approach to optimizing PDC cutter performance, enhancing drilling efficiency while minimizing cutter wear.