PurposeThe aim of this paper is to study the effect of pressure angle and helix angle on bending stress at the root of helical gear tooth under dynamic state. Gear design is a highly complex process. The consistent demand to build low-cost, quieter and efficient machinery has resulted in a gradual change in gear design. Gear parameters such as pressure angle, helix angle, etc. affect the load-carrying capacity of gear teeth. Adequate load-carrying capacity of a gear is a prime requirement. The failure at the critical section because of bending stress is an unavoidable phenomenon. Besides this fact, the extent of these failures can be reduced by a proper gear design. The stresses produced under dynamic loading conditions in machine member differ considerably from those produced under static loading.Design/methodology/approachThe present work is intended to study the effect of pressure angle and helix angle on the bending stress at the root of helical gear tooth under dynamic state. The photostress method has been used as experimental methods. Theoretical analysis was carried out by velocity factor method and Spott’s equation. LS DYNA has been used for finite element (FE) analysis.FindingsThe results show that experimental method gives a bending stress value that is closer to the true value, and bending stress varies with pressure angle and helix angle. The photostress technique gives clear knowledge of stress pattern at root of tooth.Originality/valueThe outcomes of this work help the designer use optimum weight-to-torque ratio of gear; this is ultimately going to reduce the total bulk of the gear box.