The scientific goal of this study was to investigate the effects of various parameters on cavitation-induced erosion, with the aim to enhance the understanding and assessment of cavitation resistance in hydraulic systems. Cavitation erosion poses significant challenges to the durability and efficiency of hydraulic components, such as those found in hydropower plants and pumping stations. Prompted by the need to improve the reliability of cavitation testing and material assessment, this research conducted a comprehensive sensitivity analysis of a cavitation jet apparatus (CJA). This study employed an experimental platform that consisted of a vertical cylindrical test tank, a submerged nozzle, and an aluminum sample. By examining a range of orifice diameters, this research identified that smaller diameters led to increased erosion intensity, with the most pronounced effects observed at a diameter of 2 mm. Furthermore, various standoff distances (SoDs) were tested, which revealed that shorter distances resulted in greater erosion, with the highest impact noted at an SoD of 5 cm. This study also evaluated different nozzle geometries, where it was found that a 132° conical sharped edges nozzle, combined with an orifice diameter of 2 mm and an SoD of 5 cm, produced the most severe erosion. Conversely, chamfered edges nozzles and a commercial nozzle (MEG2510) with an SoD of 10 cm or greater showed reduced erosion. These results highlight that by standardizing the testing duration to 1200 s, the CJA could reliably assess the cavitation resistance of materials. This study established a clear relationship between increased pressure and higher impact forces, which led to more severe erosion. The findings underscore the effectiveness of the CJA in evaluating material resistance under various cavitation conditions, thus addressing a critical need for reliable cavitation testing tools.