Male infertility is a serious ongoing problem, whose causes have not yet been clearly identified. However, since human exposure to silver nanoparticles (AgNPs) has recently increased due to their beneficial properties, the present study aimed to determine the impact of small-size AgNPs on mouse spermatogonia (GC-1 spg) and spermatocytes [GC-2 spd(ts)] in vitro models as well as the ability of these nanostructures to induce inflammation. The results showed a significant dose- and time-dependent decrease in the metabolic activity in both cell models, which was correlated with an increase in the intracellular ROS level. Moreover, increased activity of caspase-9 and -3, together with enhanced expression of CASP3 and p(S15)-p53 proteins, was detected. Further studies indicated a decrease in ΔΨm after the AgNP-treatment, which proves induction of apoptosis with engagement of an intrinsic pathway. The PARP1 protein expression, the activity and protein expression of antioxidant enzymes, the GSH level, and the increased level of p-ERK1/2 indicate not only the engagement of DNA damage but also the occurrence of oxidative stress. The small-size AgNPs were able to induce inflammation, proved by increased protein expression of NF-κB, p-IκBα, and NLRP3, which indicate damage to spermatogonia and spermatocyte cells. Moreover, the PGC-1α/PPARγ and NRF2/Keap1 pathways were engaged in the observed effect. The spermatogonial cells were characterized by a stronger inflammation-based response to AgNPs, which may be correlated with the TNFα/TRAF2-based pathway. Summarizing, the obtained results prove that AgNPs impair the function of testis-derived cells by inducing the redox imbalance and inflammation process; therefore, these NPs should be carefully implemented in the human environment.