Objectives: Evaluate the prevalence of genetic factors in a large population of infertile subjects and define the seminological, hormonal, and ultrasonographic features for each alteration. Methods: This single-center retrospective study included male partners of infertile couples undergoing genetic investigations due to oligozoospermia or azoospermia evaluated from January 2012 to January 2022. The genetic investigations consist of karyotype, CFTR gene mutations plus variant of the IVS8-5T polymorphic trait, Y chromosome microdeletion, and Next Generation Sequencing panel to analyze genes implicated in congenital hypogonadotropic hypogonadism (CHH). Results: Overall, 15.4% (72/466) of patients received a diagnosis of genetic cause of infertility. Specifically, 23 patients (31.9%) harbor mutations in the CFTR gene, 22 (30.6%) have a 47, XXY karyotype, 14 (19.4%) patients show a Y chromosome microdeletion, 7 (9.7%) have structural chromosomal anomalies, and 6 (8.3%) have CHH. Overall, 80.6% of patients were azoospermic and 19.4% oligozoospermic (sperm concentration 3.5 ± 3.8 million/mL). Almost all patients presented hormonal alterations related to the specific genotype, while the main ultrasound alterations were testicular hypoplasia, calcifications/microcalcifications, and enlarged/hyperechoic epididymis. Conclusions: The prevalence of genetic abnormalities in males of infertile couples was 15.4% in our Center. CFTR gene disease-causing variants resulted in more frequent, with various clinical features, highlighting the complexity and heterogeneity of the presentation. Other investigations are needed to understand if conditions like ring chromosomes and other translocations are related to infertility or are incidental factors.