Dioxins are endocrine disruptors that may disturb male sexual and reproductive function. Studies on human populations are limited, and their results are controversial. This study evaluated the impact of dioxin exposure on reproductive and thyroid hormone levels and sexual function in men. A total of 140 men working in four military airbases (three bases were formerly contaminated with dioxin by the herbicide spraying campaign in the Vietnam War) were recruited to measure the serum dioxin levels. Four reproductive hormones (testosterone, follicle-stimulating hormone, luteinizing hormone (LH), and prolactin) and three thyroid hormones (free triiodothyronine (FT3), free thyroxin (FT4), and thyroid stimulating hormone) were measured. Male sexual function endpoints including sexual drive, erection, ejaculation, problems, and overall satisfaction were assessed by the Brief Male Sexual Function Inventory. The percentage of subjects with low testosterone and LH levels was 19.6% and 16.7%, respectively. Dioxins, especially 2,3,7,8-tetrachlorodibenzo-P-dioxin and toxic equivalent concentrations of polychlorinated dibenzo-p-dioxins/polychlorinated dibenzofurans, were inversely associated with testosterone and prolactin levels, but positively associated with FT3 and FT4, and showed adverse relationships with sexual function, such as sexual drive, problems, and overall satisfaction. Our results suggested that exposure to dioxin disrupts the homeostasis of reproductive and thyroid hormones leading to adverse effects on male sexual function.