This study compares the effect of sulfur and dicumyl peroxide (DCP) vulcanizing systems on the physical and mechanical properties of rubber compounds based on acrylonitrile butadiene rubber (NBR). NBR compounds cured by different amounts of DCP and NBR vulcanizates filled with various concentrations of carbon black (CB) and a constant amount of sulfur or DCP were prepared. The vulcanizates were characterized by tensile testing, dynamic mechanical thermal analysis (DMTA), and cross-link density determination. The tensile strength and Young's modulus were found to increase with the rising amount of DCP and CB, while elongation at break decreased. The samples vulcanized by the sulfur system and filled with CB show a substantial increase in tensile strength from 13.1 to 21.2 MPa. Higher storage modulus and glass transition temperature were observed with the increase in the amount of peroxide and filler, and consequently, the increase in cross-link density, indicating rigidity increase and lower molecular mobility. The changes in the physical and mechanical properties of the NBR vulcanizates were in correlation with the changes in solvent uptake and cross-link density.