Arsenic (As) has been recognized as one of the most toxic metalloids present in the surface soil contaminating food chain and posing threat to human life. Sulfur (S) fertilizer is often supplied in paddy soil for rice growth, but its impact on As mobility and related bacteria remains poorly understood. In this study, a pot experiment was set up with two different types of sulfur treatments (element sulfur and Na2SO4) to evaluate the effect of sulfur fertilizers on As speciation in porewater, As fractions in soil, As accumulation in rice plants. Besides, rhizosphere bacterial composition and functional genes that might influence As mobility were also studied. The results revealed that the addition of 150 mg/kg Na2SO4 decreased As(III) and As(V) concentrations in soil porewater at maturation stage by 77% and 64%, respectively. With the same sulfur content, Na2SO4 was more effective than element sulfur. The addition of sulfur fertilizers promoted rice growth and reduced As accumulation in shoots, further reduced As translocation from root to above-ground parts by 39–59%. The addition of sulfur fertilizers had little effect on genes involved in As metabolism. However, the relative abundance of Fe(III) and sulfate reduction related genera increased with the addition of 150 mg/kg Na2SO4, consistent with the increase of Fe(III) reducing bacteria Geobacteraceae and sulfate reducing gene dsrA. The phenomenon likely influenced the decrease of As concentrations in soil porewater and rice uptake. The outcomes indicate that promoting Fe- and S- reducing bacteria in the rhizosphere by sulfur fertilizers may be one way to reduce As risk in the soil-rice system.