Soybean (Glycine max (L.) Merr.) is a nutritious crop that can provide both oil and protein. A variety of mutagenesis methods have been proposed to obtain better soybean germplasm resources. Among the different types of physical mutagens, carbon-ion beams are considered to be highly efficient with high linear energy transfer (LET), and gamma rays have also been widely used for mutation breeding. However, systematic knowledge of the mutagenic effects of these two mutagens during development and on phenotypic and genomic mutations has not yet been elucidated in soybean. To this end, dry seeds of Williams 82 soybean were irradiated with a carbon-ion beam and gamma rays. The biological effects of the M1 generation included changes in survival rate, yield and fertility. Compared with gamma rays, the relative biological effectiveness (RBE) of the carbon-ion beams was between 2.5 and 3.0. Furthermore, the optimal dose for soybean was determined to be 101 Gy to 115 Gy when using the carbon-ion beam, and it was 263 Gy to 343 Gy when using gamma rays. A total of 325 screened mutant families were detected from out of 2000 M2 families using the carbon-ion beam, and 336 screened mutant families were found using gamma rays. Regarding the screened phenotypic M2 mutations, the proportion of low-frequency phenotypic mutations was 23.4% when using a carbon ion beam, and the proportion was 9.8% when using gamma rays. Low-frequency phenotypic mutations were easily obtained with the carbon-ion beam. After screening the mutations from the M2 generation, their stability was verified, and the genome mutation spectrum of M3 was systemically profiled. A variety of mutations, including single-base substitutions (SBSs), insertion-deletion mutations (INDELs), multinucleotide variants (MNVs) and structural variants (SVs) were detected with both carbon-ion beam irradiation and gamma-ray irradiation. Overall, 1988 homozygous mutations and 9695 homozygous + heterozygous genotype mutations were detected when using the carbon-ion beam. Additionally, 5279 homozygous mutations and 14,243 homozygous + heterozygous genotype mutations were detected when using gamma rays. The carbon-ion beam, which resulted in low levels of background mutations, has the potential to alleviate the problems caused by linkage drag in soybean mutation breeding. Regarding the genomic mutations, when using the carbon-ion beam, the proportion of homozygous-genotype SVs was 0.45%, and that of homozygous + heterozygous-genotype SVs was 6.27%; meanwhile, the proportions were 0.04% and 4.04% when using gamma rays. A higher proportion of SVs were detected when using the carbon ion beam. The gene effects of missense mutations were greater under carbon-ion beam irradiation, and the gene effects of nonsense mutations were greater under gamma-ray irradiation, which meant that the changes in the amino acid sequences were different between the carbon-ion beam and gamma rays. Taken together, our results demonstrate that both carbon-ion beam and gamma rays are effective techniques for rapid mutation breeding in soybean. If one would like to obtain mutations with a low-frequency phenotype, low levels of background genomic mutations and mutations with a higher proportion of SVs, carbon-ion beams are the best choice.