Variation in the raffinose family oligosaccharide (RFO) content in soybean is advantageous for livestock farming and health science. In this study, a soybean variety (GmJMC172) with a significantly low stachyose content in its seeds was identified in the NARO Genebank core collection. The results of the single-nucleotide polymorphism (SNP) analysis suggested that this phenomenon was related to a single-base deletion, inducing a frameshift mutation in raffinose synthase 2 (RS2), rather than the polymorphisms in the RS3, RS4, and stachyose synthase (STS) sequences. Differences in the enzymatic properties between the native RS2 and truncated RS2 were examined by using a three-dimensional model predicted using Alphafold2. In addition to revealing the missing active pocket in truncated RS2, the modeled structure explained the catalytic role of W331* and suggested a sufficient space to bind both sucrose and raffinose in the ligand-binding pocket. The soybean line, with seeds available from the NARO Genebank, could serve as breeding materials for manipulating the RFO content.