The identification and analysis of allelic variation are important bases for crop diversity research, trait domestication and molecular marker development. Grain tannin content is a very important quality trait in sorghum. Higher tannin levels in sorghum grains are usually required when breeding varieties resistant to bird damage or those used for brewing liquor. Non-tannin-producing or low-tannin-producing sorghum accessions are commonly used for food and forage. Tan1 and Tan2, two important cloned genes, regulate tannin biosynthesis in sorghum, and mutations in one or two genes will result in low or no tannin content in sorghum grains. Even if sorghum accessions contain dominant Tan1 and Tan2, the tannin contents are distributed from low to high, and there must be other new alleles of the known regulatory genes or new unknown genes contributing to tannin production. The two parents 8R306 and 8R191 did not have any known recessive alleles for Tan1 and Tan2, and it was speculated that they probably both had dominant Tan1 and Tan2 genotypes. However, the phenotypes of two parents were different; 8R306 had tannins and 8R191 had non-tannins in the grains, so these two parents were constructed as a RIL population. Bulked segregant analysis (BSA) was used to determine other new alleles of Tan1 and Tan2 or new Tannin locus. Tan1 and Tan2 full-length sequences and tannin contents were detected in wild sorghum resources, landraces and cultivars. We identified two novel recessive tan1-d and tan1-e alleles and four recessive Tan2 alleles, named as tan2-d, tan2-e, tan2-f, and tan2-g. These recessive alleles led to loss of function of Tan1 and Tan2, and low or no tannin content in sorghum grains. The loss-of-function alleles of tan1-e and tan2-e were only found in Chinese landraces, and other alleles were found in landraces and cultivars grown all around the world. tan1-a and tan1-b were detected in foreign landraces, Chinese cultivars and foreign cultivars, but not in Chinese landraces. These results implied that Tan1 and Tan2 recessive alleles had different geographically distribution in the worldwide, but not all recessive alleles had been used in breeding. The discovery of these new alleles provided new germplasm resources for breeding sorghum cultivars for food and feed, and for developing molecular markers for low-tannin or non-tannin cultivar-assisted breeding in sorghum.