Seed size and shape are important traits that determine seed yield in sesame. Understanding the genetic basis of seed size and shape is essential for improving the yield of sesame. In this study, F2 and BC1 populations were developed by crossing the Yuzhi 4 and Bengal small-seed (BS) lines for detecting the quantitative trait loci (QTLs) of traits related to seed size and shape. A total of 52 QTLs, including 13 in F2 and 39 in BC1 populations, for seed length (SL), seed width (SW), and length to width ratio (L/W) were identified, explaining phenotypic variations from 3.68 to 21.64%. Of these QTLs, nine stable major QTLs were identified in the two populations. Notably, three major QTLs qSL-LG3-2, qSW-LG3-2, and qSW-LG3-F2 that accounted for 4.94-16.34% of the phenotypic variations were co-localized in a 2.08 Mb interval on chromosome 1 (chr1) with 279 candidate genes. Three stable major QTLs qSL-LG6-2, qLW-LG6, and qLW-LG6-F2 that explained 8.14-33.74% of the phenotypic variations were co-localized in a 3.27 Mb region on chr9 with 398 candidate genes. In addition, the stable major QTL qSL-LG5 was co-localized with minor QTLs qLW-LG5-3 and qSW-LG5 to a 1.82 Mb region on chr3 with 195 candidate genes. Gene annotation, orthologous gene analysis, and sequence analysis indicated that three genes are likely involved in sesame seed development. These results obtained herein provide valuable in-formation for functional gene cloning and improving the seed yield of sesame.