Key messageStem rust resistance was mainly based on a few, already known resistance genes; for yellow rust resistance there was a combination of designated genes and minor QTLs.Yellow rust (YR) caused by Puccinia striiformis f. sp. tritici (Pst) and stem rust (SR) caused by Puccinia graminis f. sp. tritici (Pgt) are among the most damaging wheat diseases. Although, yellow rust has occurred regularly in Europe since the advent of the Warrior race in 2011, damaging stem rust epidemics are still unusual. We analyzed the resistance of seven segregating populations at the adult growth stage with the parents being selected for YR and SR resistances across three to six environments (location–year combinations) following inoculation with defined Pst and Pgt races. In total, 600 progenies were phenotyped and 563 were genotyped with a 25k SNP array. For SR resistance, three major resistance genes (Sr24, Sr31, Sr38/Yr17) were detected in different combinations. Additional QTLs provided much smaller effects except for a gene on chromosome 4B that explained much of the genetic variance. For YR resistance, ten loci with highly varying percentages of explained genetic variance (pG, 6–99%) were mapped. Our results imply that introgression of new SR resistances will be necessary for breeding future rust resistant cultivars, whereas YR resistance can be achieved by genomic selection of many of the detected QTLs.