Wheat stripe rust, caused by Puccinia striiformis f. sp. tritici Eriks. & E. Henn, is the most devastating fungal disease of bread wheat. Here, a wheat-rye multiple disomic substitution line, SLU126 4R (4D), 5R (5D), and 6R (7D), possessing resistance against 25 races of P. striiformis f. sp. tritici, was used and crossed with Chinese Spring ph1b to induce homeologous recombination to produce introgressions with a reduced rye chromosome segment. Seedling assays confirmed that the stripe rust resistance from SLU126 was retained over multiple generations. Through genotyping-by-sequencing (GBS) platforms and aligning the putative GBS-single-nucleotide polymorphism (SNPs) to the full-length annotated rye nucleotide-binding leucine-rich repeat (NLR) genes in the parental lines (CS ph1b, SLU126, CSA, and SLU820), we identified the physical position of 26, 13, and 9 NLR genes on chromosomes 6R, 4R, and 5R, respectively. The physical positions of 25 NLR genes on chromosome 6R were identified from 568,460,437 bp to 879,958,268 bp in the 6RL chromosome segment. Based on these NLR positions on the 6RL chromosome segment, the three linked SNPs (868,123,650 to 873,285,112 bp) were validated through kompetitive allele-specific PCR (KASP) assays in SLU126 and resistance plants in the family 29-N3-5. Using these KASP markers, we identified a small piece of the rye translocation (i.e., as a possible 6DS.6DL.6RL.6DL) containing the stripe resistance gene, temporary designated YrSLU, within the 6RL segment. This new stripe rust resistance gene provides an additional asset for wheat improvement to mitigate yield losses caused by stripe rust.