Grain yield of rice consists of sink capacity and grain filling. There are some genes known to contribute to sink capacity, but few genes associated with grain filling are known. We conducted a genetic analysis on yield-related traits by using a chromosome segment substitution line population that have introgression from DV85, an aus variety of rice, in the background of T65, a japonica variety. Refined whole-genome genotypes of the 43 TD-CSSLs were obtained by genotyping-by-sequencing. The effects of previously detected quantitative trait loci (QTLs), qNSC1 and qNSC2, were confirmed by the amount of non-structural carbohydrate (NSC) at 5 days after heading (DAH). The CSSL for qSWTR11, the QTL for decrease in shoot weight during the maturity stage, showed the highest NSC at 5 DAH and lowest at 35 DAH. The brown rice yield of these lines were not stably significant. Most of the sink-related traits correlated between the 2 tested years, but most of the grain-filling traits did not show correlation between the 2 years. Correlation analysis revealed that the sink capacity is stable and primarily determines the yield, and grain filling is more affected by the environment. In addition, biomass production before heading and during the maturity stage contributes to higher yield in TD-CSSLs, and the amount of translocation of stem reserve does not affect much to the yield. We conclude that higher NSC at the heading stage and rapid decrease in shoot biomass during the maturity stage did not directly contribute to the yield formation in the japonica genetic background.