Ample studies have been conducted to investigate the population genetic structure of grass carp Ctenopharyngodon idella in the Yangtze River, China. However, samples from the upper reaches were not included. In this study, we collected samples from the entire river, including three locations in the upper reaches: Yibin, Banan and Yunyang, two locations in the middle reaches: Shishou and Ruichang and one location in the lower reaches: Hanjiang, and sequenced three mitochondrial coding genes (ND5, ND6 and Cytb) and one control region (i.e., the D-loop). Nineteen haplotypes were observed in grass carp of the Yangtze River through the analysis of combined sequence data sets (around 4428 bp). Haplotype diversity indices (0.6000 ∼ 0.9333) and nucleotide diversity indices (0.0002 ∼ 0.0020) demonstrated low genetic diversity in the Yangtze grass carp. The analysis of molecular variance and the fixation index (F ST = 0.0202) revealed insignificant genetic difference between samples from different reaches. Two monophyletic lineages of haplotypes were identified, with the lineage A experiencing potential expansion events. Along with previous findings, this study provides a better understanding of genetic diversity and variation of grass carp in the Yangtze River and will be served as an important baseline to evaluate the long-term impact of the Three Gorges Dam and other hydroelectric facilities on fish biodiversity.