Despite several phylogeographic studies had provided evidence to support the existence of glacial refugia of cool‐temperate deciduous trees in northeast China, the species used in these studies were limited by the species ranges, which could not exclude the possibility that northern populations were the colonists from southern refugial populations during the last glacial maximum (LGM). Here, we estimated the nucleotide variation in Populus davidiana, a widespread species distributed in Eurasia. Three groups in northeast, central, and southwest China were constructed according to the simulation results from SAMOVA, composition of chloroplast haplotypes and structure results. We revealed that the northeast China had endemic haplotypes, the haplotypes and nucleotide diversity in northern regions were not lower than that in southern China, and this species has not experienced population expansion base on the estimation of Bayesian skyline plots. Ecological niche modeling (ENM) indicated that the northeast China had a high suitability score during the last glacial maximum. The combined evidence clearly demonstrated that northeastern and southwestern refugia were maintained across the current distributional range of P. davidiana during the LGM. The genetic differentiation between these two refugia might be mainly caused by differences of climate among these areas. The phylogeographic analyses of a widely distributed P. davidiana provided robust evidence to clarify the issue of refugia in northeast China, and these results are of great importance for understanding the influence of Quaternary glaciations on the distribution and evolution of species in East Asia.