Leopard (Panthera pardus) populations on the Chinese Loess Plateau have experienced severe declines and were once on the verge of extinction. Currently, leopards in the Loess Plateau region are mainly scattered in human-dominated fragmented habitats in Shanxi, Shaanxi and Ningxia. The lack of information on the genetic diversity and genetic structure makes difficult to assess the resistance and persistence of this metapopulation to various factors. In this study, we used mitochondrial ND-5 gene sequences and eight microsatellite loci to genetically analyze 97 faecal samples collected from three leopard ranges on the Loess Plateau of China. Among these samples, 62 feces were successfully identified from 22 individuals (6 females, 16 males). Mitochondrial haplotypes showed four different haplotypes and the genetic diversity was moderate (Hd = 0.331, Pi = 0.0036), while SSR showed high diversity (PIC = 0.673). STRUCTURE and TESS analyses revealed that leopard populations on the Loess Plateau appeared to have a distinct population boundary (K = 2) associated with a spatial-geographic barrier (the Yellow River). We estimate that the time of population divergence occurred between 8700 and 8300 years BP. Based on this research, we suggest that the leopard population on both sides of the Yellow River should be divided into two conservation management units to improve the efficiency of conservation management and contribute to the better recovery of the North Chinese leopard population.