Platycladus orientalis is one of the main species used in afforestation projects in the arid mountains of north and northwest China, meaning that the species has high ecological and economic value. Studying its genetic diversity and obtaining a core germplasm base and genetic fingerprint data are important for the screening, development, and utilization of the species. This can provide the core materials for the preservation and evaluation and mining of germplasm resources and can provide superior gene resources for breeding programs. In this study, the genetic diversity among 104 P. orientalis germplasm resources was examined using simple sequence repeat (SSR) markers, and a core germplasm containing 31 accessions was constructed that represents the most genetic diversity of P. orientalis accessions. Each of 20 pairs of primers showed polymorphism, and 117 alleles were identified. The average number of alleles at each locus was six, and the mean effective allele number was 2.607. The average Shannon’s information index was 0.983, and the average polymorphism information content was 0.445. There is thus a significant amount of genetic variation within P. orientalis germplasm, yielding a rich genetic diversity. The constructed core germplasm accounted for 30% of the original germplasm. There was no significant difference in genetic diversity between the core germplasm and the original germplasm resources, indicating that the obtained core germplasm resources could fully represent the original germplasm. Using 17 SSR primers with high polymorphism, the DNA fingerprints of 104 P. orientalis germplasm resources were constructed. The results showed that 98 had specific DNA fingerprints. The results of this study provide a valuable basis for the collection, preservation, and utilization of P. orientalis germplasm resources, and the methods adopted in this study have important reference value for the construction of core germplasm of other perennial woody plants.