Bartonella are vector-borne gram-negative facultative intracellular bacteria that can infect a wide spectrum of mammals, and are recognized as emerging human pathogens. This study aimed to investigate the prevalence and molecular characteristics of Bartonella infections in small mammals within the Qinghai Menyuan section of Qilian Mountain National Park, China. Small mammals were captured, and the liver, spleen and kidney were collected for Bartonella detection and identification using a combination of real-time PCR targeting the transfer-mRNA (ssrA) gene and followed by sequencing of the citrate synthase (gltA) gene. A total of 52 rodents were captured, and 36 rodents were positive for Bartonella, with a positivity rate of 69.23% (36/52). Bartonella was detected in Cricetulus longicaudatus, Microtus oeconomus, Mus musculus, and Ochotona cansus. The positivity rate was significantly different in the different habitats. Two Bartonella species were observed, including Bartonella grahamii and Bartonella heixiaziensis, and B. grahamii was the dominant epidemic strain in this area. Phylogenetic analysis showed that B. grahamii mainly clustered into two clusters, which were closely related to the Apodemus isolates from China and Japan and the local plateau pika isolates, respectively. In addition, genetic polymorphism analysis showed that B. grahamii had high genetic diversity, and its haplotype had certain regional differences and host specificity. Overall, high prevalence of Bartonella in small mammals in the Qinghai Menyuan section of Qilian Mountain National Park. B. grahamii is the dominant strain with high genetic diversity and potential pathogenicity to humans, and corresponding control measures should be considered.