Many mammal species have declining populations, but the consequences of small population size on the genomic makeup of species remain largely unknown. We investigated the evolutionary history, genetic load and adaptive potential of the Cat Ba langur (Trachypithecus poliocephalus), a primate species endemic to Vietnam’s famous Ha Long Bay and with less than 100 living individuals one of the most threatened primates in the world. Using high-coverage whole genome data of four wild individuals, we revealed the Cat Ba langur as sister species to its conspecifics of the northern limestone langur clade and found no evidence for extensive secondary gene flow after their initial separation. Compared to other primates and mammals, the Cat Ba langur showed low levels of genetic diversity, long runs of homozygosity, high levels of inbreeding and an excess of deleterious mutations in homozygous state. On the other hand, genetic diversity has been maintained in protein-coding genes and on the gene-rich human chromosome 19 ortholog, suggesting that the Cat Ba langur retained most of its adaptive potential. The Cat Ba langur also exhibits several unique non-synonymous variants that are related to calcium and sodium metabolism, which may have improved adaptation to high calcium intake and saltwater consumption.