The vascular adventitia has long been postulated to play a key role in atherosclerosis, but the relevant adventitial cell populations and the mechanisms by which they influence atherosclerosis have remained elusive. To characterize relevant adventitial cells and their regulators, we have combined single cell multi-omic murine and human data with human genetics. Single cell transcriptomic and epigenetic analysis of both murine and human arterial tissue revealed a unique population of adventitial fibroblasts (AdvFib). Transcriptome and epigenome analysis revealed disproportionate enrichment for coronary artery disease (CAD) GWAS risk loci and genes in AdvFib, suggesting that AdvFib actively contributes to disease. Leveraging this rich information, we created a novel AdvFib specific CreERT2 murine model to enable AdvFib specific genetic manipulation. Murine lineage tracing using this novel AdvFib-specific model of atherosclerosis revealed early expansion and transcriptomic alteration of AdvFib during plaque development, akin to phenotypic modulation of SMC. Cell-cell communication analysis demonstrated an increase in AdvFib-driven crosstalk with other cell types during early phases of atherosclerosis, including activation of pro-inflammatory (Il6, Ccl2/7, Cxcl12) genes. Computational enrichment analysis of regulatory region of genes associated with AdvFib modulation points to a prominent role for TCF21 , a CAD GWAS risk gene. Single cell time course data of atherosclerosis demonstrates that Tcf21 is expressed primarily in AdvFib with dynamic alteration of its expression during atherosclerosis. AdvFib-specific Tcf21 loss in murine model of atherosclerosis resulted in altered expression of ECM and inflammatory genes, with corresponding changes in recruitment of inflammatory cells. Mechanistically, through histone modification cut-and-tag in human coronary AdvFib, we showed that TCF21 regulates AdvFib activation through epigenetic reprograming of key cytokine and cell fate regulators by binding and altering H3K27Acetylation. Collectively, our results begin to establish the role of AdvFib in atherosclerosis and highlight the importance of TCF21 in this process through a precise epigenetic mechanism.