The cacao swollen shoot disease (CSSD) caused by a complex of badnavirus species presents a major challenge for cacao production in West Africa, especially Ghana and Côte d'Ivoire. In this study, CSSD species detection efficiency, diversity, and geographic distribution patterns in cacao plantations in Ghana and Côte d'Ivoire were investigated through field surveillance, PCR detection assays, sequencing of positive amplicons, and phylogeographic clustering. Cumulatively, the detection efficiency of the tested CSSD primer sets that were targeting the movement protein domain of the virus ranged from 0.15% (CSSD-3 primer) to 66.91% (CSSD-1 primer) on all the symptomatic cacao leaf samples assessed. The identified CSSD species differed phylogenetically and overlapped in distribution, with the cacao swollen shoot Togo B virus (CSSTBV) (n = 588 sequences) being the most prevalent and widely distributed compared to the other CSSD species that were encountered in both countries. Geographically, the cacao swollen shoot CE virus (CSSCEV) species (n = 124 sequences) that was identified was largely restricted to the bordering regions of Ghana and Côte d'Ivoire. These results provide updated knowledge of the geographic distribution of the key CSSD species and their diagnostic efficiency and, thus, provide guidance in identifying locations for structured testing of cacao germplasm and optimal diagnostics for the predominant CSSD species in Ghana and Côte d'Ivoire.