The Small East African (SEA) goat are widely distributed in different agro‐ecological zones of Tanzania. We report the genetic diversity, maternal origin, and phylogenetic relationship among the 12 Tanzanian indigenous goat populations, namely Fipa, Songwe, Tanga, Pwani, Iringa, Newala, Lindi, Gogo, Pare, Maasai, Sukuma, and Ujiji, based on the mitochondrial DNA (mtDNA) D‐loop. High haplotype (H d = 0.9619–0.9945) and nucleotide (π = 0.0120–0.0162) diversities were observed from a total of 389 haplotypes. The majority of the haplotypes (n = 334) belonged to Haplogroup A which was consistent with the global scenario on the genetic pattern of maternal origin of all goat breeds in the world. Haplogroup G comprised of 45 haplotypes drawn from all populations except the Ujiji goat population while Haplogroup B with 10 haplotypes was dominated by Ujiji goats (41%). Tanzanian goats shared four haplotypes with the Kenyan goats and two with goats from South Africa, Namibia, and Mozambique. There was no sharing of haplotypes observed between individuals from Tanzanian goat populations with individuals from North or West Africa. The indigenous goats in Tanzania have high genetic diversity defined by 389 haplotypes and multiple maternal origins of haplogroup A, B, and G. There is a lot of intermixing and high genetic variation within populations which represent an abundant resource for selective breeding in the different agro‐ecological regions of the country.