The microbial communities in mining impacted areas rely on a variety of mechanisms to survive in such extreme environments. In this work, a meta-taxonomic approach using 16S rRNA gene sequences was used to investigate the prokaryotic diversity of sediment samples from water bodies affected by acid mine drainage at the São Domingos mining area in the south of Portugal. Samples were collected in summer and winter from the most contaminated sites from where the water flows downstream to the freshwater of Chança's river reservoir. The prokaryotic diversity on water bodies' sediments allowed us to distinguish the highly contaminated sites (pH ≈ 2) from sites with intermediate levels of contamination (pH ≈ 3-6.5), and from sites without contamination (pH ≈ 7.5). The abundances of acidophiles of genera Acidiphilium, Acidibacter, Acidobacterium and Acidocella in the sediments were correlated with the level of acid mine drainage contamination. The two first genera were among the 30 most abundant prokaryotes in all contaminated samples, including one (SS2w), where the contamination was very diluted, thereby emphasizing the impact that such type of pollution can have in the microbial communities of sediments. In addition, the high abundances of archaeal taxa from class Thermoplasmata and of bacteria from family RCP1-48 in the sediments from the most contaminated site corroborate their importance in such ecosystems and a putative role in the generation of acid mine drainage.