Understanding ecology of microbiomes in drinking water distribution systems is the most important notion in delivering safe drinking water. Drinking water distribution systems harbor various microbiota despite efforts made in improving water infrastructures in the water industry, especially, in developing countries. Intermittent water supply, long time of water storage, low water pressure, and contaminated source water are among many of the factors responsible for poor drinking water quality affecting health of people. The aim of this study was to explore microbial diversity and structure in water samples collected from source water, treated water, reservoirs, and household points of use locations (taps). High-throughput Illumina sequencing technology was employed by targeting the V4 region of the 16S rRNA gene and the V1-V3 region of the 18S rRNA gene to analyze the microbial community structure. Proteobacteria followed by Firmicutes, Bacteroidetes, and Actinobacteria were the core dominating taxa. Gammaproteobacteria was also dominant among other proteobacterial classes across all sampling points. Opportunistic bacterial genera such as Pseudomonas, Legionella, Klebsiella, Escherichia, and Actinobacteria, as well as eukaryotic microbes like Cryptosporidium, Hartmannella, Acanthamoeba, Aspergillus, and Candida were also abundant taxa found along the distribution systems. The shift in microbial community structure from source to point of use locations was influenced by basic factors such as residual chlorine, intermittent water supply, and long-time storage at the household. The complex microbiota detected in different sampling sites in this study brings drinking water quality problem which further causes significant health problems to both human and animal health. Treatment ineffectiveness, disinfection inefficiency, poor maintenance actions, leakage of sewage, and other domestic wastes are few among many other factors responsible for degraded drinking water quality in this study putting health at high risk. Findings of this research provide important and baseline information to understand the microbial profiles of drinking water along source water and distribution systems. Moreover, knowing the microbial profile will help to design proper water quality assurance approaches.