Klebsiella pneumoniae is an important multidrug-resistant (MDR) pathogen, causing both community- and healthcare-associated infections. The resistance is due to the continuous accumulation of multiple antibiotic-resistance-genes (ARGs) through spontaneous genomic mutations and the acquisition of conjugative plasmids. This study presents antibiotics resistance genes, plasmids replicons, and virulence genes of K. pneumoniae isolates from clinical specimens in a tertiary hospital, Mwanza, Tanzania. Whole genome sequencing (WGS) of 34 K. pneumoniae was performed, using an Illumina NextSeq 500, followed by in silco analysis. A total of 34 extended-spectrum beta-lactamase-producing K. pneumoniae, isolated from blood samples from neonatal units were whole-genome sequenced. Of these, 28 (82.4%) had an identified sequence type (ST), with ST14 (39.3%, n = 11) being frequently identified. Moreover, 18 (52.9%) of the bacteria harbored at least one plasmid, from which a total of 25 plasmid replicons were identified with a predominance of IncFIB(K) 48.0% (n = 12). Out of 34 sequenced K. pneumoniae, 32 (94.1%) were harboring acquired antibiotic/biocides-resistance-genes (ARGs) with a predominance of blaCTX-M-15 (90.6%), followed by oqxB (87.5%), oqxA (84.4%), blaTEM-1B (84.4%) and sul2 (84.4%). Interestingly, we observed the ColRNAI plasmid-replicon (n = 1) and qacE gene (n = 4) for the first time in this setting. Global high-risk clones of K. pneumoniae isolates carry multiple ARGs in multiple plasmid-replicons. Findings from this study warrant genomic-based surveillance to monitor high-risk global clones, epidemic plasmids and ARGs in low- and middle-income countries.