New and rapid diagnostic methods are needed for the detection of antimicrobial resistance to aid in curbing drug-resistant infections. Targeted liquid chromatography-tandem mass spectrometry (LC-MS/MS) is a method that could serve this purpose, as it can detect specific peptides of antimicrobial resistance mechanisms with high accuracy. In the current study, we developed an accurate and rapid targeted LC-MS/MS assay based on parallel reaction monitoring for detection of the most prevalent aminoglycoside-modifying enzymes and 16S rRNA methyltransferases in Escherichia coli and Klebsiella pneumoniae that confer resistance to aminoglycosides. Specific tryptic peptides needed for detection were selected and validated for AAC(3)-Ia, AAC(3)-II, AAC(3)-IV, AAC(3)-VI, AAC(6')-Ib, AAC(6')-Ib-cr, ANT(2″)-I, APH(3')-VI, ArmA, RmtB, RmtC, and RmtF. In total, 205 isolates containing different aminoglycoside resistance mechanisms that consisted mostly of E. coli and K. pneumoniae were selected for assay development and evaluation. Mass spectrometry results were automatically analyzed and were compared to whole-genome sequencing results. Of the 2,460 isolate and resistance mechanism combinations tested, 2,416 combinations matched. Discrepancies were further analyzed by repeating LC-MS/MS analysis and performing additional PCRs. Mass spectrometry results were also used to predict resistance and susceptibility to gentamicin, tobramycin, and amikacin in only the E. coli and K. pneumoniae isolates (n = 191). The category interpretations were correctly predicted for gentamicin in 97.4% of the isolates, for tobramycin in 97.4% of the isolates, and for amikacin in 82.7% of the isolates. Targeted LC-MS/MS can be applied for accurate and rapid detection of aminoglycoside resistance mechanisms.