The objective of the study was to evaluate the frequency and genetic characteristics of ESBL-producing Escherichia coli and Klebsiella spp. and the risk factors associated with a high total bacterial count in bulk tank milk samples of dairy farms in three municipalities of the Antioquia Department, Colombia. Fifteen samples were positive for E. coli and Klebsiella spp. Subsequent analysis of the 16 S rRNA gene sequences confirmed these isolates included E. coli (n = 3), K. oxytoca (n = 11), and K. pneumoniae (n = 1). None of the isolates was positive for ESBL identification by phenotypic methods, but the only the isolate of K. pneumoniae was positive for the blaSHV61 gene by sequence analysis. The antibiotic susceptibility evaluation for all Klebsiella spp. isolates identified resistance to fosfomycin (50%; 6/12) and ampicillin (100%; 12/12). While most of the herds maintain adequate hygienic quality, specific risk factors such as having more than 60 milking cows, frequent changes in milkers, milking in paddocks, and using a chlorinated product for pre-dipping have been identified as associated with a high total bacterial count > 100,000 CFU/mL in bulk tank milk. However, certain variables including the milker being the owner of the animals and the proper washing and disinfection of the milking machine contribute to maintain a high level of hygiene and quality in the raw milk stored in the tanks. In conclusion, the frequency of ESBL producers was relatively low, with only K. pneumoniae testing positive for the blaSHV ESBL type. The presence of these bacteria in milk tanks represents a potential risk to public health for consumers of raw milk and its derivatives.