The objective of this cross-sectional study was to estimate the validity of laboratory culture, Petrifilm and Tri-Plate on-farm culture systems, and luminometry to correctly identify IMI at dry-off in dairy cows, considering all tests as imperfect. From September 2020 until December 2021, we collected composite milk samples from cows before dry-off and divided them into 4 aliquots for the luminometry test, the Petrifilm (aerobic count), the Tri-Plate, and the laboratory culture. While we assessed multiple thresholds of relative light units (RLU) for the luminometry, we used thresholds of ≥100 cfu/mL for the laboratory culture, ≥ 50 cfu/mL for the Petrifilm, and ≥1 cfu for the Tri-Plate. We fitted Bayesian latent class analysis (LCA) models to estimate the sensitivity (Se) and specificity (Sp) for each test to identify IMI, with 95% credibility interval (BCI). Using different prevalence measures (0.30, 0.50, and 0.70), we calculated the predictive values (PV) and misclassification cost terms (MCT) at different false-negative to false-positive ratios (FN:FP). A total of 333 cows were enrolled in the study from one commercial Holstein herd. The validity of the luminometry was poor for all thresholds, with Se of 0.51 (95% BCI = 0.43-0.59) and Sp of 0.38 (95% BCI = 0.26-0.50) when using a threshold of ≥150 RLU. The laboratory culture had Se of 0.93 (95% BCI = 0.85-0.98) and Sp of 0.69 (95% BCI = 0.49-0.89), the Petrifilm had Se of 0.91 (95% BCI = 0.80-0.98) and Sp of 0.71 (95% BCI = 0.51-0.90), and the Tri-Plate had Se of 0.65 (95% BCI = 0.53-0.82) and Sp of 0.85 (95% BCI = 0.66-0.97). Bacteriological tests had good PVs, with comparable positive PV for all 3 tests, but lower negative PV for the Tri-Plate compared with the laboratory culture and the Petrifilm. For a prevalence of IMI of 0.30, all 3 tests had similar MCT, but for prevalence of 0.50 and 0.70, the Tri-Plate had higher MCT in scenarios where leaving a cow with IMI untreated is considered to have greater detrimental impacts than treating a healthy cow (i.e., FN:FP of 3:1). Our results showed that the bacteriological tests have adequate validity to diagnose IMI at dry-off, but the luminometry does not. We concluded that, while luminometry is not useful to identify IMI at dry-off, the Petrifilm and Tri-Plate tests performed similarly to the laboratory culture, depending on the prevalence and the importance of the FP and FN results.