Model predictive control (MPC) is a promising approach for optimizing the performance of borehole heat exchangers (BHEs) in ground-source heat pump systems. The central element of MPC is the forward model that predicts the thermal dynamics in the ground. In this work, we validate the prediction accuracy of four BHE modeling approaches against real-world measurement data across various operational events and timescales. We simulate the fluid temperature leaving a BHE using a fully discretized 3-D numerical model, a resistance–capacitance model, a g-function model, and a hybrid model. The simulated temperatures are compared to measured temperatures using three validation metrics that quantify temperature offset, noise, and accuracy. The main reason for a mismatch between measured and modeled temperatures is a temperature offset of the simulated temperature. To remove this effect, the models were calibrated for their most sensitive parameter, the ground temperature, and their prediction accuracy over 4 years was evaluated. Thereby, model calibration seems to be a viable solution to account for an unknown load history. The results show that the resistance–capacitance model provides decent predictions in the short term and the g-function model in the long term. However, both models are strongly dependent on accurate calibration. The hybrid model provides the most accurate short and long-term predictions and is less dependent on calibration. Still, its integration into optimization syntax poses challenges compared to the other models. Although not yet applied in model predictive control, the hybrid model stands out as a promising choice for optimizing BHE field operations across various timescales.