Land surface temperature (LST) is a fundamental parameter in global climate, environmental, and geophysical studies. Remote sensing is an essential approach for obtaining large-scale and frequently updated LST data. However, due to the wide field of view of remote sensing sensors, the observed LST with diverse view geometries suffers from inconsistency caused by the thermal radiation directionality (TRD) effect, which results in LST products being incomparable, especially during daytime. To address this issue and correct current off-nadir LSTs to nadir LSTs, a semi-physical time-evolved kernel-driven model (TEKDM) is proposed, which depicts multitemporal TRD patterns during the daytime. In addition, we employ a Bayesian optimization method to calibrate seven unknown parameters in the TEKDM. Validation results using the U.S. Climate Reference Network (USCRN) sites show that the RMSE (MBE) for GOES-16 and MODIS off-nadir LST products is reduced from 3.29 K (−2.0 K) to 2.34 K (−0.02 K), with an RMSE reduction of 0.95 K (29%) and a significant reduction in systematic bias. Moreover, the proposed method successfully eliminates the angular and temporal dependence of the LST difference between the satellite off-nadir LST and in situ nadir LST. In summary, this study presents a feasible approach for estimating the high-accuracy nadir LST, which can enhance the applicability of LST products in various domains.