Quantum key distribution (QKD) has been proven to be theoretically unconditionally secure. However, any theoretical security proof relies on certain assumptions. In QKD, the assumption in the theoretical proof is that the security of the protocol is considered under the asymptotic case where Alice and Bob exchange an infinite number of signals. In the continuous-variable QKD (CV-QKD), the finite-size effect imposes higher requirements on block size and excess noise control. However, the local local oscillator (LLO) CV-QKD system cannot be considered time-invariant under long blocks, especially in cases of environmental disturbances. Thus, we propose an LLO CV-QKD scheme with time-variant parameter estimation and compensation. We first establish an LLO CV-QKD theoretical model under the temporal modes of continuous-mode states. Then, a robust method is used to compensate for arbitrary frequency shift and arbitrary phase drift in CV-QKD systems with longer blocks, which cannot be achieved under traditional time-invariant parameter estimation. Besides, the digital signal processing method predicated on high-speed reference pilots can achieve a time complexity of O(1). In the experiment, the frequency shift is up to 89.05 MHz/s and phase drift is up to 3.036 Mrad/s using a piezoelectric transducer (PZT) to simulate the turbulences in the practical channel. With a signal-to-interference ratio (SIR) of −51.67 dB, we achieve a secret key rate (SKR) of 0.29 Mbits/s with an attenuation of 16 dB or a standard fiber of 80 km. This work paves the way for future long-distance field-test experiments in the finite-size regime.