Quality-relevant process monitoring provides important guarantees for the safety of industrial operation, which is based on the assumption that data collection is complete and low-order autocorrelated. However, real industrial processes always exhibit complex characteristics such as multi-rate sampling and high-order dynamic, which pose great challenges for process monitoring. To this end, a multi-rate high-order dynamic twin-latent-variable probabilistic (MHDTVP) model is presented in this paper to extract data correlations among multi-rate measurements from quality-relevant and irrelevant perspectives. Moreover, to reveal the dynamics in the multi-rate sampling process, an autoregressive twin-latent-variable structure is designed to extract both quality-relevant and quality-irrelevant high-order dynamic features. In the MHDTVP model, parameters are trained through an efficient expectation maximization (EM) iteration framework. Finally, the performance conclusions of MHDTVP are validated with the Tennessee Eastman process (TEP) and Thermal Power Plant (TPP). The experimental results demonstrate that the proposed model exhibits superior monitoring efficiency for multi-rate dynamic processes compared to similar approaches.