Momentum-incorporated Latent Factorization of Tensors for Extracting Temporal Patterns from QoS Data

Abstract

Quality-of-service (QoS) of Web services vary over time, making it a significant issue to discover temporal patterns from them for addressing various subsequent analyzing tasks like missing QoS prediction. A Latent factorization of tensors (LFT)-based approach proves to be highly efficient in addressing this issue, which can be built through a stochastic gradient descent (SGD) solver efficiently. However, an SGD-based LFT model frequently suffers low-tail convergence. For addressing this issue, we present a momentum-incorporated latent factorization of tensors (MLFT) model, which integrates a momentum method into an SGD-based LFT model, thereby improving its convergence rate as well as maintaining the prediction accuracy for missing QoS data. Empirical studies on two dynamic industrial QoS datasets show that compared with an SGD-based LFT model, an MLFT model achieves faster convergence rate and higher prediction accuracy.