Web service reliability prediction based on machine learning

Abstract

Web service reliability is an important mission that keeps web services running normally. Within web service, the web services invoked by users not only depend on the service itself, but also on web load condition (such as latency). Due to the features of web dynamics, traditional reliability methods have become inappropriate; at the same time, the web condition parameter sparsity problem will cause inaccurate reliability prediction. To address these new challenges, in this paper, we propose a new web service reliability prediction method based on machine learning considering user, web service and web condition. First we solve the web condition parameter sparsity problem, then we use the k-means clustering method to aggregate past invocation data, incorporate user, service, and web condition parameters to build a reliability feedback matrix, at last we predict web service reliability by considering specific web condition environments. The experiment shows that our machine learning method is able to solve the data sparsity problem and improve accurate web service reliability prediction, and we discuss how data sparsity and the number of feedback clusters to affect web service reliability prediction.