Microservice: dynamic load balancing strategy based on consistent hashing

Abstract

Load balance is a task that remains a challenge currently in face with the rapidly increased business volume and data flow. For the purpose of achieving the best efficiency of load balance, load distribution has recently been studied with consistent hashing algorithm in cluster load balancing system. In this work, we analyze the characteristics of load balance technology of SSL/ TLS web server cluster, design a segmentation method of consistent hashing ring based on virtual nodes and propose a distribution strategy based on dynamic weight aiming at solving the problem of service collapsing caused by the unbalanced load among microservice cluster on the basis of consistent hash algorithm. The experimental results show that the proposed load balancing strategy significantly reduces the probability of load imbalance about 25% compared with the conventional consistent hash algorithm. The proposed the dynamic allocation strategy also achieves an advantageous load balance performance for microservice distribution architecture.