Energy-efficient VM scheduling based on deep reinforcement learning

Abstract

Achieving data center resource optimization and QoS guarantee driven by high energy efficiency has become a research hotspot. However, QoS information directly sampled from the cloud environment will inevitably be affected by a small amount of structured noise. This paper proposes a deep reinforcement learning model based on QoS feature learning to optimize data center resource scheduling. In the deep learning stage, we propose a QoS feature learning method based on improved stacked denoising autoencoders to extract more robust QoS characteristic information. In the reinforcement learning stage, we propose a multi-power machines (PMs) collaborative resource scheduling algorithm based on reinforcement learning. Extensive experiments show that compared with other excellent resource scheduling strategies, our method can effectively reduce the energy consumption of cloud data centers while maintaining the lowest service level agreement (SLA) violation rate. A good balance is achieved between energy-saving and QoS optimization.