Serverless computing's promise for fine-grained and modular functions that offer unprecedented elasticity, amplifies the challenge for efficient resource management. Functions form chains to compose the services an application provides. To match the practicality of the conventional deployment types, serverless chains require performance regulation to achieve QoS requirements. At the infrastructure level, a compelling way to regulate the performance of workloads while preserving power efficiency is through Dynamic Voltage and Frequency Scaling. However, existing generic frequency governors are rendered inadequate for QoS-aware power management in serverless deployments. In this paper, we propose <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DVFaaS</i> , a per-core DVFS framework that utilizes control systems theory to assign <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">just-enough</i> frequency for the purpose of addressing the QoS requirements on serverless workflows comprising unseen functions. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DVFaaS</i> exploits the intermittent nature of serverless workflows, which enables staged control on distinguishable functions, which jointly contribute to the end-to-end latency. Our results show that <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DVFaaS</i> considerably outperforms related work, reducing power consumption by up to 22%, with 2x fewer QoS violations.
Read full abstract