Auto-scaling containerized cloud applications: A workload-driven approach

Abstract

Today, cloud computing presents new business opportunities as it offers various technological advantages including elastic computing and efficient pricing strategies. Although, cloud users have access to large amount of resources, it is yet a challenging task to efficiently manage the hardware resources in a cloud environment. In this article, we present PACE (Performance-aware Auto-scaler for Cloud Elasticity), a framework for auto-scaling containerized cloud applications based on workload demand. The framework offers a) reactive auto-scaling using threshold-based rules to avoid application failures during intensive workload tasks and b) proactive auto-scaling using convolutional neural networks (CNN) and K-means to generate elastic scaling policies that incorporate future workload demands. The experimental analysis is based on the Yahoo! Cloud Serving Benchmark (YCSB) executed in Redis containers deployed on the Google Cloud Platform. The proposed framework can automatically adjust cloud resources to satisfy workload demand and ensure Quality of Service (QoS) requirements.