A Novel Scheduling Mechanism For Hybrid Cloud Systems

Abstract

Large scale and complexity in structure are two major trends in current cloud environments. Bringing cloud computing to its full potential requires a paradigm shift toward cloud resiliency. A major challenge in designing resilient clouds is to avoid single point of failures in cloud management systems. The state-of-the-art cloud management systems are mostly designed by relying on centralized managing systems with complicated master nodes, which are prone to single point of failures. In this paper, we propose a novel resilient hybrid cloud management system to ensure offering consistent cloud services to users, which consists of two tiers: a peer-to-peer (P2P) tier and a centralized tier. In the centralized tier, each local cloud has a centralized management system, while these local clouds form a P2P cloud in the P2P tier. Our hybrid cloud system benefits from auto scaling across the entire system while it easily manages each local cloud. We propose an innovative user request scheduling mechanism, dedicated to our system, considering multi-objectives: minimizing user requests average makespan, while ensuring load balancing. Finally, we conduct extensive experiments to evaluate the performance of our proposed hybrid cloud management system.