A performance brokerage for heterogeneous clouds

Abstract

The trading of virtual machines, storage and other Cloud Computing resources on commodity exchanges has generated considerable interest from both academia and the financial services market. With multiple sellers providing appropriately equivalent virtual machines they become fungible, offering the opportunity for users to swap instances from one seller with instances from another when required, easing concerns over vendor lock-in, availability and provider failure. However, heterogeneity in the hardware from which they are provisioned is likely inevitable, given heterogeneity already found on a number of Public Clouds, where it results in performance variation across instances of the same type, and consequently variation in Cloud costs at the same price. To address this problem we propose a Cloud Service Broker (CSB) that acquires and re-sells instances on the basis of their current performance. The service reduces performance risk for users, but comes at a cost. We determine the average markup the CSB must add to the base instance price to cover the costs of operating a pool capable of satisfying a given proportion of requests. We show how increases in heterogeneity on the underlying commodity exchange lead to lower costs for the CSB, and that the largest degree of heterogeneity we consider, on the basis of real-world findings, leads to the best outcome: an average markup of just 12% on the buy price from the exchange will satisfy 95% of requests. This creates opportunities for CSB profitability to be explored on the basis of selling performance-assured instances at prices that will account for this markup