EasyDeploy: Automatic Application Deployment in Virtual Clusters

Abstract

Along with the fast development of Cloud computing, it has become a trend to use virtual clusters for scientific and business works. In spite of the fact, it is a big challenge to set up a virtual cluster to meet the user-specific requirement such as the applications to be used. In this paper we design and implement Easy Deploy, a system that can set up virtual clusters with user-specifying applications in Cloud computing environment automatically. Easy Deploy realizes its own automatic application deployment method in virtual clusters without the help of external tools for traditional clusters. It decouples application packages away from virtual machine images to save storage space. To reduce application package transfer time, cache and prefetching mechanism is provided. The experimental results show that in our settings we can create an eighteen nodes virtual cluster with Hadoop environment in less than 50 seconds. The cache and prefetching mechanism we designed can do reduce the transfer time of application packages. When we use both of them to create a virtual cluster, the transfer time will reduce by three times than that in the case without any optimization strategy.