Scheduling multiple scientific workflows using containers on IaaS cloud

Abstract

With the adaptable paradigm of cloud computing and obtainable of data accumulated from largely high-powered scientific devices, workflows have turn into an occurring aim to execute considerable scientific advances at an enhanced speed. Occurring Workflow as a Service (WaaS) frameworks provide scientists an effortless, simply accessible and cost-efficient manner of using their applications from anywhere and at anytime in the cloud. They are multitenant platforms and are developed to handle the execution of heterogeneous workflows continuous workload. To fulfill this, they utilize the compute, network and storage services provided by Infrastructure as a Service (IaaS) vendors. Therefore, at any considerable particular moment, a WaaS framework should be proficient of effectively schedule these continuous workload of workflows with various features and quality of service (QoS). Therefore, we propose a strategy of scheduling and resource provisioning planned particularly for WaaS platforms. The algorithm is dynamic and scalable to adjust to improve in the workload and platform. It supports containers to deal the inefficiency of resource utilization and targets to reduce the overall execution cost of infrastructure resources as fulfilling each single workflow deadline constraint. To our information, this approach that explicitly deals VM sharing in the subject of WaaS by devising the utilization of containers in the heuristics of scheduling and resource provisioning. Our experimental results shows its responsiveness to the uncertainties of the environment, its potential to achieve deadlines, and its cost-effectiveness when compared to other recent algorithms.