Workflow Scheduling Algorithm Research Articles

Multiobjective Prioritized Workflow Scheduling in Cloud Computing Using Cuckoo Search Algorithm

Effective workflow scheduling in cloud computing is still a challenging problem as incoming workflows to cloud console having variable task processing capacities and dependencies as they will arise from various heterogeneous resources. Ineffective scheduling of workflows to virtual resources in cloud environment leads to violations in service level agreements and high energy consumption, which impacts the quality of service of cloud provider. Many existing authors developed workflow scheduling algorithms addressing operational costs and makespan, but still, there is a provision to improve the scheduling process in cloud paradigm as it is an nondeterministic polynomial-hard problem. Therefore, in this research, a task-prioritized multiobjective workflow scheduling algorithm was developed by using cuckoo search algorithm to precisely map incoming workflows onto corresponding virtual resources. Extensive simulations were carried out on workflowsim using randomly generated workflows from simulator. For evaluating the efficacy of our proposed approach, we compared our proposed scheduling algorithm with existing approaches, i.e., Max–Min, first come first serve, minimum completion time, Min–Min, resource allocation security with efficient task scheduling in cloud computing-hybrid machine learning, and Round Robin. Our proposed approach is outperformed by minimizing energy consumption by 15% and reducing service level agreement violations by 22%.

KubeAdaptor: A docking framework for workflow containerization on Kubernetes

As Kubernetes becomes the infrastructure of the cloud-native era, the integration of workflow systems with Kubernetes is gaining more and more popularity. However, when migrating the workflow systems to the Kubernetes platform, the inconsistency between the workflow scheduling algorithms and Kubernetes in task scheduling order seriously reduces the execution efficiency of the workflow systems. Besides, the integration of existing container-based workflow systems with Kubernetes lacks a general docking framework and requires various built-in tools and specialized technique supports, which brings high research costs and inconvenience to users. To this end, this paper proposes a cloud-native workflow engine named KubeAdaptor, a general docking framework to integrate workflow systems with Kubernetes and implement workflow containerization on Kubernetes, aiming to ensure a consistent task scheduling order between workflow scheduling algorithms in workflow systems and Kubernetes. We present the KubeAdaptor architecture and elaborate on the functionality implementation, fault tolerance management, and the event trigger mechanism within the KubeAdaptor. Experimental results on four real-world scientific workflows show that the KubeAdaptor as a docking framework ensures the consistency of the workflow scheduling algorithms and Kubernetes in the task scheduling order. Compared with the state-of-the-art Argo workflow engine, the KubeAdaptor achieves better performance in terms of the average execution time of the task pod, average workflow lifecycle, and resource usage rate.

Reliability-Aware and Energy-Efficient Workflow Scheduling in IaaS Clouds

Nowadays, more and more workflow applications with different computing requirements are migrated to clouds and executed with cloud resources. Workflow scheduling becomes a critical problem in the cloud environment, which focuses on meeting various quality of service (QoS) constraints. Workflow reliability and energy consumption are two essential parts in clouds and minimizing energy consumption for scheduling workflow with the reliability constraint is a challenging issue. In response to the challenge, we propose a workflow scheduling algorithm named REWS to reduce energy consumption and satisfy workflow reliability constraints. In REWS, a new sub-reliability constraint prediction strategy is adopted to break down the workflow reliability constraint to task sub-reliability constraints and the effectiveness of this strategy is proved. Moreover, an update method is adopted to adjust the task sub-reliability constraint for reducing energy consumption. In addition, a brief system framework which consists of five parts: workflow analyzer, reliability decomposer, resource manager, workflow scheduler and feedback processer is built to support the algorithm implementation of REWS. We conduct the experiments using both synthetic data and real-world data to evaluate the proposed REWS approach. The results demonstrate the superiority of REWS as compared with the state-of-the-art algorithms. <i>Note to Practitioners</i>&#x2014;Workflow scheduling is a challenging issue in emerging trends of the cloud environment that focuses on satisfying various QoS constraints. In this paper, we investigate a reliability-aware and energy-efficient workflow scheduling problem in cloud computing. A novel workflow scheduling algorithm called REWS, is designed to reduce the energy consumption and meet the workfolw reliability constraint. The basic idea of REWS is to divide the workflow reliability constraint into task sub-reliability constraints and schedule tasks with an energy-efficient scheduling strategy. We conduct the experiments to evaluate the proposed REWS and the results demonstrate that REWS outperforms the state-of-the-art algorithms.

Integrating Cognition Cost With Reliability QoS for Dynamic Workflow Scheduling Using Reinforcement Learning

The rapid rise of microservice architecture poses severe challenges to workflow scheduling, resource allocation, and goal optimization. However, faults and failures usually happen during workflow running. To ensure the workflow's successful execution during scheduling microservices, this paper proposes a dynamic workflow scheduling algorithm by integrating cognition cost and reliability QoS for using reinforcement learning (WS-CCR). Firstly, we explore the ‘restart policy’ of containers in the Kubernetes architecture, which lays the foundation for our work that adopts the redundancy strategy to ensure workflow operation. Then we consider the cognitive cost based on the fact that users have a cognitive process for different microservices in selecting microservices. Additionally, another optimization goal is the reliability of workflows. On this basis, we design a reasonable reward function in reinforcement learning to generate dynamic strategies. Furthermore, following some generated strategies, our engine will schedule candidate microservices for tasks to execute step by step. A series of experiments on Alibaba and business areas workflows have proven the superior performance of our algorithm. Our WS-CCR can generate better Pareto solution sets than other baselines in terms of improving the reliability of running workflows. Finally, we give a case study to prove the practicability of our method.

A Fully Hybrid Algorithm for Deadline Constrained Workflow Scheduling in Clouds

With the migration of more and more workflows to clouds, the workflow scheduling in clouds (WSC) becomes a critical problem. Although many algorithms have been presented for WSC, there is still room and need for improvement. This paper formulates WSC as a constrained optimization problem that optimizes workflow execution cost within a workflow deadline constraint and proposes a fully hybrid workflow scheduling algorithm, called HPCP-PSO to solve it. Unlike previous works, HPCP-PSO is based on the repeated and alternated execution of two different methods, namely, the heuristic IaaS Cloud Partial Critical Paths (IC-PCP) and meta-heuristic Particle Swarm Optimization (PSO). Moreover, HPCP-PSO incorporates with two novel designs: 1) a new solution encoding strategy not only to sufficiently embody the elasticity of cloud resources, but also to reflect the scheduling relationship between assigned and unassigned tasks; 2) a solution repair strategy on each infeasible lease process to utilize a user-defined deadline more effectively and enhance the solution efficiency of the algorithm. Extensive experiments are conducted on four real-world scientific workflows and the results show that compared with IC-PCP, PSO, and HGSA, the proposed algorithm outperforms them on average by 35.83%, 70.53%, and 87.71% in terms of workflow execution cost.

A review on workflow scheduling and resource allocation algorithms in distributed mobile clouds

AbstractThe advent of distributed computing and mobile clouds made it possible to transfer and distribute the heavy processes of complex workflows to the cloud. Managing and with the help of the mobile cloud, virtualization and shared resources managing the executing large‐scale workflows is possible. Since virtual resources are used, scheduling and resource allocation are important and key research topics in public cloud environment and mobile clouds. The cloud model of mobile devices with public or virtual cloud, which consists of temporary mobile devices, is an interesting topic to be investigated. Workflow scheduling and availability of resources in mobile clouds by high mobility and Energy efficient, it is one of the challenges and problems that must be investigated one of the main challenges in this research area. The purpose of scheduling algorithms is to improve service quality criteria by observing the constraints. In this article, the main goal is to extensively review the scheduling algorithms for the complex scientific workflow in public and mobile clouds. Furthermore, a review of the use of heuristic and meta‐heuristic techniques in dynamic and static states, with various constraints for task scheduling in cloud and mobile computing has been performed. This article accomplishes a review of using existing techniques for scheduling tasks in mobile clouds. We also present a comprehensive analysis and systematic comparison between these scheduling algorithms.

Formula omitted]: Energy-efficient intelligent edge–cloud collaboration for remote IoT services

Existing centralized cloud-based solution is challenging to cope with the explosive growth of data generated from massive IoT devices to meet the requirements of critical services, especially for remote IoT services provided in remote/rural areas where the resource and energy capacity of local data processing infrastructure is limited. To solve this issue, we propose ELECT, an energy-efficient intelligent edge-cloud collaboration scheme that achieves satisfactory data processing performance. ELECT includes a platform that utilizes edge computing node as a core element that locates close to the IoT nodes for coordinating the data processing between the cloud and the IoT devices. Specifically, based on the importance of a node’s collected data in the overall data processing performance, a dynamic IoT node management algorithm is developed to manage each node’s active/inactive status to reduce energy consumption. Moreover, a deep Q-network (DQN)-based workflow scheduling algorithm that fully utilizes the data-centric device–edge–cloud continuum is introduced to reduce makespan and energy consumption for obtaining a compromising solution. For verification, we develop an experimental environment simulating structural health monitoring (SHM) services in remote areas. Extensive experiments verify the effectiveness of ELECT in terms of various service requirements, including makespan, energy consumption and communication cost.

A Multi-Objective Cloud Workflow Scheduling Strategy Based on the Modified HEFT Algorithm

Aiming at the issues of poor system resource utilization and the challenge of ensuring the quality of service (QoS) in scientific workflow scheduling in the current cloud computing environment. By combining the existing IaaS cloud resource model with the scientific workflow task model, the article proposed a cloud workflow scheduling model framework. Firstly, proposed multi-objective QoS constraints based on the execution time and costs in scientific workflow scheduling. Then, modified the HEFT algorithm which was a typical scientific workflow scheduling algorithm. Based on the modified HEFT algorithm makes full use of the idle time of resources and maximizes the multi-objective QoS requirements of users. The comparative experiments show that the scheduling strategy of the modified HEFT algorithm can effectively optimize the costs and execution time of scientific workflow scheduling and achieve higher system resource utilization.

Evolutionary Optimization of Energy Consumption and Makespan of Workflow Execution in Clouds

Making sound trade-offs between the energy consumption and the makespan of workflow execution in cloud platforms remains a significant but challenging issue. So far, some works balance workflows’ energy consumption and makespan by adopting multi-objective evolutionary algorithms, but they often regard this as a black-box problem, resulting in the low efficiency of the evolutionary search. To compensate for the shortcomings of existing works, this paper mathematically formulates the cloud workflow scheduling for an infrastructure-as-a-service (IaaS) platform as a multi-objective optimization problem. Then, this paper tailors a knowledge-driven energy- and makespan-aware workflow scheduling algorithm, namely EMWSA. Specifically, a critical task adjustment-based local search strategy is proposed to intelligently adjust some critical tasks to the same resource of their successor tasks, striving to simultaneously reduce workflows’ energy consumption and makespan. Further, an idle gap reuse strategy is proposed to search the optimal energy consumption of each non-critical task without affecting the operation of other tasks, so as to further reduce energy consumption. Finally, in the context of real-world workflows and cloud platforms, we carry out comparative experiments to verify the superiority of the proposed EMWSA by significantly outperforming 4 representative baselines on 19 out of 20 workflow instances.

A dynamic multipopulation genetic algorithm for multiobjective workflow scheduling based on the longest common sequence

A dynamic multipopulation genetic algorithm for multiobjective workflow scheduling based on the longest common sequence

Hybrid JAYA algorithm for workflow scheduling in cloud

Workflow scheduling and resource provisioning are two of the most critical issues in cloud computing. Developing an optimal workflow scheduling strategy in the heterogeneous cloud environment is extremely difficult due to its NP-complete nature. Various optimization algorithms have been used to schedule the workflow so that users can receive Quality of Service (QoS) from cloud service providers as well as service providers can achieve maximum gain but there is no such model that can simultaneously minimize execution time and cost while balancing the load among virtual machines in a heterogeneous environment using JAYA approach. In this article, we employed the hybrid JAYA algorithm to minimize the computation cost and completion time during workflow scheduling. We considered the heterogeneous cloud computing environment and made an effort to evenly distribute the load among the virtual machines. To achieve our goals, we used the Task Duplication Heterogeneous Earliest Finish Time (HEFT-TD) and Predict Earliest Finish Time (PEFT). The makespan is greatly shortened by HEFT-TD which is based on the Optimistic Cost Table. We used a greedy technique to distribute the workload among Virtual Machines (VMs) in a heterogeneous environment. Greedy approach assigns the upcoming task to a VM which have lowest load. In addition, we also considered performance variation, termination delay, and booting time of virtual machines to achieve our objectives in our proposed model. We used Montage, LIGO, Cybershake, and Epigenomics datasets to experimentally analyze the suggested model in order to validate the concept. Our meticulous experiments show that our hybrid approach outperforms other recent algorithms in minimizing the execution cost and makespan, such as the Cost Effective Genetic Algorithm (CEGA), Cost-effective Load-balanced Genetic Algorithm (CLGA), Cost effective Hybrid Genetic Algorithm (CHGA), and Artificial Bee Colony Algorithm (ABC).

Chaotic hybrid multi-objective optimization algorithm for scientific workflow scheduling in multisite clouds

A cloud is made up of many data centers, with its own set of data and resources. The reasons for employing several cloud sites to operate a workflow are that the data is already dispersed, the required resources surpass the constraints of a single site. This paper presents a hybrid multi-objective optimization algorithm denoted as HSOS-SOA, achieved by combining the Symbiotic Organisms Search and Seagull Optimization Algorithm. The HSOS-SOA uses chaotic maps to generate random numbers and performs a good trade-off between exploration and exploitation, resulting in a higher convergence rate. HSOS-SOA is used to solve scientific workflow scheduling problems in multisite cloud computing by taking into consideration elements such as makespan, cost, and reliability. A solution is chosen from the Pareto front using the knee-point approach in this approach. Extensive analyses are performed out in Microsoft Azure multisite cloud and the results exhibited that the HSOS-SOA can outperform other algorithms in terms of metrics such as IGD, Coverage Ratio, and so on. Experimental results of experiments reveal that the results in makespan improvement in the range of 5.72–28.61%, cost in the range of 5.16–45.16%, and reliability in the range of 3.11–25% over well-known metaheuristic algorithms.

MAA: multi-objective artificial algae algorithm for workflow scheduling in heterogeneous fog-cloud environment

With the development of current computing technology, workflow applications have become more important in a variety of fields, including research, education, health care, and scientific experimentation. A group of tasks with complicated dependency relationships constitute the workflow applications. It can be difficult to create an acceptable execution sequence while maintaining precedence constraints. Workflow scheduling algorithms (WSA) are gaining more attention from researchers as a real-time concern. Even though a variety of research perspectives have been demonstrated for WSAs, it remains challenging to develop a single coherent algorithm that simultaneously meets a variety of criteria. There is very less research available on WSA in the heterogeneous computing system. Classical scheduling techniques, evolutionary optimisation algorithms, and other methodologies are the available solution to this problem. The workflow scheduling problem is regarded as NP-complete. This problem is constrained by various factors, such as Quality of Service, interdependence between tasks, and user deadlines. In this paper, an efficient meta-heuristic approach named Multi-objective Artificial Algae (MAA) algorithm is presented for scheduling scientific workflows in a hierarchical fog-cloud environment. In the first phase, the algorithm pre-processes scientific workflow and prepares two task lists. In order to speed up execution, bottleneck tasks are executed with high priority. The MAA algorithm is used to schedule tasks in the following stage to reduce execution times, energy consumption and overall costs. In order to effectively use fog resources, the algorithm also utilises the weighted sum-based multi-objective function. The proposed approach is evaluated using five benchmark scientific workflow datasets. To verify the performance, the proposed algorithm's results are compared to those of conventional and specialised WSAs. In comparison to previous methodologies, the average results demonstrate significant improvements of about 43% in execution time, 28% in energy consumption and 10% in total cost without any trade-offs.

Gradient-Based Scheduler for Scientific Workflows in Cloud Computing

It is becoming increasingly attractive to execute workflows in the cloud, as the cloud environment enables scientific applications to utilize elastic computing resources on demand. However, despite being a key to efficiently managing application execution in the cloud, traditional workflow scheduling algorithms face significant challenges in the cloud environment. The gradient-based optimizer (GBO) is a newly proposed evolutionary algorithm with a search engine based on the Newton’s method. It employs a set of vectors to search in the solution space. This study designs a gradient-based scheduler by using GBO for workflow scheduling to minimize the usage costs of workflows under given deadline constraints. Extensive experiments are conducted on well-known scientific workflows of different sizes and types using WorkflowSim. The experimental results show that the proposed scheduling algorithm outperforms five other state-of-the-art algorithms in terms of both the constraint satisfiability and cost optimization, thereby verifying its advantages in addressing workflow scheduling problems.

Energy-Aware Workflow Scheduling in a Fog-Cloud Computing Environment Using Non-Dominated Sorting Genetic Algorithm

Cloud Computing is no longer just a fad and announcement. Since the beginning of this decade and up to the present, cloud computing has changed and evolved. Workflows are employed in many different scientific disciplines to coordinate data demanding applications, but their virtualized apps, platforms, compute, and storage must be promptly provisioned, scaled, and released instantly. The vast majority of researchers agree that using scientific workflows as a paradigm to define, arrange, and communicate complex scientific analysis is helpful. Workflow scheduling aims to optimally assign and execute sequence of tasks on various virtual machine instances shared and controlled by the workflow scheduler. Numerous scheduling algorithms have been proposed to tackle difficult problems more quickly than metaheuristic ones due to the NP-complete nature of this problem and its dependence on theproblem size. Energy consumption has emerged as a major issue in the cloud computing environment, in addition to the standard quality of service(QoS) restrictions like time and cost to handle this issue. The goal of this paper is to develop the Dynamic Provisioning Based on Demand (DPBD) algorithm for workflow scheduling. While sequential task completion and task priority are design restrictions, the dual objectives of the cloud service are to minimize makespan and energy usage. Using the non-dominated sorting genetic algorithm (NSGA-II), the multi-objective optimization problem's Pareto optimal solutions are found. Our approach is validated by simulating a complex workflow application.

PSO optimised workflow scheduling and VM replacement algorithm using gaming concept in cloud data centre

PSO optimised workflow scheduling and VM replacement algorithm using gaming concept in cloud data centre

PSO optimised workflow scheduling and VM replacement algorithm using gaming concept in cloud data centre

PSO optimised workflow scheduling and VM replacement algorithm using gaming concept in cloud data centre

A novel hybrid algorithm for workflow scheduling in cloud

A novel hybrid algorithm for workflow scheduling in cloud

A hybrid algorithm for workflow scheduling in cloud environment

A hybrid algorithm for workflow scheduling in cloud environment

A hybrid algorithm for workflow scheduling in cloud environment

A hybrid algorithm for workflow scheduling in cloud environment