Research on Hodoop Job Scheduling Algorithms Based on Dynamic Fusion

Abstract

Adaptive genetic algorithm and improved ant colony algorithm are combined to solve Hadoop job scheduling problem. Firstly, the global search ability of the adaptive genetic algorithm is used to generate the list of resources allocated by the task. When the search speed of the genetic algorithm gradually decreases, the optimal integration time of the adaptive genetic algorithm and the ant colony algorithm is determined dynamically. The initial pheromone distribution of the ant colony algorithm is generated from the optimal solution solved by the adaptive genetic algorithm. Improve the target node selection strategy of ant colony algorithm, consider the success rate of completing tasks of nodes, and accelerate the speed of ant colony algorithm to solve the optimal solution. Simulation results show that compared with genetic algorithm and ant colony algorithm, hybrid genetic algorithm takes less time, and the more tasks, the more obvious advantages.