Abstract

Recently, with the increase in network bandwidth, various cloud computing applications have become popular. A large number of network data packets will be generated in such a network. However, most existing network architectures cannot effectively handle big data, thereby necessitating an efficient mechanism to reduce task completion time when large amounts of data are processed in data center networks. Unfortunately, achieving the minimum task completion time in the Hadoop system is an NP-complete problem. Although many studies have proposed schemes for improving network performance, they have shortcomings that degrade their performance. For this reason, in this study, we propose a centralized solution, called the bandwidth-aware rescheduling (BARE) mechanism for software-defined network (SDN)-based data center networks. BARE improves network performance by employing a prefetching mechanism and a centralized network monitor to collect global information, sorting out the locality data process, splitting tasks, and executing a rescheduling mechanism with a scheduler to reduce task completion time. Finally, we used simulations to demonstrate our scheme’s effectiveness. Simulation results show that our scheme outperforms other existing schemes in terms of task completion time and the ratio of data locality.

Highlights

  • Several cloud application services [1,2] have been proposed due to an increase in network bandwidth

  • We formulate a scheduling problem for different computation times o In addition, several research results [8,9] have confirmed that software-defined netpropose a task splitting and rescheduling mechanism works node (SDNs)and

  • In order to improve the effectiveness of the Hadoop Default Scheduler (HDS), a balance-reduce scheduler (BAR)

Read more

Summary

Introduction

Several cloud application services [1,2] have been proposed due to an increase in network bandwidth Many conceptual applications, such as cloud-based artificial intelligence services, remote patient–doctor telemedicine, real-time mixed reality, and big data collection and analysis in industrial Internet-of-Things applications, will be realized in the near future. We formulate a scheduling problem for different computation times o In addition, several research results [8,9] have confirmed that software-defined netpropose a task splitting and rescheduling mechanism works node (SDNs)and [10] can significantly improve the performance of data centers. Weresults formulate a scheduling problem for different computation times of tasks for each in term show that the proposed scheme has better performance node and propose a task splitting and rescheduling mechanism to reduce the TCT and data locality ratio.

Software-Defined
Ineach
Balance-Reduce Scheduler
Bandwidth-Aware
Research Gap
Bandwidth-Aware Rescheduling
Global Information Collection
Task Assignment Scheme
Performance
Performance Evaluation
16. Effect
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call