Accelerating the Internet in the presence of Big Data: Reducing user delays by leveraging historical user request patterns for web caching

Chetan Kumar,Sean Marston

doi:10.4301/s1807-1775201916006

Abstract

Approximately 4 billion people have access to the Internet, additionally 23 billion devices are connected as of 2018. This has allowed for a substantial growth in data collection which has allowed for Big Data to flourish. The continued increase in user, devices, and Big Data usage has created a significant intensification in Internet traffic. This in turn has the potential to increase user delays when accessing data on the Internet. There are a number of ways to help reduce user latency, web caching is able to reduce web user delays in addition to reducing network traffic and the load on web servers. In this study we propose a proxy level web caching mechanism leveraging historical web patterns to help reduce user latency and accelerate the Internet. In addition we survey the state of the art of other caching approaches. Our investigation shows that using historical patterns as part of a proxy caching mechanisms in large scale networks can significantly shorten the latency for users in this era of Big Data

Highlights

The Internet has demonstrated a tremendous growth in the amount of data that is sent and received, this trend of increasing traffic is expected to continue
As Big Data moves forward it continues to increase the amount of traffic through the Internet
There are a number of aspects of Big Data that influences the amount of data collected

Summary

INTRODUCTION

The Internet has demonstrated a tremendous growth in the amount of data that is sent and received, this trend of increasing traffic is expected to continue. Due to the rapid growth of Big Data, cloud and edge computing continue to grow at a similar rate This is due to the importance of these computing paradigms in playing a key role in receiving, managing, and analyzing Big Data. Even as Big Data and analytics technology continues to develop and improve, the increase in traffic can lead to significant user delays in web access (Cui et al, 2018; Sorn & Tsuyoshi, 2013; Zhao & Wu, 2013; Kumar, 2010; Hosanagar & Tan, 2004; Datta et al, 2003). In this article we discuss the different techniques that exploit the use of historical user request patterns by proxy caches to reduce user request delays (Cui et al, 2018; Irani & Lam, 2015; Kumar, 2010; Kumar & Norris, 2008; Zeng et al, 2004)

RELATED LITERATURE AND BACKGROUND

USING HISTORICAL REQUESTS PATTERNS FOR WEB CACHING

CONCLUSION

Findings

KEY TERMS AND DEFINITIONS