Improving web cache server performance through arbitral thread and delayed caching

Abstract

As the number of Internet users increase explosively, the delay in network response time is also increasing. An economic and efficient solution for this problem is web caching. But the use of a cache server can cause another bottleneck because of the concentration of requests at the cache server. Many studies on improving cache server performance have been suggested, but existing studies have focused on load balancing and/or caching capacity, not directly on improving the throughput of a single cache server. In this paper, we analyze the causes of cache server bottleneck, and propose an arbitral thread and the delayed caching mechanism as a solution. We use an arbitral thread in order to provide a quick service to users' service requests, and we use delayed caching in order to improve system reliability. The proposed cache server is implemented through a modification of the SQUID cache server, and we compare its performance with the original SQUID cache server.