An intelligent energy efficient storage system for cloud based big data applications

Abstract

Storage technology has emerged as an indispensable paradigm for processing various applications in cloud data centers. The storage infrastructure consisting of Hard Disk Drives (HDDs) and Solid-State Drives (SSDs) accounts for high energy consumption. Also, the trade-offs between HDDs and SSDs in terms of cost and energy consumption are extremely high. Therefore, disk-based storage subsystems need to be more energy efficient. This paper proposes an intelligent energy-efficient hybrid disk storage system. The proposed system recognizes the frequently used data from traces of applications. Replica management along with data layout is used to allocate frequently used files in hot disks and the other files in cold disks. The request is executed using an intelligent scheduling technique that searches and selects the disk based on its states. The scheduling technique selects either an idle or active disk without spinning the standby disks. The selection procedure also considers minimum waiting time for the active disk and maximum remaining idle time for the idle disk. The proposed system has been implemented by adding disk management in the cloud environment, which proved to be highly effective in achieving a 39% power savings with an 18.26% decrease in execution time.