Data Replica Placement Mechanism for Open Heterogeneous Storage Systems

Abstract

Abstract: Many big data-oriented network storage platforms are open and heterogeneous, which means that the data placement mechanism has a great impact on the system performance. The data replica placement mechanism needs to consider the data availability, the load balance and the quality of service for open heterogeneous storage systems. However, current data placement mechanisms are mainly for simple homogeneous storage systems, not entirely suitable for heterogeneous storage systems. We proposed a novel data replica placement mechanism with the adjustable replica deployment strategy (ARDS) for open heterogeneous data storage systems, which considers the data availability, the data access frequency and the storage capacity. The mechanism takes the data availability as premise of the initialization number of replica, then adjusts the number of replica according to the data access frequency, and places replicas based on the node spare capacity, which effectively avoids the condition of load unbalance. We implemented simulation experiments based on OMNet++. The experimental results show that the ARDS-based mechanism improves the system performance including the system load balance and the rate of successful data access.