An Efficient Data Management System with High Scalability for ChinaGrid Support Platform

Abstract

AbstractThere are a great number of data intensive applications in ChinaGrid. They require an efficient and high performance data management. The data management in ChinaGrid Support Platform (CGSP) supplies a data access mechanism with location transparency, name transparency, and protocol transparency as while as ensuring the transfer efficiency. The data management system consists of five parts: the storage data server based on Global Distributed Storage System to guarantee the reliability and performance of data transfer; the storage resource agent to discover, publish and catalog the storage resources; the data logical domain management to enable applications to select specific storage resources; the metadata management to publish, query and access metadata; and the uniform data access entry to organize grid users’ data space. We present the design philosophy of the efficient data management system with high scalability for CGSP and also give preliminary performance results.KeywordsData TransferData Management SystemHigh ScalabilityLogical FileStorage ResourceThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.