New approach to global data access in computational infrastructures

Abstract

Data access and management on a large, global scale is currently at the center of scientific interest. This follows from the need for data access from multi- and hybrid-cloud applications. In most cases existing solutions provide sufficient functionality to scale computing resources but scaling resources in terms of efficient data access e.g. for data-intensive applications is still not comprehensively resolved.In this paper, we present a new approach to global data access that supports the execution of data-intensive applications on globally distributed heterogeneous resources provided and managed by independent providers. We identify the functionality, representation, and processing of contextual information in the form of metadata, and the organization of data, resulting in four models describing the details of the approach. An experimental evaluation of this approach is discussed. We show overheads for single- and multi-site environments, system scalability, and usage of context awareness to achieve desired behavior proving insignificant overhead introduced by the system. The results confirm usability of the approach to supporting computations in heterogeneous environments with unified access to data distributed worldwide achieved by using broad contextual information.