Abstract

All over the process of treating data on HPC Systems, parallel file systems play a significant role. With more and more applications, the need for high performance Input-Output is rising. Different possibilities exist: General Parallel File System, cluster file systems and virtual parallel file system (PVFS) are the most important ones. However, these parallel file systems use pattern and model access less effective such as POSIX semantics (A family of technical standards emerged from a project to standardize programming interfaces software designed to operate on variant UNIX operating system.), which forces the MPI-IO implementations to use inefficient techniques based on locks. To avoid this synchronization in these techniques, we ensure that the use of a versioning-based file system is much more effective.

Highlights

  • Industrial research and development on parallel file systems that can provide outstanding performance is prompted by the need to treat raising volume of data in technological and business applications that usually require high Input/output throughput [1]

  • The main purpose of this document is to emphasize the strengths of the two systems and present a prototype of a new file system based on the BlobSeer storage system that provides high Input/output throughput while ensuring simultaneous access data for distributed file systems

  • To guarantee the atomicity of access to noncontiguous and overlapping areas, parallel file systems use access patterns less powerful and less effective such as POSIX semantics that forces MPI-IO Implementations (Message Passing Interface) to use inefficient techniques based on locks [7]

Read more

Summary

INTRODUCTION

Industrial research and development on parallel file systems that can provide outstanding performance is prompted by the need to treat raising volume of data in technological and business applications that usually require high Input/output throughput [1]. We will present two important parallel file systems while addressing their major limitations and propose a new File System based on versioning and inspired from PVFS and Lustre File systems. Our choice of these parallel file systems is mainly due to their extensive use. The main purpose of this document is to emphasize the strengths of the two systems and present a prototype of a new file system based on the BlobSeer storage system that provides high Input/output throughput while ensuring simultaneous access data for distributed file systems

MAIN PROBLEM AND APPROACH
PVFS and LUSTRE
LUSTRE
Blobseer Architecture
Approach
COMPARISON WITH RELATED WORK
CONCLUSION
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call