Research on Distributed File System Framework Based on Solid State Drive

Abstract

As the computing power of high performance computing (HPC) systems is developing to exascale, and Big data application tends to be I/O intensive, the storage system is facing high I / O traffic. The poor performance of disk has gradually become the bottleneck of storage system. In recent years, Flash technology has developed rapidly, Flash-based Solid State Drive (SSD) has been widely used in HPC, adding SSD into the storage system can improve the performance of the storage system. In this paper, we designed DSFS, a user-level distributed file system based on SSD. DSFS uses SSD as the underlying storage medium, and adopts Infiniband RDMA (Remote Direct Memory Access) transmission mechanism. The test result shows that DSFS improves the performance of HPC storage system effectively.