Abstract
Abstract I/O requests from parallel processes to a disk compete with each other for a single disk head to access data. The disk efficiency can be significantly reduced due to frequent disk head seeks. In this paper, we propose a scheme, named IR+, to eliminate I/O interference for a single MPI program on disks by taking advantage of optimized access patterns and heterogeneous storage devices (e.g., solid-state disks). It identifies segments of files that could be involved in the interfering accesses and replicates them to their respectively designated storage servers. Moreover, it can further improve I/O performance by storing replicas on SSDs when accessing the on-disk replicas cannot sufficiently address the issue. IR+ has been implemented in the MPI library for high portability on top of the Lustre parallel file system. Our experiments with representative benchmarks, such as NPB BTIO and GTS , show that it can significantly improve I/O performance on the production HPC systems.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
