Abstract

We report on the status of the OSiRIS project (NSF Award #1541335, UM, IU, MSU and WSU) after its fourth year. OSiRIS is delivering a distributed Ceph storage infrastructure coupled together with software-defined networking to support multiple science domains across Michigan’s three largest research universities as well as the Van Andel Institute. The project’s goal is to provide a single scalable, distributed storage infrastructure that allows researchers at each campus to work collaboratively with other researchers across campus or across institutions. The NSF CC*DNI DIBBs program which funded OSiRIS is seeking solutions to the challenges of multi-institutional collaborations involving large amounts of data and we are exploring the creative use of Ceph and networking to address those challenges. We will present details on the current status of the project and its various science domain users and use-cases. In the presentation we will cover the various design choices, configuration and the tuning and operational challenges we have encountered in providing a multiinstitutional Ceph deployment interconnected by a monitored, programmable network fabric. We will conclude with our plans for the final year of the project and its longer term outlook.

Highlights

  • The OSiRIS project[1] has successfully connected four campuses and a smaller edge site with a software defined networking and storage system that allows the seamless sharing of large datasets

  • By the end of the fourth year of the project, we have an established rapid deployment infrastructure, automated virtual organization provisioning, self-service user enrollment with delegated approval, and AAA (Authentication, Authorization, and Accounting) infrastructure allowing for role-based fine grained access to resources

  • Our goal is to provide transparent, high-performance access to the same storage infrastructure from wellconnected locations on any of our campuses

Read more

Summary

Introduction

The OSiRIS project[1] has successfully connected four campuses and a smaller edge site with a software defined networking and storage system that allows the seamless sharing of large datasets. By the end of the fourth year of the project, we have an established rapid deployment infrastructure, automated virtual organization provisioning, self-service user enrollment with delegated approval, and AAA (Authentication, Authorization, and Accounting) infrastructure allowing for role-based fine grained access to resources. We manage our own access and usage of project resources using the very same system as our users. OSiRIS currently serves approximately 14 science virtual organizations housed across 6 US institutions or labs with collaborators worldwide. The scalable, flexible nature of OSiRIS leaves the door open for more users and more collaboration with other research platforms. The remainder of the paper will cover our accomplishments and future goals in detail

The OSiRIS Project
Ceph in OSiRIS
OSiRIS Service Monitoring
Science Domain Engagements
Next Steps
Conclusions
10 Acknowledgements
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.