Abstract

The DARPA FastNICs program targets orders of magnitude improvement in applications such as deep learning training by making radical improvements to network performance: While raw bandwidth has grown dramatically, the fundamental roadblock to application performance has been in delivering that data to the application. <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FLEET</small> provides a primarily off-the-shelf solution with high-end servers and shared computational and storage resources connected via PCIe over a reconfigurable MEMS optical switch; it uses custom Optical NICs to allow arbitrary topologies that can be configured before or even during execution to take advantage of shared resources and to flow data between components. <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FLEET</small> 's software is derived from Stanford Legion, which we are modifying to use the <sc xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">FLEET</small> hardware and to plan application execution for these dynamic network topologies.

Highlights

  • Fred Douglis, Seth Robertson, Eric van den Berg, Josephine Micallef, and Marc Pucci, Peraton Labs, Basking Ridge, NJ, 07920, USA Alex Aiken, Computer Science Department, Stanford University and SLAC, Menlo Park, CA, 94025, USA Keren Bergman, Maarten Hattink, and Mingoo Seok, Department of Electrical Engineering, Columbia University, New York, NY, 10027, USA

  • FLEET’s key hardware innovations are Optical Network Interface Cards (O-NICs) that can be plugged into the Peripheral Component Interconnect Express (PCIe) slots to extend the PCIe communication channels into the optical domain at full PCIe bandwidth

  • 2) The O-NIC is more than a PCIe channel and two optical modules that convert the PCIe bits to photonics; it has a sophisticated FPGA that runs a PCIe Manager firmware core providing security features, memory address translation, and virtualized PCIe devices to resolve the inherent problems of reconfigurable direct access to memory and physical PCIe devices

Read more

Summary

HARDWARE OVERVIEW

FLEET’s key hardware innovations are Optical Network Interface Cards (O-NICs) that can be plugged into the Peripheral Component Interconnect Express (PCIe) slots to extend the PCIe communication channels into the optical domain at full PCIe bandwidth. PCIe in the optical domain allows fine-grained direct memory transfers between servers or devices without the disadvantages of a shared bus. Our choice of PCIe allows for extremely efficient, low overhead, transparent zeroaFLEET stands for Fast Lanes for Expedited Execution at 10 Terabits

Published by the IEEE Computer Society
SOFTWARE OVERVIEW
FLEET Planner
FPGA Integration
RELATED WORK
CONCLUSION
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.