Accelerating data acquisition with FPGA-based edge machine learning: a case study with LCLS-II

Abstract

Abstract New scientific experiments and instruments generate vast amounts of data that need to be transferred for storage or further processing, often overwhelming traditional systems. Edge Machine Learning (EdgeML) addresses this challenge by integrating
Machine Learning (ML) algorithms with edge computing, enabling real-time data processing directly at the point of data generation. EdgeML is particularly beneficial for environments where immediate decisions are required, or where bandwidth and
storage are limited. In this paper, we demonstrate a high-speed configurable ML model in a fully customizable EdgeML system using a Field Programmable Gate Array (FPGA). Our demonstration focuses on an angular array of electron spectrometers,
referred to as the ’CookieBox,’ developed for the Linac Coherent Light Source II (LCLS-II) project. The EdgeML system captures 51.2 Gbps from a 6.4 GS/s analog to digital converter and is designed to integrate data pre-processing and ML inside an
FPGA. Our implementation achieves an inference latency of 0.2 μs for the ML model, and a total latency of 0.4 μs for the complete EdgeML system, which includes preprocessing, data transmission, digitization, and ML inference. The modular design of
the system allows it to be adapted for other instrumentation applications requiring low-latency data processing.