Online Federated Learning based Object Detection across Autonomous Vehicles in a Virtual World

Abstract

Federated Learning (FL) enables collaborative training of machine learning models for edge devices (e.g., mobile phones) over a network without revealing raw data of the participants. The existing FL benchmarks mostly assume static distribution of local data over time failing to capture the behavior of real-world applications with space-time varying data (e.g., autonomous cars). Our framework addresses this limitation by leveraging popular open source physics simulator (CARLA) and FL framework (OpenFL) to allow collection of streaming data from the mobile agents and feeding them to a practically deployable FL engine for online collaborative training. It also provides the FL researchers with the ability to model data heterogeneity, annotate data with practically zero cost, and perform reproducible continual FL experiments. We believe that this is one of the first attempts to demonstrate online FL on realistic streaming datasets from a virtual world. The demo showcases this framework using a popular object detection use case.