Personalized driving assistance algorithms: Case study of federated learning based forward collision warning

Abstract

Current designs of advanced driving assistance systems (ADAS) mainly developed uniform collision warning algorithms, which ignore the heterogeneity of driving behaviors, thus lead to low drivers’ trust in. To address this issue, developing personalized driving assistance algorithms is a promising approach. However, current personalization systems were mainly implemented through manually adjusting warning trigger thresholds, which would be less feasible for overall drivers as certain domain expertise is required to set personal thresholds accurately. Other personalization techniques exploited individual drivers’ data to build personalized models. Such approach could learn personal behavior but requires impractical large-scale individual data collections. To fill up the gaps, self-adaptive algorithms for personalized forward collision warning (FCW) based on federated learning were proposed in this study. A baseline model was developed by long short-term memory (LSTM) for FCW. Federated learning framework was then introduced to collect knowledge from multiple drivers with privacy preserving. Specifically, a general cloud server model was trained by collecting updated parameters from individual vehicle server models rather than collecting raw data. Besides, a driver-specific batch normalization (BN) layer was added into each vehicle server model to address the heterogeneity of driving behaviors. Experiments show empirically that the proposed federated-based personalized models with the BN layer showed to have the best performance. The average modeling accuracy has reached 84.88% and the performance is comparable to conventional total data collection training approach, where the additional BN layer could increase the accuracy by 3.48%. Finally, applications of the proposed framework and its further investigations have been discussed.