An explainable unsupervised risk early warning framework based on the empirical cumulative distribution function: Application to dairy safety

Abstract

Efficient food safety risk assessment significantly affects food safety supervision. However, food detection data of different types and batches show different feature distributions, resulting in unstable detection results of most risk assessment models, lack of interpretability of risk classification, and insufficient risk traceability. This study aims to explore an efficient food safety risk assessment model that takes into account robustness, interpretability and traceability. Therefore, the Explainable unsupervised risk Warning Framework based on the Empirical cumulative Distribution function (EWFED) was proposed. Firstly, the detection data’s underlying distribution is estimated as non-parametric by calculating each testing indicator’s empirical cumulative distribution. Next, the tail probabilities of each testing indicator are estimated based on these distributions and summarized to obtain the sample risk value. Finally, the “3σ Rule” is used to achieve explainable risk classification of qualified samples, and the reasons for unqualified samples are tracked according to the risk score of each testing indicator. The experiments of the EWFED model on two types of dairy product detection data in actual application scenarios have verified its effectiveness, achieving interpretable risk division and risk tracing of unqualified samples. Therefore, this study provides a more robust and systematic food safety risk assessment method to promote precise management and control of food safety risks effectively.