Abstract Machine learning (ML)–based models have been rapidly integrated into forecast practices across the weather forecasting community in recent years. While ML tools introduce additional data to forecasting operations, there is a need for explainability to be available alongside the model output such that the guidance can be transparent and trustworthy for the forecaster. This work makes use of the algorithm tree interpreter (TI) to disaggregate the contributions of meteorological features used in the Colorado State University Machine Learning Probabilities (CSU-MLP) system, a random forest–based ML tool that produces real-time probabilistic forecasts for severe weather using inputs from the Global Ensemble Forecast System. TI feature contributions are analyzed in time and space for CSU-MLP day 2 and day 3 individual hazard (tornado, wind, and hail) forecasts and day 4 aggregate severe forecasts over a 2-yr period. For individual forecast periods, this work demonstrates that feature contributions derived from TI can be interpreted in an ingredients-based sense, effectively making the CSU-MLP physically interpretable. When investigated in an aggregate sense, TI illustrates that the CSU-MLP system’s predictions use meteorological inputs in ways that are consistent with the spatiotemporal patterns seen in meteorological fields that pertain to severe storm climatology. A discussion on how these insights could benefit forecast operations more broadly is also provided. Significance Statement Machine learning tools are becoming more common in weather forecasting settings, and there is a need to provide information to meteorologists on how machine learning models make their predictions in real time. Severe weather forecasts made by an operational machine learning model are deconstructed into meteorological components in a way that offers physically insightful context to the model’s predictions. The results show that the machine learning model uses the input meteorological fields to make predictions that resemble various aspects of severe storm climatology and environments. This work presents an avenue for using explainable artificial intelligence in operational weather forecasting by illustrating a method that could provide trust, transparency, and confidence in machine learning–based forecast guidance.
Read full abstract