From proof‐of‐concept to proof‐of‐value: Approaching third‐party data to operational workflows of national meteorological services

Abstract

AbstractNational meteorological services (NMS) are limited by practical and financial boundaries in the number of official meteorological measurements that it can collect. This means that large regions are often unobserved. These gaps can be filled by novel data sources, including measurements from personal weather stations that are owned and operated by amateur citizen scientists, or opportunistic sensing from devices that are not designed to measure meteorological variables, like commercial microwave links (radio connections between mobile phone towers). These types of data are known as “third‐party data” (3PD) as they are not owned or operated by NMS or research institutes (e.g., university, government department). Demonstration of the quality and value of these novel data sources is an active area of research. NMS, like the Royal Netherlands Meteorological Institute (KNMI), are faced with some unique challenges when it comes to transferring research to operations. KNMI is in the early stages of developing an operational pipeline for 3PD. We outline some use cases where we have demonstrated the quality of 3PD. We discuss our experiences with some of these challenges that can occur when transferring between proof‐of‐concepts on 3PD developed in research settings into real operational workflows providing valuable services. Hence, in this work we introduce our third‐party data life cycle, in which we provide an integral overview of this transitioning process considering business and social aspects, technical feasibility assessments, the importance of quality control, and aspects related to data integration and alignment with the existing official data sources. We also reflect on how these potential new applications could fit into KNMIs long‐term strategies and contribute to the high‐resolution weather forecast and early warning issuing. We hope that sharing these experiences will provide some general guidelines to organizations in need of providing new services stemming from 3PD and transform them into “daily business.”