Formalizing Trust in Historical Weather Data

Abstract

Abstract Historical instrumental weather observations are vital to understanding past, present, and future climate variability and change. However, the quantity of historical weather observations to be rescued globally far exceeds the resources available to do the rescuing. Which observations should be prioritized? Here we formalize guidelines help make decisions on rescuing historical data. Rather than wait until resource-intensive digitization is done to assess the data’s value, insights can be gleaned from the context in which the observations were made and the history of the observers. Further insights can be gained from the transcription platforms used and the transcribers involved in the data rescue process, without which even the best historical observations can be mishandled. We use the concept of trust to help integrate and formalize the guidelines across the life cycle of data rescue, from the original observation source to the transcribed data element. Five cases of citizen science-based historical data rescue, two from Canada and three from Australia, guide us in constructing a trust checklist. The checklist assembles information from the original observers and their observations to the current transcribers and transcription approaches they use. Nineteen elements are generated to help future data rescue projects answer the question of whether resources should be devoted to rescuing historical meteorological material under consideration. Significance Statement Historical weather observations, such as ships’ logs and weather diaries, help us to understand our past, present, and future climate. More observations are waiting to be rescued than there are resources. Only after they have been rescued—transcribed—can the records be indexed, searched, and analyzed. Given the vast task, citizen scientists are often recruited to transcribe past weather records. Various tools, including software platforms, help volunteers transcribe these handwritten records. We provide guidance on choosing observations to rescue. This guidance is novel because it emphasizes trust throughout the data rescue process: trust in who the observers were and how the observations were made, trust in who the current transcribers are, and trust in the software tools that are used for transcription.