The Chalmers Cloud Ice Climatology: retrieval implementation and validation

Abstract

Abstract. Ice clouds are a crucial component of the Earth's weather system, and their representation remains a principal challenge for current weather and climate models. Several past and future satellite missions were explicitly designed to provide observations offering new insights into cloud processes, but these specialized cloud sensors are limited in their spatial and temporal coverage. Geostationary satellites have been observing clouds for several decades and can ideally complement the sparse measurements from specialized cloud sensors. However, the geostationary observations that are continuously and globally available over the full observation record are restricted to a small number of wavelengths, which limits the information they can provide on clouds. The Chalmers Cloud Ice Climatology (CCIC) is a novel cloud-property dataset that aims to provide an improved climate record of ice hydrometeor concentrations by applying state-of-the-art machine-learning techniques to retrieve ice cloud properties from globally gridded, single-channel geostationary observations that are readily available from 1980 onwards. CCIC offers a novel perspective on the record of geostationary IR observations by providing spatially and temporally continuous retrievals of the vertically integrated and vertically resolved concentrations of frozen hydrometeors, typically referred to as ice water path (IWP) and ice water content (IWC). In addition to that, CCIC provides 2D and 3D cloud masks and a 3D cloud classification. A fully convolutional quantile regression neural network constitutes the core of the CCIC retrieval, providing probabilistic estimates of IWP and IWC. The network is trained against CloudSat retrievals using 3.5 years of global collocations. Assessed on a held-out test dataset, the CCIC-provided IWP and IWC estimates achieve correlations exceeding 0.7 and 0.6, respectively, and biases better than −5 % and −2 % demonstrating considerable skill in estimating both IWP and IWC. In addition, CCIC is extensively validated against both in situ and remote sensing measurements from two flight campaign series and a ground-based radar. The results of this independent validation confirm the ability of CCIC to retrieve IWP and IWC. CCIC thus ideally complements temporally and spatially more limited measurements from dedicated cloud sensors by providing spatially and temporally continuous estimates of ice cloud properties. The CCIC network and its associated software are made accessible to the scientific community.