Bottleneck Channels Algorithm for Satellite Data Dimension Reduction: A Case Study for IASI

Abstract

The infrared atmospheric sounder interferometer (IASI) onboard the Metop-A and Metop-B satellites is an essential instrument for numerical weather prediction centers. The IASI, with its 8461 channels, enables the observation of the surface and atmospheric geophysical variables twice a day around the world. This data volume will increase in the future, stressing the need for practical and efficient dimension reduction techniques for storage and transmission but also for inversion or assimilation. In a previous paper by Aires et al. , a new dimension reduction method, the so-called bottleneck channel (BC), has been introduced. BCs are a good compromise between compression and channel selection techniques. In this paper, we introduce several new technical configurations of the BC approach, comparing their advantages/drawbacks. Comparisons are also made with two classical methodologies widely used in the satellite community: principal component analysis (PCA) compression and entropy reduction channel selection. Beyond the compression ability, the methodologies are tested on the temperature, water vapor, and ozone retrieval application using IASI measurements. Two approaches have been tested. First, theoretical retrieval improvement has been measured when using the various data reduction techniques. The BC achieves good theoretical improvements, comparable to noise-adjusted PCA (NAPCA), for the retrieval of the temperature, water vapor, and ozone. Second, a neural network inversion scheme is tested on real IASI observations using the several data reduction techniques. It is shown that BCs provide similar or better results than the other methods. The BCs present compression, denoising, and information content results comparable to the NAPCA, while preserving the physical meaning (i.e., actual channel brightness temperatures) of a channel selection approach. This has numerous advantages for inversion and assimilation: the mixing problem, contamination effects, minor constituents representation, or radiative transfer speed, and each of these will be discussed.