The PAU Survey: Operation and orchestration of multi-band survey data

Abstract

The Physics of the Accelerating Universe (PAU) Survey is an international project for the study of cosmological parameters associated with Dark Energy. PAU's 18-CCD camera (PAUCam), installed at the prime focus of the William Herschel Telescope at the Roque de los Muchachos Observatory (La Palma, Canary Islands), scans part of the northern sky, to collect low resolution spectral information of millions of galaxies with its unique set of 40 narrow-band filters in the optical range from 450 nm to 850 nm, and a set of 6 standard broad band filters. The PAU data management (PAUdm) team is in charge of treating the data, including data transfer from the observatory to the PAU Survey data center, hosted at Port d'Informaci\'o Cient\'ifica (PIC). PAUdm is also in charge of the storage, data reduction and, finally, of making the results available to the scientific community. We describe the technical solutions adopted to cover different aspects of the PAU Survey data management, from the computing infrastructure to support the operations, to the software tools and web services for the data process orchestration and exploration. In particular we will focus on the PAU database, developed for the coordination of the different PAUdm tasks, and to preserve and guarantee the consistency of data and metadata.