Data reduction pipelines for the Keck Observatory Archive

Abstract

The Keck Observatory Archive (KOA) currently serves ~ 42 TB of data spanning over 20 years from all ten past and current facility instruments at Keck. Although most of the available data are in the raw form, for four instruments (HIRES, NIRC2, OSIRIS, LWS), quick-look, browse products generated by automated pipelines are also offered to facilitate assessment of the scientific content and quality of the data. KOA underwrote the update of the MAKEE package to support reduction of the CCD upgrade to HIRES, developed scripts for reduction of NIRC2 data and automated the existing OSIRIS and LWS data reduction packages. We describe in some detail the recently completed automated pipeline for NIRSPEC, which will be used to create browse products in KOA and made available for quicklook of the data by the observers at the telescope. We review the currently available data reduction tools for Keck data, and present our plans and anticipated priorities for the development of automated pipelines and release of reduced data products for the rest of the current and future instruments. We also anticipate that Keck's newest instrument, NIRES, which will be delivered with a fully automated pipeline, will be the first to have both raw and level-1 data ingested at commissioning.