Abstract

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ∼ 20.8 and r ∼ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥ 10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

Highlights

  • The Zwicky Transient Facility (ZTF)19 is a next-generation optical time-domain survey currently in operation

  • It features 66 compute cluster nodes; four pipeline file servers connected to a file system; an archive file server connected to a separate file system; servers to support raw data ingestion, workload management, and monitoring; three database (DB) servers: the primary pipeline operations DB, the secondary pipeline DB, and the archive DB; a private webserver referred to as ZTF-Depot; a Kafka24 cluster to support alert distribution (ZADS; Section 4.1); and the IRSA public webserver for distributing archived products

  • This pipeline applies the calibration image corrections; it corrects for detector non-linearity; it masks aircraft and satellite streaks; it performs astrometric calibration; it masks ghosts from bright sources; it derives PSFs and generates a PSF-fit photometry catalog using a version of DAOPhot (Stetson 1987) optimized for ZTF

Read more

Summary

Introduction

The Zwicky Transient Facility (ZTF) is a next-generation optical time-domain survey currently in operation. Core functions of the ZSDS include managing data transfer from the P48; raw data ingestion; all processing pipelines; long-term archiving and curation of data products; user interfaces for data retrieval and access management; near-real-time distribution of flux-transient alerts and potentially new solar-system objects (SSOs); generation of quality assurance (QA) metrics for the project; analysis and trending; maintenance of all software, hardware, and databases; and user support. Caltech.edu/page/technical#science-data-system, while access to the ZTF archive with example queries are described at https://irsa.ipac.caltech.edu/Missions/ztf.html.

Data System and Operations Overview
Processing Architecture
Databases
Operational Routine and Tasks
Pipelines
Data Transfer from Telescope
Raw Data Ingestion
Calibration Image Generation
Bias-image Generation
High-frequency Flat-field Image Generation
Instrumental Calibration
Astrometric Calibration
Photometric Calibration
Image Differencing and Event Extraction
Reference Image Generation
Source Matching and Photometric Refinement
Moving Object Track Generation
Data Products
Alert Packets
Generic File-based Products
Solar-system Object Searches and Precovery
Lightcurve Retrieval and Analysis
Realtime Pipeline Runtime
Astrometric Accuracy
Sensitivity Limits
Photometric Calibration Assessment
Difference Image Event Statistics
Latency of Alert Packet Generation
Advice and Lessons Learned
Findings
Summary and Future Updates

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.