Automated Data Reduction Pipeline Research Articles

Stingray Sensor System for Persistent Survey of the GEO Belt.

The Stingray sensor system is a 15-camera optical array dedicated to the nightly astrometric and photometric survey of the geosynchronous Earth orbit (GEO) belt visible above Tucson, Arizona. The primary scientific goal is to characterize GEO and near-GEO satellites based on their observable properties. This system is completely autonomous in both data acquisition and processing, with human oversight reserved for data quality assurance and system maintenance. The 15 ZWO ASI1600MM Pro cameras are mated to Sigma 135 mm f/1.8 lenses and are controlled simultaneously by four separate computers. Each camera is fixed in position and observes a 7.6-by-5.8-degree portion of the GEO belt, for a total of a 114-by-5.8-degree field of regard. The GAIA DR2 star catalog is used for image astrometric plate solution and photometric calibration to GAIA G magnitudes. There are approximately 200 near-GEO satellites on any given night that fall within the Stingray field of regard, and all those with a GAIA G magnitude brighter than approximately 15.5 are measured by the automated data reduction pipeline. Results from an initial one-month survey show an aggregate photometric uncertainty of 0.062 ± 0.008 magnitudes and astrometric accuracy consistent with theoretical sub-pixel centroid limits. Provided in this work is a discussion of the design and function of the system, along with verification of the initial survey results.

Black hole parameter estimation with synthetic very long baseline interferometry data from the ground and from space

Context.The Event Horizon Telescope (EHT) has imaged the shadow of the supermassive black hole in M 87. A library of general relativistic magnetohydrodynamics (GMRHD) models was fit to the observational data, providing constraints on black hole parameters.Aims.We investigate how much better future experiments can realistically constrain these parameters and test theories of gravity.Methods.We generated realistic synthetic 230 GHz data from representative input models taken from a GRMHD image library for M 87, using the 2017, 2021, and an expanded EHT array. The synthetic data were run through an automated data reduction pipeline used by the EHT. Additionally, we simulated observations at 230, 557, and 690 GHz with the Event Horizon Imager (EHI) Space VLBI concept. Using one of the EHT parameter estimation pipelines, we fit the GRMHD library images to the synthetic data and investigated how the black hole parameter estimations are affected by different arrays and repeated observations.Results.Repeated observations play an important role in constraining black hole and accretion parameters as the varying source structure is averaged out. A modest expansion of the EHT already leads to stronger parameter constraints in our simulations. High-frequency observations from space with the EHI rule out all but ∼15% of the GRMHD models in our library, strongly constraining the magnetic flux and black hole spin. The 1σconstraints on the black hole mass improve by a factor of five with repeated high-frequency space array observations as compared to observations with the current ground array. If the black hole spin, magnetization, and electron temperature distribution can be independently constrained, the shadow size for a given black hole mass can be tested to ∼0.5% with the EHI space array, which allows tests of deviations from general relativity. With such a measurement, high-precision tests of the Kerr metric become within reach from observations of the Galactic Center black hole Sagittarius A*.

Murrili meteorite’s fall and recovery from Kati Thanda

AbstractOn November 27, 2015, at 10:43:45.526 UTC, a fireball was observed across South Australia by 10 Desert Fireball Network observatories lasting 6.1 s. An ~37 kg meteoroid entered the atmosphere with a speed of 13.68 ± 0.09 km s−1and was observed ablating from a height of 85 km down to 18 km, having slowed to 3.28 ± 0.21 km s−1. Despite the relatively steep 68.5° trajectory, strong atmospheric winds significantly influenced the darkflight phase and the predicted fall line, but the analysis put the fall site in the center of Kati Thanda–Lake Eyre South. Kati Thanda has meters‐deep mud under its salt‐encrusted surface. Reconnaissance of the area where the meteorite landed from a low‐flying aircraft revealed a 60 cm circular feature in the muddy lake, less than 50 m from the predicted fall line. After a short search, which again employed light aircraft, the meteorite was recovered on December 31, 2015 from a depth of 42 cm. Murrili is the first recovered observed fall by the digital Desert Fireball Network (DFN). In addition to its scientific value, connecting composition to solar system context via orbital data, the recovery demonstrates and validates the capabilities of the DFN, with its next generation remote observatories and automated data reduction pipeline.

The GMRT 150 MHz all-sky radio survey

We present the first full release of a survey of the 150 MHz radio sky, observed with the Giant Metrewave Radio Telescope between April 2010 and March 2012 as part of the TGSS project. Aimed at producing a reliable compact source survey, our automated data reduction pipeline efficiently processed more than 2000 hours of observations with minimal human interaction. Through application of innovative techniques such as image-based flagging, direction-dependent calibration of ionospheric phase errors, correcting for systematic offsets in antenna pointing, and improving the primary beam model, we created good quality images for over 95 percent of the 5336 pointings. Our data release covers 36,900 square degrees (or 3.6 pi steradians) of the sky between -53 deg and +90 deg DEC, which is 90 percent of the total sky. The majority of pointing images have a background RMS noise below 5 mJy/beam with an approximate resolution of 25" x 25" (or 25" x 25" / cos (DEC - 19 deg) for pointings south of 19 deg DEC). We have produced a catalog of 0.62 Million radio sources derived from an initial, high reliability source extraction at the 7 sigma level. For the bulk of the survey, the measured overall astrometric accuracy is better than 2" in RA and DEC, while the flux density accuracy is estimated at ~10 percent. Within the scope of the TGSS ADR project, the source catalog as well as 5336 mosaic images (5 deg x 5 deg) and an image cutout service, are made publicly available online as a service to the astronomical community. Next to enabling a wide range of different scientific investigations, we anticipate that these survey products provide a solid reference for various new low-frequency radio aperture array telescopes (LOFAR, LWA, MWA, SKA-low), and can play an important role in characterizing the EoR foreground. The TGSS ADR project aims at continuously improving the quality of the survey data products.

The Taipan Galaxy Survey: Scientific Goals and Observing Strategy

AbstractThe Taipan galaxy survey (hereafter simply ‘Taipan’) is a multi-object spectroscopic survey starting in 2017 that will cover 2π steradians over the southern sky (δ ≲ 10°, |b| ≳ 10°), and obtain optical spectra for about two million galaxies out to z < 0.4. Taipan will use the newly refurbished 1.2-m UK Schmidt Telescope at Siding Spring Observatory with the new TAIPAN instrument, which includes an innovative ‘Starbugs’ positioning system capable of rapidly and simultaneously deploying up to 150 spectroscopic fibres (and up to 300 with a proposed upgrade) over the 6° diameter focal plane, and a purpose-built spectrograph operating in the range from 370 to 870 nm with resolving power R ≳ 2000. The main scientific goals of Taipan are (i) to measure the distance scale of the Universe (primarily governed by the local expansion rate, H0) to 1% precision, and the growth rate of structure to 5%; (ii) to make the most extensive map yet constructed of the total mass distribution and motions in the local Universe, using peculiar velocities based on improved Fundamental Plane distances, which will enable sensitive tests of gravitational physics; and (iii) to deliver a legacy sample of low-redshift galaxies as a unique laboratory for studying galaxy evolution as a function of dark matter halo and stellar mass and environment. The final survey, which will be completed within 5 yrs, will consist of a complete magnitude-limited sample (i ⩽ 17) of about 1.2 × 106 galaxies supplemented by an extension to higher redshifts and fainter magnitudes (i ⩽ 18.1) of a luminous red galaxy sample of about 0.8 × 106 galaxies. Observations and data processing will be carried out remotely and in a fully automated way, using a purpose-built automated ‘virtual observer’ software and an automated data reduction pipeline. The Taipan survey is deliberately designed to maximise its legacy value by complementing and enhancing current and planned surveys of the southern sky at wavelengths from the optical to the radio; it will become the primary redshift and optical spectroscopic reference catalogue for the local extragalactic Universe in the southern sky for the coming decade.

A fully automated data reduction pipeline for the FRODOSpec integral field spectrograph

AbstractA fully autonomous data reduction pipeline has been developed for FRODOSpec, an optical fibre‐fed integral field spectrograph currently in use at the Liverpool Telescope. This paper details the process required for the reduction of data taken using an integral field spectrograph and presents an overview of the computational methods implemented to create the pipeline. Analysis of errors and possible future enhancements are also discussed (© 2011 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)

The ORAC‐DR data reduction pipeline

AbstractThe ORAC‐DR data reduction pipeline has been used by the Joint Astronomy Centre since 1998. Originally developed for an infrared spectrometer and a submillimetre bolometer array, it has since expanded to support twenty instruments from nine different telescopes. By using shared code and a common infrastructure, rapid development of an automated data reduction pipeline for nearly any astronomical data is possible. This paper discusses the infrastructure available to developers and estimates the development timescales expected to reduce data for new instruments using ORAC‐DR. (© 2008 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)

Looking towards the detection of exoearths with SuperWASP

The WASP consortium is conducting an ultra-wide field survey of stars between 8–15 mag from both hemispheres. Our primary science goal is to detect extra-solar ‘hot-Jupiter’-type planets that eclipse (or transit) bright host stars and for which further detailed investigation will be possible. We summarize the design of the SuperWASP instruments and describe the first results from our northern station SW-N, sited in La Palma, Canary Islands. Our second station, which began operations this year, is located at the South African Astronomical Observatory. Between April and September, 2004, SW-N continuously observed ~6.7 million stars. The consortium's custom-written, fully automated data reduction pipeline has been used to process these data, and the information is now stored in the project archive, held by the Leicester database and archive service (LEDAS). We have applied a sophisticated, automated algorithm to identify the low-amplitude (~0.01 mag), brief (~few hours) signatures of transiting exoplanets. In addition, we have assessed each candidate in the light of all available catalogue information in order to reject data artefacts and astrophysical false positive detections. The highest priority candidates are currently being subjected to further observations in order to select the true planets. Once the exoplanets are confirmed, a host of exciting opportunities are open to us. In this paper, we describe two techniques that exploit the transits in order to detect other objects within the same system. The first involves determining precise epochs for a sequence of transit events in order to detect the small timing variations caused by the gravitational pull of other planets in the same system. The second method employs ultra-high precision photometry of the transits to detect the deviations caused by the presence of exoplanetary moons. Both of these techniques are capable of detecting objects the size of terrestrial planets.

The Infrared Spectrograph (IRS) on the Spitzer Space Telescope

The Infrared Spectrograph (IRS) is one of three science instruments on the Spitzer Space Telescope. The IRS comprises four separate spectrograph modules covering the wavelength range from 5.3 to 38micron with spectral resolutions, R \~90 and 600, and it was optimized to take full advantage of the very low background in the space environment. The IRS is performing at or better than the pre-launch predictions. An autonomous target acquisition capability enables the IRS to locate the mid-infrared centroid of a source, providing the information so that the spacecraft can accurately offset that centroid to a selected slit. This feature is particularly useful when taking spectra of sources with poorly known coordinates. An automated data reduction pipeline has been developed at the Spitzer Science Center.

Steps Towards a Fully Automated Classification and Redshift-measurement Pipeline for LAMOST Spectra. I. Continuum level and wavelength estimation for galaxies

The Large Sky-Area Multi-Object Spectroscopic Telescope (LAMOST) under construction by the National Astronomical Observatories will yield up to four thousand multi-fiber spectra of stars and galaxies per field. The present series of papers describes the automated data-reduction pipeline currently being designed in order to cope with the anticipated flood of spectrographic data. In this preliminary paper, we present an automated method for estimating the continuum level, the positions of strong lines and the 4000Å break in galaxy spectra. In order to obtain detailed information on the continuum, we use a wavelet filter bank. After continuum fitting, our software searches for a 4000Å break and distinguishes between emission-line galaxies (ELGs)and non-ELGs according to whether the break is small or large. It then searches for strong lines and measures the intensities of emission lines and the equivalent widths of absorption lines. For non-ELGs, the absorption lines are identified automatically yielding redshift measurements.