Data Reduction System Research Articles

Kiso Supernova Survey (KISS): Survey strategy

Abstract The Kiso Supernova Survey (KISS) is a high-cadence optical wide-field supernova (SN) survey. The primary goal of the survey is to catch the very early light of a SN, during the shock breakout phase. Detection of SN shock breakouts combined with multi-band photometry obtained with other facilities would provide detailed physical information on the progenitor stars of SNe. The survey is performed using a 2 $_{.}^{\circ}$2 × 2 $_{.}^{\circ}$2 field-of-view instrument on the 1.05-m Kiso Schmidt telescope, the Kiso Wide Field Camera (KWFC). We take a 3-min exposure in g-band once every hour in our survey, reaching magnitude g ∼ 20–21. About 100 nights of telescope time per year have been spent on the survey since 2012 April. The number of the shock breakout detections is estimated to be of the order of 1 during our three-year project. This paper summarizes the KISS project including the KWFC observing setup, the survey strategy, the data reduction system, and CBET-reported SNe discovered so far by KISS.

SER-CAT Light When YOU Need It via automation & remote access

For the past 15 years, SER-CAT has been striving to provide its members with access to a "virtual beamline" which could be integrated into their daily workflow much like the X-ray lab down the hall. Working with Oceaneering Space Systems a conceptual design for automated data collection robot (ASTRO) was developed in 2000. In 2003, using funds from the Georgia Research Alliance, automation of the SER-CAT beamlines began with the installation of a highly modified Berkeley/ALS automounter (6 pucks) on beamline 22BM followed by a higher capacity system (15 pucks) installed on 22ID. SER-CAT automation also includes seamless integration with the SERGUI beamline control system, SER-CAT/UGA production of the tools (pucks, etc.) users need to ship crystals to the beamline and automated crystal screening and data reduction systems. Today over 95% of SER-CAT members routinely collect data remotely. Efficient and reliable automation has also allowed SER-CAT to offer two 12-hour data collection shifts per day with extended 16-hour/day on-site user support. An overview of SER-CAT beamline automation including robotics, beamline/experiment control, and automated data processing and structure determination will be described. Work supported by NIH NCRR (S10RR025528 & S10RR028976), SER-CAT Member Institutions, University of Georgia Research Foundation and the Georgia Research Alliance.

Data Mining Strategies for Real-time Control in New York City

The Data Mining System (DMS) at New York City Department of Transportation (NYCDOT) mainly consists of four database systems for traffic and pedestrian/bicycle volumes, crash data, and signal timing plans as well as the Midtown in Motion (MIM) systems which are used as part of the NYCDOT Intelligent Transportation System (ITS) infrastructure. These database and control systems are operated by different units at NYCDOT as an independent database or operation system. New York City experiences heavy traffic volumes, pedestrians and cyclists in each Central Business District (CBD) area and along key arterial systems. There are consistent and urgent needs in New York City for real-time control to improve mobility and safety for all users of the street networks, and to provide a timely response and management of random incidents. Therefore, it is necessary to develop an integrated DMS for effective real-time control and active transportation management (ATM) in New York City.This paper will present new strategies for New York City suggesting the development of efficient and cost-effective DMS, involving: 1) use of new technology applications such as tablets and smartphone with Global Positioning System (GPS) and wireless communication features for data collection and reduction; 2) interface development among existing database and control systems; and 3) integrated DMS deployment with macroscopic and mesoscopic simulation models in Manhattan. This study paper also suggests a complete data mining process for real-time control with traditional static data, current real timing data from loop detectors, microwave sensors, and video cameras, and new real-time data using the GPS data. GPS data, including using taxi and bus GPS information, and smartphone applications can be obtained in all weather conditions and during anytime of the day. GPS data and smartphone application in NYCDOT DMS is discussed herein as a new concept.

The Belle II Pixel Detector Data Acquisition and Reduction System

The upcoming Belle II experiment is designed to work at a luminosity of 8×10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">35</sup> cm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-2</sup> s <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">-1</sup> , 40 times higher than its predecessor. The pixel detector of Belle II with its ~ 8 million channels will deliver ten times more data than all other sub-detectors together. A data rate of 22 Gbytes/s is expected for a trigger rate of 30 kHz and an estimated pixel detector occupancy of 3%, which is by far exceeding the specifications of the Belle II event builder system. Therefore a realtime data reduction of a factor > 30 is needed. A hardware platform capable of processing this amount of data is the ATCA based Compute Node (CN). Each CN consists of an xTCA carrier board and four AMC/xTCA daughter boards. The carrier board supplies the high bandwidth connectivity to the other CNs via Rocket-IO links. In the current prototype design, each AMC board is equipped with a Xilinx Virtex-5 FX70T FPGA, 4 GB of memory, Gbit Ethernet and two bi-directional optical links allowing for a bandwidth of up to 12.5 Gbits/s. IPMI control of mother and daughter board is foreseen. One ATCA shelf containing 10 mother boards/40 daughter boards is sufficient to process the data from the 40 front end boards. The data reduction on the CN is done in two steps. First, the event data delivered by the front end electronics via optical links is stored in memory until the high level trigger (HLT) decision has been made. The HLT rejects >2/3 of these events. In a second step, pixel data of positively triggered events is reduced with the help of regions of interest (ROI), calculated by the HLT from projecting trajectories back to the pixel detector plane. The design allows additional ROI inputs computed from hit cluster properties or tracklets from the surrounding silicon strip detector. The final data reduction is achieved by sending only data within these ROIs to the main event builder.

Clinical Validation of a Highly Sensitive GC-MS Platform for Routine Urine Drug Screening and Real-Time Reporting of up to 212 Drugs

An important role of the clinical toxicology laboratory is to provide continuous diagnostic testing for patients with altered mental status and for other medical indications. To meet these needs, we have developed a new Gas Chromatography-Mass Spectrometry (GC-MS) platform that facilitates routine screening and automated reporting of 212 drugs by laboratory technologists around the clock without the need to sign out by an on-site mass spectrometry-trained toxicologist. The platform uses a programmable temperature vaporizer (PTV) injector for large sample volume injection and the free software Automated Mass Spectral Deconvolution and Identification System (AMDIS) for data reduction and spectral matching that facilitates rapid library searching and analyte identification. Method comparison with 118 patient samples demonstrated that this platform and data searching algorithm independently provided improvements in sensitivity compared to an established GC-MS platform. Further examination of the role of the data processing software and the in-house databases used in the established versus the new platform demonstrated that the improved analytical sensitivity of the new platform was attributed to both the technical superiority of the new GC-MS instrumentation and the use of AMDIS in conjunction with the newly generated in-house library for data processing.

EVALUATION OF SPEECH ENHANCEMENT IN NOISY CONDITIONS USING A SPECTRAL SUBTRACTION AND LINEAR PREDICTION COMBINATION

Improving quality and intelligibility of speech signals in mobile devices has been studied with great interest in the past. Speech information in communication channels is usually corrupted by additive acoustic noise, reverberation or channel noise. This paper explores into the possibilities of enhancing corrupted speech using the Spectral Subtraction (SS) and Linear Prediction Coding (LPC) system for mobile applications only in acoustically noisy conditions. A Spectral Subtraction block is cascaded in series with a LPC system. For a pth order LPC system, a Levinson-Durbin based algorithm computes the LPC coefficients. Typically LPC is used as a data reduction system in speech communication but in this work, we try to find an optimum pth order LPC system that could enhance speech quality. We focus on improving speech quality and not speech intelligibility in this paper. The algorithm output will be evaluated objectively with a combined Perceptual Evaluation of Speech Quality (PESQ) and Itakura-Saito (IS) system and will be compared against Mean Opinion Scores (MOS) of various other Speech Enhancement algorithms.

Toward automated denoising of single molecular Förster resonance energy transfer data

A wide-field two-channel fluorescence microscope is a powerful tool as it allows for the study of conformation dynamics of hundreds to thousands of immobilized single molecules by Förster resonance energy transfer (FRET) signals. To date, the data reduction from a movie to a final set containing meaningful single-molecule FRET (smFRET) traces involves human inspection and intervention at several critical steps, greatly hampering the efficiency at the post-imaging stage. To facilitate the data reduction from smFRET movies to smFRET traces and to address the noise-limited issues, we developed a statistical denoising system toward fully automated processing. This data reduction system has embedded several novel approaches. First, as to background subtraction, high-order singular value decomposition (HOSVD) method is employed to extract spatial and temporal features. Second, to register and map the two color channels, the spots representing bleeding through the donor channel to the acceptor channel are used. Finally, correlation analysis and likelihood ratio statistic for the change point detection (CPD) are developed to study the two channels simultaneously, resolve FRET states, and report the dwelling time of each state. The performance of our method has been checked using both simulation and real data.

Accurate galactic 21-cm H I measurements with the NRAO Green Bank Telescope

Aims: We devise a data reduction and calibration system for producing highly-accurate 21-cm H I spectra from the Green Bank Telescope (GBT) of the NRAO. Methods: A theoretical analysis of the all-sky response of the GBT at 21 cm is made, augmented by extensive maps of the far sidelobes. Observations of radio sources and the Moon are made to check the resulting aperture and main beam efficiencies. Results: The all-sky model made for the response of the GBT at 21 cm is used to correct for "stray" 21-cm radiation reaching the receiver through the sidelobes rather than the main beam. This reduces systematic errors in 21-cm measurements by about an order of magnitude, allowing accurate 21-cm H I spectra to be made at about 9' angular resolution with the GBT. At this resolution the procedures discussed here allow for measurement of total integrated Galactic H I line emission, W, with errors of 3 K km s^-1, equivalent to errors in optically thin N_HI of 5 x 10^18 cm^-2.

Xia2: an expert system for macromolecular crystallography data reduction

An expert system for macromolecular crystallography data reduction is presented, which builds on existing software to automate the complete data reduction process from images to merged structure factor amplitudes. This can automatically identify multi-wedge, multi-pass and multiwavelength data sets and includes explicit procedures to test for crystallographic special cases. With the push towards high-thoughput crystallography at synchrotron beamlines and automation of structure solution, the ability to reduce data with no user input fills an important gap in the pipeline.

Observations of flat-spectrum radio sources at λ850 μm from the James Clerk Maxwell Telescope II. April 2000 to June 2005

Calibrated data for 143 flat-spectrum extragalactic radio sources are presented at a wavelength of 850 microns covering a five-year period from April 2000. The data, obtained at the James Clerk Maxwell Telescope using the SCUBA camera in pointing mode, were analysed using an automated pipeline process based on the Observatory Reduction and Acquisition Control - Data Reduction (ORAC-DR) system. This paper describes the techniques used to analyse and calibrate the data, and presents the database of results along with a representative sample of the better-sampled lightcurves. A re-analysis of previously published data from 1997 to 2000 is also presented. The combined catalogue, comprising 10493 flux density measurements, provides a unique and valuable resource for studies of extragalactic radio sources.

A microprocessor based system for on-line data reduction of ECG signal and arrhythmia detection

A microprocessor based system for on-line data reduction of ECG signal and arrhythmia detection

Telemetry/Computer System for Data Acquisition and Reduction in Field-test Environments

Telemetry/Computer System for Data Acquisition and Reduction in Field-test Environments

ESO imaging survey: optical deep public survey

This paper presents new five passbands (UBVRI) optical wide-field imaging data accumulated as part of the DEEP Public Survey (DPS) carried out as a public survey by the ESO Imaging Survey (EIS) project. Out of the 3 square degrees originally proposed, the survey covers 2.75 square degrees, in at least one band (normally R), and 1.00 square degrees in five passbands. The median seeing, as measured in the final stacked images, is 0.97, ranging from 0.75 to 2.0. The median limiting magnitudes (AB system, 2 aperture, 5 sigma detection limit) are U_(AB)=25.65, B_(AB)=25.54, V_(AB)=25.18, R_(AB) = 24.8 and I_(AB)=24.12 mag, consistent with those proposed in the original survey design. The paper describes the observations and data reduction using the EIS Data Reduction System and its associated EIS/MVM library. The quality of the individual images were inspected, bad images discarded and the remaining used to produce final image stacks in each passband, from which sources have been extracted. Finally, the scientific quality of these final images and associated catalogs was assessed qualitatively by visual inspection and quantitatively by comparison of statistical measures derived from these data with those of other authors as well as model predictions, and from direct comparison with the results obtained from the reduction of the same dataset using an independent (hands-on) software system. Finally to illustrate one application of this survey, the results of a preliminary effort to identify sub-mJy radio sources are reported. To the limiting magnitude reached in the R and I passbands the success rate ranges from 66 to 81% (depending on the fields). These data are publicly available at CDS.

ESO imaging survey: infrared observations of CDF-S and HDF-S

This paper presents infrared data obtained from observations carried out at the ESO 3.5m New Technology Telescope (NTT) of the Hubble Deep Field South (HDF-S) and the Chandra Deep Field South (CDF-S). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted by ESO to promote follow-up observations with the VLT. In the HDF-S field the infrared observations cover an area of ~53 square arcmin, encompassing the HST WFPC2 and STIS fields, in the JHKs passbands. The seeing measured in the final stacked images ranges from 0.79 to 1.22 and the median limiting magnitudes (AB system, 2 aperture, 5sigma detection limit) are J_AB~23.0, H_AB~22.8 and K_AB~23.0 mag. Less complete data are also available in JKs for the adjacent HST NICMOS field. For CDF-S, the infrared observations cover a total area of \~100 square arcmin, reaching median limiting magnitudes (as defined above) of J_AB~23.6 and K_AB~22.7 mag. For one CDF-S field H-band data are also available. This paper describes the observations and presents the results of new reductions carried out entirely through the un-supervised, high-throughput EIS Data Reduction System and its associated EIS/MVM C++-based image processing library developed, over the past 5 years, by the EIS project and now publicly available. The paper also presents source catalogs extracted from the final co-added images which are used to evaluate the scientific quality of the survey products, and hence the performance of the software. This is done comparing the results obtained in the present work with those obtained by other authors from independent data and/or reductions carried out with different software packages and techniques. The final science-grade catalogs and co-added images are available at CDS.

ESO imaging survey: optical follow-up of 12 selected XMM-Newton fields

This paper presents the data recently released for the XMM-Newton/WFI survey carried out as part of the ESO Imaging Survey (EIS) project. The aim of this survey is to provide optical imaging follow-up data in BVRI for identification of serendipitously detected X-ray sources in selected XMM-Newton fields. In this paper, fully calibrated individual and stacked images of 12 fields as well as science-grade catalogs for the 8 fields located at high-galactic latitude are presented. These products were created, calibrated and released using the infrastructure provided by the EIS Data Reduction system and its associated EIS/MVM image processing engine, both of which are briefly described here. The data covers an area of ∼3 square degrees for each of the four passbands. The median seeing as measured in the final stacked images is 0. �� 94, ranging from 0. �� 60 and 1. �� 51. The median limiting magnitudes (AB system, 2 �� aperture, 5σ detection limit) are 25.20, 24.92, 24.66, and 24.39 mag for B-, V-, R-, and I-band, respectively. When only the 8 high-galactic latitude fields are included these become 25.33, 25.05, 25.36, and 24.58 mag, in good agreement with the planned depth of the survey. Visual inspection of images and catalogs, comparison of statistics derived from the present data with those obtained by other authors and model predictions, as well as direct comparison of the results obtained from independent reductions of the same data, demonstrate the science-grade quality of the automatically produced final images and catalogs. These survey products, together with their logs, are available to the community for science exploitation in conjunction with their X-ray counterparts. Preliminary results from the X-ray/optical cross-correlation analysis show that about 61% of the detected X-ray point sources in deep XMM-Newton exposures have at least one optical counterpart within 2 �� radius down to R � 25 mag, 50% of which are so faint as to require VLT observations thereby meeting one of the top requirements of the survey, namely to produce large samples for spectroscopic follow-up with the VLT, whereas only 15% of the objects have counterparts down to the DSS limiting magnitude.

Measuring Impacts of High-Occupancy-Vehicle Lane Operations on Light-Duty-Vehicle Emissions

High-occupancy-vehicle (HOV) lanes on urban highways have long been proved to increase the efficiency of highway operations, as measured by person throughput, vehicle occupancy, travel time, speed, and reliability. Operational measures of effectiveness, such as speed and travel time, for HOV facilities are superior to general purpose (GP) lanes, in which predominantly single-occupancy vehicles operate. Few studies have attempted to study the emissions on HOV facilities vis-à-vis their GP lane counterparts. In this research, differences in vehicle emissions between HOV lane and GP lane facilities were measured with portable emissions sensors. Several hundred miles of on-road emissions data were collected by vehicles instrumented with portable emissions-monitoring systems (PEMSs) operated in HOV and GP lanes during peak hours in the metropolitan Washington, D.C., area. Data were collected at HOV facilities with buffer separation and at HOV facilities with barrier separation (limited-access lanes). Experimental runs were conducted with pairs of nearly identical instrumented vehicles that simultaneously began trips in parallel HOV and GP lanes and ended them at a common location. The experimental design controlled for vehicle type and driver characteristics. Analysis identified the emissions profiles of vehicles operating in barrier-separated HOV lanes (I-95) and vehicles operating in buffer-separated HOV lanes (I-66). Experiences related to the experimental design with the PEMS, the field deployment of the PEMS, data collection, and analysis are discussed. Included in the discussion is a description of the application of a geographic information system for data reduction and analysis.

Transit Search for Exoplanets with the Vulcan Camera

The NASA Ames Research Center's Vulcan photometer is being used in a search for close–in giant extrasolar planets. With our current data reduction system we achieve 0.2–0.8% hour–to–hour relative photometric precision on ∽ 6000 stars brighter than 13th magnitude. Three Galactic-plane fields have so far yielded hundreds of variable stars, including ∽ 50 eclipsing or interacting binaries per field. Several candidate detections have been followed up with radial velocity observations. High-resolution spectroscopy revealed many of the strongest candidates to be grazing eclipsing binaries.

The Princeton Variability Survey

ABSTRACTThe Princeton Variability Survey (PVS) is a robotic survey that makes use of readily available “off‐the‐shelf” type hardware products, in conjunction with a powerful set of commercial software products, in order to monitor and discover variable objects in the night sky. The main goal of the PVS has been to devise an automated telescope and data reduction system requiring only moderate technical and financial resources to assemble, which may be easily replicated by the dedicated amateur, a student group, or a professional and used to study and discover a variety of variable objects, such as stars. This paper describes the hardware and software components of the PVS device as well as observational results from the initial season of the PVS, including the discovery of a new bright variable star.

Concept and realization of a fully configurable and programmable data-acquisition system for the neutron scattering instruments at SINQ

We present the basic concept and the realization of our fully configurable data-acquisition hardware for the neutron scattering instruments at SINQ. This system allows collection of the different data entities and event-related signals generated by the various detector units. It offers a variety of synchronization options, including a time-measuring mode for time-of-flight determinations. Based on configurable logic (FPGA, CPLD), event rates up to the MHz range can be processed and transmitted to a programmable online data-reduction system (Histogram Memory). It is implemented on a commercially available VME Power PC module running a real-time operating system (VxWorks).

LIMSport: Optimizing a Windows-Based Computer Data Acquisition and Reduction System for the General Chemistry Laboratory

ADVERTISEMENT RETURN TO ISSUEPREVArticleNEXTLIMSport: Optimizing a Windows-Based Computer Data Acquisition and Reduction System for the General Chemistry LaboratoryEd Vitz and Brenda P. Egolf View Author Information Department of Chemistry, Kutztown University, Kutztown, PA 19530 Center for Social Research, Lehigh University, Bethlehem, PA 18015Cite this: J. Chem. Educ. 2002, 79, 9, 1060Publication Date (Web):September 1, 2002Publication History Received3 August 2009Published online1 September 2002Published inissue 1 September 2002https://doi.org/10.1021/ed079p1060RIGHTS & PERMISSIONSArticle Views71Altmetric-Citations-LEARN ABOUT THESE METRICSArticle Views are the COUNTER-compliant sum of full text article downloads since November 2008 (both PDF and HTML) across all institutions and individuals. These metrics are regularly updated to reflect usage leading up to the last few days.Citations are the number of other articles citing this article, calculated by Crossref and updated daily. Find more information about Crossref citation counts.The Altmetric Attention Score is a quantitative measure of the attention that a research article has received online. Clicking on the donut icon will load a page at altmetric.com with additional details about the score and the social media presence for the given article. Find more information on the Altmetric Attention Score and how the score is calculated. Share Add toView InAdd Full Text with ReferenceAdd Description ExportRISCitationCitation and abstractCitation and referencesMore Options Share onFacebookTwitterWechatLinked InReddit PDF (66 KB) Get e-AlertsSUBJECTS:Cross-disciplinary concepts,Redox reactions,Students,Transfer reactions Get e-Alerts