Archived Intelligent Transportation System Data Quality: Preliminary Analyses of San Antonio TransGuide Data

Abstract

Described are three data quality attributes that are considered relevant to intelligent transportation system (ITS) data archiving: suspect or erroneous data, missing data, and data accuracy. Preliminary analyses of loop detector data from the TransGuide system in San Antonio were performed to identify the nature and extent of these data quality concerns in typical archived ITS data. The findings of the analyses indicated that missing data were inevitable, accounting for about one in five of all possible data records. Error detection rules were developed to screen for suspect or erroneous data, which accounted for only 1 percent of all possible data records. Baseline testing of TransGuide detector accuracy showed mixed results; one location collected traffic volumes within 5 percent of ground truth, whereas traffic volumes at another location ranged from 12 to 38 percent of ground truth. It was concluded that data quality procedures will be essential for realizing the full potential of archived ITS data.