Predicting Data Quality Success - The Bullwhip Effect in Data Quality

Abstract

Over the last years many data quality initiatives and suggestions report how to improve and sustain data quality. However, almost all data quality projects and suggestions focus on the assessment and one-time quality improvement, especially, suggestions rarely include how to sustain the continuous data quality improvement. Inspired by the work related to variability in supply chains, also known as the Bullwhip effect, this paper aims to suggest how to sustain data quality improvements and investigate the effects of delays in reporting data quality indicators. Furthermore, we propose that a data quality prediction model can be used as one of countermeasures to reduce the Data Quality Bullwhip Effect. Based on a real-world case study, this paper makes an attempt to show how to reduce this effect. Our results indicate that data quality success is a critical practice, and predicting data quality improvements can be used to decrease the variability of the data quality index in a long run.