A Novel Approach to Evaluate Repeatability and Reproducibility for Ordinal Data

Abstract

We propose a novel usage of CUB models in order to evaluate Repeatability and Reproducibility (R&R) for ordinal data in business and industrial experiments. This is a context where there is a small group of appraisers who have to evaluate a sample of objects classifying them according to ordinal categories. By comparing the cumulative distribution functions obtained fitting CUB models to judgments given by appraisers, we give both graphical and analytical instruments to assess R&R for an ordinal measurement system. The approach is applied to the real-life example reported in de Mast and van Wieringen (2010).