Is what you choose what you want?—outlier detection in choice-based conjoint analysis

Abstract

Choice-based conjoint (CBC) analysis has long been a popular technique in market research. Because CBC is dependent upon respondents’ stated preferences, respondent variability should be taken into account in part-worth estimation. In the spirit of Bayesian residuals within the probit framework, this paper proposes a novel respondent variability measure for CBC, called the “utility deviation” (UD), to detect outliers who have unusually high respondent variability. UD is constructed based on the standardized deviation between a respondent’s true and representative utilities on the made choices. We compare UD with the largest absolute realized deviation (LARD) statistic and the typically used metric, root likelihood (RLH), in the performance of outlier detection using simulated and empirical data. The results show that UD performs slightly better than LARD and significantly outperforms RLH. Finally, we show that performing outlier detection to exclude misleading data can significantly improve the quality of estimation and resultant applications.