Dispersion of relative importance values contributes to the ranking uncertainty: Sensitivity analysis of Multiple Criteria Decision-Making methods

Abstract

Multiple Criteria Decision-Making (MCDM) methods are widely used in research and industrial applications. These methods rely heavily on expert perceptions and are often sensitive to the assumptions made. The reliability and robustness of MCDM analysis can be further tested and verified by a computer simulation and sensitivity analysis. In order to address this, five different MCDM approaches, including Weighted Sum Model (WSM), Weighted Product Model (WPM), revised Analytic Hierarchy Process (rAHP), Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) and COmplex PRoportional ASsessment (COPRAS) are explored in the paper. Real data of the case study for assessing housing affordability are used for testing the robustness of alternative ranking and finding the most sensitive criteria to the change of criterion weight. We identify the most critical criteria for any and best ranking alternatives. The paper highlights the significance of sensitivity analysis in assessing the robustness and reliability of MCDM outcomes. Furthermore, randomly generated and model-based data sets are used to establish relationship between the dispersion of relative importance values of alternatives and ranking uncertainty. Our findings demonstrate that the dispersion of relative importance values of alternatives correlate with the Euclidian distances of aggregated values. We conclude that the dispersion of relative importance values contributes directly to the ranking uncertainty and can be used as a measure for identifying critical criteria.