Comparison of Multi-Criteria Decision-Making Models: Analyzing the Steps in the Domain of Websites’ Evaluation

Abstract

Websites of environmental content constitute an important tool for promoting environmental information, affect environmental attitudes and promote protected areas as touristic destinations. However, these websites have to be evaluated to ensure that they reach their final goal. The use of multi-criteria decision-making (MCDM) models in website evaluation is relatively new and not many models have been tested for this purpose. Comparisons of such models have been implemented in various domains but not for the purposes of environmental website evaluation. The main objective of this paper is on presenting the procedure of comparison of MCDM models spherical by providing in detail the steps that have to be followed. This process was implemented for website evaluation and investigated the comparative performance of the TOPSIS and VIKOR models. This comparison process involves reliability analysis of the questionnaire and the sample of decision makers, pairwise comparisons of the models by calculating the Pearson correlation coefficient and estimation of the Cohen’s Kappa for testing the inter-rater comparability, using the models as raters. Furthermore, a sensitivity and robustness analysis of those models is implemented, which also has not been implemented before in the application of those models in website evaluation. The tests implemented and presented in this paper reveal that the reasonable disagreement that was often observed among the methods did not affect their reliability. As a result, MCDM models proved very effective for evaluating websites of environmental content.