EVALUATING A COMPUTER APPLICATION THAT AIDS MULTI-CRITERIA DECISION MAKING

Abstract

In this article, we describe and assess the implementation of several methods of multi-criteria decision-making using a web-based computer application. Such an application makes it easier to determine the effective- ness of decisions. The methods adopted in this application are SMART (Simple Multi-Attribute Rating Technique), AHP (Analytic Hierarchy Pro- cess), and ANP (Analytic Network Process). Each of these methods has distinctive characteristics in determining the best alternative for the user. This study assesses the feasibility of each method in the application. The application is assessed based on functionality, reliability, efficiency, and usability. (1) Functionality is tested according to the appropriateness of the decisions made, (2) Reliability is assessed using stress testing, (3) Effi- ciency is assessed according to the computational effort, and (4) System usability is tested according to the user’s answers to the Computer System Usability Questionnaire authored by J.R. Lewis. This research results in a decision support system based on SMART that has been appropriately tested and is ready for use. Keywords: multi-criteria analysis, SMART, AHP, ANP, system usability.