An integrated Delphi/VAHP/DEA framework for evaluation of information technology/information system (IT/IS) investments

Abstract

This article presents an integrated voting analytic hierarchy process (VAHP), Delphi, and data envelopment analysis (DEA) framework for information technology and information systems (IT/IS) investment evaluation problems. Furthermore, IT/IS adoption and investments issues are stressed in organizations by several authors. Moreover, several studies have identified the lack of complete and effective method in this area. Delphi is designed to overcome the interpersonal behavior problems of work groups. VAHP has been used for supplier selection problem, and DEA is a universally accepted non-parametric method that uses linear programming to calculate the efficiency of defined decision-making units. Each of the above tools is placed in appropriate stage of the proposed framework to solve the current IT/IS investment issues in organizations. At first, by conducting Delphi, the appropriate hierarchy structure of input/output criteria and sub-criteria is established. In second step, by using statistical analysis, validation of Delphi results for selecting criteria is assessed. Then, by evaluating team votes, the input/output criteria and global weights of criteria are determined by VAHP. As a fourth step, Delphi is used again to score alternative investments on all sub-criteria of each input/output criterion. Finally, once each input/output criterion for each alternative is determined, DEA is used to determine the efficient and inefficient IT/IS investment alternatives. The proposed framework is applied to a large multi-disciplinary power holding organization, and its advantages and superiorities are analyzed and discussed. Also, its advantages have been shown versus existing methods in the literature.