Formal validation of a knowledge-based system using a variation of the Turing test

Abstract

Abstract The proliferation of computer-based information systems makes an organization's operations exceedingly vulnerable to several types of risks, including loss of data, unauthorized use of data, errors in recording data, and loss of assets or property. Exposure to such risks is typically mitigated through the institution of internal controls. Since systems designers are often not cognizant of control design strategies, the participation of an auditor has been recommended. To avoid potential auditor independence problems caused by the same set of auditors participating both in the design and evaluation of control strategies, a knowledge-based system for control design has been developed. Ten practicing internal auditors participated in the validation of the knowledge-based system using a variation of the Turing test. This paper reports on the validation procedures: results indicate that the knowledge-based support system can perform at a level comparable to that of internal auditors for the purchasing cycle in business organizations, thereby helping alleviate the auditor independence problem.