The usability evaluation of a web-based test blueprint system

Abstract

Usability Evaluation is one of the techniques used in the field of Human-Computer Interaction (HCI) in order to evaluate the extent of usability and level of acceptability of an Information System (IS) such as Web-Based Test Blueprint. A user-centered approach to development i.e. Interaction Design Model is encouraged in the design of computing interactive systems. First of its kind to carry out a usability evaluation for an educational assessment artefact such as the Web-based Test Blueprint, focusing on two (2) categories: the User Interface Heuristic Evaluation and the Test Blueprint Heuristic Evaluation. The User Interface Heuristics include the following: (a) Visibility of System Status, (b) Match Between the System and the Real World, (c) User Control and Freedom, (d) Consistency and Adherence to Standards, (e) Error Prevention, (f) Recognition Rather than Recall, (g) Flexibility and Efficiency of Use, (h) Authenticity and Minimalism in Design, (i) Recognition, Diagnosis, and Recovery from Errors, and (j) Help and Documentation. On the other hand, the Test Blueprint Heuristics include the following: (a) Content Validity, (b) Fairness and Comprehensiveness, (c) Accountability, and (d) Flexibility. In addition to these heuristics used in the evaluation are usability goals such as (a) Learnability, (b) Memorability, (c) Efficiency, (d) Effectiveness, and (e) Satisfaction of end users on the use of the Web-based Test Blueprint. The test case of this study is a website curtly called ‘Test Prep e-ToolKit’ which is readily accessible online.