Quantitive analysis in a heuristic evaluation for usability of Educational Computer Game (UsaECG)

Abstract

Usability problems found in most of heuristic evaluation process normally being presented based on mean value of severity rating. In some cases, mean value of severity rating is not accurate to determine level of usability problems found. This is because mean value will ignore the most critical problems found in specific part. One of the possible solutions to overcome this problem is by analyzing the numbers of severity rating for critical problem found. Pilot study was conducted using Playability Heuristic Evaluation for Educational Computer Game (PHEG) that being developed based on Heuristic Evaluation technique. Quantitative analysis for PHEG was use as the basis of this analysis. Numbers of subheuristics for each heuristic were used in order to calculate the percentage for each heuristic. Result shows that the most critical problem found in Educational Element and Content heuristics where there are 57.14% critical problems found for each heuristics. The least critical problem found is in Playability heuristic where the value is 18.18%. Mean value (42.42%) for the overall critical problem found in ECG can be referred as an indicator for the overall usability level of the ECG.