Evaluation of software usability using scenarios organized by abstraction structure

Abstract

Motivation -- To improve the current practice of scenario-based usability evaluation by suggesting a new method for generating more comprehensive scenarios and using the scenarios more easily and systematically.Research approach -- Work domain analysis (WDA) concept in cognitive work analysis (CWA) framework was employed to develop a method for identifying functions and their relationships, which need to be reflected in scenarios. Two methodological tools were developed to help evaluators analyze functional structure and generate meaningful scenarios respectively.Findings/Design -- A new method for generating and using scenarios was developed, which accompanies two new tools (function-control matrix and function order diagram).Research limitations/Implications -- As the method was applied to only one word processing software, there is a lack of case studies; however, the method has features that may be generalized to other kinds of software.Originality/Value -- This research contributes to making a scenario-based evaluation process more systematic by supplementing its current weak points. Also this research applied abstraction hierarchy concept to software systems to which little attention has been given.Take away message -- Scenario-based usability evaluation can be enriched with the use of abstraction-based functional structure of software.