Measurement Information Model Research Articles

Integration of Subjective and Objective Usability Evaluation Based on IEC/IEC 15939: A Case Study for Traffic Supervision Systems

ABSTRACTUsability evaluation for interactive systems is one of the greatest interests for the Human–Computer Interaction community. To support this evaluation, several subjective and objective methods have been proposed and applied in academy and industry. In this context, usability evaluators usually work with a lot of and different kinds of data (e.g., ordinal values from questionnaires and performance rates) generated from different methods and tools and related to different usability criteria. In this article, we propose to integrate these data in a single way to better support the quality evaluators’ decision-making for traffic supervision systems domain. We apply the measurement information model defined by IEC/IEC 15939 with the use of indicators in an interactive system evaluation environment. Four indicators are presented from their specifications to their application in the evaluation of a system from a company. These indicators integrate evaluation results from usability questionnaires, an automated ergonomic guidelines inspector, and an electronic informer.

Measurement and quantification are not the same: ISO 15939 and ISO 9126

SUMMARYMeasurement based on the international standards for measurement (i.e., metrology) is not the same as judgmental‐based quantification of implicit relationships across a mix of entities and attributes without due consideration of admissible mathematical operations on numbers of different scale types. This paper presents first the Measurement Information Model in ISO 15939 and clarifies next what in it refers to the classical metrology field, and what refers to the quantitative analysis of relationships. The paper concludes with two examples of the designs of a measure for ISO 9126, one focusing on a single attribute and the second attempting to quantify a set of relationships across a number of entities and attributes. Copyright © 2010 John Wiley & Sons, Ltd.