Usability Analysis of Messages from a Security System

Abstract

Most software systems issue messages to reflect their progress in processing users' requests and to report error conditions. By instrumenting systems to collect these messages for later processing, a rich source of information about system and user behavior can be tapped. The work described herein is a study of system and user behavior related to messages, in an actual use setting. Our objective is assessing and improving the interaction with VMSECURE, a user directory management and security package for IBM's VM operating system. (VM is IBM's interactive system for mainframe computers. VMSECURE manages user resources and controls data access.) Pareto's principle applies to VMSECURE messages and error messages. A few different messages make up most of the traffic. Password prompting provides efficient, effective protection against unauthorized use of VMSECURE. Users of VMSECURE, when they receive an error messages, often re-enter the same, unsuccessful command again. Users of VMSECURE do not improve their error rates with experience, possibly due to the low level of daily use they make of the product.