Assessing informatics students’ satisfaction with a web-based courseware system

Abstract

This study assessed health informatics student satisfaction with two subsequent versions of Prometheus, a web-based courseware system. Prometheus versions 4 and 5 were assessed to gauge the effect of modifications to improve the usability of the system. The Questionnaire for User Interaction Satisfaction (QUIS, version 7.0) was administered at the end of fall semester 2001 (in which Prometheus version 4 was used) and again at the end of Spring 2002 (in which Prometheus version 5 was used). QUIS contains measures of user satisfaction of the overall system and 11 specific dimensions, including screen, terminology and system information, learning, system capabilities, manuals and online help, multimedia, and teleconferencing. In general, students had favorable judgments of Prometheus, and their satisfaction level remained relatively stable across the two versions. However, usability enhancements incorporated into version 5 produced no significant differences in student satisfaction ratings. The results of this study provide a benchmark for comparing the relative usability of alternative courseware systems and demonstrate the utility of user satisfaction surveys for assessing and improving courseware systems. With increases in the need for compliance education and the education of clinicians with ‘just in time knowledge’, courseware systems will become an integral part of the clinical information systems, increasing the importance of usability studies such as this one.