Results Of User Evaluation Research Articles

An Intelligent Tutoring System for Circuit Analysis

The Interactive Multimedia Intelligent Tutoring System (IMITS) is designed to assist electrical engineering undergraduate students taking their first circuits courses. The IMITS system places the student in a engineering scenario in which the student is a newly hired engineer within the fictional IMITS Corporation and given real-life problems to solve, corresponding to course material. The office has file cabinets, bookshelves, a printer, and a personal computer. The personal computer allows the student to receive televideo messages, receive e-mail, and send e-mail reports to senior engineers. A feature of IMITS is that the student decides which actions to take and may validate analyses and designs using a virtual laboratory incorporated with the software. A brief historical perspective of intelligent tutoring systems is presented, followed by an explanation of their architecture. Next, a detailed discription of the intelligent tutoring system IMITS is given. Then the results of usability and effectiveness evaluations of the software are given

Strong and privacy-friendly management of federated identities for service provision over UMTS

Mobile subscribers who wish to mutually authenticate to service providers on the Internet utilize existing identity management mechanisms, such as Microsoft .net passport, overlooking the existing trust relationship between the subscriber and the 3G mobile operator and increasing network resources consumption, in an environment that requires security mechanisms that are as lightweight as possible. Furthermore, knowledge as well as the possession of an item, does not distinguish a person uniquely, revealing an inherent security weakness of pin authentication mechanisms. This paper proposes a protocol (3GbioId) for implementing strong identity management for Internet applications over 3G mobile networks. 3GBioId introduces biometrics, as well as the principles of the Liberty Alliance, into the 3G mobile security architecture, targeting to a more effective, secure and lightweight identity management alternative to the existing protocols. The results of a security, privacy, performance, usability and complexity evaluation indicate 3GbioId’s benefits and limits.

MinimUML

In introductory computer science courses, the Unified Modeling Language (UML) is commonly used to teach basic object-oriented design. However, there appears to be a lack of suitable software to support this task. Many of the available programs that support UML focus on developing code and not on enhancing learning. Programs designed for educational use sometimes have poor interfaces or are missing common and important features such as multiple selection and undo/redo. Hence the need for software that is tailored to an instructional environment and that has all the useful and needed functionality for that specific task. This is the purpose of minimUML. It provides a minimum amount of UML, just what is commonly used in beginning programming classes, and a simple, usable interface. In particular, minimUML is designed to support abstract design while supplying features for exploratory learning and error avoidance. It supports functionality that includes multiple selection, undo/redo, flexible printing, cut and paste, and drag and drop. In addition, it allows for the annotation of diagrams, through text or free-form drawings, so students can receive feedback on their work. minimUML was developed with the goals of supporting ease of use, of supporting novice students, and of requiring no prior training for its use. This article presents the rationale behind the minimUML design, a description of the tool, and the results of usability evaluations and student feedback on the use of the tool.

Search history tools for user support in information retrieval systems: Evaluation results from an iterative, user‐centered process

AbstractThis poster describes the results of usability evaluation of a novel search history tool and a set of iteratively developed user interface design guidelines for search histories that support execution of complex tasks by information seekers. Search histories have a great potential in search support. To support the information seekers' needs, an integrated search history tool was developed based on the results of an extensive user study of attorneys and law librarians' memory use in searching and is described in the poster. This tool has been iteratively refined through a cooperative design process and two cycles of usability evaluations in legal and medical domains. An integrated and interactive search history display is proposed with user annotations and marking. The history displays details of search steps and can be selectively edited by users. An additional notepad area affords flexible results collection and early integration via user annotations and notes. The evaluation of the search history tool shows great promise in providing improved search history support for information seekers for complex tasks. The results of the evaluation validated the user interface design guidelines for search histories and will be described in this poster. It is hoped that these results will enable the designers of IR systems to better integrate historical information into their systems and provide improved support for users.

Sebew — An Evaluation Method for User Interfaces of Command and Control Systems

A computer-based evaluation method (SEBEW) for design of user interfaces has been developed. For this purpose existing standards, guidelines, and evaluation instruments have been analyzed. Evaluation and design criteria were extracted, reformulated or newly formulated for command and control systems. A data base, structured and created by a complex data model and realized in Microsoft Access, contains the complete volume of about 1500 design and evaluation criteria. For the evaluation of information systems SEBEW allows the display of selected items, which have to be rated. Attached features like references, instructions, examples, and drawings can be offered, if required, for additional information. This paper describes the functional design of the evaluation system as well as the evaluation procedure with the rating and scoring methods. Results and experiences using the system in the usability evaluation process and results of validation studies for two military systems are discussed. These studies concentrated on the interrater consistency of the method. Additionally, an investigation is in progress to determine empirical validity by comparing two alternative command and control systems with known different software-ergonomic quality.

Telecare delivery of health and social care information

If the growing population of older people are to be effectively supported in their own homes, new ways of delivering care must be found. In addition, individual users of health and social services need greater empowerment and autonomy. These imperatives provide opportunities for the creative use of information and communication technology. One telecare approach that can be used to maintain or improve the quality of life for older people is the provision of health and social care information in electronic form.This paper identifies and discusses issues that contribute to the information agenda for older people. It describes the background to the present UK health strategy, most significantly the shift from institutional based care towards care at home, with the associated change of priorities within health and social care agencies. It suggests that different methods of information delivery are needed to meet the requirements of older people, and directs information providers towards the use of paper-based media and digital TV, as well as Web-based resources. It highlights the importance of user interface design and argues for an approach whereby interface design is changed when necessary, according to the results of user evaluation. Information content needs to be appropriate and managed; verification and validity of content are ensured by a continuous iterative review system.

WalkMap: Developing an augmented reality map application for wearable computers

We have designed, implemented, and evaluated a map application for wearable computer users. Our application, called WalkMap, is targeted at a walking user in an urban environment, offering the user both navigational aids as well as contextual information. WalkMap uses augmented reality techniques to display a map on the surrounding area on the user's head-worn display. WalkMap is constructed by the means of software development, user interface design and evaluations, and existing knowledge on how humans use maps and navigate. The key design driver in our approach is intuitivity of use. In this paper, we present the design and implementation process of our application, considering human-map interfaces, technical implementation, and human-computer interfaces. We identify some of the key issues in these areas, and present the way they have been solved. We also present some usability evaluation results.

A smart itsy bitsy spider for the Web

As part of the ongoing Illinois Digital Library Initiative project, this research proposes an intelligent agent approach to Web searching. In this experiment, we developed two Web personal spiders based on best first search and genetic algorithm techniques, respectively. These personal spiders can dynamically take a user's selected starting homepages and search for the most closely related homepages in the Web, based on the links and keyword indexing. A graphical, dynamic, Java-based interface was developed and is available for Web access. A system architecture for implementing such an agent-based spider is presented, followed by detailed discussions of benchmark testing and user evaluation results. In benchmark testing, although the genetic algorithm spider did not outperform the best first search spider, we found both results to be comparable and complementary. In user evaluation, the genetic algorithm spider obtained significantly higher recall value than that of the best first search spider. However, their precision values were not statistically different. The mutation process introduced in genetic algorithm allows users to find other potential relevant homepages that cannot be explored via a conventional local search process. In addition, we found the Java-based interface to be a necessary component for design of a truly interactive and dynamic Web agent. © 1998 John Wiley & Sons, Inc.

A smart itsy bitsy spider for the Web

As part of the ongoing Illinois Digital Library Initiative project, this research proposes an intelligent agent approach to Web searching. In this experiment, we developed two Web personal spiders based on best first search and genetic algorithm techniques, respectively. These personal spiders can dynamically take a user's selected starting homepages and search for the most closely related homepages in the Web, based on the links and keyword indexing. A graphical, dynamic, Java-based interface was developed and is available for Web access. A system architecture for implementing such an agent-based spider is presented, followed by detailed discussions of benchmark testing and user evaluation results. In benchmark testing, although the genetic algorithm spider did not outperform the best first search spider, we found both results to be comparable and complementary. In user evaluation, the genetic algorithm spider obtained significantly higher recall value than that of the best first search spider. However, their precision values were not statistically different. The mutation process introduced in genetic algorithm allows users to find other potential relevant homepages that cannot be explored via a conventional local search process. In addition, we found the Java-based interface to be a necessary component for design of a truly interactive and dynamic Web agent. © 1998 John Wiley & Sons, Inc.

Choosing a commode for the ward environment.

The choice of appropriate equipment to promote patient independence and enhance nursing care is of major concern to the nurse in the ward environment. This article reports on a recent evaluation of specialist commodes, (Ballinger et al, 1994), with reference to the programme funded by the Medical Devices Agency, Department of Health, under whose auspices the project was carried out. The results of user evaluations and technical tests of six mobile commodes are presented, the preferred model being the Mayfair commode supplied by Carters (J&A) Ltd. The article concludes by identifying a number of important considerations to bear in mind when selecting a commode.

Data entry in computer-based care planning

If computer-based care planning is to be acceptable to nurses, they must be able to enter care plans in a flexible and intuitive manner that does not distort their observations about the patient. The limitations of existing computer-based data entry techniques are discussed. A novel method of data entry called Predictive Data Entry is presented, and the underlying model of nursing terminology which supports it is described. The results of user evaluations are discussed.

Development of an applications software workbench for extracting and analysing data from a clinical database

This paper describes the development of an applications software workbench called the clinician's Workbench (cW), for use by clinical workers in a modern, distributed, computing environment. We first discuss the need for a comprehensive cW to support the interaction of clinical workers with a variety of software tools, in the process facilitating interoperability between database and analytical application software packages. A discussion of our cW architecture and operation then follows. Finally, preliminary results of user evaluation are reported and conclusions are drawn. One function of our cW is to be able to extract data from a clinical database by allowing the formulation of repeatable queries that can be easily customized and extended by clinical workers in later use. Its other functions are to provide integration and interoperability with existing software packages and other tools, thereby enabling preliminary and advanced statistical analysis to be done on the extracted data. Reuse of queries and...

Productivity, or quality of work as the decisive factor in marketing ergonomics? Design considerations for a new ergonomic welding-table

Quality tools should be designed from the starting point of adjusting tasks and equipment to human possibilities and limitations. Companies should consider an investment in ergonomic equipment as a profitable addition to indispensable productive machinery. As an example to support this statement, the authors describe the health risks of welders and the possible solutions. As the result of investigations a list of requirements was drafted for a product that would have less of the disadvantages of the products mentioned. The designed product, the 'ergonomic welding-table', aims to be a quality tool for welders working at small and medium-sized tasks. The product consists of a cabin (2.35 m wide) with a built-in ventilator for very efficient welding-fume extraction (90%-95%). Welders can set their preferred working height at any time. Another advantage is the option of performing the welding task while standing or sitting. The results of user-evaluation among welders and purchasers indicates considerable satisfaction.

Computer network operation: applicability of the vigilance paradigm to key tasks.

This paper examines the applicability of the vigilance paradigm to the task of monitoring data communication networks. Survey work and the results of usability evaluations of IBM network management products suggest that several key aspects of the vigilance paradigm do apply to this task. The task is prolonged but not necessarily continuous because of time sharing and social interaction. The signals are of the cognitive type and are many and varied. The simple ones are obvious; more difficult ones are not. The signals are infrequent and aperiodic. The frequency is probably lower than in most vigilance experiments, and the response does have an impact on future signal rate. Often the response to a detected problem is to begin problem recording and troubleshooting. A set of recommendations for modification of the paradigm and experimental parameter values is provided that will make the results of future vigilance experiments more applicable to this type of operational monitoring. A second set of recommendations is provided for improving human performance in this type of system monitoring.