Graphical Interface System Research Articles

Hierarchical GUI test case generation using automated planning

The widespread use of GUIs for interacting with software is leading to the construction of more and more complex GUIs. With the growing complexity come challenges in testing the correctness of a GUI and its underlying software. We present a new technique to automatically generate test cases for GUIs that exploits planning, a well-developed and used technique in artificial intelligence. Given a set of operators, an initial state, and a goal state, a planner produces a sequence of the operators that will transform the initial state to the goal state. Our test case generation technique enables efficient application of planning by first creating a hierarchical model of a GUI based on its structure. The GUI model consists of hierarchical planning operators representing the possible events in the GUI. The test designer defines the preconditions and effects of the hierarchical operators, which are input into a plan-generation system. The test designer also creates scenarios that represent typical initial and goal states for a GUI user. The planner then generates plans representing sequences of GUI interactions that a user might employ to reach the goal state from the initial state. We implemented our test case generation system, called Planning Assisted Tester for Graphical User Interface Systems (PATHS) and experimentally evaluated its practicality and effectiveness. We describe a prototype implementation of PATHS and report on the results of controlled experiments to generate test cases for Microsoft's WordPad.

Automated test oracles for GUIs

Graphical User Interfaces (GUIs) are critical components of today's software. Because GUIs have different characteristics than traditional software, conventional testing techniques do not apply to GUI software. In previous work, we presented an approach to generate GUI test cases, which take the form of sequences of actions. In this paper we develop a test oracle technique to determine if a GUI behaves as expected for a given test case. Our oracle uses a formal model of a GUI, expressed as sets of objects, object properties, and actions. Given the formal model and a test case, our oracle automatically derives the expected state for every action in the test case. We represent the actual state of an executing GUI in terms of objects and their properties derived from the GUI's execution. Using the actual state acquired from an execution monitor, our oracle automatically compares the expected and actual states after each action to verify the correctness of the GUI for the test case. We implemented the oracle as a component in our GUI testing system, called Planning Assisted Tester for grapHical user interface Systems (PATHS), which is based on AI planning. We experimentally evaluated the practicality and effectiveness of our oracle technique and report on the results of experiments to test and verify the behavior of our version of the Microsoft WordPad's GUI.

Enhanced computational infrastructure for data analysis at the DIII–D National Fusion Facility

Recently a number of enhancements to the computer hardware infrastructure have been implemented at the DIII–D National Fusion Facility. Utilizing these improvements to the hardware infrastructure, software enhancements are focusing on streamlined analysis, automation, and graphical user interface (GUI) systems to enlarge the user base. The adoption of the load balancing software package LSF Suite by Platform Computing has dramatically increased the availability of CPU cycles and the efficiency of their use. Streamlined analysis has been aided by the adoption of the MDSplus system to provide a unified interface to analyzed DIII–D data. The majority of MDSplus data is made available in between pulses giving the researcher critical information before setting up the next pulse. Work on data viewing and analysis tools focuses on efficient GUI design with object–oriented programming (OOP) for maximum code flexibility. Work to enhance the computational infrastructure at DIII–D has included a significant effort to aid the remote collaborator since the DIII–D National Team consists of scientists from nine national laboratories, 19 foreign laboratories, 16 universities, and five industrial partnerships. As a result of this work, DIII–D data is available on a 24×7 basis from a set of viewing and analysis tools that can be run on either the collaborators’ or DIII–D's computer systems. Additionally, a web based data and code documentation system has been created to aid the novice and expert user alike.

A User Interface Design Requirement Document: What's Wrong with it?

This paper analyzes the changes in a Graphical User Interface (GUI) design requirement document from the time that the document was baselined to the time that the software system was delivered to the customer. The purpose is to find out where the most changes are in order to develop strategies to improve the efficiency of delivering GUI requirements. One hundred and seventy modification requests, which include 266 requested changes against a baselined GUI requirement document were analyzed. The requested changes were classified into three categories: Wrong Information, Missing Information and System Changes. It was found that 62% requested changes fell into the Wrong Information category, 18% were in the Missing Information category and 20% were in the System Changes category. In the Wrong Information category, most of the changes were due to inconsistencies within the document (39%) followed by wrong information on screens (28%) and wrong processing rules (24%). Nine percent requested changes were due to inconsistencies between the GUI and other system components such as the server. In the Missing Information category, most of the requested changes were about missing processing rules (60%). In the System Changes category, most of the changes were about enhancing system performance or usability (45%). The changes due to server or other related system requirement changes accounted for 38%. Some suggestions made to reduce the errors in the document include: to review the document thoroughly, to conduct synchronization reviews between system documents, and to conduct walk through/usability studies on the prototype before baselining the document.

A walk‐through programmed robot for welding in shipyards

Automating the welding process for the shipbuilding industry is very challenging and important, as this industry relies heavily on quality welds. Conventional robotic welding systems are seldom used because the welding tasks in shipyards are characterised by non‐standardised workpieces which are large but small in batch sizes. Furthermore, geometries and locations of the workpieces are uncertain. To tackle the problem, a Ship Welding Robot System (SWERS) has been developed for the welding process. The main features of the SWERS include a special teaching procedure that allows the human user to teach the robot welding paths at a much easier and faster pace. In addition, operation of the system is made easier through a custom designed man‐machine interface. Through this interface, only a few buttons need to be pressed to command the robot into different modes. Optimised welding parameters can be selected from a large database through a Graphical User Interface system.

A Windows-based interactive and graphic package for the education and training of power system analysis and operation

This paper presents a Windows-based interactive graphic package developed by the authors for the education and training of the power system modeling, analysis and operation with a user-friendly graphical user interface (GUI) and visual database management system (VDBMS). To achieve this goal, the package is designed to have following features: a graphic editor to visually edit the power system diagram; Windows-based power system database to interactively manage the data; graphic representations; animation; and interrupting schemes. The application programs in this package include the power flow calculation, transient stability analysis, fault analysis, economic dispatch and automatic load-frequency control. This package may be useful for educational and training purposes.

Support of Conceptual Design of Engineering Systems Applying Functional Modeling. 1st Report, Systematic Representation of Design Information.

This study investigates a computer support system applying functional modeling techniques for the conceptual design phase of engineering systems. This paper describes a systematic representation of design information, where a design is represented by the four models of goal, function-goal, function-structure, and structure in a systematic and organized form. A graphical interface system is developed to support the efficient representation of the design information. The design information of a waste process plant is expressed to demonstrate the representation capability of the design models.

Automatic communication from a neutral object model of mechanism to mechanism analysis programs based on a finite element approach in a software environment for CADCAM of mechanisms

The development of an intelligent graphical user-interface system for mechanism analysis and design suggests a neutral object model of mechanisms. This has raised an issue called automatic communication of the neutral object model of mechanism with programs for mechanism analysis and design. In this paper, we particularly address our developed system called GMMFEM which performs the automatic communication of a neutral object model of mechanisms, reported elsewhere, with the finite element program systems for mechanism analysis and design, developed at Delft University of Technology. The finite element approach to mechanism analysis and design has many advantages over others, which makes the current work significant. In addition, because the finite element theory has unanimously been used in analysis and design for flexible mechanisms, the discussion makes sense of generality. An approach called model-based reasoning, is clarified and four features or ingredients of this approach are concluded. We illustrate the appropriateness of the approach to our problem and recognize the need of a Finite Element Mechanism Model (FEMM) in the GMMFEM system. FEMM is built by using a semantic data modelling approach to make the model more generic and extendable. The reasoning strategy and reasoning in the GMMFEM system to perform the automatical communication via FEMM are presented. The model-based reasoning approach to the GMMFEM system is applicable to other Computer Aided Engineering (CAE) systems.

System for analyzing high-resolution three-dimensional coronary angiograms

Three-dimensional (3-D) high-resolution coronary angiograms offer a means for visualizing the entire coronary arterial tree from any orientation and for detecting and quantitating coronary arterial stenoses. Previously, a skilled operator had to perform several hours of tedious manual analysis using an interactive graphical user-interface (GUI) system (Tree Trace) to analyze a 3-D angiogram. The authors have devised an improved GUI system, consisting of three tools for analyzing 3-D angiograms. The Artery Extractor first performs automatic image-analysis operations to extract the central axes of the arterial tree. Next, using the Artery Display tool and results from the Artery Extractor, the operator can visualize structures in the angiogram and compute various measurements. Finally, the aforementioned Tree Trace tool can be used to manually correct irregularities in the automatically generated results of the Artery Extractor. The system greatly reduces operator analysis time, gives exactly reproducible results, uses true 3-D image-processing operations, and provides a comprehensive interface for visualizing and quantifying features of the 3-D coronary arteries.

Impromptu: a system for automatic 3D medical image-analysis

The utility of three-dimensional (3D) medical imaging is hampered by difficulties in extracting anatomical regions and making measurements in 3D images. Presently, a user is generally forced to use time-consuming, subjective, manual methods, such as slice tracing and region painting, to define regions of interest. Automatic image-analysis methods can ameliorate the difficulties of manual methods. This paper describes a graphical user interface (GUI) system for constructing automatic image-analysis processes for 3D medical-imaging applications. The system, referred to as IMPROMPTU, provides a user-friendly environment for prototyping, testing and executing complex image-analysis processes. IMPROMPTU can stand alone or it can interact with an existing graphics-based 3D medical image-analysis package (VIDA), giving a strong environment for 3D image-analysis, consisting of tools for visualization, manual interaction, and automatic processing. IMPROMPTU links to a large library of 1D, 2D, and 3D image-processing functions, referred to as VIPLIB, but a user can easily link in custom-made functions. 3D applications of the system are given for left-ventricular chamber, myocardial, and upper-airway extractions.

The KLYDE workbench for studying experimental algorithm analysis

KLYDE is a software workbench that helps students study issues related to the design, implementation, and empirical analysis of algorithms. Using the system's graphical user interface students can design and conduct experiments to study the efficiency of a variety of algorithms and their underlying implementations. The data generated by these experiments can be studied directly, or imported into speadsheet and presented graphically. This paper gives an overview of the KLYDE system and illustrates how the system can be used in a variety of undergraduate computer science courses.

Graphical Interfaces for Network Modeling: A Model Management System Perspective

This paper develops, based on the requirements of model management systems, the characteristics of a PC-based, graphical interface for networks which supports all phases of minimum cost flow network model development. The unique characteristics provided by such an interface include: 1) a nonmathematical environment for building network models via direct manipulation of model-specific, rule-based, arc-node icons, 2) the simultaneous display of multiple model views with instantaneous and transparent update of these views, 3) the functional power of modern algebraic modeling languages, and 4) an integrated, pictorial display of model structure, instantiating data and optimal flows for one or more related model instances. In addition, the paper describes a prototype implementation of such an interface. This prototype demonstrates how such a graphical interface system could change the way decision makers and model builders utilize optimization-based decision support models in a microcomputer environment. INFORMS Journal on Computing, ISSN 1091-9856, was published as ORSA Journal on Computing from 1989 to 1995 under ISSN 0899-1499.

Graphical Interfaces for Network Operations and Management

This paper describes the advantages to the network manager of using graphical user interface systems, and ways to alleviate the software development challenges they present. We discuss some of the graphical techniques and tools that allow developers to efficiently summarize, manipulate, and navigate complex network data. The paper encourages development organizations to consider an iterative refinement development style for graphics applications. Applications built using this style are constructed from small, reusable processes that can be incrementally specified by members of the application team.

MARCO — models of accelerators and rings to commission and operate

MARCO is a knowledge-based user interface for commissioning and operating modern accelerators and storage rings. Its purpose is to provide a model-referenced graphical interface system between the users and the machine. It allows access to modeling and simulation codes that are used in the design of the machine. It can be used to predict the effects of a change of parameters on the beam, or to compare the predicted with the measured effects. The design and prototype development of MARCO using HyperCard will be described in this paper.

The Architecture of the IRCAM Musical Workstation

The IRCAM Musical Workstation (IMW) is designed to facilitate experimentation with real-time signal processing and event processing. The main focus is on interactive musical composition and performance algorithms. The hardware architecture of the IMW is based around a general-purpose multiprocessor providing sufficient number-crunching power for real-time musical signal processing and event processing. A real-time operating system has been written for this multiprocessor as well as a toolbox that provides support for distributed real-time signal processing and event processing applications. The toolbox also defines an object system to support interactive CAD-like applications. Support for musical applications is in the form of MIDI, digital audio I/O, and music-oriented event scheduling. The multiprocessor consists of a number of processor boards, each with two Intel i860 processors (Intel 1989), that plug into a host computer, the NeXT machine. The host is used for its graphic interface and file system. The i860 processors handle all realtime event processing and signal processing. A number of distributed applications have been written for the system. User interfaces run on the host and communicate with tasks on the multiprocessor. These include Animal (Lindemann and De Cecco 1991), an object-oriented data definition and manipulation environment; MAX (Puckette 1991), a graphical programming language; IMW Signal Editor (Eckel 1990), a tool for manipulating sampled signals in time and frequency domains; and the IMW Universal Recorder (Smith 1990), a multitrack real-time data recorder for spooling event and signal streams to disk. This article provides a general overview of the IMW system with a special focus on the hardware architecture. Musical Signal Processing Architectures