GUI Elements Research Articles

Aiding exploratory testing with pruned GUI models

Exploratory testing is a kind of software testing approach that emphasizes tester's experience to maximize the chances to find bugs within a specific time period. It is naturally a GUI-oriented testing activity for GUI-based systems. We propose aiding exploratory testing by providing a GUI model of the region impacted by the most recent internal code changes. We create such a delimited GUI model by pruning an original GUI model, quickly built by static analysis. This pruned GUI model is result of a reachability analysis between GUI elements and internal source code changes. Only related GUI elements are preserved. To illustrate the idea, we consider five GUI applications found in public repositories with varying changes among them. We present experimental data concerning two executions of two exploratory testing sessions: one without using our proposal and another with our proposal. For both testers, our proposal showed coverage gain in experimental data.

待ち時間を知らせるGUIがユーザの時間感覚に与える影響 : 主観的等価点(PSE)を用いた評価

待ち時間を知らせるGUIがユーザの時間感覚に与える影響 : 主観的等価点(PSE)を用いた評価

On the misuse of graphical user interface elements to implement security controls

Abstract GUIs are the predominant means by which users interact with modern programs. GUIs contain a number of common visual elements widgets such as buttons, textfields, and lists, and GUIs typically provide the ability to change attributes on these widgets to control their visibility and behavior. While these attributes are extremely useful to provide visual cues to users to guide them through an application's GUI, they can also be misused for purposes they were not intended. In particular, in the context of GUI-based applications that include multiple privilege levels within the application, GUI element attributes may be misused as a mechanism for enforcing access control policies. This work presents a method to detect misuse of user interface elements to implement access control, it is based on our earlier work C. Mulliner, W. Robertson, and E. Kirda, “Hidden GEMs: Automated Discovery of Access Control Vulnerabilities in Graphical User Interfaces”, in Proceedings of the IEEE Symposium on Security and Privacy, 2014. that introduced the vulnerability class the we refer to as GEMs, or instances of GUI element misuse. Using our GEM detection method we discovered unknown vulnerabilities in several applications.

Color design strategy for improvement in learning effect of online education content

In digital age, mankinds life style is more connected to online environment than ever and there have been some changes in paradigm. One of the most conservative area, the field of education, is also merging with online environment, and E-learning contents are becoming the norm of the society. With pros consisting of constant learning, personalized customized learning and utilization of multimedia, education field is expected to be developed into something more. Unlike traditional education system, importance of e-learnings GUI is prominent due to characteristics like self-learning, learning through a monitor, etc. Among composing elements of GUI, color as the primary cognitive element is very important due to creation of memory and positive image, increase in concentration and effective in creating learning environment. It is also effective in transferring information and knowledge and establishing an identity. However, even with its importance, the research regarding application methods and standards have been insufficient. Therefore, I have researched into various effects of color in e-learning, insufficient parts in color planning of contents and proposition of standards. In this research, each colors detailed effects in learning and suitability was studied. 135 e-learning contents that were being utilized at S cyber university were selected from 7 departments (20 contents each, 15 contents for cultural arts department) and analyzed for general color psychology, cognition and color characteristics through survey of students centered on suitability of color. Color guidelines were provided to simplify color selection by the teacher and the producer but there wasnt any standards on color selection regarding characteristics of subject or creation of environment centered on students. This research classifies and analyzes contents centered on 8 kinds of color to suggest guidelines and importance of color planning during e-learning content production in order to provide comfortable and effective learning environment. I hope that increase in learning effectiveness of contents to be produced is realized through establishment of correct color planning with considerations of subjects characteristics, students and topic from the planning stage of contents.

고령화 세대의 스마트폰 사용자를 위한 GUI 디자인 융복합 가이드라인 연구

Abstract 21st Century is getting into Super aging society worldwide basis. Among those population, silver(aged) generation users’ physical condition, such as sight, hearing and body, is getting older, especially sight ability which processes 80% of input data, it requires us studying new smartphone GUI designs convergence for the elderly. In light of this social phenomenon, this study suggests smartphone GUI designs convergence guideline for the silver generation through the research of text, icon which are basic elements of smartphone GUI with proper visual attributes. I had inferred UX designs, expert group and evaluation categories from existing papers, related books and designed some displays for the survey. I also offered this guideline with the deep survey of 101 people over 65 years old. Key Words : GUI Design convergence Guidelines, Convergence, GUI components, Smartphone, Elderly, Universal Design Received 22 April 2015, Revised 8 June 2015Accepted 20 July 2015Corresponding Author: Jean Hun Chung (Dongguk Graduate School of Digital Image and Contents professor) Email: evengaters@gmail.comⒸ The Society of Digital Policy & Management. All rights reserved. This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.ISSN: 1738-1916

Structural Information Aided Automated Test Method for Magic 4GL

Nowadays testing data intensive, GUI enhanced applications properly on an easily maintainable way has become a more crucial part of the application life cycle. There are many evolving technologies to support automatized GUI testing in various environments. However there are hardly any methods that support 4GLs, especially Magic. Fortunately, the characteristics of the 4th generation of programming languages - like explicit definition of the relations between GUI elements and data - eliminate most of the problems raised during testing the GUI in the case of 3GLs. By utilizing these advantages we were able to develop a generalized testing method that supports 4GLs, and as a proof of concept a system for testing Magic xpa applications was built. In this paper, a generalized testing method for 4GLs, our path and script generator algorithms, and their implementations for Magic xpa applications are presented. In addition, the cooperation of these components with existing solutions is demonstrated, and a test method that has been competed by the application of our tools (and which is an instantiation of the generalized method) is introduced as a possible use of the results.

RTOS 기반의 소프트웨어 2D BitBLT 엔진의 설계

본 논문은 소프트웨어 기반의 2D BitBLT 엔진을 pSOS 운영체제에서 구현하는 것을 제안하였으며, 제안된 BitBLT엔진을 환자감시장치에서 동작을 검증하였다. 본 논문에서 제안한 방법의 검증을 위해, 환자감시장치 보드를 기반으로 하는 별도의 프로토 타입 PCB 보드를 제작하고, 동작을 검증하였다. 메인 보드는 ARM9 기반의 CPU로 설계하였으며, 하드웨어 기반의 BitBLT 모듈을 소프트웨어 기반의 모듈로 동작하면서 가중되는 CPU의 부하문제의 해결을 위해 200Mhz 프로세서 대신 400Mhz 프로세서로 변경하였다. 본 논문에서는 환자감시장치에서 GUI를 구현하는데 있어 그래픽 콘트롤러의 핵심요소 중의 하나인 2D BitBLT 모듈을 커널의 디바이스 드라이버로 구현하였다. In this paper, we proposed the implementation of software-based 2D BitBLT engine on the pSOS operating system and the operation of the BitBLT engine on patient monitoring device was verified. To verify the proposed method on the patient monitoring device, we designed prototype PCB board, and verified the operation. We designed the motherboard by using ARM9-based CPU. Because hardware-based BitBLT module was replaced with software-based one, CPU load problem was weighted. To solve this problem, w changed 400Mhz processor instead of 200Mhz processor. We implemented 2D BitBLT kernel module as a device driver which is one of the key elements of a graphics controller GUI in patient monitoring device.

XML을 이용한 안드로이드 GUI 위젯의 기능 테스트 자동화

캡처 리플레이 기법은 GUI 테스팅을 위하여 흔히 사용되는 자동화 방법이다. 하지만 안드로이드 플랫폼 애플리케이션 테스팅에는 직접 이용하기 어렵다. 그 이유는 좋은 테스팅 프레임워크가 제공되고 있지만 GUI 요소들과 위젯 이벤트 처리 부분이 자동 링크되지 않기 때문이다. 캡처 리플레이 테스팅 도구가 없다면 명세서를 이용하여 테스팅 시나리오를 만들고 일일이 수동으로 GUI 요소들과 연결하여 테스팅 하여야 한다. 이 논문은 현재 사용되고 있는 안드로이드기반 GUI 자동화 테스트 기법보다 발전되고 최적화된 캡처 리플레이 방법을 제안하고 이의 효율성을 증명하기 위한 것이다. XML을 이용하여 주요 위젯기반 원소를 추출하기 위한 기술들을 정립하고 위젯기반 API 이벤트 처리 방법을 고안하였다. 제안한 방법으로 캡처 단계에 모니터링하여 클릭 이벤트가 일어나는 형태를 추적한 후 리플레이 단계에서 활성화 된 위젯을 API 이벤트와 상태를 교환하여 테스트 케이스를 생성한다. Capture-and-replay technique is a common automatic method for GUI testing. Testing applications on Android platform cannot use directly capture-and-replay technique due to the testing framework which is already set up and technical supported by Google and lack of automatic linking GUI elements to actions handling widget events. Without capture-and-replay testing tools testers must design and implement testing scenarios according to the specification, and make linking every GUI elements to event handling parts all by hand. This paper proposes a more improved and optimized approach than common capture-and-replay technique for automatic testing Android GUI widgets. XML is applied to extract GUI elements from applications based on tracing the actions to handle widget events. After tracing click events using monitoring in capture phase test cases will be created by communicating status of activated widget in replay phase with API events.

Automated GUI performance testing

A significant body of prior work has devised approaches for automating the functional testing of interactive applications. However, little work exists for automatically testing their performance. Performance testing imposes additional requirements upon GUI test automation tools: the tools have to be able to replay complex interactive sessions, and they have to avoid perturbing the application’s performance. We study the feasibility of using five Java GUI capture and replay tools for GUI performance test automation. Besides confirming the severity of the previously known GUI element identification problem, we also describe a related problem, the temporal synchronization problem, which is of increasing importance for GUI applications that use timer-driven activity. We find that most of the tools we study have severe limitations when used for recording and replaying realistic sessions of real-world Java applications and that all of them suffer from the temporal synchronization problem. However, we find that the most reliable tool, Pounder, causes only limited perturbation and thus can be used to automate performance testing. Based on an investigation of Pounder’s approach, we further improve its robustness and reduce its perturbation. Finally, we demonstrate in a set of case studies that the conclusions about perceptible performance drawn from manual tests still hold when using automated tests driven by Pounder. Besides the significance of our findings to GUI performance testing, the results are also relevant to capture and replay-based functional GUI test automation approaches.

Cluster‐based modularization of processes recovered from web applications

SUMMARYWeb applications are often used to expose business processes implemented as software systems. This paper describes a technique for recovering business processes based on a dynamic analysis of the applications behavior. The technique described here does not require any access to internal software artifacts of the application, such as source code or documentation. An initial process is inferred to by means of the analysis of execution traces, in which the execution of GUI elements such as forms and links is recorded. The recovered process is then abstracted by clustering its elements according to four different criteria: structural, page‐based, dependency‐based and semantical. A case study has been conducted with the aim of evaluating understandability and readability of the reverse engineered processes as well as the clustering techniques used in refining them. Copyright © 2010 John Wiley & Sons, Ltd.

A Proposal for Automatic Testing of GUIs Based on Annotated Use Cases

This paper presents a new approach to automatically generate GUI test cases and validation points from a set of annotated use cases. This technique helps to reduce the effort required in GUI modeling and test coverage analysis during the software testing process. The test case generation process described in this paper is initially guided by use cases describing the GUI behavior, recorded as a set of interactions with the GUI elements (e.g., widgets being clicked, data input, etc.). These use cases (modeled as a set of initial test cases) are annotated by the tester to indicate interesting variations in widget values (ranges, valid or invalid values) and validation rules with expected results. Once the use cases are annotated, this approach uses the new defined values and validation rules to automatically generate new test cases and validation points, easily expanding the test coverage. Also, the process allows narrowing the GUI model testing to precisely identify the set of GUI elements, interactions, and values the tester is interested in.

Inventions on Three Dimensional GUI - A TRIZ Based Analysis

The graphical user interface has become popular because of its simplicity and user friendliness. The user can do very complex operations through GUI by simple pointer movements. One of its major drawbacks is that it consumes active display area. Every icon, every window and every other GUI element occupies some amount of screen space. It is desirable to display more GUI features within the limited amount of display screen.Adding another dimension to a graphical user interface can yield tremendous benefits such as improving aesthetics, data presentation, screen-space utilization and user friendliness. The user can easily locate the objects in a three-dimensional environment by using his spatial memory. Many people think that a three-dimensional GUI is the future of the current trend in the evolution of graphical user interface.

Why Do Street-Smart People Do Stupid Things Online?

The systems we worry about securing include the people who use them. In everyday offline life, an average person's policy consists of a few simple, intuitive rules. We believe that the majority of users continuously employ risk analysis heuristics to plan both their online and offline actions; the overwhelming problem of online security is that this analysis, in the online case, is based primarily on entirely wrong assumptions, intuitively derived from incorrect interpretation of GUI elements and processes. We propose a core user interface design principle for the designers to follow when considering and building trust-decision-related user interface features.

Inventions on Selecting GUI Elements

Selecting an object or element is a fundamental operation in any graphic user interface. It is necessary to select an object before doing any operation (such as, dragging, copying, opening, deleting etc.) on that object. The GUI may provide features to select any single object or even multiple objects. The feature of selecting multiple objects can provides tremendous power to the GUI as the user can do complex operations on multiple objects in one go. However, the process of selection is not as simple as it appears to the user of a GUI. The internal logic of a selection mechanism can be very complex in some situations. The article describes some fundamental difficulties associated with the selection mechanism, and illustrates the solutions provided by different inventions selected from US patent database.

Identity-Differentiating Widgets for Multiuser Interactive Surfaces

Widgets - standard reusable GUI elements - are a staple of user-interface development. The use of widget toolkits, such as Java's Swing, X Window System's Motif, or Microsoft's MFC, allows programmers to quickly incorporate a number of standard interactions (such as clicking buttons, selecting check boxes, or scrolling through lists) into their software. To date, most widgets have been designed for use by one person at a time. Within a single session, a widget behaves the same regardless of who uses it. By applying the iDwidgets concept, the authors supplement traditional widgets with identity differentiation that supports widget reuse, dynamic widget customization, clutter reduction, and novel multiuser widget type creation. This article introduces a conceptual framework for iDwidgets, describing four axes that application can customize by exploiting identity differentiation: function, content, appearance, and group input

10 Inventions on Command Buttons in a Graphical User Interface

A command button may contain a textual label or a graphic image or both. It may be static or animated. There can be many different features to make a command button attractive and effective. As command button is a typical GUI element, most improvement on GUI in general will also be applicable to command buttons. Besides, there are also inventions to improve various aspects of command buttons in specific. This article illustrates 10 selected inventions from US patent database. Each invention is followed by a TRIZ based analysis in brief.

Shader Programming: An Introduction Using the Effect Framework

Current commodity graphics cards offer programmability through vertex shaders and pixel shaders to create special effects by deformation, lighting, texturing, etc. The Effect framework introduced by Microsoft allows to store shader program code, settings, and a limited graphical user interface within a single .fx text file. This supports a division of labor between programmers writing the code and designers using the GUI elements to control settings. Furthermore, the Effect framework proves to be ideal for experimenting with shader programming — be it for learning purposes or for rapid prototyping. In this tutorial, we employ the Effect framework for an exploratory, hands-on approach, introducing first principles only as needed, not in advance. Simple shader programs are used to review basic 3D techniques such as homogeneous coordinates and the Phong shading model. Then we turn to basic deformation effects employing vertex shaders and the use of texture maps as decals or reflected environments inside pixel shaders. To create bump mapping and related effects, tangent space coordinates and normal maps are introduced. Finally, we treat more complex effects such as anisotropic specular highlights. Keywords : Pixel shader, Vertex shader, HLSL, Effect framework

Project Imperion: New Semantics, Façade and Command Design Patterns for Swing.

Project Imperion consists of a library of GUI elements that combine the command and facade design patterns to add new semantic meaning to some common Swing components. This simplifies the synthesis and maintenance of the code. It also shortens the code, while improving readability, speeding synthesis and easing maintenance. It also promotes better code organization, including the separation of business logic from GUI code and a logical grouping of the code along the same lines as its GUI’s appearance. Started in the late ‘90’s, in the DocJava, Inc. Skunkworks, the Imperion project was meant only for menu items using AWT, targeting the single application of image processing programs. It has since been reworked and extended to support the use of 16 Swing components with built-in keyboard shortcuts. The Imperion project was named for the Latin root, imperium, meaning the power to command.

Visual Ada developer

Programming language popularity depends not only on its properties and quality, but also on service which the user gets in its environment. Gui and visual developer are important components of IDE (Integrated-Development Environment).Visual Ada Developer (VAD) helps Ada programmers easily create OS independent application, using standard set of components, such as GUI elements, Multimedia elements, Network connections, DB connections and others.

Framelets—small and loosely coupled frameworks

article Free Access Share on Framelets—small and loosely coupled frameworks Authors: Wolfgang Pree Univ. of Constance, Constance, Germany Univ. of Constance, Constance, GermanyView Profile , Kai Koskimies Nokia Research Center, Helsinki, Finland Nokia Research Center, Helsinki, FinlandView Profile Authors Info & Claims ACM Computing SurveysVolume 32Issue 1esMarch 2000 pp 6–eshttps://doi.org/10.1145/351936.351942Online:01 March 2000Publication History 10citation1,009DownloadsMetricsTotal Citations10Total Downloads1,009Last 12 Months7Last 6 weeks0 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF