Evaluation Of Interface Research Articles

7-4 高齢者によるデータ放送コンテンツのユーザーインターフェース評価

7-4 高齢者によるデータ放送コンテンツのユーザーインターフェース評価

Towards interacting with smarter systems

The aim of this article is the requirement analysis, design, proof-of-concept implementation and user evaluation of a novel user interface that is specifically developed to support interaction with ambient intelligence systems. The focus of the user interface is rather on interacting with ambient intelligence, a meta system that comes into existence as the result of the coherent behavior and collective intelligence of interconnected smart devices and systems of a domain such as meeting rooms or smart homes. To design the user interface, we conducted an empirical user and task analysis and elaborated requirements, defining the scope of human interaction with ambient intelligence. The captured requirements shed light on the characteristics of such a user interface and lay the foundations for describing a meta system architecture. As our major contribution, we provide an interaction model formally specifying human–meta system interaction. Based on this specification, we have designed and developed basic affordances of the specified meta user interface such as overriding default system behavior, monitoring and predicting past, current, and future automations, or exploring the possible effects of a certain type of automation. The prototype and implementation of the meta-UI is then assessed through a Cognitive Walkthrough and a formative user evaluation. The result of the evaluation indicates that the designed meta-UI can increase usability of the human-meta system interaction.

A STUDY TO EVALUATE USERS’ SATISFACTION OF BLACKBOARD LEARN

This study summarizes and reports first-time users’ satisfaction of a Blackboard Learn user interface that had been adopted as an online/blended teaching-learning management tool. Users’ satisfaction was measured in terms of the overall consistency, ease of use, universability, positive aspects, and problems/limitations of the Blackboard Learn user interface. Data were collected through a number of 5-point Likert scale type items using an online survey. The survey also gathered participants’ gender and major area of study to determine if there exists any significant difference in their satisfaction, among the possible groups in these measures. Results revealed that first-time Blackboard Learn users are most likely overall satisfied in using it without any significant difference among male vs. female; and engineering vs. non-engineering major users. Blackboard users are satisfied with a number of its advanced features, although they have reported some noticeable problems, limitations, and recommendations. Keywords : Blackboard Learn, Shneiderman’s golden rules of user interface design, User interface evaluation

Big Data in a Crisis? Creating Social Media Datasets for Crisis Management Research

Abstract A growing body of research in the area of information systems for crisis management is based on data from social media. After almost every larger disaster studies emerge with the focus on the specific use of social media. Much of this research is based on Twitter data, due to the ease of access of this (mainly public) data, compared to (more closed) data, such as Facebook or Google+. Based on the experience gained from a research project on social media in emergencies and our task to collect social media data sets for other partners, we present the design and evaluation of a graphical user interface that supports those stakeholders (such as emergency services or researchers) that are interested in creating social media datasets for further crisis management research. We do not specifically focus on the analysis of social media data. Rather we aim to support the gathering process and how actors without sophisticated technical skills can be supported to get what they want and especially need: relevant social media data. Within this article, we present a practice-oriented approach and implications for designing tools that support the collection of social media data as well as future work.

Designing Academic Writing Analytics for Civil Law Student Self-Assessment

Research into the teaching and assessment of student writing shows that many students find academic writing a challenge to learn, with legal writing no exception. Improving the availability and quality of timely formative feedback is an important aim. However, the time-consuming nature of assessing writing makes it impractical for instructors to provide rapid, detailed feedback on hundreds of draft texts which might be improved prior to submission. This paper describes the design of a natural language processing (NLP) tool to provide such support. We report progress in the development of a web application called AWA (Academic Writing Analytics), which has been piloted in a Civil Law degree. We describe: the underlying NLP platform and the participatory design process through which the law academic and analytics team tested and refined an existing rhetorical parser for the discipline; the user interface design and evaluation process; and feedback from students, which was broadly positive, but also identifies important issues to address. We discuss how our approach is positioned in relation to concerns regarding automated essay grading, and ways in which AWA might provide more actionable feedback to students. We conclude by considering how this design process addresses the challenge of making explicit to learners and educators the underlying mode of action in analytic devices such as our rhetorical parser, which we term algorithmic accountability.

Tools Used in Ambient User Interfaces

Research of ambient user interfaces is popular among many researchers. The main idea is that a user interface would react onto its user and would execute reactions on his/her actions. Main problem with creating ambient user interface is that for different domains the human-computer interaction changes. In this article we investigate different tools that are employed in ambient user interface and the different approaches how they are used. We focus mainly on the use of the multi-display set-up, touch screens, kinect, eye-tracking devices and brain-computer interface technology. We propose approaches how they can be utilized in an ambient user interface, how they affect the user and how they can be used for the evaluation of ambient user interface. It is essential for future research that these measures evaluate the efficiency of the use of ambient user interface in different domains. We briefly analyze natural user interface and its association to ambient user interface. In the conclusion we establish the steps for the future research of this topic.

A Case Study of Design and Usability Evaluation of the Collaborative Problem Solving Instructional Platform System

This study used Focus Group to analyze user requirements for user interface so as to understand what capabilities of the Collaborative Problem Solving (CPS) Instructional Platform were expected by users. After 12 focus group interviews, the following four functions had been identified as essential to the CPS Instructional Platform: CPS instructional models, instructional resources database, evaluation system, and instructional plan sharing. The user interface for the CPS Instructional Platform were designed accordingly. After programmers of the integrated project had completed system development based on the design, the study was proceeded usability evaluation of user interface of the CPS Instructional Platform. As for the satisfaction survey, 33 users were chosen based on purposive sampling. In the Likert Scale of five levels, the average score of this system was 4.1 by the testers. And, it indicated that most users were satisfied with the system user interface design and functions.

Human interaction with IoT-based smart environments

This paper describes concepts, design, implementation, and performance evaluation of a 3D-based user interface for accessing IoT-based Smart Environments (IoT-SE). The generic interaction model of the described work addresses some major challenges of Human-IoT-SE-Interaction such as cognitive overload associated with manual device selection in complex IoT-SE, loss of user control, missing system image or over-automation. To address these challenges we propose a 3D-based mobile interface for mixed-initiative interaction in IoT-SE. The 3D visualization and 3D UI, acting as the central feature of the system, create a logical link between physical devices and their virtual representation on the end user's mobile devices. By so doing, the user can easily identify a device within the environment based on its position, orientation, and form, and access the identified devices through the 3D interface for direct manipulation within the scene. This overcomes the problem of manual device selection. In addition, the 3D visualization provides a system image for the IoT-SE, which supports users in understanding the ambience and things going on in it. Furthermore, the mobile interface allows users to control the amount and the way the IoT-SE automates the environment. For example, users can stop or postpone system triggered automatic actions, if they don't like or want them. Users also can remove a rule forever. By so doing, users can delete smart behaviors of their IoT-SE. This helps to overcome the automation challenges. In this paper, we present the design, implementation and evaluation of the proposed interaction system. We chose smart meeting rooms as the context for prototyping and evaluating our interaction concepts. However, the presented concepts and methods are generic and could be adapted to similar environments such as smart homes. We conducted a subjective usability evaluation (ISO-Norm 9241/110) with 16 users. All in one the study results indicate that the proposed 3D-User Interface achieved a good high score according to the ISO-Norm scores.

Development of Emulation Network Analyzer Tool for Computer Network Planning

This paper describes the development of Emulation Network Analyzer (ENA) for heterogeneous services in campus environment. The purpose of this paper is to inform this ENA able to plan and predict network performance. For this purpose, our ENA development is differ from others system such as application and hardware network analyzer. This study focuses on the design of emulation network analyzer, user interface design, characteristics, model description, implementation and evaluation. This ENA can provide a useful network architectural solutions and optimization of network resources during preparation, proposal and planning phases. Finally, ENA tool is a good emulation analyzer that can be used in small to medium size networks for campus environment purposes with minimum cost.

Metrics for Event Driven Software

The evaluation of Graphical User Interface has significant role to improve its quality. Very few metrics exists for the evaluation of Graphical User Interface. The purpose of metrics is to obtain better measurements in terms of risk management, reliability forecast, project scheduling, and cost repression. In this paper structural complexity metrics is proposed for the evaluation of Graphical User Interface. Structural complexity of Graphical User Interface is considered as an indicator of complexity. The goal of identifying structural complexity is to measure the GUI testability. In this testability evaluation the process of measuring the complexity of the user interface from testing perspective is proposed. For the GUI evaluation and calculating structural complexity an assessment process is designed which is based on types of events. A fuzzy model is developed to evaluate the structural complexity of GUI. This model takes five types of events as input and return structural complexity of GUI as output. Further a relationship is established between structural complexity and testability of event driven software. Proposed model is evaluated with four different applications. It is evident from the results that higher the complexities lower the testability of application.

Integrated Model for E-Learning Acceptance

E-learning is not going to work if the system is not used in accordance with user needs. User Interface is very important to encourage using the application. Many theories had discuss about user interface usability evaluation and technology acceptance separately, actually why we do not make it correlation between interface usability evaluation and user acceptance to enhance e-learning process. Therefore, the evaluation model for e-learning interface acceptance is considered important to investigate. The aim of this study is to propose the integrated e-learning user interface acceptance evaluation model. This model was combined some theories of e-learning interface measurement such as, user learning style, usability evaluation, and the user benefit. We formulated in constructive questionnaires which were shared at 125 English Language School (ELS) students. This research statistics used Structural Equation Model using LISREL v8.80 and MANOVA analysis.

Team Building in Multidisciplinary Client-Sponsored Project Courses

Experience working in multidisciplinary teams is important both to prepare Computer Science (CS) students for industry and to improve their communication with teammates from disciplines other than their own. This article describes the evolution and results of collaborations among three courses: an undergraduate CS course about user interface design and implementation, an undergraduate Scientific and Technical Communication (STC) course about usability and instructions writing, and a graduate CS/Human Factors course about user-interface evaluation and usability testing. Students from all three courses work with scientists to complete the scientist-sponsored citizen science Android applications (apps). Students from the undergraduate CS and STC courses form multidisciplinary teams to design and implement apps, while the graduate students consult with the teams by evaluating and user-testing the apps. The collaboration's effectiveness was assessed using student surveys, interviews, and evaluations of student work. This article compares the collaboration within the teams and the coordination with the scientists across two years of activities in order to determine the effectiveness of course modifications. The article concludes with recommendations for improving the collaboration within teams and the coordination with clients in multidisciplinary course projects.

Practitioners’ efforts to communicate corporate values in Japan

This paper examines practitioners’ efforts to share corporate values among internal and external stakeholders by conducting a quantitative content analysis on corporate messages and a user interface evaluation, and compares these efforts between business-to-business (B2B) companies and business-to-consumer (B2C) companies in Japan. The results indicate that B2B companies are more public-oriented than have generally been recognized. This paper reveals that communication strategies can be detected from outside the companies.

An Empirical Evaluation of a Vocal User Interface for Programming by Voice

Although Graphical User Interfaces (GUIs) often improve usability, individuals with physical disabilities may be unable to use a mouse and keyboard to navigate through a GUI-based application. In such situations, a Vocal User Interface (VUI) may be a viable alternative. Existing vocal tools (e.g., Vocal Joystick) can be integrated into software applications; however, integrating an assistive technology into a legacy application may require tedious and manual adaptation. Furthermore, the challenges are deeper for an application whose GUI changes dynamically (e.g., based on the context of the program) and evolves with each new application release. This paper provides a discussion of challenges observed while mapping a GUI to a VUI. The context of the authors' examples and evaluation are taken from Myna, which is the VUI that is mapped to the Scratch programming environment. Initial user studies on the effectiveness of Myna are also presented in the paper.

Evaluating User Interface Management Systems based on Quality Attributes and Unit Operations

architecture is an essential early stage in the software design process. In this stage, the architect should give the quality attributes a special consideration because a good level of meeting these attributes can be performed by well-designed architecture. This means that there is a close relationship between quality attributes and software architecture. However, quality attributes can be achieved through the appropriate application of a set of unit operations. A unit operation is a systematic designing operation that can be applied directly to system architecture. Architectural styles (patterns) include high level design decisions that address quality attributes. Many general architectural styles are defined in the literature. For the domain of user interactive systems there are many architectural styles that address some important quality attributes. In many cases, it is essential to evaluate software styles in terms of their achievement of the required quality attributes by analyzing the relationships between these attributes, unit operations, and styles. This evaluation can help and facilitate the process of selecting a specified style. In this paper the authors propose a structured quantitative evaluation method to show a rank of four well- known user interface management systems (UIMSs) in terms of their supporting a set of six important selected quality attributes.

AHP 기반 모바일 MMORPG 인터페이스 사용성 평가

Abstract The use of games using smartphones have become universal, and the market share of MMORPG among various game genres shows an uptrend. However, MMORPG requires complex interface in view of the genre characteristics, and therefore, there are difficulties in building interface for efficient game play. This study analyzed game interface characteristics to suggest MMORPG game interface suitable for the mobile environment, and carried out a questionnaire survey evaluation on the usability of fight, exploration, character and transaction interfaces targeting 12 users. To quantitatively evaluate the subjective questionnaire survey results, this study analyzed a correlation between the characteristics of game interface and popularity using AHP. As a result, there was a close correlation between game selection & popularity and interface, and this study ascertained that interface development through game interface usability evaluation using AHP was possible. Key Words : AHP, Analytic Hierarchy Process, MMORPG, Game Interface, Mobile Game Interface

Query-by-Gaming: Interactive spatio-temporal querying and retrieval using gaming controller

Spatio-temporal querying and retrieval is a challenging task due to the lack of simple user interfaces for building queries despite the availability of powerful indexing structures and querying languages. In this paper, we propose Query-by-Gaming scheme for spatio-temporal querying that can benefit from gaming controller for building queries. By using Query-by-Gaming, we introduce our spatio-temporal querying and retrieval system named as GStar to interactively build subsequent spatio-temporal queries to determine if a state is directly reachable from current state and eventual spatio-temporal queries to know whether a spatial state is reachable from a current state. Queries are built using features of gaming controller by displaying the original video frames rather than on a graphical interface using a mouse or a keyboard. GStar has three main components: building the query, searching and retrieval of clips, and displaying query results. The queries are applied to an indexing structure called semantic sequence state graph (S3G) and results of the query are displayed dynamically to provide timely feedback to the user. Experimental results and user interface are provided for a tennis video database. Users define desired game state (player and ball position) using an interactive interface at multiple points in time and GStar automatically retrieves all rallies that contain both states. Finally, the user interface evaluation comparing gamepad-based interface and mouse interface for spatio-temporal querying has been studied.

RITA : a useR Interface evaluaTion frAmework

Interactive systems are constantly evolving. This evolution leads to new challenges. One of these challenges pertains to the quality of dialogue between interactive systems and humans. This dialogue essentially takes place through user interfaces. User interface evaluation is essential to improve communication between a system and its users. The research on interface evaluation is plentiful. Nevertheless, user interface evaluators still encounter difficulties. Therefore, in this article we suggest expanding the functionalities of existing evaluation tools by proposing a user interface evaluation framework. This framework is composed by software applications structured following a modular architecture. It is based on three different evaluation techniques and has a modular architecture that can be configured to evaluate different user interfaces. After being presented, this framework is tested on a network supervision system for a project in the transportation domain. The main advantages of the presented Framework are the following: (1) the guidelines are not hard coded into the evaluation engine; (2) it is based on three different evaluation techniques to avail further data for the evaluation; (3) it is structured following a modular architecture to enable flexible and configurable use; (4) interaction data are automatically captured and analyzed; and (5) the framework is intended for the evaluation of different kind of user interfaces.

Improving Healthcare System Usability Without Real Users

This paper describes an early stage usability study conducted on a prototype system designed to capture and analyse Patient Reported Outcome Measures (PROMs) activities. The system – PROMS 2.0, was developed by Bluespier for the trauma and orthopaedic department in Trafford Hospital, Manchester, United Kingdom (UK). The Centre for Health and Social Care Informatics (CHaSCI), Liverpool John Moores University (LJMU) examined the system without real users, identified potential usability issues and suggested possible solutions for improvements before final release by Bluespier. Three different approaches were adopted for evaluating user interface (UI) design without users. The first approach is the Cognitive Walkthrough (CW), a task-oriented technique capable of identifying issues through action sequence required to perform a task. The second approach is action analysis which predicts the time a skilled user would need to perform a task. The third approach is heuristic evaluation which tends to identify problems based on recognised standards. Results support the argument from relevant cognitive psychology theories and user-centric design principles that UI evaluation without real users is a useful tool in yielding rapid output for subsequent enhancement. It is concluded that semi-parallel design concept could be the key to timely delivery of software design projects.

Empirical validation of an automatic usability evaluation method

Today, the success of a software application strongly depends on the usability of its interface, so the evaluation of interfaces has become a crucial aspect of software engineering. It is recognized that automatic tools for graphical user interface evaluation may greatly reduce the costs of traditional activities performed during expert evaluation or user testing in order to estimate the success probability of an application. However, automatic methods need to be empirically validated in order to prove their effectiveness with respect to the attributes they are supposed to evaluate.In this work, we empirically validate a usability evaluation method conceived to assess consistency aspects of a GUI with no need to analyze the back-end. We demonstrate the validity of the approach by means of a comparative experimental study, where four web sites and a stand-alone interactive application are analyzed and the results compared to those of a human-based usability evaluation. The analysis of the results and the statistical correlation between the tool׳s rating and humans׳ average ratings show that the proposed methodology can indeed be a useful complement to standard techniques of usability evaluation.