Proposed User Interface Research Articles

Towards an AI-Driven User Interface Design for Web Applications

The increasing exploitation of Artificial Intelligence (AI) technologies has enabled the design of user interfaces in a way that integrating artificial intelligence capabilities has become crucial in the modern digital landscape. Exploring the main features and best practices for designing user interfaces for Web applications, which effectively support and leverage AI functionalities, is currently one of the relevant topics in this context. This research work discusses the fundamental principles of user interface (UI) design, and the challenges posed by the integration of AI into web applications. It emphasizes the need to strike a balance between the AI advanced capabilities and the users' ability to understand and control the system. Furthermore, the paper highlights the importance of creating intuitive and engaging UI designs that empower users to interact with AI-driven features effortlessly. The study presents a comprehensive analysis of various UI design techniques specifically tailored for AI-enabled web applications user interfaces. Additionally, the paper explores the incorporation of AI-driven recommendation systems, personalized interfaces, and adaptive designs, which dynamically adapt to users' preferences and behavior. To validate the proposed user interface design principles, the study presents a proposal for a guidelines structure that promotes empirical evaluations through user studies and usability testing. Results collected via a survey based on measuring the effectiveness and user satisfaction of AI-enabled Web interfaces. User interfaces in real-life scenarios are presented and provides information on the impact of UI design decisions on user interaction and overall experience. The outcomes of this research work contribute to a deeper understanding of UI design for AI-supported Web applications user interfaces and offer practical guidelines for designers and developers. By embracing the suggested principles, organizations and designers can create Web interfaces that effectively harness the power of AI while prioritizing user-centricity, accessibility, and ethical considerations.

Integrating Fleet Management: Streamlining Vehicle Monitoring and Maintenance Processes

This research paper explores the development of an integrated fleet management system designed to streamline the process of vehicle monitoring and maintenance decision-making. Focusing on the current challenges faced by fleet managers like Tim, the paper proposes a unified solution that combines fault code diagnostics, vehicle tracking, and vendor lookup into a single, efficient platform. Wireframes are included to illustrate the proposed user interface.

IoMT with Deep CNN: AI-Based Intelligent Support System for Pandemic Diseases

The Internet of Medical Things (IoMT) is an extended version of the Internet of Things (IoT). It mainly concentrates on the integration of medical things for servicing needy people who cannot get medical services easily, especially rural area people and aged peoples living alone. The main objective of this work is to design a real time interactive system for providing medical services to the needy who do not have a sufficient medical infrastructure. With the help of this system, people will get medical services at their end with minimal medical infrastructure and less treatment cost. However, the designed system could be upgraded to address the family of SARs viruses, and for experimentation, we have taken COVID-19 as a test case. The proposed system comprises of many modules, such as the user interface, analytics, cloud, etc. The proposed user interface is designed for interactive data collection. At the initial stage, it collects preliminary medical information, such as the pulse oxygen rate and RT-PCR results. With the help of a pulse oximeter, they could get the pulse oxygen level. With the help of swap test kit, they could find COVID-19 positivity. That information is uploaded as preliminary information to the designed proposed system via the designed UI. If the system identifies the COVID positivity, it requests that the person upload X-ray/CT images for ranking the severity of the disease. The system is designed for multi-model data. Hence, it can deal with X-ray, CT images, and textual data (RT-PCR results). Once X-ray/CT images are collected via the designed UI, those images are forwarded to the designed AI module for analytics. The proposed AI system is designed for multi-disease classification. It classifies the patients affected with COVID-19 or pneumonia or any other viral infection. It also measures the intensity level of lung infection for providing suitable treatment to the patients. Numerous deep convolution neural network (DCNN) architectures are available for medical image classification. We used ResNet-50, ResNet-100, ResNet-101, VGG 16, and VGG 19 for better classification. From the experimentation, it observed that ResNet101 and VGG 19 outperform, with an accuracy of 97% for CT images. ResNet101 outperforms with an accuracy of 98% for X-ray images. For obtaining enhanced accuracy, we used a major voting classifier. It combines all the classifiers result and presents the majority voted one. It results in reduced classifier bias. Finally, the proposed system presents an automatic test summary report textually. It can be accessed via user-friendly graphical user interface (GUI). It results in a reduced report generation time and individual bias.

Enabling multimodal cross-border journey planning in the EU

Many online multimodal journey planners already exist, but they are usually limited to a specific geographical location or mode. There is a need to develop door-to-door, cross-border and multimodal solutions to provide a seamless user experience. This paper develops a novel solution using a recently established Open Journey Planner (OJP) standard supporting open and distributed journey planning. The OJP4Danube concept is presented, where the system architecture, the connection of different local journey planning services, and the proposed user interface are discussed. Key features to include are defined, particularly those related to enabling the combination of micromobility modes (e.g. cycling and walking) together with available public transport routes. This approach is one of the pioneer works in this field testing the applicability of the OJP standard in a realistic environment.

RISC-V Hardware Synthesizable Processor Design Test and Verification Using User-Friendly Desktop Application

Although the RISC-V ISA has not been around for long, it is a processor architecture that has been highlighted by many businesses and individuals for its low-cost and rapid pace of development. They are open-source-synthesizable hardware processors with minimal functionality that is ideal for current IoT applications involving simple sensors and actuator controls. Due to some qualities of hardware, they can operate in areas where software programs and applications cannot be used whereas, these software programs that run on such hardware equally help in understanding how hardware operates. This paper, therefore, proposes and discusses the design, implementation, and internal verification and test platform for a Reduced Instruction Set Code-V’s (RISC-V) Instruction Set Architecture (ISA), using an interactive desktop program for a 32-bit single-cycle processor. This paper developed a system that functions as interactive assistance to RISC-V's ISA design and debugger using a more user-friendly desktop UI application. The uniqueness of this design is the flexibility of testing and debugging that is possible through either the software interface or through hardware peripherals such as Universal Asynchronous Receiver/Transmitter (UART) protocols in FPGA or even both. These peripherals allow users to view the contents of the register files and RAM being utilized by the implemented processor on the FPGA. The proposed desktop User Interface program monitors and controls the sequential processing and states of a 32-bit single-cycle RISC-V processor’s operation on an FPGA. Contents of the proposed processor’s registers and memory are displayed alongside other temporal or internal data. Internal components such as Program Counters (PC), Random Access Memory (RAM), are displayed all through the proposed User Interface (UI) program and also through various peripherals on the FPGA board. The software program is implemented using C# programing language through Microsoft Visual Studio 2019 Integrated Development Environment (IDE). The proposed hardware synthesizable processor core is implemented using Verilog Hardware Description Language (HDL) and synthesized with Xilinx Integrated Synthesis Environment (ISE) version 14.7. The proposed processor and its corresponding hardware test modules occupy 6476 Look-Up-Tables (LUT) and operate at a maximum frequency of 49MHz and its operation is verified on a Field Programmable Gate Array (FPGA). The proposed processor and its test platform can serve as a good educational tool as well as a help for processor design engineers both experienced and beginners.

Predictive text analysis using eye blinks

The current work aims to facilitate interaction with others to those with the inability to perform activities requiring motor skills or those who cannot speak. It proposes a modus operandi or a system based on Histogram of Oriented Gradients (HOG) and Support Vector Machine (SVM), which automatically identifies eye blinks in real-time to predict a lexicon. The system implements an auxiliary input that enables individuals to interact with others with the help of a device, where voluntary long blinks help in transition from a counter to a predictive table, while the short blinks are used to make the counter stop and select the lexicon. The system does not require prior manual initialization, special lighting, or previous face detection as it can calibrate it if the user is in the camera region and close. The proposed user interface makes the process of words detection by blinking easier with 74% accuracy.

Visually Guided Acquisition of Contact Dynamics and Case Study in Data-Driven Haptic Texture Modeling.

Data-driven modeling of human hand contact dynamics starts with a tedious process of data collection. The data of contact dynamics consist of an input describing an applied action and response stimuli from the environment. The quality and stability of the model mainly depend on how well data points cover the model space. Thus, in order to build a reliable data-driven model, a user usually collects data dozens of times. In this article, we aim to build an interactive system that assists a user in data collection. We develop an online segmentation framework that partitions a multivariate streaming signal. Real-time segmentation allows for tracking the process of how the model space is being populated. We applied the proposed framework for a haptic texture modeling use-case. In order to guide a user in data collection, we designed a user interface mapping applied input to alternative visual modalities based on the theory of direct perception. A combination of the segmentation framework and user interface implements a human-in-loop system, where the user interface assigns the target combination of input variables and the user tries to acquire them. Experimental results show that the proposed data collection schema considerably increases the approximation quality of the model, whereas the proposed user interface considerably reduces mental workload experienced during data collection.

A Preliminary Study : User Interface Design of Online Travel Booking Application

In recent years, area of software product development not only focused on features but also usability aspect. Software product must deliver the best user interface since it launched. To achieve this aim, the developers should realize application with suitable features and good interface based on user needs. This paper aim is to present user interface design for online travel booking application. This research is consisted of five phases, i.e. defining research problem, collecting literatures, designing research methodology, evaluating existing system, proposing of an initial model of user interface. As the research result, we proposed user interface of initial design that is consisted of main menu, content sliders, online booking form, body and footer. Main menu is designed by providing menu flight, hotel, train, travel add-ons, promo, register, login, and contact. Content sliders contained image about promo and favorite destination. The online booking is provided for many types based on order such as flight service, hotel service, trains service and so forth. The body of web contained information about favorite destination, promo and best offers. For footer presented social media, about, support and many more.

A Novel User Interface for Text Dependent Human Voice Recognition System

In an effort to provide a more efficient representation of the speech signal, the application of the wavelet analysis is considered. This research presents an effective and robust method for extracting features for speech processing. Here, we proposed a novel user interface for Text Dependent Human Voice Recognition (TD-HVR) system. The proposed HVR model utilizes decimated bi-orthogonal wavelet transform (DBT) approach to extract the low level features from the given input voice signal, then the noise elimination will be done by band pass filtering followed by normalization for better quality of a voice signal and finally the formants of a train and test voices will be calculated by using the Additive Prognostication (AP) algorithm. Simulation results have been compared with the existing HVR schemes, and shown that the proposed user interface system has performed superior to the conventional HVR systems with an accuracy rate of approximately 99 %.

A Novel User Interface for Text Dependent Human Voice Recognition System

In an effort to provide a more efficient representation of the speech signal, the application of the wavelet analysis is considered. This research presents an effective and robust method for extracting features for speech processing. Here, we proposed a novel user interface for Text Dependent Human Voice Recognition (TD-HVR) system. The proposed HVR model utilizes decimated bi-orthogonal wavelet transform (DBT) approach to extract the low level features from the given input voice signal, then the noise elimination will be done by band pass filtering followed by normalization for better quality of a voice signal and finally the formants of a train and test voices will be calculated by using the Additive Prognostication (AP) algorithm. Simulation results have been compared with the existing HVR schemes, and shown that the proposed user interface system has performed superior to the conventional HVR systems with an accuracy rate of approximately 99 %.

Analysis and Development of Interface Design on DKI Jakarta & Tangerang‘S Qlue Application based on Don Norman’s 6 Design Principles

The Qlue Community App is one of government’s effort to embrace the social media trend. Initial study of user experience showed that there are two things in Qlue App user experience that don’t comply with six design principles from Don Norman’s Design Principles. The two things are constraints and consistency. That was the reason for this research, to analyze and make a better version of user interface for the community service application based on the six design principles from Don Norman. Methodology used in this research is Task-Centered System Design (TCSD). The result of this research is an UI that have a constraint which is a warning page that appeared before user finished writing any report and wanted to go back to previous page. The second result is a consistency of all report writing process and interface including buttons and icons. The conclusion of this research is that the revised proposed user interface has solved the problems that appeared on the UI of Qlue application.
 Index Terms— Donald Norman, Six Design Principles, Task-Centered System Design, TCSD, User Interface Analysis, Qlue.

Generic drug device combination products: Regulatory and scientific considerations

Complex regulatory and scientific considerations exist for drug-device combination products submitted under an Abbreviated New Drug Application. The Agency has published several guidances to aid industry in the development of a generic drug-device combination product: providing recommendations on the types of studies necessary to establish bioequivalence, providing considerations on product quality and performance for certain types of device constituents, and most recently, providing tools to assess the proposed user interface when compared to the user interface of the Reference Listed Drug.In addition, the Office of Generic Drugs11The Office of Generic Drugs is in the Center for Drug Evaluation and Research (CDER) in the United States Food and Drug Administration. has established a regulatory science research program intended to support projects that examine scientific questions relating to the development of generic combination products and their associated regulatory review. Several research examples are described within this article, which demonstrate how equivalence can be evaluated when the function of the device could potentially impact drug delivery. Moreover, this article provides an overview of regulatory recommendations and ongoing scientific research efforts to further develop guidances and ultimately improve public access to generic combination products.

Comparative performance analysis of M-IMU/EMG and voice user interfaces for assistive robots.

People with a high level of disability experience great difficulties to perform activities of daily living and resort to their residual motor functions in order to operate assistive devices. The commercially available interfaces used to control assistive manipulators are typically based on joysticks and can be used only by subjects with upper-limb residual mobilities. Many other solutions can be found in the literature, based on the use of multiple sensory systems for detecting the human motion intention and state. Some of them require a high cognitive workload for the user. Some others are more intuitive and easy to use but have not been widely investigated in terms of usability and user acceptance. The objective of this work is to propose an intuitive and robust user interface for assistive robots, not obtrusive for the user and easily adaptable for subjects with different levels of disability. The proposed user interface is based on the combination of M-IMU and EMG for the continuous control of an arm-hand robotic system by means of M-IMUs. The system has been experimentally validated and compared to a standard voice interface. Sixteen healthy subjects volunteered to participate in the study: 8 subjects used the combined M-IMU/EMG robot control, and 8 subjects used the voice control. The arm-hand robotic system made of the KUKA LWR 4+ and the IH2 Azzurra hand was controlled to accomplish the daily living task of drinking. Performance indices and evaluation scales were adopted to assess performance of the two interfaces.

接触感覚を有する能動鉗子直接操作インタフェースの操作性評価

We have previously proposed a prototype of a hands-on type user interface for intuitive and dexterous manipulation of articulated surgical instruments in transnasal endoscopic neurosurgery. The proposed user interface was designed to provide a surgeon with intuitiveness and safe operation of the surgical instruments based on a passive mechanism. In this paper, we present an experimental feasibility study of the proposed interface to evaluate the usability in performing dexterous manipulation tasks.

Device- and system-independent personal touchless user interface for operating rooms : One personal UI to control all displays in an operating room.

In the modern day operating room, the surgeon performs surgeries with the support of different medical systems that showcase patient information, physiological data, and medical images. It is generally accepted that numerous interactions must be performed by the surgical team to control the corresponding medical system to retrieve the desired information. Joysticks and physical keys are still present in the operating room due to the disadvantages of mouses, and surgeons often communicate instructions to the surgical team when requiring information from a specific medical system. In this paper, a novel user interface is developed that allows the surgeon to personally perform touchless interaction with the various medical systems, switch effortlessly among them, all of this without modifying the systems' software and hardware. To achieve this, a wearable RGB-D sensor is mounted on the surgeon's head for inside-out tracking of his/her finger with any of the medical systems' displays. Android devices with a special application are connected to the computers on which the medical systems are running, simulating a normal USB mouse and keyboard. When the surgeon performs interaction using pointing gestures, the desired cursor position in the targeted medical system display, and gestures, are transformed into general events and then sent to the corresponding Android device. Finally, the application running on the Android devices generates the corresponding mouse or keyboard events according to the targeted medical system. To simulate an operating room setting, our unique user interface was tested by seven medical participants who performed several interactions with the visualization of CT, MRI, and fluoroscopy images at varying distances from them. Results from the system usability scale and NASA-TLX workload index indicated a strong acceptance of our proposed user interface.

Using Qualitative Methods to Create a Home Health Web Application User Interface for Patients with Low Computer Proficiency.

Introduction:Despite the investment in public reporting for a number of healthcare settings, evidence indicates that consumers do not routinely use available data to select providers. This suggests that existing reports do not adequately incorporate recommendations for consumer-facing reports or web applications.Methods:Healthcentric Advisors and Brown University undertook a multi-phased approach to create a consumer-facing home health web application in Rhode Island. This included reviewing the evidence base review to identify design recommendations and then creating a paper prototype and wireframe. We performed qualitative research to iteratively test our proposed user interface with two user groups, home health consumers and hospital case managers, refining our design to create the final web application.Results:To test our prototype, we conducted two focus groups, with a total of 13 consumers, and 28 case manager interviews. Both user groups responded favorably to the prototype, with the majority commenting that they felt this type of tool would be useful. Case managers suggested revisions to ensure the application conformed to laws requiring Medicare patients to have the freedom to choose among providers and could be incorporated into hospital workflow. After incorporating changes and creating the wireframe, we conducted usability testing interviews with 14 home health consumers and six hospital case managers. We found that consumers needed prompting to navigate through the wireframe; they demonstrated confusion through both their words and body language. As a result, we modified the web application’s sequence, navigation, and function to provide additional instructions and prompts.Discussion:Although we designed our web application for low literacy and low health literacy, using recommendations from the evidence base, we overestimated the extent to which older adults were familiar with using computers. Some of our key learnings and recommendations run counter to general web design principles, leading us to believe that such guidelines need to be adapted for this user group. As web applications proliferate, it is important to ensure those who are most vulnerable—who have the least knowledge and the lowest literacy, health literacy, and computer proficiency—can access, understand, and use them.Conclusions:In order for the investment in public reporting to produce value, consumer-facing web applications need to be designed to address end users’ unique strengths and limitations. Our findings may help others to build consumer-facing tools or technology targeted to a predominantly older population. We encourage others designing consumer-facing web technologies to critically evaluate their assumptions about user interface design, particularly if they are designing tools for older adults, and to test products with their end users.

Virtual Agent as a User Interface for Home Network System

In order to achieve intuitive and easy operations for home network system (HNS), the authors have previously proposed user interface with virtual agent (called HNS virtual agent user interface, HNS-VAUI). The HNS-VAUI was implemented with MMDAgent toolkit. A user can operate appliances and services interactively through dialog with a virtual agent in a screen. However, the previous prototype heavily depends on MMDAgent, which causes a tight coupling between HNS operations and agent behaviors, and poor capability of using external information.To cope with the problem, this paper proposes a service-oriented framework that allows the HNS-VAUI to provide richer interaction. Specifically, the authors decompose the tightly-coupled system into two separate services: MMC Service and MSM service. The MMC service concentrates on controlling detailed behaviors of a virtual agent, whereas the MSM service defines logic of HNS operations and dialog with the agent with richer state machines. The two services are loosely coupled to enable more flexible and sophisticated dialog in the HNS-VAUI. The proposed framework is implemented in a real HNS environment. The authors also conduct a case study with practical service scenarios, to demonstrate effectiveness of the proposed framework.

A Method for the Autonomous Control of Lower Limb Exoskeletons for Persons With Paraplegia

Efforts have recently been reported by several research groups on the development of computer-controlled lower limb orthoses to enable legged locomotion in persons with paraplegia. Such systems must employ a control framework that provides essential movements to the paraplegic user (i.e., sitting, standing, and walking), and ideally enable the user to autonomously command these various movements in a safe, reliable, and intuitive manner. This paper describes a control method that enables a paraplegic user to perform sitting, standing, and walking movements, which are commanded based on postural information measured by the device. The proposed user interface and control structure was implemented on a powered lower limb orthosis, and the system was tested on a paraplegic subject with a T10 complete injury. Experimental data is presented that indicates the ability of the proposed control architecture to provide appropriate user-initiated control of sitting, standing, and walking. The authors also provide a link to a video that qualitatively demonstrates the user's ability to independently control basic movements via the proposed control method.

User interaction in smart ambient environment targeted for senior citizen

Many countries are facing a problem when the age-structure of the society is changing. The numbers of senior citizen are rising rapidly, and caretaking personnel numbers cannot match the problems and needs of these citizens. Using smart, ubiquitous technologies can offer ways in coping with the need of more nursing staff and the rising costs of taking care of senior citizens for the society. Helping senior citizens with a novel, easy to use interface that guides and helps, could improve their quality of living and make them participate more in daily activities. This paper presents a projection-based display system for elderly people with memory impairments and the proposed user interface for the system. The user's process recognition based on a sensor network is also described. Elderly people wearing the system can interact the projected user interface by tapping physical surfaces (such as walls, tables, or doors) using them as a natural, haptic feedback input surface.

Real-time user interface using particle filter with integral histogram

To apply a vision technique to real-time user interface, we suggest a fast and effective method of tracking human limbs and recognizing poses, with the kinematics chain model. The proposed method is able to evaluate the observation likelihood between particle samples and reference histograms in high speed with the integral histogram. Results demonstrate that using the integral histogram is faster than the existing color histogram method as evidenced by the increase in the number and size of samples. In addition, robust results are realized during evaluation involving overlapping objects. The proposed user interface system is ideally suited for gaming devices that utilize user gestures and poses as control input in real-time. Experiments for the real-time game demonstrate the robustness of the proposed method.